Fast global interactive volume segmentation with regional supervoxel descriptors

Luengo, Imanol; Basham, Mark; French, Andrew P.

Abstract

In this paper we propose a novel approach towards fast multi-class volume segmentation that exploits supervoxels in order to reduce complexity, time and memory requirements. Current methods for biomedical image segmentation typically require either complex mathematical models with slow convergence, or expensive-to-calculate image features, which makes them non-feasible for large volumes with many objects (tens to hundreds) of different classes, as is typical in modern medical and biological datasets. Recently, graphical models such as Markov Random Fields (MRF) or Conditional Random Fields (CRF) are having a huge impact in different computer vision areas (e.g. image parsing, object detection, object recognition) as they provide global regularization for multiclass problems over an energy minimization framework. These models have yet to find impact in biomedical imaging due to complexities in training and slow inference in 3D images due to the very large number of voxels. Here, we define an interactive segmentation approach over a supervoxel space by first defining novel, robust and fast regional descriptors for supervoxels. Then, a hierarchical segmentation approach is adopted by training Contextual Extremely Random Forests in a user-defined label hierarchy where the classification output of the previous layer is used as additional features to train a new classifier to refine more detailed label information. This hierarchical model yields final class likelihoods for supervoxels which are finally refined by a MRF model for 3D segmentation. Results demonstrate the effectiveness on a challenging cryo-soft X-ray tomography dataset by segmenting cell areas with only a few user scribbles as the input for our algorithm. Further results demonstrate the effectiveness of our method to fully extract different organelles from the cell volume with another few seconds of user interaction. © (2016) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.

Citation

Luengo, I., Basham, M., & French, A. P. (2016, March). Fast global interactive volume segmentation with regional supervoxel descriptors. Presented at SPIE Medical Imaging, San Diego, California, United States

• Presentation Conference Type: Edited Proceedings
• Conference Name: SPIE Medical Imaging
• Start Date: Mar 1, 2016
• End Date: Mar 3, 2016
• Acceptance Date: Oct 30, 2015
• Online Publication Date: Mar 21, 2016
• Publication Date: Mar 21, 2016
• Deposit Date: Jun 20, 2016
• Publicly Available Date: Jun 20, 2016
• Publisher: Society of Photo-optical Instrumentation Engineers
• Peer Reviewed: Peer Reviewed
• Volume: 9784
• Article Number: 97842D
• Series Title: Progress in biomedical optics and imaging
• Series ISSN: 1605-7422
• Book Title: Medical Imaging 2016: Image Processing
• ISBN: 9781510600195
• DOI: https://doi.org/10.1117/12.2216382
• Keywords: Volume, Interactive segmentation, Random Forest, Contextual Information, Markov Random Fields
• Public URL: https://nottingham-repository.worktribe.com/output/779071
• Publisher URL: http://proceedings.spiedigitallibrary.org/proceeding.aspx?articleid=2506227
• Contract Date: Jun 20, 2016