Three-Dimensional GPU-Accelerated Active Contours for Automated Localization of Cells in Large Images

2018·Arxiv

Abstract

Abstract

Cell segmentation in microscopy is a challenging problem, since cells are often asymmetric and densely packed. This becomes particularly challenging for extremely large images, since manual intervention and processing time can make segmentation intractable. In this paper, we present an efficient and highly parallel formulation for symmetric three-dimensional (3D) contour evolution that extends previous work on fast two-dimensional active contours. We provide a formulation for optimization on 3D images, as well as a strategy for accelerating computation on consumer graphics hardware. The proposed software takes advantage of Monte-Carlo sampling schemes in order to speed up convergence and reduce thread divergence. Experimental results show that this method provides superior performance for large 2D and 3D cell segmentation tasks when compared to existing methods on large 3D brain images.

I. INTRODUCTION

QUANTIFYING the size and distribution of cell nuclei inoptical images is critical to understanding the underlying tissue structure [1] and organization [2], [3]. Segmentation is crucial to this analysis, by providing quantitative data that pathologists can use to characterize diseases and evaluate their progression [4]. Since manual analysis of microscopy images is time consuming and labor intensive, automated cell segmentation is essential for detecting and locating cells in massive images. Microscopy images exhibit a large degree of variability and complexity, due to large numbers of overlapping cells and variations in cell types and stages of cell division, imaging systems, and staining protocols. In order to deal with this complexity, a large number of segmentation algorithms have been proposed [5], [6]. Most current algorithms use basic techniques combined with complicated pipelines to overcome those challenges. These methods include thresholding [7]–[9], feature extraction [10], [11], classification [12], c-means [8] and k-means [13] clustering, region growing [14]–[16], and deformable models [17]–[19]. Recently, learning based approaches using artificial neural networks (ANN) and convolutional neural networks (CNN) have gained increased attention. These methods rely on example data to train a machine learning algorithm to identify boundary pixels [20] or directly perform binary segmentation

M. Lotfollahi, S. Berisha and D. Mayerich are with the Department of Electrical and Computer engineering, University of Houston, Houston, TX.

L. Montier and J. Ziburkus are with the department of Biology and Biochemistry, University of Houston, TX

[21]. In general, most pipelines include prepossessing, finding cell bounding boxes, extracting either spatial or frequencybased features [2], [22]–[24] or using several convolution layers followed by max-pooling [25], [26], and finally classifying the image. In these approaches, the training phase is time consuming and requires massive amounts of labeled data [27].

Most current algorithms focus on two-dimensional data, such as histology slides, and utilize a variety of techniques to deal with specific tissue types, stains, and labels. For example, deep CNNs have been used for segmentation of overlapping clumps in Pap smear images [28], and support vector machines (SVMs) have been employed to segment epithelial cells [29] and skeletal muscle [30]. Finally, active contours have been shown to be effective for cell nuclei segmentation [31].

The major limitation of histology slices is that they are limited to 2D sampling. Although histological assesments convey some of the structure and morphology of the tissue, they do not provide proper insights into the 3D layout of cells. In addition, 3D images provide much better separability when cells are overlapping or hidden in the corresponding 2D images.

To date, several software solutions are available for specialized cell segmentation on 3D images. FARSIGHT [32] uses graph cuts and multi-scale Laplacian of Gaussian filters to detect cell seed points. Region growing is then used based on local-maximum clustering. MINIS [33] performs blob detection by smoothing the image with Gaussian kernels at different scales and computing eigenvalues of the Hessian matrix at each pixel from these smoothed images. It then thresholds the respective eigenvalues to obtain a mask of nuclei and a connected component analysis assigns a unique ID to each nucleus. The 3D object counter plugin for ImageJ [34] is a simple 3D cell counter which uses a user-specified intensity threshold to separate foreground and background, resulting in an over-segmented image. Since fundamental thresholding is not robust, adaptive and iterative thresholding on smoothed 3D images can also be used [35], [36].

One method for addressing large-scale segmentation relies on simple active contours, such as snakuscules [37], [38], which are fast to evaluate and rely on very few user-specified input parameters. However, a three-dimensional application of this algorithm has not been derived. In addition, the sampling required to evolve a primitive active contour is computationally intractable for images containing thousands of cells.

Fig. 1. (a) A snakuscule is defined by by two points p and q. (b) Initial configuration of multitude snakuscules congregated together at a distance .

II. APPROACH

Most deformable models transform an image segmentation task to an optimization problem. An energy function is defined based on the image content and desired behavior of a curve. Snakuscules, introduced in [37], are region-based snakes optimized for the segmentation of approximately circular features. In this section, we will describe the previously published snakuscule algorithm as well as generalize the mathematics to three-dimensional images.

A. Snakuscules

Snakuscules are active contours optimized for fast convergence around circular image features. Their fast evaluation time allows the initialization of many contours that cover an entire image, allowing segmentation of blob-like features without manual initialization.

A Snakuscule is defined by a pair of concentric disks parameterized by two points p and q (Figure 1a). The optimization attempts to minimize an energy function measuring the contrast between the inner disk and annulus in order to completely surround a bright round object with a circular curve. The energy function is defined to balance the weighted inner area against the weighted outer area of the curve:

where I(x) is a two-dimensional image, is an image coordinate, R is the radius of the snake, and c is its center. The value , derived previously for the two- dimensional case [37], enforces the equal area for both inner disk and outer annulus.

One snakuscule can find and segment one light blob in the image. To catch all interesting features, many initial contours are specified to cover the image (Figure 1b). The contours are then evolved, and trivial contours that do not converge to image features are eliminated (Figure 2).

B. 3D Snakuscules

We first propose a mathematical framework for evolving snakuscules in 3D by moving and expanding/contracting an

Fig. 2. (a) A DAPI stained brain tissue slice. (b) The initial configuration and (c) final configuration of snakuscules on a zoomed region.

initial 3D contour to fit cell nuclei. This generalization makes it viable to extend similar contours to higher-dimensional or hyperspectral data (ex. hypersnakuscules). The 3D snakuscule is based on a pair of concentric spheres that are parameterized by two points an (Figure 4a). The optimization process minimizes a local energy function, which favors high contrast between weighted inner and outer volumes. Contours move and evolve within the spatial domain of an image to minimize the contrast energy function (Equation 2).

This optimization leads the contour toward a bright spherical object on a dark background. To ensure the snake does not move in uniform regions with constant intensity where , the energy is defined using two sub-terms that cancel each other out; therefore, . This prevents the contour from sliding when the surrounding gradient is zero [37]. We illustrate energy minimization for a generic model of a light blob , which is a sphere of radius in a black background. When the contour is concentric within the blob, the resulting energy is given by:

The energy achieves an optimal value for any contour equal or larger than the blob, so there is no unique optimal contour. To ensure that the volume occupied by the contour is also minimized, a normalization term is used to reformulate the energy function:

where to apply a penalty when the contour becomes larger than the blob. To balance the expansion and contraction speed when the contour is approaching the blob size, we force

Fig. 3. Energy changes of the 3D snake with and without normalization term w.r.t its radius. Energy function with normalization term has a single local minimum when the snake fit the blob.

the energy gradient to be symmetric as the optimal value is approached:

which results in a normalization value . Figure 3 depicts the energy function with respect to the contour radius with and without normalization. Note that this normalization term can be optimized as desired for objects that are not binary indicator functions (ex. Gaussian kernels).

A discrete formulation of the energy function is generated by substituting summation for integration in the pixel domain. The final discrete energy function is given by:

where K is the set of all pixels within of the 3D snake center, , and S(r) is a differentiable weight function (Figure 4d), so that. The 3D snake is composed of four different regions (Figure 4c); two dynamic and two fixed regions. During evolution, the entire footprint becomes smaller or larger while and remain unchanged:

To simplify calculations, the two identifier points p and q are considered to be in the same line along both the y and z directions (and ). The energy function can be rewritten as:

C. 3D contour evolution

The 3D snakuscule evolves by movements of p and q in the opposite direction of to minimize the energy function using gradient descent. Therefore, partial derivatives of the

Fig. 4. (a) A 3D snakuscule defined by two points p and q; to simplify computations 3D snakusules identifier points are considered in the same y and z levels. (b) The initial configuration consists of every two neighboring 3D contours located at a distanceapart. (c) The middle section of the 3D snakuscule with four distinct regions are shown in different colors. (d) The weight function assigns a weight to any portion of the 3D snakuscule shown in (c).

energy function E with respect to the identifier points p and q are required:

where

We minimize the energy (Equation 6) using gradient descent to update the position of the identifier points. Each point K applies a force to p and q that dictate its motion over time:

where is learning rate, is constant and n is the iteration number.

D. Parallelizing the process

Regarding cell localization and counting, 3D snakuscules can be initially placed on the 3D image in a lattice (Figure 4b) similar to the 2D case (Figure 1b). They evolve independently

Fig. 5. Execution time for the method implemented on CPU and GPU. Time axis is plotted on a logarithmic scale.

to segment a nearby spherical structure (blob). However, the higher dimensional integration results in excessive computing time, making a serial implementation impractical for large high resolution images.

Since the evolution of each contour is completely independent from the others, this process is highly data-parallel and an ideal application for graphic processing units (GPUs). GPUs consist of a large number of parallel processors that can be used for general purpose parallel computing to improve the performance of algorithms that are highly data parallel and can be split into a large number of independent threads. A GPU has a local single-instruction on multiple data (SIMD) architecture, making execution of the same program on multiple values extremely efficient. The set of instructions applied on each element is called a kernel [39]. We define our evolutionary instructions as a GPU kernel that can be executed for thousands of snakes in parallel.

For instance, snakuscules are run on various pieces of a 2D DAPI stained rat brain tissue image. The image is a whole rat brain slice with resolution of 350nm/pixel. The initial and final snakuscules configurations for a image are shown (Figure 2). Figure 5 illustrates performance of GPU implementation in comparison to an optimized CPU version. By increasing number of contours, image size, CPU execution time increases significantly, quickly becoming impractical.

The 3D snakuscule is computationally more expensive because of integration over a 3D space using a uniform grid. Therefore, parallel computing using a GPU is employed to assign one contour evolution to one GPU thread.

E. Monte-Carlo Integration

In order to further accelerate contour evolution, MonteCarlo (MC) integration is used. It estimates the integral values using a uniform distribution of randomized samples. In the 2D case, samples are chosen from a uniform distribution inside of a circle with radius . If r and are random numbers in [0, 1] and respectively; a uniform set of

Fig. 6. Execution time of snakuscules (2D) on GPU with and without Monte- Carlo sampling.

points within the circle with radius r are computed:

MC integration is selected because it provides two advantages over uniform sampling:

• Convergence is significantly faster for higher-dimensional data sets, providing an error of , regardless of the number of dimensions.

• The use of MC sampling allows us to specify a constant number of samples per snake, minimizing branch divergence in the GPU-based SIMD algorithm. One constraint of MC integration is that we are relying on an underlying assumption that the integral is well-behaved (smooth). Given that we expect cell nuclei to be relatively consistent in size, this assumption is well founded. However, it can be mathematically enforced using a low-pass filter that forces the image to be smooth. For 3D images, uniform sampling is done within a sphere with radius . Execution time using Monte-Carlo sampling in comparison with the original integration for different number of snakes on the 2D (Figure 6) and the 3D (Figure 7) images shows significant improvement. As expected, a significantly greater acceleration can be seen in the 3D algorithm, with an gain in performance on average.

F. Parallel Contour Evaluation

In order to improve the GPU efficiency by utilizing more GPU resources, we further parallelize each 3D contour. We instead assign each block to one contour so that threads in that block are responsible for smaller parts of Equation 12 and 13. For each snake, if MC integration selects N random samples and the CUDA kernel is launched with T threads (the maximum number of threads per block), each thread calculates a portion of the energy (Equation 7-10) corresponding to N/T spatial locations within the contour. The results are stored in shared memory and combined (Equation 12-13) to calculate the final contour at each iteration. This allows employing more GPU threads to cooperatively walk through a snake evolution process.

Fig. 7. Execution time of 3D snakuscules on GPU with and without Monte Carlo sampling

Fig. 8. (a) A section of DAPI stained mouse hippocampus 3D image and (b) the final configuration of 3D snakuscules on the section.

In order to find all sphere-like objects in an 3D-image without user interaction, the image is covered by close initial 3D contours. The 3D contours update their current configurations by individually optimizing their energies. Contour evolution is stopped when either (a) they meet maximum number of iterations or (b) they converge. Overlapping snakes, as defined by , undergo a competition with the lower energy snake surviving. 3D snakuscules with energy greater than a threshold () are also removed.

Images of the hilus region of the dentate gyrus in the mouse hippocampus were collected with a 40X oil objective on a Leica TCS SP8 confocal microscope (pixels; ). A 405nm laser excited the DAPI signal that was detected between . A step size was set for z stack collection of the entire tissue thickness. Acquisition speed was set to 600 Hz, with a 0.75 zoom factor. Raw images for all data analysis were exported as TIFFs. Transgenic mice that model Dravet syndrome with spontaneous seizure onset at postnatal day 15 were housed in a 12 hour light/dark cycle. These mice have a knock-in mutant Scn1A gene containing a nonsense substitution (CgG to TgA) in exon 21 [40]. All animal experiments were approved by the Institutional Animal Care and Use Committee of the University of Houston.

We applied our method to the image of size 40 (Figure 8a). In order to deal with pixel anisotropy, the images were re-sampled to obtain a uniform pixel size. The contours are initialized as a lattice of 3D snakuscules. The 3D snakuscules are evolved and culled using the proposed methods. Figure 8b depicts the final configuration of them on a 2D slice.

To quantitatively evaluate the performance of our method, 3D snakuscules are considered as either a cell (foreground) or non-cell (background) using a K-nearest neighborhood (KNN) search. The three evaluation parameters, precision (), recall () and the F-measure (F), are calculated as follows:

detected cells, the false positive (FP) value is the number of falsely detected cells, and the false negative (FN) value is number of undetected cells. Table I illustrates the performance of MINIS, FARSIGHT, 3D object counter, CellSegm and the proposed method on a DAPI-labeld image with 53 annotated cells. In this experiment, we set the 3D snake parameters so that initial radius is 15 pixels (), the energy threshold , and the maximum number of iterations is 400. Also, We adjusted the hyperparameters of other methods to optimize their performance on our dataset. The results clearly demonstrate that 3D snakuscules are suitably capable of capturing round cell nuclei, and provide considerable performance advantages over other conventional methods with F-measure of 90% in comparison with that of 82%, 74%, 62% and 82% for MINIS, FARSIGHT, 3D object counter and CellSegm respectively. Additional advantages include the minimal number of parameters required for initialization. We also evaluated our algorithm on two publicly available data sets (Figure II) available at www.celltrackingchallenge.net:

• Fluo-N3DH CE: Caenorhabditis elegans embryos stained with green flourescent protein (GFP) transfection collected with Plan-Apochromat 63X/1.4 (oil) objective lense on Zeiss LSM 510 Meta and the voxel size [41], [42].

• Fluo-N3DH-SIM+: A simulated video from fluorescently labeled nuclei of the HL60 cells stained with Hoescht. It is imaged using Plan-Apochromat 40X/1.3 (oil) objective with resolution [41], [42].

III. GPU OCCUPANCY

Occupancy is a measure of how many warps the kernel has active on the GPU, relative to the maximum number of warps supported by the GPU. The graphic processor used in our experiments is GetForce GTX-1070. Theoretical occupancy provides an upper bound while achieved occupancy indicates the kernel’s actual performance. When the GPU does not have enough work, resources are wasted.

TABLE I PERFORMANCE OF DIFFERENT ALGORITHMS AGAINST MANUALLY SEGMENTED GROUND TRUTH THROUGH EVALUATION PARAMETERS, PRECISION, RECALL AND FMEASURE

Fig. 9. Evaluation of different segmentation algorithms on the same DAPI stained image. Our proposed method (3D snakuscule) provides results which matches the ground truth better than others.

The theoretical occupancy for our algorithm is 50%, limited by the number of registers required for contour evolution. This is a relatively standard theoretical occupancy for complex calculations, however a more rigorous optimization may yield better results in the future. Since any 3D contour is assigned to one GPU thread, the number of utilized threads is equal to the number of initial 3D snakes. Therefore, a small image with a small number of cells occupies fewer resources, resulting in low compute performance that is unable to hide operation and memory latency (Figure 11a). Comparing achieved occupancy with and without Monte-Carlo sampling shows that

Fig. 10. Representing one section of different 3D datasets used for cell detection. (a)Fluo-N3DH CE (b)Fluo-N3DH-SIM+ (c) Mouse-Brain

TABLE II PERFORMANCE OF 3D SNAKESCULE ON DIFFERENT DATASETS WITH DIFFERENT NUMBER OF EXISTING CELLS

MC integration improves GPU performance and occupancy by reducing thread stalls. Since there are cells with various sizes in the image, uniform integration takes longer for contours corresponding to bigger cells, resulting in additional stalls. These are mitigated using MC integration.

Since the reduction in efficiency is due primarily to low occupancy, further parallelizing each 3D contour (Section II-F) allows for the generation of more threads. This provides an achieved occupancy much closer to the theoretical limit (Figure 11a), further reducing processing time (Figure 11b).

IV. CONCLUSION

We developed a 3D blob-detector, based on the miniscule snakes (snakuscule) algorithm, that provides a method for 3D nuclei detection with minimal user interaction. This paper describes a unified formulation of snakuscules in three dimensional space, so that the new cost function is minimized with respect to two points which define the contour. Although the method is initially computationally expensive, it is extremely data parallel and can be efficiently implemented using GPU hardware. A GPU implementation, combined with MonteCarlo sampling, results in a simple and fast blob detector for large images with numerous cells. Our method requires the specification of a minimum contour size, which is usually readily available for microscopy images. We have illustrated that the GPU implementation and Monte Carlo sampling sig-nificantly increase performance, making 3D snakuscules viable for image segmentation. The experimental results demonstrate that the proposed method outperforms state of art methods in overall accuracy.

One major limitation of this algorithm is that a significant portion of the evaluation is devoted to the evolution of snakes that will ultimately be culled. This suggests that any method that reliably places initial contours could significantly increase snakuscule performance. A more optimal placement of initial contours could significantly improve performance beyond what we were able to achieve with a lattice. However, methods such as iterative voting and Laplacian of Gaussian blob detection resulted in reduced accuracy when tested. Therefore more advanced algorithms, such as dynamic culling or insertion of contours during evolution, may be a better approach.

In addition, further optimization of the evolution kernel to increase theoretical occupancy limited by register usage could double performance.

ACKNOWLEDGMENT

This work was funded in part by the Cancer Prevention and Research Institute of Texas (CPRIT) #RR140013, the National Institutes of Health / National Library of Medicine (NLM) #4 R00 LM011390-02, as well as the National Science Foundation I/UCRC BRAIN Center #1650566. The authors would like to thank Dr. Leigh Leasure and Dr. Amy Sater for the use of their staining reagents and access to microscopy equipment.

Fig. 11. (a) Theoretical occupancy, green, and achieved occupancy using different size images (different number of initial 3D snakuscules) with and without Monte Carlo integration, blue and red respectively. Parallel 3D snakuscules provide an achieved occupancy (purple) comparable to the theoretical limit. (b) The diagram shows execution time of the method implemented on GPU using MC integration before and after further parallelization for different number of initiated 3D snakuscules.

REFERENCES

[1] H. Su, Z. Yin, S. Huh, T. Kanade, and J. Zhu, “Interactive Cell Segmentation Based on Active and Semi-Supervised Learning,” IEEE Transactions on Medical Imaging, vol. 35, no. 3, pp. 762–777, Mar. 2016. [Online]. Available: http://ieeexplore.ieee.org/document/7307213/

[2] H. Irshad, A. Veillard, L. Roux, and D. Racoceanu, “Methods for nuclei detection, segmentation, and classification in digital histopathology: a reviewcurrent status and future potential,” IEEE reviews in biomedical engineering, vol. 7, pp. 97–114, 2014.

[3] G. Lin, U. Adiga, K. Olson, J. F. Guzowski, C. A. Barnes, and B. Roysam, “A hybrid 3d watershed algorithm incorporating gradient cues and object models for automatic segmentation of nuclei in confocal image stacks,” Cytometry, vol. 56A, no. 1, pp. 23–36, Nov. 2003. [Online]. Available: http://doi.wiley.com/10.1002/cyto.a.10079

[4] F. Xing, Y. Xie, and L. Yang, “An Automatic Learning-Based Framework for Robust Nucleus Segmentation,” IEEE Transactions on Medical Imaging, vol. 35, no. 2, pp. 550–566, Feb. 2016. [Online]. Available: http://ieeexplore.ieee.org/document/7274740/

[5] C. Wahlby, I.-M. Sintorn, F. Erlandsson, G. Borgefors, and E. Bengtsson, “Combining intensity, edge and shape information for 2d and 3d segmentation of cell nuclei in tissue sections,” Journal of Microscopy, vol. 215, no. 1, pp. 67–76, Jul. 2004. [Online]. Available: http://doi.wiley.com/10.1111/j.0022-2720.2004.01338.x

[6] E. Meijering, “Cell Segmentation: 50 Years Down the Road [Life Sciences],” IEEE Signal Processing Magazine, vol. 29, no. 5, pp. 140–145, Sep. 2012. [Online]. Available: http://ieeexplore.ieee.org/ document/6279591/

[7] Xiaobo Zhou, Fuhai Li, Jun Yan, and S. Wong, “A Novel Cell Segmentation Method and Cell Phase Identification Using Markov Model,” IEEE Transactions on Information Technology in Biomedicine, vol. 13, no. 2, pp. 152–157, Mar. 2009. [Online]. Available: http://ieeexplore.ieee.org/document/4663850/

[8] Y. M. George, B. M. Bagoury, H. H. Zayed, and M. I. Roushdy, “Automated cell nuclei segmentation for breast fine needle aspiration cytology,” Signal Processing, vol. 93, no. 10, pp. 2804–2816, Oct. 2013. [Online]. Available: http://linkinghub.elsevier.com/retrieve/pii/ S0165168412002642

[9] H. Xu, C. Lu, and M. Mandal, “An Efficient Technique for Nuclei Segmentation Based on Ellipse Descriptor Analysis and Improved Seed Detection Algorithm,” IEEE Journal of Biomedical and Health Informatics, vol. 18, no. 5, pp. 1729–1741, Sep. 2014. [Online]. Available: http://ieeexplore.ieee.org/document/6698355/

[10] S. Grigorescu, N. Petkov, and P. Kruizinga, “Comparison of texture features based on Gabor filters,” IEEE Transactions on Image Processing, vol. 11, no. 10, pp. 1160–1167, Oct. 2002. [Online]. Available: http://ieeexplore.ieee.org/document/1042386/

[11] G. Ongun, U. Halici, K. Leblebicioglu, V. Atalay, M. Beksac, and S. Beksac, “Feature extraction and classification of blood cells for an automated differential blood count system.” IEEE, 2001, pp. 2461– 2466. [Online]. Available: http://ieeexplore.ieee.org/document/938753/

[12] Z. Yin, R. Bise, M. Chen, and T. Kanade, “Cell segmentation in microscopy imagery using a bag of local Bayesian classifiers.” IEEE, 2010, pp. 125–128. [Online]. Available: http://ieeexplore.ieee. org/document/5490399/

[13] A. S. Jrgensen, A. M. Rasmussen, N. K. M. Andersen, S. K. Andersen, J. Emborg, R. Rge, and L. R. stergaard, “Using cell nuclei features to detect colon cancer tissue in hematoxylin and eosin stained slides: Detection of Colon Cancer Tissue,” Cytometry Part A, Jul. 2017. [Online]. Available: http://doi.wiley.com/10.1002/cyto.a.23175

[14] Jun Tang, “A color image segmentation algorithm based on region growing.” IEEE, 2010, pp. V6–634–V6–637. [Online]. Available: http://ieeexplore.ieee.org/document/5486012/

[15] C. F. Koyuncu, S. Arslan, I. Durmaz, R. Cetin-Atalay, and C. GunduzDemir, “Smart Markers for Watershed-Based Cell Segmentation,” PLoS ONE, vol. 7, no. 11, p. e48664, Nov. 2012. [Online]. Available: http://dx.plos.org/10.1371/journal.pone.0048664

[16] A. L. Maycock, R. H. Abeles, J. I. Salach, and T. P. Singer, “The structure of the covalent adduct formed by the interaction of 3-dimethylamino-1-propyne and the flavine of mitochondrial amine oxidase,” Biochemistry, vol. 15, no. 1, pp. 114–125, Jan. 1976.

[17] F. Sadeghian, Z. Seman, A. R. Ramli, B. H. Abdul Kahar, and M.-I. Saripan, “A Framework for White Blood Cell Segmentation in Microscopic Blood Images Using Digital Image Processing,” Biological Procedures Online, vol. 11, no. 1, pp. 196–206, Dec. 2009. [Online]. Available: http://www.biologicalproceduresonline.com/content/11/1/196

[18] B. C. Ko, J.-W. Gim, and J.-Y. Nam, “Automatic white blood cell segmentation using stepwise merging rules and gradient vector flow snake,” Micron, vol. 42, no. 7, pp. 695–705, Oct. 2011. [Online]. Available: http://linkinghub.elsevier.com/retrieve/pii/S0968432811000576

[19] M. Lotfollahi, M. Gity, J. Y. Ye, and A. Mahlooji Far, “Segmentation of breast ultrasound images based on active contours using neutrosophic theory,” Journal of Medical Ultrasonics, Aug. 2017. [Online]. Available: http://link.springer.com/10.1007/s10396-017-0811-8

[20] O. Ronneberger, P. Fischer, and T. Brox, “U-net: Convolutional net- works for biomedical image segmentation,” in International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, 2015, pp. 234–241.

[21] H. Chen, X. Qi, L. Yu, and P.-A. Heng, “Dcan: Deep contour-aware networks for accurate gland segmentation,” in Proceedings of the IEEE conference on Computer Vision and Pattern Recognition, 2016, pp. 2487–2496.

[22] Q. Wang, S. Wang, X. Zhu, T. Liu, Z. Humphrey, V. Ghukasyan, M. Conway, E. Scott, G. Fragola, K. Bradford et al., “Accurate and

high throughput cell segmentation method for mouse brain nuclei using cascaded convolutional neural network,” in International Workshop on Patch-based Techniques in Medical Imaging. Springer, 2017, pp. 55–62.

[23] S. U. Akram, J. Kannala, L. Eklund, and J. Heikkil¨a, “Cell proposal network for microscopy image analysis,” in Image Processing (ICIP), 2016 IEEE International Conference on. IEEE, 2016, pp. 3199–3203.

[24] J. Shan, H. Cheng, and Y. Wang, “Completely automated segmentation approach for breast ultrasound images using multiple-domain features,” Ultrasound in medicine & biology, vol. 38, no. 2, pp. 262–275, 2012.

[25] M. Khoshdeli, R. Cong, and B. Parvin, “Detection of nuclei in h&e stained sections using convolutional neural networks,” in Biomedical & Health Informatics (BHI), 2017 IEEE EMBS International Conference on. IEEE, 2017, pp. 105–108.

[26] H. Sailem, M. Arias-Garcia, C. Bakal, A. Zisserman, and J. Rittscher, “Discovery of rare phenotypes in cellular images using weakly supervised deep learning,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017, pp. 49–55.

[27] Z. Cao, L. Duan, G. Yang, T. Yue, Q. Chen, H. Fu, and Y. Xu, “Breast tumor detection in ultrasound images using deep learning,” in International Workshop on Patch-based Techniques in Medical Imaging. Springer, 2017, pp. 121–128.

[28] Y. Song, E.-L. Tan, X. Jiang, J.-Z. Cheng, D. Ni, S. Chen, B. Lei, and T. Wang, “Accurate cervical cell segmentation from overlapping clumps in pap smear images,” IEEE transactions on medical imaging, vol. 36, no. 1, pp. 288–300, 2017.

[29] A. Santamaria-Pang, J. Rittscher, M. Gerdes, and D. Padfield, “Cell seg- mentation and classification by hierarchical supervised shape ranking,” in Biomedical Imaging (ISBI), 2015 IEEE 12th International Symposium on. IEEE, 2015, pp. 1296–1299.

[30] T. Janssens, L. Antanas, S. Derde, I. Vanhorebeek, G. Van den Berghe, and F. G. Grandas, “Charisma: An integrated approach to automatic h&e-stained skeletal muscle cell segmentation using supervised learning and novel robust clump splitting,” Medical image analysis, vol. 17, no. 8, pp. 1206–1219, 2013.

[31] B. Nielsen, J. Maddison, and H. Danielsen, “Optimizing the initialization and convergence of active contours for segmentation of cell nuclei in histological sections,” Jan. 27 2015, uS Patent 8,942,441.

[32] Y. Al-Kofahi, W. Lassoued, W. Lee, and B. Roysam, “Improved au- tomatic detection and segmentation of cell nuclei in histopathology images,” IEEE transactions on bio-medical engineering, vol. 57, no. 4, pp. 841–852, Apr. 2010.

[33] X. Lou, M. Kang, P. Xenopoulos, S. Muoz-Descalzo, and A.-K. Hadjantonakis, “A Rapid and Efficient 2d/3d Nuclear Segmentation Method for Analysis of Early Mouse Embryo and Stem Cell Image Data,” Stem Cell Reports, vol. 2, no. 3, pp. 382–397, Mar. 2014. [Online]. Available: http://linkinghub.elsevier.com/retrieve/ pii/S2213671114000277

[34] S. Bolte and F. P. Cordeli?Res, “A guided tour into subcellular colocalization analysis in light microscopy,” Journal of Microscopy, vol. 224, no. 3, pp. 213–232, Dec. 2006. [Online]. Available: http://doi.wiley.com/10.1111/j.1365-2818.2006.01706.x

[35] E. Hodneland, T. Kgel, D. Frei, H.-H. Gerdes, and A. Lundervold, “CellSegm - a MATLAB toolbox for high-throughput 3d cell segmentation,” Source Code for Biology and Medicine, vol. 8, no. 1, p. 16, 2013. [Online]. Available: http://scfbm.biomedcentral.com/ articles/10.1186/1751-0473-8-16

[36] Y.-H. Cheng, T.-C. Lin, J.-J. Ding, Y.-F. Wu, and S.-J. Lin, “Adaptive 3d cell segmentation and tracing algorithm using convex separation and histogram information for vivo images,” in Multimedia & Expo Workshops (ICMEW), 2017 IEEE International Conference on. IEEE, 2017, pp. 133–138.

[37] P. Thevenaz and M. Unser, “Snakuscules,” IEEE transactions on image processing: a publication of the IEEE Signal Processing Society, vol. 17, no. 4, pp. 585–593, Apr. 2008.

[38] A. K. Pediredla and C. S. Seelamantula, “A unified approach for optimization of Snakuscules and Ovuscules.” IEEE, Mar. 2012, pp. 681–684. [Online]. Available: http://ieeexplore.ieee.org/document/ 6287975/

[39] E. Smistad, T. L. Falch, M. Bozorgi, A. C. Elster, and F. Lindseth, “Med- ical image segmentation on GPUs- A comprehensive review,” Medical Image Analysis, vol. 20, no. 1, pp. 1–18, Feb. 2015. [Online]. Available: http://linkinghub.elsevier.com/retrieve/pii/S1361841514001819

[40] I. Ogiwara, H. Miyamoto, N. Morita, N. Atapour, E. Mazaki, I. Inoue, T. Takeuchi, S. Itohara, Y. Yanagawa, K. Obata et al., “Nav1. 1 localizes to axons of parvalbumin-positive inhibitory interneurons: a circuit basis for epileptic seizures in mice carrying an scn1a gene mutation,” Journal of Neuroscience, vol. 27, no. 22, pp. 5903–5914, 2007.

[41] M. Maˇska, V. Ulman, D. Svoboda, P. Matula, P. Matula, C. Ederra, A. Urbiola, T. Espa˜na, S. Venkatesan, D. M. Balak et al., “A benchmark for comparison of cell tracking algorithms,” Bioinformatics, vol. 30, no. 11, pp. 1609–1617, 2014.

[42] V. Ulman, M. Maˇska, K. E. Magnusson, O. Ronneberger, C. Haubold, N. Harder, P. Matula, P. Matula, D. Svoboda, M. Radojevic et al., “An objective comparison of cell-tracking algorithms,” Nature methods, vol. 14, no. 12, p. 1141, 2017.

designed for accessibility and to further open science