DeepXScope: Segmenting Microscopy Images With a Deep Neural Network

Philip Saponaro, Wayne Treible, Abhishek Kolagunda, Timothy Chaya, Jeffrey Caplan, Chandra Kambhamettu, Randall Wisser; Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2017, pp. 91-98

High-speed confocal microscopy has shown great promise to yield insights into plant-fungal interactions by allowing for large volumes of leaf tissue to be imaged at high magnification. Currently, segmentation is performed either manually, which is infeasible for large amounts of data, or by developing separate algorithms to extract individual features within the image data. In this work, we propose the use of a single deep convolutional neural network architecture dubbed DeepXScope for automatically segmenting hyphal networks of the fungal pathogen and cell boundaries and stomata of the host plant. DeepXScope is trained on manually annotated images created for each of these structures. We describe experiments that show each individual structure can be accurately extracted automatically using DeepXScope. We anticipate that plant scientists will be able to use this network to automatically extract multiple structures of interest, and we plan to release our tool to the community.