VICE: Visual Identification and Correction of Neural Circuit Errors

Felix Gonda, Xueying Wang, Johanna Beyer, Markus Hadwiger, Jeff W. Lichtman and Hanspeter Pfister

VICE: Visual Identification and Correction of Neural Circuit Errors
Computer Graphics Forum, Vol.40, No.3 (Proceedings Eurographics/IEEE Symposium on Visualization, Eurovis 2021), pp. 447-458 , 2021

A connectivity graph of neurons at the resolution of single synapses provides scientists with a tool for understanding the nervous system in health and disease. Recent advances in automatic image segmentation and synapse prediction in electron microscopy (EM) datasets of the brain have made reconstructions of neurons possible at the nanometer scale. However, automatic segmentation sometimes struggles to segment large neurons correctly, requiring human effort to proofread its output. General proofreading involves inspecting large volumes to correct segmentation errors at the pixel-level, a visually intensive and time-consuming process. This paper presents the design and implementation of an analytics framework that streamlines proofreading, focusing on connectivity-related errors. We accomplish this with automated likely-error detection and synapse clustering that drives the proofreading effort with highly interactive 3D visualizations. In particular, our strategy centers on proofreading the local circuit of a single cell to ensure a basic level of completeness. We demonstrate our framework’s utility with a user study and report quantitative and subjective feedback from our users. Overall, users find the framework more efficient for proofreading, understanding evolving graphs, and sharing error correction strategies.

@article{Gonda2021VisualIdentificationCorrection,
  title = {VICE: Visual Identification and Correction of Neural Circuit Errors},
  author = {Gonda, Felix and Wang, Xueying and Beyer, Johanna and Hadwiger, Markus and Lichtman, Jeff W. and Pfister, Hanspeter},
  journal = {Computer Graphics Forum (Proceedings Eurographics/IEEE Symposium on Visualization, Eurovis 2021},
  year = {2021},
  volume = {40},
  number = {3},
  pages = {447-458}
}