Command Palette
Search for a command to run...
Biologically-Constrained Graphs for Global Connectomics Reconstruction
{ Hanspeter Pfister Toufiq Parag Donglai Wei Haidong Zhu Daniel Haehn Brian Matejek}

Abstract
Most current state-of-the-art connectome reconstruction pipelines have two major steps: initial pixel-based segmentation with affinity prediction and watershed transform, and refined segmentation by merging over-segmented regions. These methods rely only on local context and are typically agnostic to the underlying biology. Since a few merge errors can lead to several incorrectly merged neuronal processes, these algorithms are currently tuned towards over-segmentation producing an overburden of costly proofreading. We propose a third step for connectomics reconstruction pipelines to refine an over-segmentation using both local and global context with an emphasis on adhering to the underlying biology. We first extract a graph from an input segmentation where nodes correspond to segment labels and edges indicate potential split errors in the over-segmentation. In order to increase throughput and allow for large-scale reconstruction, we employ biologically inspired geometric constraints based on neuron morphology to reduce the number of nodes and edges. Next, two neural networks learn these neuronal shapes to further aid the graph construction process. Lastly, we reformulate the region merging problem as a graph partitioning one to leverage global context. We demonstrate the performance of our approach on four real-world connectomics datasets with an average variation of information improvement of 21.3%.
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| electron-microscopy-image-segmentation-on | Waterz (3D U-Net) | Total Variation of Information: 0.807 VI Merge: 0.236 VI Split: 0.571 |
| electron-microscopy-image-segmentation-on | Waterz (3D U-Net) + Refinement | Total Variation of Information: 0.647 VI Merge: 0.209 VI Split: 0.438 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.