HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Biologically-Constrained Graphs for Global Connectomics Reconstruction

{ Hanspeter Pfister Toufiq Parag Donglai Wei Haidong Zhu Daniel Haehn Brian Matejek}

Biologically-Constrained Graphs for Global Connectomics Reconstruction

Abstract

Most current state-of-the-art connectome reconstruction pipelines have two major steps: initial pixel-based segmentation with affinity prediction and watershed transform, and refined segmentation by merging over-segmented regions. These methods rely only on local context and are typically agnostic to the underlying biology. Since a few merge errors can lead to several incorrectly merged neuronal processes, these algorithms are currently tuned towards over-segmentation producing an overburden of costly proofreading. We propose a third step for connectomics reconstruction pipelines to refine an over-segmentation using both local and global context with an emphasis on adhering to the underlying biology. We first extract a graph from an input segmentation where nodes correspond to segment labels and edges indicate potential split errors in the over-segmentation. In order to increase throughput and allow for large-scale reconstruction, we employ biologically inspired geometric constraints based on neuron morphology to reduce the number of nodes and edges. Next, two neural networks learn these neuronal shapes to further aid the graph construction process. Lastly, we reformulate the region merging problem as a graph partitioning one to leverage global context. We demonstrate the performance of our approach on four real-world connectomics datasets with an average variation of information improvement of 21.3%.

Benchmarks

BenchmarkMethodologyMetrics
electron-microscopy-image-segmentation-onWaterz (3D U-Net)
Total Variation of Information: 0.807
VI Merge: 0.236
VI Split: 0.571
electron-microscopy-image-segmentation-onWaterz (3D U-Net) + Refinement
Total Variation of Information: 0.647
VI Merge: 0.209
VI Split: 0.438

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp