HyperAIHyperAI

Command Palette

Search for a command to run...

4 months ago

Towards End-to-End Neuromorphic Voxel-based 3D Object Reconstruction Without Physical Priors

Xu Chuanzhi ; Chen Langyi ; Chen Haodong ; Chung Vera ; Qu Qiang

Towards End-to-End Neuromorphic Voxel-based 3D Object Reconstruction
  Without Physical Priors

Abstract

Neuromorphic cameras, also known as event cameras, are asynchronousbrightness-change sensors that can capture extremely fast motion withoutsuffering from motion blur, making them particularly promising for 3Dreconstruction in extreme environments. However, existing research on 3Dreconstruction using monocular neuromorphic cameras is limited, and most of themethods rely on estimating physical priors and employ complex multi-steppipelines. In this work, we propose an end-to-end method for dense voxel 3Dreconstruction using neuromorphic cameras that eliminates the need to estimatephysical priors. Our method incorporates a novel event representation toenhance edge features, enabling the proposed feature-enhancement model to learnmore effectively. Additionally, we introduced Optimal Binarization ThresholdSelection Principle as a guideline for future related work, using the optimalreconstruction results achieved with threshold optimization as the benchmark.Our method achieves a 54.6% improvement in reconstruction accuracy compared tothe baseline method.

Benchmarks

BenchmarkMethodologyMetrics
single-view-3d-reconstruction-on-synthevox3dtowards end-to-end neuromorphic voxel-based 3d object reconstruction without physical priors
A-mIoU: 0.535

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Towards End-to-End Neuromorphic Voxel-based 3D Object Reconstruction Without Physical Priors | Papers | HyperAI