Command Palette
Search for a command to run...
Iterative Corresponding Geometry: Fusing Region and Depth for Highly Efficient 3D Tracking of Textureless Objects
Stoiber Manuel ; Sundermeyer Martin ; Triebel Rudolph

Abstract
Tracking objects in 3D space and predicting their 6DoF pose is an essentialtask in computer vision. State-of-the-art approaches often rely on objecttexture to tackle this problem. However, while they achieve impressive results,many objects do not contain sufficient texture, violating the main underlyingassumption. In the following, we thus propose ICG, a novel probabilistictracker that fuses region and depth information and only requires the objectgeometry. Our method deploys correspondence lines and points to iterativelyrefine the pose. We also implement robust occlusion handling to improveperformance in real-world settings. Experiments on the YCB-Video, OPT, and Choidatasets demonstrate that, even for textured objects, our approach outperformsthe current state of the art with respect to accuracy and robustness. At thesame time, ICG shows fast convergence and outstanding efficiency, requiringonly 1.3 ms per frame on a single CPU core. Finally, we analyze the influenceof individual components and discuss our performance compared to deeplearning-based methods. The source code of our tracker is publicly available.
Code Repositories
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| 6d-pose-estimation-on-opt | ICG | AUC: 16.54 |
| 6d-pose-estimation-on-ycb-video-2 | ICG | ADDS AUC: 96.5 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.