HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Fully Convolutional Geometric Features

{Christopher Choy Vladlen Koltun Jaesik Park}

Fully Convolutional Geometric Features

Abstract

Extracting geometric features from 3D scans or point clouds is the first step in applications such as registration, reconstruction, and tracking. State-of-the-art methods require computing low-level features as input or extracting patch-based features with limited receptive field. In this work, we present fully-convolutional geometric features, computed in a single pass by a 3D fully-convolutional network. We also present new metric learning losses that dramatically improve performance. Fully-convolutional geometric features are compact, capture broad spatial context, and scale to large scenes. We experimentally validate our approach on both indoor and outdoor datasets. Fully-convolutional geometric features achieve state-of-the-art accuracy without requiring prepossessing, are compact (32 dimensions), and are 600 times faster than the most accurate prior method.

Benchmarks

BenchmarkMethodologyMetrics
3d-feature-matching-on-3dmatch-benchmarkFCGF
Average Recall: 0.9578
point-cloud-registration-on-3dlomatch-10-30FCGF (reported in PREDATOR)
Recall ( correspondence RMSE below 0.2): 40.1
point-cloud-registration-on-3dmatch-at-least-2FCGF (reported in PREDATOR)
Recall ( correspondence RMSE below 0.2): 85.1
point-cloud-registration-on-3dmatch-benchmarkFCGF + RANSAC
Feature Matching Recall: 85
point-cloud-registration-on-3dmatch-trainedFCGF
Recall: 0.325
point-cloud-registration-on-eth-trained-onFCGF
Feature Matching Recall: 0.161
point-cloud-registration-on-kittiFCGF
Success Rate: 96.57
point-cloud-registration-on-kitti-fcgfFCGF
Recall (0.6m, 5 degrees): 98.2
point-cloud-registration-on-kitti-trained-onFCGF
Success Rate: 24.19
point-cloud-registration-on-rotkittiFCGF
RR@(1,0.1): 3.6
RR@(1.5,0.3): 11.6

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp