Command Palette
Search for a command to run...
Semantic Segmentation for Real Point Cloud Scenes via Bilateral Augmentation and Adaptive Fusion
Shi Qiu Saeed Anwar Nick Barnes

Abstract
Given the prominence of current 3D sensors, a fine-grained analysis on the basic point cloud data is worthy of further investigation. Particularly, real point cloud scenes can intuitively capture complex surroundings in the real world, but due to 3D data's raw nature, it is very challenging for machine perception. In this work, we concentrate on the essential visual task, semantic segmentation, for large-scale point cloud data collected in reality. On the one hand, to reduce the ambiguity in nearby points, we augment their local context by fully utilizing both geometric and semantic features in a bilateral structure. On the other hand, we comprehensively interpret the distinctness of the points from multiple resolutions and represent the feature map following an adaptive fusion method at point-level for accurate semantic segmentation. Further, we provide specific ablation studies and intuitive visualizations to validate our key modules. By comparing with state-of-the-art networks on three different benchmarks, we demonstrate the effectiveness of our network.
Code Repositories
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| 3d-semantic-segmentation-on-semantickitti | BAAF-Net | test mIoU: 59.9% |
| semantic-segmentation-on-s3dis | BAAF-Net | Mean IoU: 72.2 Number of params: N/A mAcc: 83.1 oAcc: 88.9 |
| semantic-segmentation-on-s3dis-area5 | BAAF-Net | Number of params: N/A mAcc: 73.1 mIoU: 65.4 oAcc: 88.9 |
| semantic-segmentation-on-semantic3d | BAAF-Net | mIoU: 75.4% oAcc: 94.9% |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.