HyperAIHyperAI

Command Palette

Search for a command to run...

Point-JEPA: A Joint Embedding Predictive Architecture for Self-Supervised Learning on Point Cloud

Saito Ayumu ; Kudeshia Prachi ; Poovvancheri Jiju

Abstract

Recent advancements in self-supervised learning in the point cloud domainhave demonstrated significant potential. However, these methods often sufferfrom drawbacks, including lengthy pre-training time, the necessity ofreconstruction in the input space, or the necessity of additional modalities.In order to address these issues, we introduce Point-JEPA, a joint embeddingpredictive architecture designed specifically for point cloud data. To thisend, we introduce a sequencer that orders point cloud patch embeddings toefficiently compute and utilize their proximity based on the indices duringtarget and context selection. The sequencer also allows shared computations ofthe patch embeddings' proximity between context and target selection, furtherimproving the efficiency. Experimentally, our method achieves competitiveresults with state-of-the-art methods while avoiding the reconstruction in theinput space or additional modality.


Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing

HyperAI Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp