HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

Hyperbolic Entailment Cones for Learning Hierarchical Embeddings

Octavian-Eugen Ganea; Gary Bécigneul; Thomas Hofmann

Hyperbolic Entailment Cones for Learning Hierarchical Embeddings

Abstract

Learning graph representations via low-dimensional embeddings that preserve relevant network properties is an important class of problems in machine learning. We here present a novel method to embed directed acyclic graphs. Following prior work, we first advocate for using hyperbolic spaces which provably model tree-like structures better than Euclidean geometry. Second, we view hierarchical relations as partial orders defined using a family of nested geodesically convex cones. We prove that these entailment cones admit an optimal shape with a closed form expression both in the Euclidean and hyperbolic spaces, and they canonically define the embedding learning process. Experiments show significant improvements of our method over strong recent baselines both in terms of representational capacity and generalization.

Code Repositories

dalab/hyperbolic_cones
Official
Mentioned in GitHub
iesl/geometric_graph_embedding
pytorch
Mentioned in GitHub
dinobby/hypemo
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
link-prediction-on-wordnetHyperbolic Entailment Cones
Accuracy: 94.4

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Hyperbolic Entailment Cones for Learning Hierarchical Embeddings | Papers | HyperAI