HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Ensembling Graph Predictions for AMR Parsing

Hoang Thanh Lam Gabriele Picco Yufang Hou Young-Suk Lee Lam M. Nguyen Dzung T. Phan Vanessa López Ramon Fernandez Astudillo

Ensembling Graph Predictions for AMR Parsing

Abstract

In many machine learning tasks, models are trained to predict structure data such as graphs. For example, in natural language processing, it is very common to parse texts into dependency trees or abstract meaning representation (AMR) graphs. On the other hand, ensemble methods combine predictions from multiple models to create a new one that is more robust and accurate than individual predictions. In the literature, there are many ensembling techniques proposed for classification or regression problems, however, ensemble graph prediction has not been studied thoroughly. In this work, we formalize this problem as mining the largest graph that is the most supported by a collection of graph predictions. As the problem is NP-Hard, we propose an efficient heuristic algorithm to approximate the optimal solution. To validate our approach, we carried out experiments in AMR parsing problems. The experimental results demonstrate that the proposed approach can combine the strength of state-of-the-art AMR parsers to create new predictions that are more accurate than any individual models in five standard benchmark datasets.

Code Repositories

ibm/graph_ensemble_learning
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
amr-parsing-on-bioGraphene Smatch
Smatch: 62.8
amr-parsing-on-ldc2017t10Graphene Smatch (IBM)
Smatch: 86.26
amr-parsing-on-ldc2017t10Graphene Support (IBM)
Smatch: 85.85
amr-parsing-on-ldc2020t02Graphene Support (IBM)
Smatch: 84.41
amr-parsing-on-ldc2020t02Graphene Smatch (IBM)
Smatch: 84.87
amr-parsing-on-new3Graphene Smatch
Smatch: 76.32
amr-parsing-on-the-little-princeGraphene Smatch
Smatch: 79.52

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Ensembling Graph Predictions for AMR Parsing | Papers | HyperAI