HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

DiaASQ : A Benchmark of Conversational Aspect-based Sentiment Quadruple Analysis

Bobo Li; Hao Fei; Fei Li; Yuhan Wu; Jinsong Zhang; Shengqiong Wu; Jingye Li; Yijiang Liu; Lizi Liao; Tat-Seng Chua; Donghong Ji

DiaASQ : A Benchmark of Conversational Aspect-based Sentiment Quadruple Analysis

Abstract

The rapid development of aspect-based sentiment analysis (ABSA) within recent decades shows great potential for real-world society. The current ABSA works, however, are mostly limited to the scenario of a single text piece, leaving the study in dialogue contexts unexplored. To bridge the gap between fine-grained sentiment analysis and conversational opinion mining, in this work, we introduce a novel task of conversational aspect-based sentiment quadruple analysis, namely DiaASQ, aiming to detect the quadruple of target-aspect-opinion-sentiment in a dialogue. We manually construct a large-scale high-quality DiaASQ dataset in both Chinese and English languages. We deliberately develop a neural model to benchmark the task, which advances in effectively performing end-to-end quadruple prediction, and manages to incorporate rich dialogue-specific and discourse feature representations for better cross-utterance quadruple extraction. We hope the new benchmark will spur more advancements in the sentiment analysis community.

Code Repositories

unikcc/diaasq
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
conversational-sentiment-quadruple-extractionE2E-DiaASQ
Pair F1 (aspect-opinion): 44.27
Pair F1 (target-aspect): 47.91
Pair F1 (target-opinion): 45.58
Quad F1 (identification): 36.80
Quad F1 (micro): 33.31
Span F1 (aspect): 74.71
Span F1 (opinion): 60.22
Span F1 (target): 88.62
conversational-sentiment-quadruple-extraction-1E2E-DiaASQ
Pair F1 (aspect-opinion): 45.44
Pair F1 (target-aspect): 48.61
Pair F1 (target-opinion): 43.31
Quad F1 (identification): 37.51
Quad F1 (micro): 34.94
Span F1 (aspect): 76.94
Span F1 (opinion): 59.35
Span F1 (target): 90.23

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
DiaASQ : A Benchmark of Conversational Aspect-based Sentiment Quadruple Analysis | Papers | HyperAI