HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

FABSA: An aspect-based sentiment analysis dataset of user reviews

{Aji Ghose Hassan Tahir Patrycja Sliwiak Thomas Metcalfe Georgia Harrison Jordan Clive Georgios Kontonatsios}

Abstract

Aspect-based sentiment analysis (ABSA) aims at automatically extracting aspects of entities and classifying the polarity of each extracted aspect. The majority of available ABSA systems heavily rely on manually annotated datasets to train supervised machine learning models. However, the development of such manually curated datasets is a labour-intensive process and therefore existing ABSA datasets cover only a few domains and they are limited in size. In response, we present FABSA (Feedback ABSA), a new large-scale and multi-domain ABSA dataset of feedback reviews. FABSA consists of approximately 10,500 reviews which span across 10 domains. We conduct a number of experiments to evaluate the performance of state-of-the-art deep learning models when applied to the FABSA dataset. Our results demonstrate that ABSA models can generalise across different domains when trained on our FABSA dataset while the performance of the models is enhanced when using a larger training dataset. Our FABSA dataset is publicly available.

Benchmarks

BenchmarkMethodologyMetrics
aspect-based-sentiment-analysis-absa-on-fabsaDeBERTa-pair-large
F1 (%): 80.9
aspect-based-sentiment-analysis-absa-on-fabsaRoBERTa-pair-large
F1 (%): 80.0
aspect-based-sentiment-analysis-absa-on-fabsaBERT-single-large
F1 (%): 78.8
aspect-based-sentiment-analysis-absa-on-fabsaBERT-PT
F1 (%): 78.8
aspect-category-sentiment-analysis-on-fabsaDeBERTa-pair-large
F1 (%): 80.9
aspect-category-sentiment-analysis-on-fabsaBERT-PT
F1 (%): 78.8
aspect-category-sentiment-analysis-on-fabsaBERT-single-large
F1 (%): 78.8
aspect-category-sentiment-analysis-on-fabsaRoBERTa-pair-large
F1 (%): 80.0

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
FABSA: An aspect-based sentiment analysis dataset of user reviews | Papers | HyperAI