HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

SemEval-2022 Task 4: Patronizing and Condescending Language Detection

{Steven Schockaert Luis Espinosa-Anke Carla Perez-Almendros}

SemEval-2022 Task 4: Patronizing and Condescending Language Detection

Abstract

This paper presents an overview of Task 4 at SemEval-2022, which was focused on detecting Patronizing and Condescending Language (PCL) towards vulnerable communities. Two sub-tasks were considered: a binary classification task, where participants needed to classify a given paragraph as containing PCL or not, and a multi-label classification task, where participants needed to identify which types of PCL are present (if any). The task attracted more than 300 participants, 77 teams and 229 valid submissions. We provide an overview of how the task was organized, discuss the techniques that were employed by the different participants, and summarize the main resulting insights about PCL detection and categorization.

Benchmarks

BenchmarkMethodologyMetrics
binary-condescension-detection-on-dpmRoBERTa Baseline
F1-score: 49.1
multi-label-condescension-detection-on-dpmRoBERTa Baseline
Macro-F1: 10.4
semeval-2022-task-4-1-binary-pcl-detection-onRoBERTa Baseline
F1-score: 49.1
semeval-2022-task-4-2-multi-label-pclRoBERTa Baseline
Macro-F1: 10.4

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp