HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Adapting BERT for Continual Learning of a Sequence of Aspect Sentiment Classification Tasks

Zixuan Ke Hu Xu Bing Liu

Adapting BERT for Continual Learning of a Sequence of Aspect Sentiment Classification Tasks

Abstract

This paper studies continual learning (CL) of a sequence of aspect sentiment classification (ASC) tasks. Although some CL techniques have been proposed for document sentiment classification, we are not aware of any CL work on ASC. A CL system that incrementally learns a sequence of ASC tasks should address the following two issues: (1) transfer knowledge learned from previous tasks to the new task to help it learn a better model, and (2) maintain the performance of the models for previous tasks so that they are not forgotten. This paper proposes a novel capsule network based model called B-CL to address these issues. B-CL markedly improves the ASC performance on both the new task and the old tasks via forward and backward knowledge transfer. The effectiveness of B-CL is demonstrated through extensive experiments.

Code Repositories

zixuanke/pycontinual
Official
pytorch

Benchmarks

BenchmarkMethodologyMetrics
continual-learning-on-20newsgroup-10-tasksB-CL
F1 - macro: 0.9504
continual-learning-on-asc-19-tasksB-CL
F1 - macro: 0.8140
continual-learning-on-dsc-10-tasksB-CL
F1 - macro: 0.7651

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp