HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

CARLA: Self-supervised Contrastive Representation Learning for Time Series Anomaly Detection

Zahra Zamanzadeh Darban Geoffrey I. Webb Shirui Pan Charu C. Aggarwal Mahsa Salehi

CARLA: Self-supervised Contrastive Representation Learning for Time Series Anomaly Detection

Abstract

One main challenge in time series anomaly detection (TSAD) is the lack of labelled data in many real-life scenarios. Most of the existing anomaly detection methods focus on learning the normal behaviour of unlabelled time series in an unsupervised manner. The normal boundary is often defined tightly, resulting in slight deviations being classified as anomalies, consequently leading to a high false positive rate and a limited ability to generalise normal patterns. To address this, we introduce a novel end-to-end self-supervised ContrAstive Representation Learning approach for time series Anomaly detection (CARLA). While existing contrastive learning methods assume that augmented time series windows are positive samples and temporally distant windows are negative samples, we argue that these assumptions are limited as augmentation of time series can transform them to negative samples, and a temporally distant window can represent a positive sample. Our contrastive approach leverages existing generic knowledge about time series anomalies and injects various types of anomalies as negative samples. Therefore, CARLA not only learns normal behaviour but also learns deviations indicating anomalies. It creates similar representations for temporally closed windows and distinct ones for anomalies. Additionally, it leverages the information about representations' neighbours through a self-supervised approach to classify windows based on their nearest/furthest neighbours to further enhance the performance of anomaly detection. In extensive tests on seven major real-world time series anomaly detection datasets, CARLA shows superior performance over state-of-the-art self-supervised and unsupervised TSAD methods. Our research shows the potential of contrastive representation learning to advance time series anomaly detection.

Code Repositories

zamanzadeh/CARLA
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
time-series-anomaly-detection-on-kpiCARLA
AUPR: 0.299
F1 Score: 0.3083
Recall: 0.736
precision: 0.195
time-series-anomaly-detection-on-mslCARLA
AUPR: 0.501
F1 Score: 52.27
Recall: 0.7959
precision: 0.3891
time-series-anomaly-detection-on-smapCARLA
AUPR: 0.448
F1 Score: 0.5292
Recall: 0.804
precision: 0.3944
time-series-anomaly-detection-on-smdCARLA
AUPR: 0.507
F1 score: 0.5114
Recall: 0.63062
precision: 0.4276
time-series-anomaly-detection-on-swatCARLA
AUPR: 0.681
F1 Score: 0.7209
Recall: 0.5673
precision: 0.9886
time-series-anomaly-detection-on-wadiCARLA
AUPR: 0.126
F1 Score: 0.2953
Recall: 0.7316
precision: 0.185
time-series-anomaly-detection-on-yahoo-a1CARLA
AUPR: 0.645
F1 Score: 0.7233
precision: 0.9755

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
CARLA: Self-supervised Contrastive Representation Learning for Time Series Anomaly Detection | Papers | HyperAI