HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Unsupervised Offline Changepoint Detection Ensembles

{Maksimov I. Lobachev V Kozitsin V Katser I}

Abstract

Offline changepoint detection (CPD) algorithms are used for signal segmentation in an optimal way. Generally, these algorithms are based on the assumption that signal’s changed statistical properties are known, and the appropriate models (metrics, cost functions) for changepoint detection are used. Otherwise, the process of proper model selection can become laborious and time-consuming with uncertain results. Although an ensemble approach is well known for increasing the robustness of the individual algorithms and dealing with mentioned challenges, it is weakly formalized and much less highlighted for CPD problems than for outlier detection or classification problems. This paper proposes an unsupervised CPD ensemble (CPDE) procedure with the pseudocode of the particular proposed ensemble algorithms and the link to their Python realization. The approach’s novelty is in aggregating several cost functions before the changepoint search procedure running during the offline analysis. The numerical experiment showed that the proposed CPDE outperforms non-ensemble CPD procedures. Additionally, we focused on analyzing common CPD algorithms, scaling, and aggregation functions, comparing them during the numerical experiment. The results were obtained on the two anomaly benchmarks that contain industrial faults and failures—Tennessee Eastman Process (TEP) and Skoltech Anomaly Benchmark (SKAB). One of the possible applications of our research is the estimation of the failure time for fault identification and isolation problems of the technical diagnostics.

Benchmarks

BenchmarkMethodologyMetrics
change-point-detection-on-skabBinSeg CPD algorithm (Mahalanobis metric)
NAB (LowFN): 25.04
NAB (lowFP): 21.69
NAB (standard): 24.1
change-point-detection-on-skabOpt CPD algorithm (Mahalanobis metric)
NAB (LowFN): 23.37
NAB (lowFP): 19.9
NAB (standard): 22.37
change-point-detection-on-skabWin CPD algorithm (l1 metric)
NAB (LowFN): 19.19
NAB (lowFP): 16.22
NAB (standard): 18.4
change-point-detection-on-skabWinEnsemble CPDE algorithm (Sum+MinAbs)
NAB (LowFN): 20.35
NAB (lowFP): 17.03
NAB (standard): 19.38
change-point-detection-on-skabBinSegEnsemble CPDE algorithm (WeightedSum+Rank)
NAB (LowFN): 19.51
NAB (lowFP): 15.36
NAB (standard): 18.1
change-point-detection-on-skabOptEnsemble CPDE algorithm (WeightedSum+Rank)
NAB (LowFN): 24.35
NAB (lowFP): 20.52
NAB (standard): 23.07
change-point-detection-on-tepWin CPD algorithm (Mahalanobis metric)
NAB (LowFN): 28.05
NAB (lowFP): 27
NAB (standard): 27.79
change-point-detection-on-tepBinSeg CPD algorithm (Mahalanobis metric)
NAB (LowFN): 37.29
NAB (lowFP): 35.82
NAB (standard): 36.88
change-point-detection-on-tepBinSegEnsemble CPDE algorithm (Min+MinMax/Rank)
NAB (LowFN): 42.16
NAB (lowFP): 41
NAB (standard): 41.81
change-point-detection-on-tepOpt CPD algorithm (Mahalanobis metric)
NAB (LowFN): 37.29
NAB (lowFP): 35.82
NAB (standard): 36.88
change-point-detection-on-tepWinEnsemble CPDE algorithm (WeightedSum+MinAbs)
NAB (LowFN): 26.29
NAB (lowFP): 24.33
NAB (standard): 25.14
change-point-detection-on-tepOptEnsemble CPDE algorithm (Min+MinMax/Rank)
NAB (LowFN): 42.16
NAB (lowFP): 41
NAB (standard): 41.81

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Unsupervised Offline Changepoint Detection Ensembles | Papers | HyperAI