HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Isolation forest

{Zhi-Hua Zhou Kai Ming Ting Fei Tony Liu}

Abstract

Most existing model-based approaches to anomaly detection construct a profile of normal instances, then identify instances that do not conform to the normal profile as anomalies. This paper proposes a fundamentally different model-based method that explicitly isolates anomalies instead of profiles normal points. To our best knowledge, the concept of isolation has not been explored in current literature. The use of isolation enables the proposed method, iForest, to exploit sub-sampling to an extent that is not feasible in existing methods, creating an algorithm which has a linear time complexity with a low constant and a low memory requirement. Our empirical evaluation shows that iForest performs favourably to ORCA, a near-linear time complexity distance-based method, LOF and Random Forests in terms of AUC and processing time, and especially in large data sets. iForest also works well in high dimensional problems which have a large number of irrelevant attributes, and in situations where training set does not contain any anomalies.

Benchmarks

BenchmarkMethodologyMetrics
unsupervised-anomaly-detection-with-specifiedIsolation Forest
AUC-ROC: 0.638
unsupervised-anomaly-detection-with-specified-1Isolation Forest
AUC-ROC: 0.690
unsupervised-anomaly-detection-with-specified-10Isolation Forest
AUC-ROC: 0.777
unsupervised-anomaly-detection-with-specified-11Isolation Forest
AUC-ROC: 0.908
unsupervised-anomaly-detection-with-specified-12Isolation Forest
AUC-ROC: 0.777
unsupervised-anomaly-detection-with-specified-14IF
AUC-ROC: 0.889
unsupervised-anomaly-detection-with-specified-15Isolation Forest
AUC-ROC: 0.917
unsupervised-anomaly-detection-with-specified-16Isolation Forest
AUC-ROC: 0.876
unsupervised-anomaly-detection-with-specified-17Isolation Forest
AUC-ROC: 0.846
unsupervised-anomaly-detection-with-specified-18Isolation Forest
AUC-ROC: 0.917
unsupervised-anomaly-detection-with-specified-19IF
AUC-ROC: 0.878
unsupervised-anomaly-detection-with-specified-20IF
AUC-ROC: 0.797
unsupervised-anomaly-detection-with-specified-21IF
AUC-ROC: 0.786
unsupervised-anomaly-detection-with-specified-22IF
AUC-ROC: 0.821
unsupervised-anomaly-detection-with-specified-23IF
AUC-ROC: 0.797
unsupervised-anomaly-detection-with-specified-24IF
AUC-ROC: 0.706
unsupervised-anomaly-detection-with-specified-25IF
AUC-ROC: 0.889
unsupervised-anomaly-detection-with-specified-26IF
AUC-ROC: 0.798
unsupervised-anomaly-detection-with-specified-27IF
AUC-ROC: 0.915
unsupervised-anomaly-detection-with-specified-5Isolation Forest
AUC-ROC: 0.718
unsupervised-anomaly-detection-with-specified-6Isolation Forest
AUC-ROC: 0.721
unsupervised-anomaly-detection-with-specified-7IF
AUC-ROC: 0.661
unsupervised-anomaly-detection-with-specified-8Isolation Forest
AUC-ROC: 0.890
unsupervised-anomaly-detection-with-specified-9Isolation Forest
AUC-ROC: 0.894

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Isolation forest | Papers | HyperAI