HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Look Around for Anomalies: Weakly-Supervised Anomaly Detection via Context-Motion Relational Learning

{Sangyoun Lee Kyungjae Lee Chaewon Park Sangwon Hwang Minjung Kim MyeongAh Cho}

Look Around for Anomalies: Weakly-Supervised Anomaly Detection via Context-Motion Relational Learning

Abstract

Weakly-supervised Video Anomaly Detection is the task of detecting frame-level anomalies using video-level labeled training data. It is difficult to explore class representative features using minimal supervision of weak labels with a single backbone branch. Furthermore, in real-world scenarios, the boundary between normal and abnormal is ambiguous and varies depending on the situation. For example, even for the same motion of running person, the abnormality varies depending on whether the surroundings are a playground or a roadway. Therefore, our aim is to extract discriminative features by widening the relative gap between classes' features from a single branch. In the proposed Class-Activate Feature Learning (CLAV), the features are extracted as per the weights that are implicitly activated depending on the class, and the gap is then enlarged through relative distance learning. Furthermore, as the relationship between context and motion is important in order to identify the anomalies in complex and diverse scenes, we propose a Context--Motion Interrelation Module (CoMo), which models the relationship between the appearance of the surroundings and motion, rather than utilizing only temporal dependencies or motion information. The proposed method shows SOTA performance on four benchmarks including large-scale real-world datasets, and we demonstrate the importance of relational information by analyzing the qualitative results and generalization ability.

Benchmarks

BenchmarkMethodologyMetrics
weakly-supervised-video-anomaly-detection-onCLAV-CoMo
AUC-ROC: 97.59

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Look Around for Anomalies: Weakly-Supervised Anomaly Detection via Context-Motion Relational Learning | Papers | HyperAI