Command Palette
Search for a command to run...
RCT: Random Consistency Training for Semi-supervised Sound Event Detection
Nian Shao Erfan Loweimi Xiaofei Li

Abstract
Sound event detection (SED), as a core module of acoustic environmental analysis, suffers from the problem of data deficiency. The integration of semi-supervised learning (SSL) largely mitigates such problem while bringing no extra annotation budget. This paper researches on several core modules of SSL, and introduces a random consistency training (RCT) strategy. First, a self-consistency loss is proposed to fuse with the teacher-student model to stabilize the training. Second, a hard mixup data augmentation is proposed to account for the additive property of sounds. Third, a random augmentation scheme is applied to flexibly combine different types of data augmentations. Experiments show that the proposed strategy outperform other widely-used strategies.
Code Repositories
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| sound-event-detection-on-desed | RCT | PSDS1: 0.4395 PSDS2: 0.6711 event-based F1 score: 49.62 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.