HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

Simple vs complex temporal recurrences for video saliency prediction

Panagiotis Linardos; Eva Mohedano; Juan Jose Nieto; Noel E. O'Connor; Xavier Giro-i-Nieto; Kevin McGuinness

Simple vs complex temporal recurrences for video saliency prediction

Abstract

This paper investigates modifying an existing neural network architecture for static saliency prediction using two types of recurrences that integrate information from the temporal domain. The first modification is the addition of a ConvLSTM within the architecture, while the second is a conceptually simple exponential moving average of an internal convolutional state. We use weights pre-trained on the SALICON dataset and fine-tune our model on DHF1K. Our results show that both modifications achieve state-of-the-art results and produce similar saliency maps. Source code is available at https://git.io/fjPiB.

Code Repositories

Linardos/SalEMA
pytorch
Mentioned in GitHub
imatge-upc/SalEMA
Official
pytorch

Benchmarks

BenchmarkMethodologyMetrics
video-saliency-detection-on-msu-videoSalEMA
AUC-J: 0.821
CC: 0.636
FPS: 32.97
KLDiv: 0.647
NSS: 1.63
SIM: 0.571

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Simple vs complex temporal recurrences for video saliency prediction | Papers | HyperAI