Learning a distance function with a Siamese network to localize anomalies in videos

Bharathkumar Ramachandra, Michael Jones, Ranga Vatsavai; Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2020, pp. 2598-2607

Abstract


This work introduces a new approach to localize anomalies in surveillance video. The main novelty is the idea of using a Siamese convolutional neural network (CNN) to learn a distance function between a pair of video patches (spatio-temporal regions of video). The learned distance function, which is not specific to the target video, is used to measure the distance between each video patch in the testing video and the video patches found in normal training video. If a testing video patch is not similar to any normal video patch then it must be anomalous. We compare our approach to previously published algorithms using 4 evaluation measures and 3 challenging target benchmark datasets. Experiments show that our approach either surpasses or performs comparably to current state-of-the-art methods.

Related Material


[pdf] [supp] [video]
[bibtex]
@InProceedings{Ramachandra_2020_WACV,
author = {Ramachandra, Bharathkumar and Jones, Michael and Vatsavai, Ranga},
title = {Learning a distance function with a Siamese network to localize anomalies in videos},
booktitle = {Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)},
month = {March},
year = {2020}
}