Anomaly Detection using Context Dependent Optical Flow

Document Type

Conference Article

Publication Title

ACM International Conference Proceeding Series


Anomaly detection is a major task in crowd management through video surveillance. It refers to the events which are deviated from normal events. We have introduced an unsupervised method to detect motion anomaly in surveillance video. In this work we have considered only optical flow as feature. First, for each frame we compute magnitude of optical flow of motion using flownet2 [10]. Then, mean of magnitude of flow due to regular normal motion (given in training data) is computed at each pixel where such motion exists in the training video frames. Our strategy is to compare the motion under consideration against this mean flow magnitude, and we expect that the anomalous motion would differ significantly from normal motion. An autoencoder type network is trained to detect this anomaly. Training data patch is constructed by Interleaving the columns of mean optical flow patch and the corresponding flow patch from each frame. This interleaving is done to incorporate context dependency. The autoencoder is trained to minimize mean-square reconstruction error between input column wise interleaved patch and output (i.e., reconstructed patch) of the autoencoder. During testing, a patch is declared anomalous if the reconstruction error is high compared to the training error. Experiments have been carried out on UCSD and UMN dataset and are compared with other methods. Our method gives comparable results with other state-of-the-art methods.



Publication Date


This document is currently not available here.