A Scalable Architecture for Operational FMV Exploitation

William R. Thissell, Robert Czajkowski, Francis Schrenk, Timothy Selway, Anthony J. Ries, Shamoli Patel, Patricia L. McDermott, Rod Moten, Ron Rudnicki, Guna Seetharaman, Ilker Ersoy, Kannappan Palaniappan; Proceedings of the IEEE International Conference on Computer Vision (ICCV) Workshops, 2015, pp. 10-18

Abstract

A scalable open systems and standards derived software ecosystem is described for computer vision analytics (CVA) assisted exploitation of full motion video (FMV). The ecosystem, referred to as the Advanced Video Activity Analytics (AVAA), has two instantiations, one for size, weight, and power (SWAP) constrained conditions, and the other for large to massive cloud based configurations. The architecture is designed to meet operational analyst requirements to increase their productivity and accuracy for exploiting FMV using local cluster or scalable cloud-based computing resources. CVAs are encapsulated within a software plug-in architecture and FMV processing pipelines are constructed by combining these plug-ins to accomplish analytical tasks and manage provenance of processing history. An example pipeline for real-time motion detection and moving object characterization using the flux tensor approach is presented. An example video ingest experiment is described. Quantitative and qualitative methods for human factors engineering (HFE) assessment to evaluate cognitive loads for alternative work flow design choices are discussed. This HFE process is used for validating that an AVAA system instantiation with candidate workflow pipelines meets CVA assisted FMV exploitation operational goals for specific analyst workflows. AVAA offers a new framework for video understanding at scale for large enterprise applications in the government and commercial sectors.

Related Material

[pdf]
[bibtex]
@InProceedings{Thissell_2015_ICCV_Workshops,
author = {Thissell, William R. and Czajkowski, Robert and Schrenk, Francis and Selway, Timothy and Ries, Anthony J. and Patel, Shamoli and McDermott, Patricia L. and Moten, Rod and Rudnicki, Ron and Seetharaman, Guna and Ersoy, Ilker and Palaniappan, Kannappan},
title = {A Scalable Architecture for Operational FMV Exploitation},
booktitle = {Proceedings of the IEEE International Conference on Computer Vision (ICCV) Workshops},
month = {December},
year = {2015}
}