A flexible system for automated composition of intelligent video analysis

This paper outlines the automatic construction of video processing solutions using multiple software components as opposed to traditional monolithic approaches undertaken by image processing experts. A combined top-down and bottom-up methodology was adopted for the derivation of a suitable level of granularity for a subset of image processing components that implement video classification, object detection, counting and tracking tasks. 90% of these components are generic and could be applied to any video processing task, indicating a high level of reusability for a spectrum of video analyses. Domain-specific video analysis approaches (that exploit combinations of the above components) are built by using an automatic workflow composition module that relies on decomposition-based planning and ontologies. Evaluation on a set of ecological videos indicate that the proposed approach is faster and more flexible to adapt to changes in domain descriptions than specialized components written from scratch by image processing experts.