Integration of color and shape for detecting and tracking security breaches in airports

We present an integrated surveillance system for detecting and tracking security breaches in airports. The first part of the system uses an overhead camera to detect security breaches in exit lanes using a motion-based segmentation algorithm, and the second part of the system tracks the detected target with a pan/tilt/zoom (PTZ) camera using color and shape information. If an object comes into the exit lane from the wrong direction, the first subsystem detects a security breach and sends information to the second subsystem located inside the airport. The second subsystem then extracts the target that caused the security breach using motion-based segmentation and collects features for tracking. Color is initially used as the only feature and shape incorporated in a second step for a more robust tracking.