Model-based crew activity tracking for precision descent procedure refinement

New procedures for human operators in complex systems must be both operationally effective and inexpensive to introduce. Procedures may require refinement to meet these objectives. The paper illustrates how process measures about operator performance using a new procedure can be derived via activity tracking, and how this information can supplement product measures to support procedure refinement. Activity tracking is a form of intent inferencing suitable for constructing and maintaining a representation of operator activities in real time (T.J. Callantine et al., 1997). The Crew Activity Tracking System (CATS) uses a normative model of the new procedure to predict how operators should perform the procedure; operator actions that CATS cannot interpret signal potential operator difficulties. By using the model to track the activities of operators using the new procedure, CATS can identify mismatches between the model and actual operator actions. Through this process, CATS can help substantiate potentially problematic aspects of the procedure. Difficulties identified by CATS then serve as the focus for further refinements to the procedural elements, or the supporting documentation and training used to introduce it