Towards automated drive analysis: A multimodal synergistic approach

Naturalistic driving studies (NDS) capture huge amounts of drive data, that is analyzed for critical information about driver behavior, driving characteristics etc. Moreover, NDS involve data collected from a wide range of sensing technologies in cars and this makes the analysis of this data a challenging task. In this paper, we propose a multimodal synergistic approach for automated drive analysis process that can be employed in analyzing large amounts of drive data. The visual information from cameras, vehicle dynamics from CAN bus, vehicle global positioning coordinates from GPS and digital road map data, that are collected during the drive, are analyzed in a collaborative and complementary manner in the approach presented in this paper. It will be shown that the proposed synergistic drive analysis approach automatically determines a wide range of critical information about the drive in varying road conditions.