A Sensor for Urban Driving Assistance Systems Based on Dense Stereovision

The urban driving environment is a complex and demanding one, requiring increasingly complex sensors for the driving assistance systems. These sensors must be able to analyze the complex scene and extract all the relevant information, while keeping the response time as low as possible. The sensor presented in this paper answers to the requirements of the urban scenario through a multitude of detection modules, built on top of a hybrid (hardware plus software) dense stereo reconstruction engine. The sensor is able to detect and track clothoid and non-clothoid lanes, cars, pedestrians (classified as such), and drivable areas in the absence of lane markings. The hybrid stereovision engine and the proposed detection algorithms allow accurate sensing of the demanding urban scenario at a high frame rate.