Natural language processor for user driven free speech voice interaction in multimodal smart environments

The aim of the paper is to introduce a natural language processor enabling mobile multimodal interfaces to receive user driven free speech in order to enable more natural voice interaction with mobile applications and services to control devices in smart environments. Free speech of users is continuously analysed and matched against semantically defined device service commands. The concept and requirements of the language processor and the semantic description for application commands will be explained. Further the paper elaborates on how this concept was fitted into the general concept of a mobile multimodal interface and elaborates on implementation aspects of the language processor. The feasibility of the approach has been shown in a prototypical implementation. The work has been carried out as part of the research on mobile multimodal interfaces within the IST-FP6 MobiLife project. First order or main headings should commence at the left hand margin of each column, and should be in capitals and can be in bold. Except at the top of a new column the first order heading should be preceded by two lines of space and followed by two lines of space