Extraction of actions and objects from instruction manual for executable robot planning

Home service robots are expected to execute many tasks for human in daily life. Many tasks are often related to handling or operating a certain home appliance. This research aims to analyze the instructions from the user manuals of some types of home appliances to extract actions and objects which then can be understood by robot and used for building the working robot plan. We propose a processing procedure including grammatical parsing the instruction sentences by using a parser, then extracting the pairs of action and object from parse tree of each instruction sentence. A manual comparison is executed to evaluate the extraction results. The suitable extracted actions will be selected for building executing plans for a robot in the next stage.