Toward understanding of an instruction manual in mechanical assemblies

An experimental task-understanding robotics system is reported that can simulate real assembly operations in an imaginary three-dimensional geometric space. The system is given as input to a set of sentences from an instruction manual elucidating mechanical assembly operations. It is considered that these sentences give a set of subgoals that must be attained for the mechanical parts to be assembled. The system must solve them and translate them into more complete command sequences by referring to three-dimensional geometric models of mechanical parts and figures attached to these sentences. Ambiguity of natural language and the assumption that readers have common-sense knowledge on assembling operations make it difficult for the system to get a correct sequence of operations