The well-designed logical robot: Learning and experience from observations to the Situation Calculus Original Research Article

The well-designed logical robot paradigmatically represents, in the words of McCarthy, the abilities that a robot-child should have to reveal the structure of reality within a “language of thought”. In this paper we partially support McCarthyʹs hypothesis by showing that early perception can trigger an inference process leading to the “language of thought”. We show this by defining a systematic transformation of structures of different formal languages sharing the same signature kernel for actions and states. Starting from early vision, visual features are encoded by descriptors mapping the space of features into the space of actions. The densities estimated in this space form the observation layer of a hidden states model labelling the identified actions as observations and the states as action preconditions and effects. The learned parameters are used to specify the probability space of a first-order probability model. Finally we show how to transform the probability model into a model of the Situation Calculus in which the learning phase has been reified into axioms for preconditions and effects of actions and, of course, these axioms are expressed in the language of thought. This shows, albeit partially, that there is an underlying structure of perception that can be brought into a logical language.