Toward text based information processing: with an example of natural language modeling of a line chart

In order to achieve intellectual information processing on a computer as human beings do in their brain, we have to focus on the work of language in human intellectual activities such as thinking and reasoning. Language has lots of good characteristics as an information medium, for example, language can aggregate various kinds of information, can represent different kinds of modalities, and so on. In the paper, as an example of that, we consider how we can transfer non-verbal information to verbal information by showing a line chart which shows how the behavior of the foreign exchange rate changes is explained with natural language