Exploring Problem Solving Performance through Natural User Interfaces

Insight problems are the problems that require discoveries of novel solutions. To come up with novel solutions, the correct mental representations will need to be activated. Spatial insight problems, for example, require activation of spatial representations. To explore the potential use of a motion-sensing technology for facilitating spatial insight problem solving, a Body-based system using natural user interfaces (NUIs) and a Mouse-based system using graphical user interfaces (GUIs) were developed. An experiment was conducted using these two systems for seeking possible solutions to a hands-on problem and then solving that problem in physical environment using real objects. Results showed that there was no difference in the completion rate between the two conditions. However, there was a tendency of more uses of spatial strategies by the Body-based group. Those in the Body-based condition did not significantly lose their confidence in solving the problem during the solution-seeking stage.