Designing Dynamic Scaffolding Strategy for Improving Video-Based Learning in a Gesture and Speech-Based Learning Configuration

With the advancement of information and communication technologies, a great deal of learning resources can be easily accessed over the Internet, especially video-based materials. Most of them are recordings of speeches and instructions. Learners can also provide their feedback on a specific website or a learning management system. Besides, natural user interface (NUI) has become affordable which sheds a light on the new form of human-computer interaction. A new research issue regarding how to effectively use the large amount of existing video-based learning resources and related feedback by leveraging the NUI interface is worth of exploration. This study aims to explore and propose a new effective scaffolding strategy to facilitate video-based learning by applying NUI-based technologies with an integration of existing constructive feedback generated by the crowd. In this paper, a preliminary design and corresponding examples of this idea will be delineated.