The effect of semantic multi-modal aids using guided virtual assembly environment

In Virtual Environments (VE) users are provided with cognitive aids in order to improve task performance or achieve accuracy. Recent research shows that providing direct aids to trainee´s in a guided virtual training environment improves performance (reduce cognitive load) but at the same time reduces the active exploration and makes user dependent on these aids. This paper presents a new strategy to reduce the bad effects of the use of direct aids while taking the benefits of it. A Guided Virtual Reality Training System (GVRTS) is used for training the students of polytechnic colleges. The system uses fiducial markers to interact with the spatial environment. A comparison is made between the direct aids (color change of object and guiding arrow) and semantic multi-modal (audio/visual) aids plus direct aids. The system improves the learning capabilities of students while it doesn´t harm their performance. The analysis shows that the average learning (active exploration) of students using direct aids is 30% which is increased to 80% by using the semantic with direct aids.