Integrating immersive 3D worlds and real lab equipment for teaching mechatronics

In this paper, a learning environment for mechatronics training is proposed, which combines immersive 3D worlds and real lab equipment. A key feature of the system is the tight coupling between virtual and real mechatronics by implementing a system, which allows interfacing an immersive 3D World with physical sensors and actuators. A communication link between a microcontroller and a virtual mechatronics device is available. The virtual system is modeled in OpenSimulator and users are able to control mechatronics hardware via a 3D virtual environment and vice versa. The proposed solution opens interoperability both with local and remote lab devices. This includes remote experimentation in which all lab equipment is real and accessible via the Internet, but also examples in which real devices interact with simulation models created in a 3D virtual world. The concept is open for further enhancements.