MPEG-4 extension for augmented stereoscopic video

We propose the extended MPEG-4 for augmented stereoscopic video. Augmented stereoscopic video is a stereoscopic synthetic video. Natural stereoscopic video and virtual CG object are synthesized. MPEG-4 has a scene graph, BIFS. BIFS is based on VRML. Augmented stereoscopic video is thought of as an off-line AR. Thus, there are some mismatch problems when augmented stereoscopic video is presented in MPEG-4. VR is based on the virtual environment. AR is based on real environment. A user can move view-position in VR. It´s not possible in AR. In AR, the registration is a key technology. MPEG-4 does not support that. We introduce registration mechanism to MPEG-4. We also, propose new nodes for stereoscopic and camera information stream. Some nodes are needed for stereoscopic in MPEG-4, because MPEG-4 BIFS can´t handle the stereoscopic scene. BackgroundSS and StereoTexture nodes are the new nodes for natural stereoscopic visual object and CameraViewpointSS and CameraInfoSS nodes are the new nodes for natural video camera information. Those are used for registration task in our MPEG-4 extension.