Model based coding revisited: Employing model data for 21st century image and video coding

We present a Model Based Coding (MBC) scheme which employs 3D scene information resulting in more efficient image coding. We propose a balancing between texture and difference, such that MBC is a dynamic enhancement to current standard image encoders: if no usable model data can be produced, all information remains in the difference, corresponding to standard encoding schemes. The higher the model quality, the more information can be transmitted. The result is an encoding scheme which offers at least the code rate of current encoders and additionally produces a 3D model.