Multimodal Sleeping Posture Classification

Sleeping posture reveals important information for eldercare and patient care, especially for bed ridden patients. Traditionally, some works address the problem from either pressure sensor or video image. This paper presents a multimodal approach to sleeping posture classification. Features from pressure sensor map and video image have been proposed in order to characterize the posture patterns. The spatiotemporal registration of the two modalities has been considered in the design, and the joint feature extraction and data fusion is presented. Using multi-class SVM, experiment results demonstrate that the multimodal approach achieves better performance than the approaches using single modal sensing.