Building a framework for recognition of activities of daily living from depth images using fuzzy logic

Complex activities such as instrumental activities of daily living (IADLs) can be identified by creating a hierarchical model of fuzzy rules. In this work, we present a framework to model a specific IADL - "making the bed". For this activity recognition, the need for a three level Fuzzy Inference System (FIS) model is shown. Simple features such as bounding box parameters were extracted from the foreground images and combined with 3D features extracted from the Kinect depth data. This was then fed as input to the three layered FIS for further analysis. Data collected from several participants were tested and evaluated. Such a framework can be used to model several other IADLS as well as basic activities of daily living (ADLs). Analysis of ADLs can be used to compare daily patterns in older adults to measure changes in behavior. This can then be used to predict health changes to assist older adults in leading independent lifestyles for longer time periods.