Knowledge as action: A cognitive framework for indoor scene classification

Indoor scene classification is an important topic in computer vision, which is challenging due to the variability of decoration. Human vision system, on the other hand, is marvelous in adaptively recognizing scene categories with excellent performance and can be used for reference. Although bio-inspired computer vision algorithms have proven their effectiveness in classification applications, nowadays few researches on indoor scene classification algorithms attempt to model human vision system, restricting further improvement of performance and making it difficult to achieve adaptive scene understanding. To deal with this problem, in this paper we attempt to model the human vision system and achieve scene classification according to the cognitive theory, by dividing the problem into low-level objection annotation and high-level knowledge inference respectively on a macro perspective. Inspired by the biotical perception principle, a novel cognitive hybrid motivation framework is proposed, including empirical based annotation and inference over knowledge base, which is a simple yet effective framework based on techniques of object detection and classification. For a given indoor scene, objects of indoor scene are first annotated, then knowledge base is utilized to infer the category, reducing the effect of variable background. Environmental context is also utilized to assist classification. The proposed framework are evaluated on popular indoor scene dataset, and its effectiveness is proved by experimental results.