Observation System for Assessment of Learning Engagement in Various Pedagogies

This study is focused on the development of an instrument for the measurement of learning engagement. It evaluates engagement as a function of students´ attitudes displayed in form of concentration on or distraction from learning based on the pedagogy being employed by the teacher. The instrument, Code for Students´ Performance Measures (COSPERM) is designed to provide a measure of student engagements within different pedagogies and especially in learning settings that employ technology-based modes. The COSPERM validation process involves different pedagogies as well as live and recorded observations. COSPERM is content-validated and inter-observer agreement and intra-observer reliability measures established through Cohen´s kappa are consistently high for item-by-item as well as whole observer matches showing very good agreement and a minimum of 0.418 (moderate reliability). This shows the COSPERM is a reliable instrument employable in either live or recorded observations. It can also be reliably employed by single or multiple observers.