Student Emotions with an Edu-game: A Detailed Analysis

We present the results of a study that explored the emotions experienced by students during interaction with an educational game for math (Heroes of Math Island). Starting from emotion frameworks in affective computing and education, we considered a larger set of emotions than in related research. For emotion labeling, we employed a standard method that relies on trained judges to report emotions over 20-second intervals. However, we asked judges to report all observed emotions in each interval, as opposed to only choosing one, as is standard practice. This variation allows us to discuss the appropriateness of this interval for emotion labeling. We present a detailed analysis of inter-coder reliability, both aggregated and over individual students, that considers not only the matching by judges over emotion type, but also the number of emotions detected.