The reliability of production strategy scores for the Ruff Figural Fluency Test

This study examined the interrater and test–retest reliability of qualitative scoring indices for the Ruff Figural Fluency Test (RFFT) in a sample (N=90) of healthy college undergraduates. In addition to rotational and enumerative strategies proposed by [Ruff, 1988], other supplemental indices were developed and examined. Seven raters scored protocols independently using guidelines proposed by [Ruff, 1988] and additional scoring examples developed by the primary investigator. Intraclass correlation coefficients (ICCs) were excellent, ranging from rICC=.91 for number of strategic clusters, to rICC=.79 for mean cluster size. Coefficients of stability (n=48; mean interval=7 weeks) for strategy scores were also acceptable (e.g., rICC=.80 for enumerative, rICC=.71 for rotational). This study is the first to examine the psychometric properties of these supplemental scores for the RFFT. Reliability coefficients obtained for traditional RFFT indices (e.g., unique designs, perseverations) were consistent with previous investigations (e.g., [Basso et al., 1999]; [Ruff, 1988]). Modest practice effects were observed on unique designs produced, but not for strategy scores. The implications of using RFFT strategy scores for assessing executive functions are discussed and considerations for future research are presented.