Cross-informant agreement for ratings for social skill and problem behavior ratings: an investigation of the Social Skills Improvement System-Rating Scales
Abstract
One of the most consistent findings in rating scale research with children and adolescents is the modest agreement among different informants' ratings. The present study systematically explored patterns of agreement among teachers, parents/caregivers, and students in domains of social skills and problem behaviors using the Social Skills Improvement System-Rating Scales (SSIS-RS; F. M. Gresham & S. N. Elliott, 2008). Two subsamples from the normative sample of the SSIS-RS were used. The first sample of participants consisted of 168 students who had all 3 informants (parent, teacher, and self) complete the SSIS-RS scales, which was necessary to assess agreement across different raters. The second sample consisted of 164 students who had raters in a similar or same role (father-mother, teacher-teacher). The results replicated an extensive literature showing that cross-informant agreements for social skills and problem behaviors are weak to moderate. The current study invoked multitrait-multimethod logic to interpret the correlations among raters derived from different informants and showed that the convergent validity coefficients were consistently stronger than the discriminant validity correlations. Implications for assessment practices and future research are discussed.