Equivalence of Testing Instruments in Canada: Studying Item Bias in a Cross-Cultural Assessment for Preschoolers

Résumé

Item bias, which occurs when items function differently for different groups of
respondents, is of particular concern to cross-cultural assessments. It threatens measurement equivalence and causes intergroup comparisons to be invalid. This study assessed item bias among francophone, anglophone, and Aboriginal preschoolers in New Brunswick, Canada. We used data from the Early Years Evaluation-Direct Assessment (EYE-DA), an assessment tool that measures children’s early educational development. The analytical approach used to investigate item bias is called differential item functioning (DIF). This study offers an application of DIF analysis that combines statistical testing and graphical representation of DIF. Analyses yielded consistent results revealing that linguistic and cultural differences between francophone and anglophone children are more challenging to achieve transferability than cultural differences between Aboriginal and anglophone examinees.