Standardized, norm-referenced tests of language often contain cultural and linguistic biases (de Villiers, 2017). Consequently, the language skills of children from diverse backgrounds may be misdiagnosed, resulting in the under- or over-representation of children from cultural and linguistic minorities in special education.

Cultural and Linguistic Biases in Assessment

The cultural and linguistic biases inherent in most current standardized, norm-referenced language assessments stem from numerous sources, including:

  • Normative Samples: The normative samples of most standardized language assessments are based on the demographics of the U.S. population. As a result, the language skills of children from minority backgrounds are compared to children who are largely representative of the majority cultural and linguistic group (Stockman, 2000; Hendricks & Adolf, 2020).

  • Test Content: Standardized, norm-referenced language assessments are most often developed based on the vocabulary, morphosyntax and pragmatics of General American English (i.e., School English, Academic English). As a result, the responses of children who speak other varieties of English may be penalized based on the test’s scoring system (Peña & Quinn, 1997).

  • Test Format: Standardized tests may include response formats and interaction styles that are unfamiliar to children from diverse cultural backgrounds. For example, testing interactions often include labeling and pointing to objects upon command, maintaining eye contact with an adult, and producing narratives in a linear, sequential manner. As a consequence, the language abilities of children who are unfamiliar with mainstream testing formats and pragmatic expectations may be underestimated (Wyatt, 2012)

  • Linguistic and Dialectal Differences: Norm-referenced language assessments are developed based on the developmental sequence and linguistic structure of General American English (Stockman, 2000; Washington & Craig, 2004). Children who speak a variation of English, such as African American English or Southern English, or children who are multilingual speakers, may be penalized for responses that do not match the linguistic norms of General American English.

  • Cultural Values: Test items in standardized, norm-referenced language assessments may involve asking children to make subjective judgements or express opinions. Children’s responses may be influenced by their cultural values and lived experiences that do not match those of the majority culture. As a result, their responses may be penalized based on the test’s scoring system (Wyatt, 2012).

Unbiased Language Assessment

Researchers have provided recommendations for reducing bias when assessing children’s language abilities. Examples include:

  • Examiner Knowledge: Examiners must develop their own awareness and knowledge of cultural and linguistic diversity in order to conduct unbiased assessments of children’s language skills (Jackson & Pearson, 2010; Latimer-Hearn, 2020; Oetting, 2024).

  • Dynamic Assessment: Research has shown that incorporating dynamic assessment, which often utilizes an interactive, test-teach-retest approach, measures a child’s potential for language learning and helps in distinguishing children with and without language disorder (Peña et al., 2016).

  • Language Sampling: Collecting and analyzing a child’s spontaneous spoken language using culturally appropriate elicitation methods captures a more ecologically valid picture of a child’s language abilities. Examiner knowledge of the child’s language background and cultural-linguistic communication style is critical for accurate analysis (Heilmann et al., 2010; Oetting & McDonald, 2002; Washington, 2019).

  • Use of Dialect-Neutral Assessments: The Diagnostic Evaluation of Language Variation-Norm Referenced (DELV-NR; Seymour et al., 2018) is a standardized, norm-refenced assessment of children’s language development designed as a dialect-neutral assessment of English. Other standardized language assessments provide alternative scoring for common varieties of English (e.g., African American English; but see Hendricks and Adlof, 2018).

  • Collaborating with Families and Communities: Incorporating the perspectives of caregivers and other adults from the child’s cultural and linguistic community is a key step toward reducing bias in language assessment (Hamilton, 2020).

Bibliography

de Villiers, J. G. (2017) Unbiased Language Assessment: Contributions of Linguistic Theory. Annual Review of Linguistics, 3(1), 309–330.

Heilmann, J., Miller, J. F., & Nockerts, A. (2010). Using language sample databases. Language, Speech, and Hearing Services in Schools, 41(1), 84–95. https://doi.org/10.1044/0161-1461(2009/08-0075)

Hamilton, M. B. (2020, January/February). An informed lens on African American English. The ASHA Leader, 25(1), 46-53.

Hendricks, A., & Adlof, S. (2018). Language assessment with children who speak nonmainstream dialects: Examining the effects of scoring modifications in norm-referenced assessment. Language, Speech, and Hearing Services in Schools, 48(3), 168-182.

Hendricks, A. E., & Adlof, S. M. (2020). Production of morphosyntax within and across different dialects of American English. Journal of Speech, Language, and Hearing Research, 63(7), 2322-2333.

Jackson, J. E., & Pearson, B. Z. (2010). Variable use of features associated with African American English by typically developing children. Topics in Language Disorders, 30(2), 135-144.

Latimer-Hearn, D. (2020, January/February). Don’t get it twisted – hear my voice. Understanding AAE: A national survey of school-based SLPs indicates a need for more training on African American English—both its viability as a linguistic system and its deep cultural value. The ASHA Leader, 25(1), 54-59.

Oetting, J. B. (2024). Approaching Developmental Language Disorder from a Disorder within Dialects framework: A focus on dialect-informed terms, materials, and strategic scoring. In Multilingual Acquisition and Learning (pp. 116-142). John Benjamins.

Peña, E. D., & Quinn, R. (1997). Task familiarity: Effects on the test performance of Puerto Rican and African American children. Language, Speech, and Hearing Services in Schools, 28(4), 323–332. https://doi.org/10.1044/0161-1461.2804.323

Seymour, H. N., Roeper, T., & de Villiers, J. (2018). Diagnostic Evaluation of Language Variation–Norm Referenced. Ventris Learning.

Stockman, I. J. (2000). The new Peabody Picture Vocabulary Test-III: An illusion of unbiased assessment? Language, Speech, and Hearing Services in Schools, 31(4), 340–353. https://doi.org/10.1044/0161-1461.3104.340

Washington, J. A. (2019). The dialect features of African American English and their importance in LSA. In J. F. Miller, K. Andriacchi, & A. Nockerts (Eds.), Assessing language production using SALT software: A clinician’s guide to language sample analysis (3rd ed., pp. 125–136). Madison, WI: SALT Software LLC.

Wyatt, T. (2012). Assessment of multicultural and international clients with communication disorders. In Communication disorders in multicultural and international populations (pp. 243-278). Mosby.