Skip to main content

Advertisement

Log in

Dynamic assessment as a screening tool for early identification of reading disabilities: a latent change score approach

  • Published:
Reading and Writing Aims and scope Submit manuscript

Abstract

We examined whether dynamic decoding assessment (DDA) predicts growth in word reading skill during first grade using latent change score models. In addition, we compared classification accuracy of the DDA to static measures for identifying students at risk for reading disabilities (RD) designated using the dual discrepancy criteria. At the beginning of first grade, students (N = 104) were assessed on the DDA and static measures of word reading, arithmetic, and domain-general and domain-specific skills. They were assessed again at the end of first grade on static measures of word reading and arithmetic. In DDA, students were taught six novel symbols associated with English sounds and how to read words in this new orthography. Instructional prompts were provided incrementally, from least to most explicit. The amount of instructional prompts required for a student to decode words in this new orthography was indexed as students’ learning potential for decoding. Results from a series of latent change score models indicate the DDA is positively associated with growth in word reading but not with arithmetic skill growth. The DDA made significant, positive contributions to word reading growth beyond domain-specific (phonological awareness, rapid automatized naming) and domain-general (behavioral attention, intelligence) predictors. Furthermore, the DDA improved classification accuracy by improving sensitivity when added to the static measures of word reading predictors, supporting the use of DDA as a supplementary screener for early prediction of RD.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2

Similar content being viewed by others

Notes

  1. When the measurement model of the LCS model was retained in the SEM with WR2 as outcome, the model fit was very poor, χ2 (65) = 283.28, p < .01; RMSEA = .18, CFI = .80, TLI = .76, SRMR = .23, AIC = 7486.30, SBIC = 7466.23. Thus, we started from testing the measurement model for the alternative SEM model. To improve the model fit of this measurement model, we estimated the co-variances between wid1 and wid2, swe1 and swe2, and cbmT1 and cbmT2, resulting in adequate fit to data, χ2 (59) = 95.62, p < .01, RMSEA = .08, CFI = .87, TLI = .96, SRMR = .06, AIC = 7311.32, SBIC = 7288.17. Then, we estimated the structural path predicting WR2 with WR1 and DA and predicting AR2 with AR1 and DA. This model show inadequate fit to data, χ2 (61) = 178.38, p < .01, RMSEA = .14, CFI = .89, TLI = .86, SRMR = .18, AIC = 7387.45, SBIC = 7365.33. Structural path coefficients cannot be compared between the two models due to differences in the measurement models.

  2. When the measurement model of the LCS model was retained in the SEM with WR2 as outcome, the model fit was very poor, χ2 (52) = 240.27, p < .01, RMSEA = .18, CFI = .78, TLI = .70, SRMR = .15, AIC = 5260.45, SBIC = 5238.85. Thus, we started from testing the measurement model for the alternative SEM model. To improve the model fit of this measurement model, we estimated the covariances between SWE1 and SWE2, SWE1 and RAN-L, and fixed residual variance of WID to 0 to address Heywood case. This CFA model demonstrated good fit to data, χ2 (49) = 63.56, p < .01, RMSEA = .05, CFI = .98, TLI = .98, SRMR = .05, AIC = 6635.84, SBIC = 6607.54. Then, we estimated the structural path predicting WR2 with six predictors. Several modifications were necessary to resolve Heywood case, including fixing residual variance of WID2 and MR to 0. No other modifications improved the fit. This model showed poor fit to data, χ2 (51) = 203.88, p < .01, RMSEA = .17, CFI = .84, TLI = .75, SRMR = .19, AIC = 6770.81, SBIC = 6743.53. Structural path coefficients cannot be compared between the two models due to differences in the measurement model.

  3. Item-level data was initially not entered for the standardized assessment to calculate sample-based reliability coefficients.

References

  • Al Otaiba, S., & Fuchs, D. (2002). Characteristics of children who are unresponsive to early literacy intervention: A review of the literature. Remedial and Special Education,23, 300–316.

    Article  Google Scholar 

  • Al Otaiba, S., Connor, C. M., Folsom, J. S., Wanzek, J., Greulich, L., Schatschneider, C., et al. (2014). To wait in Tier 1 or inervene immediately: A randomized experiment examining first-grade response to intervention in reading. Exceptional Children, 81, 11–27.

    Article  Google Scholar 

  • American Educational Research Association, American Psychological Association, National Council on Measurement in Education, Joint Committee on Standards for Educational and Psychological Testing (U.S.). (2014). Standards for educational and psychological testing. Washington, DC: AERA.

    Google Scholar 

  • Aravena, S., Tijms, J., Snellings, P., & van der Molen, M. W. (2016). Predicting responsiveness to intervention in dyslexia using dynamic assessment. Learning and Individual Differences,49, 209–215.

    Article  Google Scholar 

  • Bridges, M., & Catts, H. W. (2011). The use of a dynamic screening of phonological awareness to predict risk for reading disabilities in kindergarten children. Journal of Learning Disabilities,44, 330–338.

    Article  Google Scholar 

  • Brown, T. A. (2006). Confirmatory factor analysis for applied research. New York: The Guilford Press.

    Google Scholar 

  • Budoff, M. (1987). Measures for assessing learning potential. In C. S. Lidz (Ed.), Dynamic testing (pp. 173–195). New York: Guilford Press.

    Google Scholar 

  • Caffrey, E., Fuchs, D., & Fuchs, L. S. (2008). The predictive validity of dynamic assessment: A review. Journal of Special Education,41, 254–270.

    Article  Google Scholar 

  • Campione, J. C., & Brown, A. L. (1987). Linking dynamic testing with school achievement. In C. S. Lidz (Ed.), Dynamic testing (pp. 82–115). New York: Guilford Press.

    Google Scholar 

  • Carlson, J. S., & Wiedl, K. H. (1992). Principles of dynamic testing: The application of a specific model. Learning and Individual Differences,4, 153–166.

    Article  Google Scholar 

  • Catts, H. W., Petscher, Y., Schatschneider, C., Bridges, M., & Mendoza, K. (2009). Floor effects associated with universal screening and their impact on the early identification of reading disabilities. Journal of Learning Disabilities,42, 163–176.

    Article  Google Scholar 

  • Cho, E., & Compton, D. L. (2015). Construct and incremental validity of dynamic assessment of decoding within and across domains. Learning and Individual Differences, 37, 183–196.

    Article  Google Scholar 

  • Cho, E., Compton, D. L., Fuchs, D., Fuchs, L. S., & Bouton, B. (2014). Examining the predictive validity of a dynamic assessment of decoding to forecast response to tier 2 intervention. Journal of Learning Disabilities,47, 409–423.

    Article  Google Scholar 

  • Cho, E., Compton, D. L., Gilbert, J. K., Steacy, L. M., Collins, A. A., & Lindström, E. R. (2017). Development of first-graders’ word reading skills: For whom can dynamic assessment tell us more? Journal of Learning Disabilities,50, 95–112.

    Article  Google Scholar 

  • Compton, D. L. (2000). Modeling the response of normally achieving and at-risk first grade children to word reading instruction. Annals of Dyslexia,50, 53–84.

    Article  Google Scholar 

  • Compton, D. L., Fuchs, D., Fuchs, L. S., Bouton, B., Gilbert, J. K., Barquero, L. A., et al. (2010). Selecting at-risk first-grade readers for early intervention: Eliminating false positives and exploring the promise of a two-stage gated screening process. Journal of Educational Psychology,102, 327–340.

    Article  Google Scholar 

  • Compton, D. L., Fuchs, L. S., Fuchs, D., Lambert, W., & Hamlett, C. (2012). The cognitive and academic profiles of reading and mathematics learning disabilities. Journal of Learning Disabilities,45, 79–95.

    Article  Google Scholar 

  • Coventry, W. L., Byrne, B., Olson, R. K., Corley, R., & Samuelsson, S. (2011). Dynamic and static assessment of phonological awareness in preschool: A behavior-genetic study. Journal of Learning Disabilities,44, 322–329.

    Article  Google Scholar 

  • Dally, K. (2006). The influence of phonological processing and behavioral inattention on reading acquisition. Journal of Educational Psychology,98, 420–437.

    Article  Google Scholar 

  • Doornik, J. A., & Hansen, H. (2008). An omnibus test for univariate and multivariate normality. Oxford Bulletin of Economics and Statistics,70, 927–939.

    Article  Google Scholar 

  • Durand, M., Hulme, C., Larkin, R., & Snowling, M. (2005). The cognitive foundations of reading and arithmetic skills in 7-to 10-year-olds. Journal of Experimental Child Psychology,91, 113–136.

    Article  Google Scholar 

  • Elliott, J. G., & Resing, W. (2015). Can intelligence testing inform educational intervention for children with reading disability? Journal of Intelligence,3, 137–157.

    Article  Google Scholar 

  • Feuerstein, R., Rand, Y., & Hoffman, M. B. (1979). The dynamic testing of retarded performers: The learning potential testing device: Theory, instruments, and techniques. Baltimore: University Park Press.

    Google Scholar 

  • Fuchs, L. S. (2003). Assessing intervention responsiveness: Conceptual and technical issues. Learning Disabilities Research and Practice,18, 172–186.

    Article  Google Scholar 

  • Fuchs, D., Compton, D. L., Fuchs, L. S., Bouton, B., & Caffrey, E. (2011). The construct and predictive validity of a dynamic assessment of young children learning to read: Implications for RTI frameworks. Journal of Learning Disabilities,44, 339–347.

    Article  Google Scholar 

  • Fuchs, L. S., & Fuchs, D. (1998). Treatment validity: A unifying concept for reconceptualizing the identification of learning disabilities. Learning Disabilities Research and Practice,13, 204–219.

    Google Scholar 

  • Fuchs, D., Fuchs, L. S., & Compton, D. L. (2012). Smart RTI: A next-generation approach to multilevel prevention. Exceptional Children,78, 263–279.

    Article  Google Scholar 

  • Fuchs, D., Fuchs, L. S., Compton, D. L., Bouton, B., Caffrey, E., & Hill, L. (2007). Dynamic assessment as responsiveness to intervention; a scripted protocol to identify young at-risk readers. Teaching Exceptional Children,39, 58–63.

    Article  Google Scholar 

  • Fuchs, L. S., Fuchs, D., & Speece, D. L. (2002). Treatment validity as a unifying construct for identifying learning disabilities. Learning Disability Quarterly,25, 33–45.

    Article  Google Scholar 

  • Fuchs, L. S., Hamlett, C. L., & Fuchs, D. (1990). Curriculum-based math computation and concepts/applications. (Available from L. S. Fuchs, 328 Peabody, Vanderbilt University, Nashville, TN 37203).

  • Gellert, A. S., & Elbro, C. (2017a). Does a dynamic test of phonological awareness predict early reading difficulties? A longitudinal study from Kindergarten through grade 1. Journal of Learning Disabilities,50, 227–237.

    Article  Google Scholar 

  • Gellert, A. S., & Elbro, C. (2017b). Try a little bit of teaching: A Dynamic assessment of word decoding as a kindergarten predictor of word reading difficulties at the end of grade 1. Scientific Studies of Reading,21, 277–291.

    Article  Google Scholar 

  • Gellert, A. S., & Elbro, C. (2018). Predicting reading disabilities using dynamic assessment of decoding before and after the onset of reading instruction: a longitudinal study from kindergarten through grade 2. Annals of Dyslexia,68, 126–144.

    Article  Google Scholar 

  • Gilbert, J. K., Compton, D. L., & Kearns, D. M. (2011). Word and person effects on decoding accuracy: A new look at an old question. Journal of Educational Psychology,103, 489–507.

    Article  Google Scholar 

  • Grigorenko, E. L. (2009). Dynamic assessment and response to intervention: Two sides of one coin. Journal of Learning Disabilities,42, 111–132.

    Article  Google Scholar 

  • Grigorenko, E. L., & Sternberg, R. J. (1998). Dynamic testing. Psychological Bulletin,124, 75–111.

    Article  Google Scholar 

  • Guthke, J. (1992). Learning tests—The concept, main research findings, problems and trends. Learning and Individual Differences,4, 137–151.

    Article  Google Scholar 

  • Haywood, H. C. (2011). Dynamic assessment: A history of fundamental ideas. In Paper presented at the international conference of the International Association for Cognitive Education and Psychology, Boston, MA.

  • Hecht, S. A., Torgesen, J. K., Wagner, R. K., & Rashotte, C. A. (2001). The relations between phonological processing abilities and emerging individual differences in mathematical computation skills: A longitudinal study from second to fifth grades. Journal of Experimental Child Psychology,79, 192–227.

    Article  Google Scholar 

  • Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal,6, 1–55.

    Article  Google Scholar 

  • Jenkins, J. R., Hudson, R. F., & Johnson, E. S. (2007). Screening for at-risk readers in a response to intervention framework. School Psychology Review,36, 582–600.

    Google Scholar 

  • Kline, R. B. (2005). Principles and practice of structural equation modeling (2nd ed.). New York: The Guilford Press.

    Google Scholar 

  • Lidz, C. S. (1995). Dynamic assessment and the legacy of LS Vygotsky. School Psychology International,16, 143–153.

    Article  Google Scholar 

  • Little, T. D., Bovaird, J. A., & Slegers, D. W. (2006). Methods for the analysis of change. In D. Mroczek & T. D. Little (Eds.), The handbook of personality development (pp. 181–211). Mahwah: Erlbaum.

    Google Scholar 

  • McArdle, J. J. (2009). Latent variable modeling of differences and changes with longitudinal data. Annual Review of Psychology,60, 577–605.

    Article  Google Scholar 

  • McArdle, J. J., & Prindle, J. J. (2008). A latent change score analysis of a randomized clinical trial in reasoning training. Psychology and Aging,23, 702–719.

    Article  Google Scholar 

  • Muthén, L. K., & Muthén, B. O. (2015). Mplus statistical modeling software: Release 7.0. Los Angeles: Muthén & Muthén.

    Google Scholar 

  • O’Connor, R. E., & Jenkins, J. R. (1999). Prediction of reading disabilities in kindergarten and first grade. Scientific Studies of Reading,3, 159–197.

    Article  Google Scholar 

  • Petersen, D. B., Allen, M. M., & Spencer, T. D. (2016). Predicting reading difficulty in first grade using dynamic assessment of decoding in early kindergarten: A large-scale longitudinal study. Journal of Learning Disabilities,49, 200–215.

    Article  Google Scholar 

  • Petersen, D. B., & Gillam, R. B. (2015). Predicting reading ability for bilingual Latino children using dynamic assessment. Journal of Learning Disabilities,48, 3–21.

    Article  Google Scholar 

  • Petersen, D. B., Gragg, S. L., & Spencer, T. D. (2018). Predicting reading problems 6 years into the future: Dynamic assessment reduces bias and increases classification accuracy. Language, Speech, and Hearing Services in Schools,49, 875–888.

    Article  Google Scholar 

  • Quinn, J. M., Wagner, R. K., Petscher, Y., & Lopez, D. (2015). Developmental relations between vocabulary knowledge and reading comprehension: A latent change score modeling study. Child Development,86, 159–175.

    Article  Google Scholar 

  • Ron Nelson, J., Benner, G. J., & Gonzalez, J. (2003). Learner characteristics that influence the treatment effectiveness of early literacy interventions: A meta-analytic review. Learning Disabilities Research & Practice,18(4), 255–267.

    Article  Google Scholar 

  • Share, D. L. (1995). Phonological recoding and self-teaching: Sine qua non of reading acquisition. Cognition,55, 151–218.

    Article  Google Scholar 

  • Shaywitz, S. E., & Shaywitz, B. A. (2003). Dyslexia (specific reading disability). Pediatrics in Review,24, 147–153.

    Article  Google Scholar 

  • Simmons, F. R., & Singleton, C. (2008). Do weak phonological representations impact on arithmetic development? A review of research into arithmetic and dyslexia. Dyslexia: An International Journal of Research and Practice,14, 77–94.

    Article  Google Scholar 

  • Spector, J. E. (1992). Predicting progress in beginning reading: Dynamic assessment of phonemic awareness. Journal of Educational Psychology,84, 353–363.

    Article  Google Scholar 

  • Speece, D. L. (2005). Hitting the moving target known as reading development: Some thoughts on screening children for secondary interventions. Journal of Learning Disabilities,38, 487–493.

    Article  Google Scholar 

  • Speece, D. L., & Case, L. P. (2001). Classification in context: An alternative approach to identifying early reading disability. Journal of Educational Psychology,93, 735–749.

    Article  Google Scholar 

  • Stuebing, K. K., Barth, A. E., Molfese, P. J., Weiss, B., & Fletcher, J. M. (2009). IQ is not strongly related to response to reading instruction: A meta-analytic interpretation. Exceptional Children,76, 31–51.

    Article  Google Scholar 

  • Swanson, J., Schuck, S., Mann, M., Carlson, C., Hartman, K., Sergeant, J., et al. (2004). Categorical and dimensional definitions and evaluations of symptoms of ADHD: The SNAP and the SWAN rating scales. Retrieved 20 July 2012, from https://www.amerihealth.com/pdfs/providers/resources/worksheets/prevhealth_swan.pdf.

  • Swets, J. A. (1988). Measuring the accuracy of diagnostic systems. Science,240, 1285–1293.

    Article  Google Scholar 

  • Torgesen, J. K. (2000). Individual differences in response to early interventions in reading: The lingering problem of treatment resisters. Learning Disabilities Research and Practice,15, 55–64.

    Article  Google Scholar 

  • Torgesen, J. K., Rashotte, C. A., & Wagner, R. K. (1999). Test of word reading efficiency: (TOWRE). Austin: Pro-ed.

    Google Scholar 

  • Wagner, R. K., & Compton, D. L. (2011). Dynamic assessment and its implications for RTI models. Journal of Learning Disabilities,44, 311–312.

    Article  Google Scholar 

  • Wagner, R. K., Torgesen, J. K., & Rashotte, C. A. (1999). Comprehensive test of phonological processes: (CTOPP). Austin: Pro-Ed.

    Google Scholar 

  • Wechsler, D. (1999). Wechsler abbreviated intelligence scale. San Antonio: Psychological Corporation.

    Google Scholar 

  • Wilkinson, G. S. (1993). Wide range achievement Test 3. Wilmington: Wide Range.

    Google Scholar 

  • Wolf, M., & Bowers, P. G. (1999). The double-deficit hypothesis for the developmental dyslexias. Journal of Educational Psychology,91, 415–438.

    Article  Google Scholar 

  • Woodcock, R. W. (1998). Woodcock reading mastery tests—Revised. Circle Pines: American Guidance Service.

    Google Scholar 

Download references

Acknowledgements

This study was in part supported by award number RG100898 from Dunn Family Foundation to Michigan State University. Study data were entered and managed using REDCap electronic data capture tools hosted at Vanderbilt University, which was supported by Vanderbilt Institute for Clinical and Translational Research Grant UL1 TR000445 from NCATS/NIH. The opinions expressed are those of the authors and do not represent views of the Institute or the U.S. Department of Education.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Eunsoo Cho.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (DOCX 28 kb)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Cho, E., Compton, D.L. & Josol, C.K. Dynamic assessment as a screening tool for early identification of reading disabilities: a latent change score approach. Read Writ 33, 719–739 (2020). https://doi.org/10.1007/s11145-019-09984-1

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11145-019-09984-1

Keywords

Navigation