Design Framework for the ACT Enhancements

March 2025 Authors Acknowledgments Introduction While the team of authors was responsible for creatingthis report that synthesizes all findings related to the ACTEnhancements, there are countless team membersacross Measurement Research and Development whocontributed to the original research and contentpresented in this report. We would like to acknowledgethe contributions from individuals on the psychometricsteam (Dongmei Li, Shalini Kapoor, Ann Arthur, Chi-YuHuang, YoungWoo Cho, Chen Qiu, and Hongling Wang),the ELA team (in particular, Kelly Smith), the math team,and the science team (in particular, Greg Hanson). Wewould also like to thank the many other teams acrossACT that facilitated and supported the ACTEnhancements. Jeff Allen, PhD; Jay Thomas; Stacy Dreyer;Scott Johanningmeier; and Dana Murano, PhD Chapter 1 Jay Thomas, Stacy Dreyer, and ScottJohanningmeier Chapter 2 Jay Thomas, Stacy Dreyer, and ScottJohanningmeier Chapter 3 Jay Thomas, Stacy Dreyer, and ScottJohanningmeier Chapter 4 Jeff Allen, PhD; Ty Cruce, PhD; Xin Li, PhD;Edgar Sanchez, PhD Table of Contents Maintaining the Foundations of the ACT Test ....................................................................................... 9The Enhanced ACT Test ..................................................................................................................... 11Navigating This Report ........................................................................................................................ 16 Chapter 1: Identifying Potential Areas for Revision of the ACT and Drafting the InitialBlueprints ...............................................................................................................................19 1.1 Introduction .................................................................................................................................... 19 1.2 The Need for Periodic Review and Revision ................................................................................. 201.3 Primary Considerations and Proposed Changes .......................................................................... 221.4 Decisions Related to the Periodic Review and Updates to the ACT ............................................. 281.5 Initial Proposed Solutions and Blueprints by Test Section ............................................................ 301.6 Overview of Initial Review and Decisions ...................................................................................... 57 Chapter 2: Panels, Initial Studies, and Revisions to Blueprints .......................................582.1 External Expert Panel Overview .................................................................................................... 58 2.2 External Expert Panel Results ....................................................................................................... 592.3 Panel Impact on Final Content Blueprints ..................................................................................... 682.4 Summary of Panels and Future Plans ........................................................................................... 71 Chapter 3: Validity Evidence Based on Test Content and Response Processes............723.1 Evidence Based on Test Content .................................................................................................. 72 3.2 Expert Judgements of the Relationship Between Parts of the Test and the Construct................. 803.3 Evidence Based on Response Processes..................................................................................... 823.4 Conclusions ................................................................................................................................. 138 4.1 Introduction .................................................................................................................................. 1394.2 June 2024 Linking Study ............................................................................................................. 1394.3 October 2024 Mode Comparability Study.................................................................................... 1474.4 Concurrent Validity Evidence....................................................................................................... 1544.5 Predictive Validity Evidence......................................................................................................... 1594.6 Composite Score Comparability .................................................................................................. 1614.7 Conclusion ................................................................................................................................... 173 References ...........................................................................................................................174 Figures Figure 1.1. Dual Validity Loop..............................