Skip main content and go to side content

Where am I?

REL Midwest Archived Events

Connecting Research to Practice Connecting Research to Practice:
Archived Events


Interpreting Test Score Trends and Gaps

May 8, 2009
Chicago, Illinois

At this event, Andrew Ho, Ph.D., discussed some common misinterpretations of proficiency rates and then introduced a toolbox of alternative reporting strategies for trends, gaps, and trends in gaps. Links to each video segment follow.

After each video loads, press the button in the lower left of the window to view it.
Press the "CC" button in the upper right of each video window to view Closed Captions.
Note: You will not be able to view the video segments and supporting materials simultaneously.

Interpreting Test Score Trends and Gaps

Video Segment Title

Supporting
PowerPoint Slides
Supporting Policy
Brief Pages

Segment 1: Introduction and the History of Proficiency Research [Time: 00:10:58]
Slides 1-6

Policy Brief, page 2


Segment 2: The Problem with Proficiency [Time: 00:01:28]
Slide 7

Policy Brief, page 5


Segment 3: Level 1: Cut scores are judgmental [Time: 00:04:16]
Slides 8-22

Policy Brief, pages 5–7


Segment 4: Level 2: Proficiency-based trends and gaps are not representative
[Time: 00:06:17]
Slides 24–46


Policy Brief, pages 5–7



Segment 5: Just one cut-score? [Time: 00:04:15]

Slides 48–60

Policy Brief, pages 5–7


Segment 6: Summary of Levels 1&2 and Quiz [Time: 00:04:21]
Slides 61–65




Segment 7: Answers to Quiz and Discussion [Time: 00:10:52]
Slide 65




Segment 8: Level 3- Proficiency-based gap trends are not representative [Time: 00:06:00]
Slides 66–74

Policy Brief, pages 9–10


Segment 9: Level 4- Proficiency-based statistics are inherently short-sighted and not subject to quick fixes [Time: 00:14:14]
Slides 76–96


Policy Brief, pages 8–9



Segment 10: Conclusion of argument [Time: 00:04:48]
Slides 98–99

Policy Brief, page 11


Segment 11: Introduction to Building a Toolbox [Time: 00:04:19]
Slides 100–102

Policy Brief, pages 12–13


Segment 12: Transformed Percentages [Time: 00:05:33]
Slides 111–114




Segment 13: Means [Time: 00:07:41]
Slides 115–117
Policy Brief, page 12

Segment 14: Percentiles [Time: 00:07:28]
Slides 119–123
Policy Brief, page 13

Segment 15: Effect Sizes [Time: 00:09:16]
Slides 124–127
Policy Brief, pages 14–15

Segment 16: Toolbox Summary and Conclusion [Time: 00:05:39]
Slides 132–134




Go back to main content | Go back to main navigation

Go back to main content | Go back to main navigation

Go back to main content | Go back to main navigation