For best and worst schools in Ohio, AYP status seems accurate
AYP, or ?adequate yearly progress,? has become one of the most derided parts of the No Child Left Behind Act and the accountability requirements it set in motion for states. Simply put, a school makes AYP if it is progressing adequately enough toward meeting NCLB's goal of having 100 percent of children proficient in key tested subjects by 2014, and fails to meet AYP if it's not. States set annual targets and have different methods for calculating whether schools are meeting these targets; Ohio, for example, is one of nine states under the federal ?Growth Model Pilot Project? allowed to incorporate its growth model into AYP calculations.
But meeting AYP is like trying to ride an escalator that speeds up with each step you take. As schools progress toward 2014 more and more are labeled as failing, in part because states set low targets in earlier years and then increasingly steeper ones in the years leading up to 2014. Even those school serving kids well have an increasingly difficult time of getting every child to proficiency. On a national level, Secretary Duncan predicted earlier this year that as many as 80+ percent of schools could fail to meet AYP. On a school level, among those that are already very high performing, good schools may inadvertently be punished (anecdotally at least, Fordham knows this to be true).
This has become a common meme in education circles. And it's intuitive, like the law of marginal returns and the line graph that extends into infinity. Most educators and policy people alike ? even those who have high expectations for poor kids ? admit that 100 percent proficiency is impossible.
But how heinously inaccurate is the AYP measure when you really break it down?
In Ohio, among the top-performing schools and among the bottom tier alike, it's surprisingly accurate according to a rudimentary glance at the data. Using data from the recent 2010-11 report cards, we looked at schools statewide that were low growth (according to Ohio's value-added data, so only those schools serving some combination of grades 3-8) and low achieving (those with a performance index score of less than 80 out of 120, which indicates the schools' students are not meeting overall proficiency targets). (So these would be the schools statewide to fall into the lower left hand corner of a chart like this.)
Eighty-four schools statewide were low growth and low achieving. Of these, 74 of them failed to make AYP and just six managed to eke by under the metric. Those that were poorly performing but did make AYP did so through the Safe Harbor provision (just one of them) and Ohio's growth model (four of them). One school met AYP via both escape routes.
So for the poorly performing tail end of schools, AYP was largely accurate. But what about the best schools, the ones allegedly penalized by rapidly increasing expectations as we hurdle toward 2014? We looked at schools that had performance index scores above 100 (the state's goal) out of 120, and that met or exceeded value-added growth expectations. Of these 832 schools, 735 (88 percent) met AYP. Twelve percent of these schools, then, could miss AYP and possibly be unfairly penalized, though Ohio's accountability system has few sanctions for those schools that are otherwise deemed ?Excellent? or ?Effective? but miss AYP.
At least for now we know that among the best schools in the state, relatively few are missing AYP. And among failing schools, most of them merit their AYP label.
A more interesting take might be a look at the large, middle swath of schools to see how/to what extent decent schools are failing to meet AYP and whether this warrants the waiver that Ohio may be seeking.
-Jamie Davies O'Leary