Perdido 03

Perdido 03
Showing posts with label outliers. Show all posts
Showing posts with label outliers. Show all posts

Thursday, August 8, 2013

How Success Academy Fared Against Other Renowned Charter Networks

I posted earlier today about the miraculous statistics Eva Moskowitz's Success Academy Schools garnered on the new Common Core tests.

Scores across the state plummeted on the 3rd-8th grade ELA and math exams, but Eva Moskowitz's Success Academy schools bucked that trend with some amazing scores:

There were some charter networks that boasted victory — like the aptly named Success Academy Charter Schools.

At one Bronx school, a whopping 97% of students were proficient in math, and 77% passed English. Overall, the 14-school charter network saw 82% of students meet standards in math and 58% meet standards in English.

Success Academy students outperformed traditional public schools students on math exams by 52% and ELA exams by 32%.  
 
Success Academy students outperformed charter school students on math exams by 47% and ELA exams by 33%.
 
And one Success Academy school was head and shoulders above all the other Success Academy schools.
 
At Bronx Success Academy, students outperformed traditional public school students on the math exams by 67%, charter school students by 62%.
 
On the ELA exams, Bronx Success Academy students outperformed charter school students by 52%, traditional public schools by 51%.
 
Those are truly, truly awe-inspiring statistics.
 
At Politico, Stephanie Simon took a closer look at how some of Eva Moskowitz's famous compatriots in the charter world did on the new Common Core tests and found them dragging well behind Eva's schools:
 
The Democracy Prep chain posted uneven results, with particularly poor scores in sixth grade. In its Harlem charter, fewer than 4 percent of sixth graders passed the language arts exam, and fewer than 12 percent passed math. Its best results came at the eighth grade level, but even then the pass rate on both tests was under 33 percent — better than the citywide average of about 26 percent, but not a quantum leap above other public schools.

Democracy Prep officials didn’t respond to a request for comment.

The highly touted KIPP network also stumbled, with proficiency rates well below the city average for several grades and subjects. At KIPP Star College Prep, just 11 percent of fifth graders were proficient in math and just 16 percent passed the reading test.
Seventh grade was another weak point, with 11 percent proficient in language arts and 14 percent in math. KIPP also did not respond to a request for comment.

The poor results for KIPP, Democracy Prep and other renowned charters suggest that “we have to be more careful about claims of miracle schools,” said Michael Petrilli, an education analyst at the Thomas B. Fordham Institute.

Michael Petrilli seems to forget that Success Academy charter schools did post miraculous results on the state tests - especially at Bronx Success Academy, where 97% of students were proficient in math.

It seems to me achieving a 97% proficiency rate on the state math exam when so many other schools, including schools in fellow charter networks like Democracy Prep and KIPP, saw their scores plunge rates Bronx Success Academy as a "miracle school."

Eva Moskowitz and the crew at the Success Academies, especially at the Bronx Success Academy, deserve "Huzzahs!" for their amazing achievements on these state exams.

And after those "Huzzahs!", maybe somebody ought to take a closer look at those statistics to see just how Eva Moskowitz and her crew got those awe-inspiring scores - especially at Bronx Success Academy.

Clearly Eva Moskowitz and the Success Academy crew have something to teach the rest of us - including the KIPPsters and Democracy Prep people - about how to run schools.

I do hope some independent entity does a study of the Success Academy test score results so that we can all learn just how they got such awe-inspiring scores.

Just How Did They Get To Be So Successful At Success Academy?

Yesterday before the Common Core test scores were released, Gotham Schools offered a handy guide for what to watch for:

Here was the first of those items (emphasis added):

Where are the outliers?
 
All scores are expected to be low, but some will be lower than others. And some will almost certain fall by much less than the average. Identifying those outliers will be a first step in telling the story of schools’ first year under the new standards.

A school whose scores fall by far less than other similar schools might be the site of exceptional, Common Core-aligned teaching — or there might be more nefarious explanations worth looking into.

The Daily News reports the following about the test scores:

Dismal state test scores don’t discriminate between charter schools and traditional public schools.
Charter schools performed better than their district school counterparts on some benchmarks — but not enough to separate themselves from the widespread drop in scores.

Across the city, about 25% of charter school students rated proficient in English, compared with 26% of traditional public school students. In math, 35% of charter school students rated proficient, compared with 30% of traditional public school students.

Traditional public school students slightly outperformed charter school students on the ELA exams, charter school students outperformed traditional public school students by about 4.5% on the math exams.

There are no red flags here - until you dig into the individual charter networks and find this:

There were some charter networks that boasted victory — like the aptly named Success Academy Charter Schools.

At one Bronx school, a whopping 97% of students were proficient in math, and 77% passed English. Overall, the 14-school charter network saw 82% of students meet standards in math and 58% meet standards in English.

“For years, we and other educators have asked for more rigorous tests which would go beyond filling in bubbles,” said Success Academy founder Eva Moskowitz. “Parents finally know if their kids are ready for college.”

Using the handy Gotham Schools "What To Look For In The Scores" guide, we find ourselves an outlier here.

Not only did Success Academy students outperform both traditional public schools students and charter school students, they vastly outperformed them.
 
Overall, Success Academy students outperformed traditional public schools students on math exams by 52% and ELA exams by 32%.  
 
Success Academy students as a whole outperformed charter school students on math exams by 47% and ELA exams by 33%.
 
But one Success Academy School managed to not only vastly outperform all traditional public schools and charter schools, it managed to vastly outperform the rest of the Success Academy network.
 
That would be at the Bronx Success Academy, where students outperformed traditional public school students on the math exams by 67%, charter school students by 62%.
 
On the ELA exams, Bronx Success Academy students outperformed charter school students by 52%, traditional public schools by 51%.
 
Those are impressive statistics!

They are outliers, in fact, something our trusty Gotham Schools "What To Look For In The Scores" guide told us we should take a closer look at, because a school that is an outlier might be "the site of exceptional, Common Core-aligned teaching — or there might be more nefarious explanations worth looking into."
 

For years, we and other educators have asked for more rigorous tests which would go beyond filling in bubbles to measure whether kids are learning at the level they need to succeed in life. These new tests are much closer to the mark. Parents finally know if their kids are ready for college. Our results are a reflection of our commitment to critical thinking, high standards, and lots and lots of hard work by our students, teachers and families.
 
Perhaps Eva Moskowitz is right - perhaps these test scores her schools got do reflect high standards and hard work by both staff and students at the schools.

Moskowitz is known for running test prep factories and being obsessed with test score rates, so it is quite possible the "success" of Success Academy students is due completely to the high standards and hard work, not to mention obsessive test prep, at the schools.

And yet, these stats are truly breath-taking in a year when everybody else's stats fell.

And the scores at that Bronx Academy school - truly, truly awe-inspiring.
 
Think about this - a 97% proficiency rate on the math tests in the very year almost every other school saw scores on the math tests plummet.

That sure is an awfully good proficiency rate - one might say "too good."

In Indiana, at least one politically connected charter school had it's grade changed from a C to an A by the former state superintendent, Tony Bennett.

There is a massive cheating scandal in Beverly Hall's old Atlanta district and there are rumors of a massive cheating scandal and cover-up during Michelle Rhee's Washington D.C. tenure.

This is not to say that anybody at Eva's Success Academies did anything wrong during last April's testing season.

But grades as good as the Success Academy charter organization got - especially one of the Academy school in the Bronx - do bear a little extra scrutiny.

As the folks at Gotham Schools noted in their handy "What To Look For In The Scores" guide, these Success Academy schools might be the sites of "exceptional, Common Core-aligned teaching — or there might be more nefarious explanations worth looking into."
 
And this is especially so at one Bronx Success Academy school with truly miracle statistics.