WRONG SCORES

Scoring glitch means thousands of Tennessee students got wrong TNReady score

PHOTO: Chalkbeat Photo Illustration

Just when it seemed that this year’s state testing had gone off with minimal hitches, news has emerged that thousands of exams were incorrectly scored.

About 9,400 students in 33 districts across Tennessee received incorrect scores after the testing vendor, Questar, used a scanning program that included an error. That includes Shelby County Schools in Memphis, where the problem affected just over a thousand students at 11 high schools, school board members confirmed on Friday.

An official with the state’s Achievement School District said he wasn’t aware of the issue, but the ASD is one of 33 districts affected, according to the state.

The errors were isolated to English I and II and Integrated Math II tests for high school students, according to an email to school board members.

Shante Avant, chairwoman for Shelby County’s board, said the errors are concerning, especially after the tumultuous rollout of TNReady in 2016.

“Our kids do have to be assessed so we know how best to support them. And there’s a heightened scrutiny with test scores. But when we’re not able to provide accurate information, it breeds mistrust,” she said.

Here are the Shelby County Schools affected:

The state said tests for students in grades three through eight were re-checked and no errors were detected. “All student score results for grade 3-8 are correct and final,” according to a state email to superintendents.

It’s unclear how much the scoring errors might have distorted district averages, which the state reported in late August. About 1,700 of the changed scores statewide affected whether or not a student passed the test. 

“I don’t know if 1,000 out of 10,000 students is going to significantly impact the district,” said Shelby County board member Chris Caldwell. “But we certainly want to make sure they come out as accurate. It’s especially important for the students.”

Several districts, including Shelby County Schools, chose not to include raw TN Ready scores in student report cards, meaning student grades wouldn’t have been affected by incorrect scores. But confusion remains for board members on how exactly this will impact students as well as teachers, who are evaluated based on their students’ exam scores, Caldwell said.

What is clear is that the scores could have implications for historically low-performing schools. This year’s scores were the second year of the state’s new test for high school students — and the state will use them to decide what happens to struggling schools under its new accountability plan to comply with federal law.  

While TNReady results for individual schools haven’t been released yet, district-level scores for high schoolers showed that few were on grade-level in Memphis school districts.

Questar was new to Tennessee test-making this year and was responsible for distributing and scoring the exams. Questar took over following a string of TNReady challenges in the test’s inaugural year. After the online platform failed and numerous delivery delays of printed testing materials, McQueen canceled testing in grades 3-8 and fired its previous test maker, Measurement Inc.

 “Questar takes responsibility for and apologizes for this scoring error,” Chieff Operating Officer Brad Baumgartner said in an email to the state. “We are putting in additional steps in our processes to prevent any future occurrence. We are in the process of producing revised reports and committed to doing so as quickly as possible.”

Here is the full list of district’s affected:

  • Achievement School District
  • Anderson County
  • Benton County
  • Bradley County
  • Bristol City
  • Carter County
  • Cocke County
  • Collierville City
  • Crockett County
  • Davidson County
  • Elizabethton City
  • Giles County
  • Hamilton County
  • Hardin County
  • Henry County
  • Huntingdon Special School District
  • Jackson-Madison County
  • Knox County
  • Lewis County
  • Lincoln County
  • Marshall County
  • Maryville City
  • Monroe County
  • Montgomery County
  • Obion County
  • Putnam County
  • Roane County
  • Rutherford County
  • Shelby County
  • Smith County
  • Sumner County
  • Union City
  • Weakley County

This story has been updated with comments from Shelby County Schools board chair Shante Avant and Questar. We have updated the story with a full list of districts affected. 

Mixed messages

Is the Board of Regents hostile to charter schools? Depends upon whom you ask.

PHOTO: Monica Disare
Regent Collins and Regent Johnson engage in a discussion after a Board of Regents meeting.

When the Board of Regents took the unprecedented step of rejecting two new charter schools last week, it sent shudders through the charter school sector.

Even before the meeting last Monday, the Regents had been making charters “nervous,” said Andrea Rogers, the New York State Director for the Northeast Charter Schools Network. The rejections only heightened the anxiety.

“I think these denials skyrocketed the issue to the front of people’s minds,” she said.  

And yet, during the same meeting, the board praised and signed off on the opening of five other charter schools, which brings the number of new schools approved this year to more than any year since 2013.

The meeting was emblematic of the mixed signals that this Board of Regents have been sending over the last few months, feeding different interpretations among both those who advocate for charter schools and those who champion traditional schools

The board’s willingness to criticize and question charters have many believing the Regents are, at best, skeptics and, at worst, opposed to the publicly funded, privately run schools that they authorize and oversee.

At the same time, the Regents have not been without praise for charters, and some charters say they have appreciated the support of the body and the state’s support staff.

Chancellor Betty Rosa said the Regents’ decisions are evidence of nuance, not rigid ideology or partisanship.

“I think there’s too many times when people want to simply say ‘you’re for’ or ‘you’re against.’ It’s so much more complicated than that,” Rosa told Chalkbeat in an interview Wednesday. “To me, if it’s a wonderful opportunity for kids — you got me. If it’s not, I’m probably going to be your worst enemy.”

As an authorizer, the Board of Regents has the power to approve new schools and decide which of its 87 schools should remain open. In addition to deciding the fate of individual schools, the board is rethinking how it evaluates all of its schools   and whether they should take a closer look at measures like surveys or chronic absenteeism.

With several new members and a relatively new leader, the Regents’ actions have been under particular scrutiny for signs of partisanship. Some have seized on recent events, such as critical statements made by some Regents as charter schools have come before the board for approval or renewal.

One Regent suggested that charter schools achieve high test scores by pushing out students; another suggested a charter school in Brooklyn is contributing to segregation.

Rosa has fiercely opposed a proposal that would allow some charter schools to certify their own teachers, calling the idea  “insulting.” The board also rejected a batch of Success Academy renewals, arguing that their authorizer attempted to renew the high-performing but controversial charter schools too soon. (The move had little practical effect, since their authorizer, SUNY, can override the board’s decision.)

Rosa said the sum of these decisions does not mean either she or the board is anti-charter. Her opposition to the teacher certification proposal had nothing to do with the source of the proposal — a charter authorizer — but because, she said, she believes the idea is an affront to the teaching profession and will allow unqualified teachers to enter classrooms.

The Success Academy renewals, she said, were returned based on legal requirements — and were not an appraisal of the charter network.

But taken together, observers of different educational ideologies have concluded that the board is more likely to probe problems with charter schools than in the past.

“It is quite a change from a couple years ago, and it does show greater misgivings about charter schools than what we saw under the board as it was previously constructed,” said Bob Lowry, deputy director of the New York State Council of School Superintendents. (Lowry said he appreciates that the board is paying more attention to how charter schools will affect the funding of surrounding school districts.)

The state’s teachers union has picked up on the change and praised the board for providing more oversight of charter schools, while calling on them to do more.

“The Regents, at this point, are providing much overdue scrutiny of the charter sector,” said NYSUT spokesman Carl Korn. “We believe that the Regents and the state education department need to do more, but this is a good step.”

Charter school advocates agree, seeing the Board of Regents’ actions as worrying. Since the board’s philosophy is hard to pin down, schools are starting to wonder if they can switch authorizers, Rogers said.

Yet there are signs that charters’ fear are based on conclusions that are far too sweeping. As the board rejected two schools outside of New York City, they also lauded applications for schools opening in the city a fact that may suggest differences in how the Regents assess schools in different areas of the state.

Regent Christine Cea welcomed a new school in Staten Island, saying she is “totally in favor of it.” Rosa expressed excitement about a new KIPP school in the Bronx, saying the community has “tremendous support” for its opening.

Rosa said Regents are more thoughtful and involved in reviewing schools now. She suggested that there are educational innovations that can be learned from charter schools, but also offered some critiques. At the top of her list, she worries that charter schools are not well-equipped to serve students with the most severe disabilities.

Several schools that are currently authorized by the board expressed their appreciation for the Board of Regents and those in the state education department’s charter school office who provide technical assistance to schools and create charter school recommendations for the board.

“On our quest to better serve scholars with learning differences, we have found no better ally,” said Eric Tucker, who is a co-founder of Brooklyn Laboratory Charter School. “Through technical assistance and oversight, the Regents push public schools like ours to continually improve to better serve the needs of all students, all days.”

Still, said Bob Bellafiore, an education consultant who works with charter schools, several Regents come from district school backgrounds, and so their default attitude is to question charter schools and support the traditional school model.

“They’re much more district school system people,” Bellafiore said.

What's Your Education Story?

Tips for teaching poetry in a women’s prison. ‘Remember, you are not allowed to hug anyone.’

PHOTO: Lwp Kommunikáció, Flickr CC
Inmates at the Indiana Women's Prison.

Adam Henze was one of seven educators who participated in a story slam sponsored by Chalkbeat, Teachers Lounge Indy, WFYI Public Media and the Indianapolis Public Library on Sept. 5. Every teacher shared stories about their challenges and triumphs in Circle City classrooms.

A poet and educator, Henze read a poem about a day in his life as a poetry instructor at the Indiana Women’s Prison. Henze recounts the painful struggle to reconcile his experiences with the crimes for which his students were serving time — some life sentences for murder

It’s a story full of darkness, but it also offers hope that, as Henze said, “we are the sum of the things that we have done, but we’re also the sum of the things that we have yet to do.”

Check out the video below to hear Henze’s story.

You can find more stories from educators, students and parents here.