big testing

Colorado scores on “nation’s report card” decline but stay above national scores

Colorado students did worse this year on the test known as “the nation’s report card” than they did the last time it was administered two years ago, according to data released Wednesday. But the state’s scores are still better than national averages.

The National Assessment of Educational Progress, or NAEP, is a set of reading and math tests given every two years to a sample of fourth and eighth graders in each state. Earlier this year, 4,500 Colorado students spent one hour each taking one of the tests.

On the fourth-grade math tests, 43 percent of Colorado students scored proficient or better, down from 50 percent in 2013. On the eighth-grade math tests, 37 percent of students scored proficient or better, down from 42 percent two years ago.

On the fourth-grade reading tests, 39 percent of students scored proficient or better, down from 41 percent in 2013. On the eighth-grade reading tests, 38 percent of students scored proficient or better, down from 40 percent two years ago.

Most national scores, with the exception of fourth-grade reading, dipped as well but the declines weren’t as steep. However, Colorado education officials said the decreasing scores aren’t cause for concern.

“If we start seeing declines over a period of time — if we see scores dip again in 2017 — it becomes a little more alarming,” said Will Morton, director of assessment administration for the Colorado Department of Education. “Right now, with a single-year dip, I wouldn’t be too concerned about it yet.”

HOW DO COLORADO’s 2015 SCORES COMPARE TO NATIONAL SCORES?

U.S. students have taken the NAEP exams since the early 1990s in an effort to provide a consistent measure of student performance at a time when states’ standards varied widely.

Many states have adopted or are developing new tests that reflect shared standards, potentially allowing for more detailed and frequent comparisons of students across the country. But the NAEP tests are not officially aligned with the standards adopted by Colorado and more than 40 other states. Called the Common Core standards, they detail what students should know in reading and math.

By the 2013-2014 school year, the Common Core standards were in effect in all Colorado schools. The state also rolled out new tests that align with them. Students took the reading and math tests, known as PARCC, for the first time last spring.  The state is scheduled to release the results in November.

“When we look at tests as a measurement for student success — and they’re only one way to measure student success — those tests, which are taken by all students … are what we really look at,” said Dana Smith, interim chief communications officer for CDE.

HOW HAVE MATH SCORES CHANGED OVER 10 YEARS?

But officials said NAEP serves a purpose, too, in that it provides a glimpse into how Colorado students are performing compared to students across the country. Colorado ranks in the middle: Its scores were 23rd highest in fourth-grade math, 17th highest in eighth-grade math, 23rd highest in fourth-grade reading and 18th highest in eighth-grade reading.

“Overall, we’re about where we would expect to be,” Morton said, adding that “if you look at it on a bell curve, we’re in the middle of that bell curve toward the higher end.”

Colorado’s scores have generally improved over the years, while achievement gaps between white and minority students and low-income and non-low-income students have stayed the same. This year, Colorado’s scores did not improve. Morton and Smith were hesitant to speculate as to why, but they noted the differences between NAEP and the Common Core.

NAEP may not be testing what students are learning in their classrooms, they said. A recent study by the American Institutes for Research found that the similarity between the NAEP math tests and the Common Core is “reasonable,” but there are gaps. For example, the study said it appears that “a notable amount” of middle-school math content recommended by the Common Core is not part of the NAEP test.

“As our teachers continue to teach to our Colorado standards,” Morton said, “those differences between what NAEP is designed to test versus what our teachers are being asked to teach — those differences may be highlighted.” But it’s too early to tell for sure, he said.

“Until we have more years of implementation, we can’t really tell if this is an implementation dip or a fundamental difference between our standards and the blueprint of the NAEP test,” Morton said.

HOW HAVE READING SCORES CHANGED OVER 10 YEARS?

NAEP officials took a similar view of the scores, which stayed stagnant or declined in most states.

“One downturn does not a trend make,” said Peggy Carr, the acting commissioner of the National Center for Education Statistics, which administers the NAEP tests.

“It’s not a multi-year trend we’re seeing,” added Bill Bushaw, the executive director of the National Assessment Governing Board, which sets the framework for the NAEP tests. He referenced “curricular uncertainty” in American classrooms and said experts have suggested that “slight declines” often precede improvements.

The NAEP tests are not meant to be tied to a specific curriculum, Bushaw said. However, he predicted that the national board would take another look at the framework in light of this year’s scores and reports such as the one from the American Institutes for Research.

In Colorado, officials said that while NAEP is helpful, it’s just one piece of the overall testing puzzle — and one that’s based on a small sampling of the state’s nearly 900,000 students.

“We don’t get too upset when we see small gains or losses,” Morton said.

Chalkbeat Tennessee reporter Grace Tatter contributed information to this report.

Data source: National Assessment of Educational Progress 

Graphics by: Sarah Glen/Chalkbeat

Silver Lining Playbook

Memphis’ youngest students show reading gains on 2018 state tests — and that’s a big deal

PHOTO: Caroline Bauman
A student works on reading comprehension skills at Lucie E Campbell Elementary School in Memphis and Shelby County Schools.

Those working to improve early literacy rates in Shelby County Schools got a small morale boost Thursday as newly released scores show the district’s elementary school students improved their reading on 2018 state tests.

The percentage of Memphis elementary-age students considered proficient in reading rose by 3 points to almost one-fourth of the district’s children in grades 3 through 5. That’s still well below the state average, and Superintendent Dorsey Hopson said “we obviously have a long way to go.”

PHOTO: Caroline Bauman
Superintendent Dorsey Hopson has overseen Tennessee’s largest public school district since 2013.

Strengthening early literacy has been a priority for the Memphis district, which views better reading skills as crucial to predicting high school graduation and career success. To that end, Shelby County Schools has expanded access to pre-K programs, adjusted reading curriculum, and made investments in literacy training for teachers.

Hopson said the payoff on this year’s TNReady scores was a jump of almost 5 percentage points in third-grade reading proficiency.

“It was about five years ago when we really, really, really started pushing pre-K, and those pre-K kids are now in the third grade. I think that’s something that’s really positive,” Hopson said of the gains, adding that third-grade reading levels are an important indicator of future school performance.

TNReady scores for Shelby County Schools, which has a high concentration of low-performing schools and students living in poverty, were a mixed bag, as they were statewide.

Math scores went up in elementary, middle, and high schools in Tennessee’s largest district. But science scores went down across the board, and the percentage of high school students who scored proficient in reading dropped by 4 percentage points.

PHOTO: Shelby County Schools

Hopson said he was unsure how much the scores of older students — all of whom tested online — were affected by technical problems that hampered Tennessee’s return this year to computerized testing.

“From what people tell me, kids either didn’t try as hard in some instances or didn’t take it seriously,” Hopson told reporters. “We’ll never know what the real impact is, but we have to accept the data that came from these tests.”

But students in two of the district’s school improvement initiatives — the Innovation Zone and the Empowerment Zone — showed progress. “We’re going to double down on these strategies,” Hopson said of the extra investments and classroom supports.

In the state-run Achievement School District, or ASD, which oversees 30 low-performing schools in Memphis, grades 3 through 8 saw an uptick in scores in both reading and math. But high schoolers scored more than 3 percentage points lower in reading and also took a step back in science.

The ASD takes over schools in the state’s bottom 5 percent and assigns them to charter operators to improve. But in the five years that the ASD has been in Memphis, its scores have been mostly stagnant.

Tennessee Education Commissioner Candice McQueen said she and new ASD Superintendent Sharon Griffin are reviewing the new data to determine next steps.

“We are seeing some encouraging momentum shifts,” McQueen said.

Scores in

After a wild testing year, Tennessee student scores mostly dip — but there are a few bright spots

PHOTO: Getty Images/Sathyanarayan

Student test scores were mostly flat or dipped this year in Tennessee, especially in middle school where performance declined in every subject, according to statewide data released on Thursday.

But there were a few bright spots, including improvement in elementary school English and high school math — both areas of emphasis as the state tries to lift its proficiency rates in literacy and math.

Also, performance gaps tightened in numerous subjects between students in historically underserved populations and their peers. And scores in the state’s lowest-performing “priority” schools, including the state-run Achievement School District, generally improved more than those in non-priority schools.

But in science, students across the board saw declines. This was not expected because Tennessee has not yet transitioned to new, more difficult standards and a new aligned test for that subject. Education Commissioner Candice McQueen said the drops reinforce the need to support science teachers in the shift to higher expectations beginning this fall.

The mixed results come in the third year of the state’s TNReady test, which measures learning based on academic standards that have undergone massive changes in the last five years. The 2017-18 school year was the first under new math and English standards that are based on the previous Common Core benchmarks but were revised to be Tennessee-specific. And in addition to new science standards that kick off this fall, new expectations for social studies will reach classrooms in the 2019-20 school year.

In an afternoon press call, McQueen said “stability matters” when you’re trying to move the needle on student achievement.

“It takes time to really align to the full depth and breadth of these expectations,” she said.

The three charts below illustrate, by subject, the percentage of students statewide who performed on track or better, both this year and last year, in elementary, middle, and high schools. The blue bars reflect the most recent scores.

McQueen acknowledged the good and bad from this year’s results.

“While we’ve focused extensively on early grade reading and are starting to see a shift in the right direction, we know middle school remains a statewide challenge across the board,” she said in a statement.

Tennessee’s data dump comes after a tumultuous spring of testing that was marred by technical problems in the return to statewide computerized exams. About half of the 650,000 students who took TNReady tested online, while the rest stuck with paper and pencil. Online testing snafus were so extensive that the Legislature — concerned about the scores’ reliability — rolled back their importance in students’ final grades, teachers’ evaluations, and the state’s accountability system for schools.

However, the results of a new independent analysis show that the online disruptions had minimal impact on scores. The analysis, conducted by a Virginia-based technical group called the Human Resources Research Organization, will be released in the coming weeks.

Even so, one variable that can’t be measured is the effect of the technical problems on student motivation, especially after the Legislature ordered — in the midst of testing — that the scores didn’t have to be included in final grades.

“The motivation of our students is an unknown we just can’t quantify. We can’t get in their minds on motivation,” McQueen told Chalkbeat on the eve of the scores’ release.

Thursday’s rollout marked the biggest single-day release of state scores since high school students took their first TNReady tests in 2016. (Grades 3-8 took their first in 2017.) The data dump included state- and district-level scores for math, English, science, and U.S. history for grades 3-12.

More scores will come later. School-by-school data will be released in the coming weeks. In addition, Tennessee will unveil the results of its new social studies test for grades 3-8 this fall after setting the thresholds for what constitutes passing scores at each grade level.

You can find the state-level results here and the district-level results here.

Chalkbeat illustrator Sam Park contributed to this story.