ISTEP disruptions had no impact on scores, review finds

Back to TopCommentsE-mailPrintBookmark and Share

Glitches that disrupted Indiana's online standardized testing this spring had no measurable negative impact on scores, even though at least one-sixth of students taking the exam were kicked offline at some point, according to an independent review released Monday.

Contractor CTB/McGraw Hill reported that nearly 80,000 students in third through eighth grade — or 16 percent of the more than 482,000 Indiana students who took the online test — had their ISTEP exam interrupted at least once when computer glitches kicked them offline during the April-May testing period, the report released by the state Department of Education concludes.

But the problems had no negative impact on scores for the "vast majority" of students, said Dr. Richard Hill of the National Center for the Improvement of Educational Assessment Inc., who conducted the review. Hill said, however, that 600 students who were taking the test lost data "that was not 'restored' when they logged back in."

Student ISTEP scores slightly increased between 2012 and 2013, on par with improvements in previous years, Hill said.

"It does appear, looking at the data, that the net impact of the interruptions was nil. Students scored about as well as they would have had no interruptions occurred," he told Indiana's Commission on Education on Monday. "That may come as a surprise to many, but there's a lot of evidence to back up that statement."

Hill credited school staff's actions as well as students' own resolve to press on and work "diligently" to complete the multi-part test.

State Superintendent of Public Instruction Glenda Ritz halted testing for two straight days in April as the server problems knocked students offline or left them unable to access the online test, which assesses students' proficiency in mathematics and English/language arts. Some students are also tested on their proficiency in social studies or science.

Because of the problems, the state asked schools to cut their normal test loads by half for a few days and the testing period was extended.

Hill's report states that school districts reported an additional 60,000 students' tests were interrupted by the glitches. That figure, combined with the number reported by CTB/McGraw-Hill, would mean 29 percent of students tested were affected.

Hill said he considers the company's numbers more accurate than the schools', but added that the school's numbers cannot be discounted.

Ritz told the commission Monday it's unclear how many students' tests were affected in some way by the disruptions.

"You need to keep in mind, anyone sitting next to somebody who's interrupted for any length of a period of time, that's going to cause an interruption in their own testing, whether they didn't spend time on the question they were on, or whatever the case may be," she said.

Indiana's troubles punctuated a nationwide shift from pencil-and-paper tests to online exams. Troubles earlier this year also disrupted high-stakes testing in other states, including Kentucky, Minnesota and Oklahoma.

In Indiana, ISTEP scores are used to assess student performance and determine teacher pay and school rankings.

Ritz said the testing problems were "extremely stressful" for teachers and students. She said that given the uncertainties about how students might have scored without the glitches, she's given local schools the "flexibility to minimize the effect" of test results on this year's teacher evaluations.

"There is no mandate. It's up to the individual school districts to look at that," she said, noting that 2013 is the first year Indiana is tying student test scores to teacher evaluations.

Ritz said the state Department of Education is continuing to negotiate with CTB McGraw-Hill to seek a settlement with the company, which has a four-year, $95 million state contract to administer the test.

In June, Ritz said her office was seeking at least $614,000 in damages from CTB/McGraw-Hill for the testing troubles. That amount included $400,000 for fines covered in the company's state contract. The remainder would pay for the independent review and better reporting data.

Schools typically receive ISTEP results in May, but Ritz said the glitches and the review means the data won't be released until late August.


Post a comment to this story

We reserve the right to remove any post that we feel is obscene, profane, vulgar, racist, sexually explicit, abusive, or hateful.
You are legally responsible for what you post and your anonymity is not guaranteed.
Posts that insult, defame, threaten, harass or abuse other readers or people mentioned in IBJ editorial content are also subject to removal. Please respect the privacy of individuals and refrain from posting personal information.
No solicitations, spamming or advertisements are allowed. Readers may post links to other informational websites that are relevant to the topic at hand, but please do not link to objectionable material.
We may remove messages that are unrelated to the topic, encourage illegal activity, use all capital letters or are unreadable.

Messages that are flagged by readers as objectionable will be reviewed and may or may not be removed. Please do not flag a post simply because you disagree with it.

Sponsored by

facebook - twitter on Facebook & Twitter

Follow on TwitterFollow IBJ on Facebook:
Follow on TwitterFollow IBJ's Tweets on these topics:
Subscribe to IBJ
  1. I am a Lyft driver who is a licensed CDL professional driver. ALL Lyft drivers take pride in providing quality service to the Indianapolis and surrounding areas, and we take the safety of our passengers and the public seriously.(passengers are required to put seat belts on when they get in our cars) We do go through background checks, driving records are checked as are the personal cars we drive, (these are OUR private cars we use) Unlike taxi cabs and their drivers Lyft (and yes Uber) provide passengers with a clean car inside and out, a friendly and courteous driver, and who is dressed appropriately and is groomed appropriately. I go so far as to offer mints, candy and/or small bottle of water to the my customers. It's a mutual respect between driver and passenger. With Best Regards

  2. to be the big fish in the little pond of IRL midwest racin' when yer up against Racin' Gardner

  3. In the first sentance "As a resident of one of these new Carmel Apartments the issue the local governments need to discuss are build quality & price." need a way to edit

  4. As a resident of one of these new Carmel Apartments the issue the local governments need to discuss is build quality & price. First none of these places is worth $1100 for a one bedroom. Downtown Carmel or Keystone at the Crossing in Indy. It doesn't matter. All require you to get in your car to get just about anywhere you need to go. I'm in one of the Carmel apartments now where after just 2.5 short years one of the kitchen cabinet doors is crooked and lawn and property maintenance seems to be lacking my old Indianapolis apartment which cost $300 less. This is one of the new star apartments. As they keep building throughout the area "deals" will start popping up creating shoppers. If your property is falling apart after year 3 what will it look like after year 5 or 10??? Why would one stay here if they could move to a new Broad Ripple in 2 to 3 years or another part of the Far Northside?? The complexes aren't going to let the "poor" move in without local permission so that's not that problem, but it the occupancy rate drops suddenly because the "Young" people moved back to Indy then look out.

  5. Why are you so concerned about Ace hardware? I don't understand why anyone goes there! Every time ive gone in the past, they don't have what I need and I end up going to the big box stores. I understand the service aspect and that they try to be helpful but if they are going to survive I think they might need to carry more specialty parts.