ISTEP disruptions had no impact on scores, review finds

Back to TopCommentsE-mailPrintBookmark and Share

Glitches that disrupted Indiana's online standardized testing this spring had no measurable negative impact on scores, even though at least one-sixth of students taking the exam were kicked offline at some point, according to an independent review released Monday.

Contractor CTB/McGraw Hill reported that nearly 80,000 students in third through eighth grade — or 16 percent of the more than 482,000 Indiana students who took the online test — had their ISTEP exam interrupted at least once when computer glitches kicked them offline during the April-May testing period, the report released by the state Department of Education concludes.

But the problems had no negative impact on scores for the "vast majority" of students, said Dr. Richard Hill of the National Center for the Improvement of Educational Assessment Inc., who conducted the review. Hill said, however, that 600 students who were taking the test lost data "that was not 'restored' when they logged back in."

Student ISTEP scores slightly increased between 2012 and 2013, on par with improvements in previous years, Hill said.

"It does appear, looking at the data, that the net impact of the interruptions was nil. Students scored about as well as they would have had no interruptions occurred," he told Indiana's Commission on Education on Monday. "That may come as a surprise to many, but there's a lot of evidence to back up that statement."

Hill credited school staff's actions as well as students' own resolve to press on and work "diligently" to complete the multi-part test.

State Superintendent of Public Instruction Glenda Ritz halted testing for two straight days in April as the server problems knocked students offline or left them unable to access the online test, which assesses students' proficiency in mathematics and English/language arts. Some students are also tested on their proficiency in social studies or science.

Because of the problems, the state asked schools to cut their normal test loads by half for a few days and the testing period was extended.

Hill's report states that school districts reported an additional 60,000 students' tests were interrupted by the glitches. That figure, combined with the number reported by CTB/McGraw-Hill, would mean 29 percent of students tested were affected.

Hill said he considers the company's numbers more accurate than the schools', but added that the school's numbers cannot be discounted.

Ritz told the commission Monday it's unclear how many students' tests were affected in some way by the disruptions.

"You need to keep in mind, anyone sitting next to somebody who's interrupted for any length of a period of time, that's going to cause an interruption in their own testing, whether they didn't spend time on the question they were on, or whatever the case may be," she said.

Indiana's troubles punctuated a nationwide shift from pencil-and-paper tests to online exams. Troubles earlier this year also disrupted high-stakes testing in other states, including Kentucky, Minnesota and Oklahoma.

In Indiana, ISTEP scores are used to assess student performance and determine teacher pay and school rankings.

Ritz said the testing problems were "extremely stressful" for teachers and students. She said that given the uncertainties about how students might have scored without the glitches, she's given local schools the "flexibility to minimize the effect" of test results on this year's teacher evaluations.

"There is no mandate. It's up to the individual school districts to look at that," she said, noting that 2013 is the first year Indiana is tying student test scores to teacher evaluations.

Ritz said the state Department of Education is continuing to negotiate with CTB McGraw-Hill to seek a settlement with the company, which has a four-year, $95 million state contract to administer the test.

In June, Ritz said her office was seeking at least $614,000 in damages from CTB/McGraw-Hill for the testing troubles. That amount included $400,000 for fines covered in the company's state contract. The remainder would pay for the independent review and better reporting data.

Schools typically receive ISTEP results in May, but Ritz said the glitches and the review means the data won't be released until late August.


Post a comment to this story

We reserve the right to remove any post that we feel is obscene, profane, vulgar, racist, sexually explicit, abusive, or hateful.
You are legally responsible for what you post and your anonymity is not guaranteed.
Posts that insult, defame, threaten, harass or abuse other readers or people mentioned in IBJ editorial content are also subject to removal. Please respect the privacy of individuals and refrain from posting personal information.
No solicitations, spamming or advertisements are allowed. Readers may post links to other informational websites that are relevant to the topic at hand, but please do not link to objectionable material.
We may remove messages that are unrelated to the topic, encourage illegal activity, use all capital letters or are unreadable.

Messages that are flagged by readers as objectionable will be reviewed and may or may not be removed. Please do not flag a post simply because you disagree with it.

Sponsored by

facebook - twitter on Facebook & Twitter

Follow on TwitterFollow IBJ on Facebook:
Follow on TwitterFollow IBJ's Tweets on these topics:
thisissue1-092914.jpg 092914

Subscribe to IBJ
  1. Here are a few candidates for this new group, "ripped from the headlines." First up, that bizzaro State Senator Brent Waltz; secondly, the unethical Todd Huston, and his contractual arrangements scheme; Finally, but not least of all, the dishonorable Eric Turner. What sayeth you Greg Zoeller?

  2. Good day. I can't hide this great testimony that take place in my life I will love everyone to know it and be partaker that is why I always place it on answer, I am Mrs,Natalie Cuttaia by name, I live in Texas, United State Of America, I want to thank (Mr.Bruce Brandon) for his kindness upon my family life. I never knew that there is still nice lender like this on internet and earth here. Just some Months Back, I was in search for a loan of $100,000,00 as I was running out of money for feeding and rent. I was scammed $6,800 Dollars and I decided not to involve my self in such business again but a Friend of my introduced me to a loan firm due to my appearance and doings. And I told him that I am not interested of any loan deal anymore but he told me that there is still a nice lender who he will recommend me to, and I made a trial and I am most grateful lucky am I today, I was given a loan amount of $100,000.00usd, by this great Company (Bruce Brandon Loan Company) managed by (Mr.Bruce Brandon) If you are in need of a genuine or legit loan or financial assistance and you can be reliable and trusted of capable of paying back at the due time of the funds I will advice you to, contact him via: ( bruce.brandon071@gmail.com ) And you will be free from scams in the internet. All thanks to Mr.Bruce Brandon You are the one who remove me and my family out of poverty. The reason why i am doing this is that, i promise Mr.Bruce Brandon that if i truly got my loan, i will advertize his company and bring customers to his company. Contact him via ( bruce.brandon071@gmail.com )for the Loan you have been looking for..

  3. Hello, We are firm Organization formed to help people in needs of helps,such as financial help. So if you are going through financial difficulty or you are in any financial mess,and you need funds to start up your own business,or you need loan to settle your debt or pay off your bills,start a nice business, or you are finding it hard to obtain capital loan from local banks,contact us today via email mrsroseberrywilkinsfunds.usa@gmail.com So do not let these opportunity pass you by because Jesus is the same yesterday, today and forever more. Please these is for serious minded and God fearing People. Your Name: Loan Amount: Loan Duration: Valid Cell Phone Number: Thanks for your understanding to your contact as we Await Regards Management Email:mrsroseberrywilkinsfunds.usa@gmail.com

  4. The question is, where could they build a new stadium? It seems in the past year, all the prime spots have been spoken for with potential projects. Maybe in the industrial wasteland area a block past Lucas Oil? I think it needs to be close to the core, if a new stadium is built.

  5. Aldi is generally a great shopping experience. Still, I'm sure YOU wouldn't want to shop there, which I consider a positive.