IBJNews

ISTEP disruptions had no impact on scores, review finds

Back to TopCommentsE-mailPrintBookmark and Share

Glitches that disrupted Indiana's online standardized testing this spring had no measurable negative impact on scores, even though at least one-sixth of students taking the exam were kicked offline at some point, according to an independent review released Monday.

Contractor CTB/McGraw Hill reported that nearly 80,000 students in third through eighth grade — or 16 percent of the more than 482,000 Indiana students who took the online test — had their ISTEP exam interrupted at least once when computer glitches kicked them offline during the April-May testing period, the report released by the state Department of Education concludes.

But the problems had no negative impact on scores for the "vast majority" of students, said Dr. Richard Hill of the National Center for the Improvement of Educational Assessment Inc., who conducted the review. Hill said, however, that 600 students who were taking the test lost data "that was not 'restored' when they logged back in."

Student ISTEP scores slightly increased between 2012 and 2013, on par with improvements in previous years, Hill said.

"It does appear, looking at the data, that the net impact of the interruptions was nil. Students scored about as well as they would have had no interruptions occurred," he told Indiana's Commission on Education on Monday. "That may come as a surprise to many, but there's a lot of evidence to back up that statement."

Hill credited school staff's actions as well as students' own resolve to press on and work "diligently" to complete the multi-part test.

State Superintendent of Public Instruction Glenda Ritz halted testing for two straight days in April as the server problems knocked students offline or left them unable to access the online test, which assesses students' proficiency in mathematics and English/language arts. Some students are also tested on their proficiency in social studies or science.

Because of the problems, the state asked schools to cut their normal test loads by half for a few days and the testing period was extended.

Hill's report states that school districts reported an additional 60,000 students' tests were interrupted by the glitches. That figure, combined with the number reported by CTB/McGraw-Hill, would mean 29 percent of students tested were affected.

Hill said he considers the company's numbers more accurate than the schools', but added that the school's numbers cannot be discounted.

Ritz told the commission Monday it's unclear how many students' tests were affected in some way by the disruptions.

"You need to keep in mind, anyone sitting next to somebody who's interrupted for any length of a period of time, that's going to cause an interruption in their own testing, whether they didn't spend time on the question they were on, or whatever the case may be," she said.

Indiana's troubles punctuated a nationwide shift from pencil-and-paper tests to online exams. Troubles earlier this year also disrupted high-stakes testing in other states, including Kentucky, Minnesota and Oklahoma.

In Indiana, ISTEP scores are used to assess student performance and determine teacher pay and school rankings.

Ritz said the testing problems were "extremely stressful" for teachers and students. She said that given the uncertainties about how students might have scored without the glitches, she's given local schools the "flexibility to minimize the effect" of test results on this year's teacher evaluations.

"There is no mandate. It's up to the individual school districts to look at that," she said, noting that 2013 is the first year Indiana is tying student test scores to teacher evaluations.

Ritz said the state Department of Education is continuing to negotiate with CTB McGraw-Hill to seek a settlement with the company, which has a four-year, $95 million state contract to administer the test.

In June, Ritz said her office was seeking at least $614,000 in damages from CTB/McGraw-Hill for the testing troubles. That amount included $400,000 for fines covered in the company's state contract. The remainder would pay for the independent review and better reporting data.

Schools typically receive ISTEP results in May, but Ritz said the glitches and the review means the data won't be released until late August.

ADVERTISEMENT

Post a comment to this story

COMMENTS POLICY
We reserve the right to remove any post that we feel is obscene, profane, vulgar, racist, sexually explicit, abusive, or hateful.
 
You are legally responsible for what you post and your anonymity is not guaranteed.
 
Posts that insult, defame, threaten, harass or abuse other readers or people mentioned in IBJ editorial content are also subject to removal. Please respect the privacy of individuals and refrain from posting personal information.
 
No solicitations, spamming or advertisements are allowed. Readers may post links to other informational websites that are relevant to the topic at hand, but please do not link to objectionable material.
 
We may remove messages that are unrelated to the topic, encourage illegal activity, use all capital letters or are unreadable.
 

Messages that are flagged by readers as objectionable will be reviewed and may or may not be removed. Please do not flag a post simply because you disagree with it.

Sponsored by
ADVERTISEMENT

facebook - twitter on Facebook & Twitter

Follow on TwitterFollow IBJ on Facebook:
Follow on TwitterFollow IBJ's Tweets on these topics:
 
Subscribe to IBJ
  1. Uh, sorry Johnnie, but you are incorrect. Despite the assertions by yourself and various defenders and captains, sports attendance is NOT off significantly at most sporting events in the US. Variances in attendance has been in the range of single digits, both + & - for years now. MLB has had most of its best overall attendance nubers in the last decade, and that trend has been consistent for most major sporting events. The number one issue cited by most fans when asked about attendance is the overall cost of attending. The presence of HD and big screen televisions in home doesn't even register, as a factor for not attending an event. VALUE in the product is the key, and apparently is something lacking in the current ICS. What other explanation is there when with what is routinely touted as the "best" racing on the planet, fans are staying away in DROVES. A "close" title battle into the last event at Fontana, with the "cars and stars" of the ICS, and who showed up? MAYBE 8K. Sorry, but HD TV isn't to blame for that kind of fan apathy.

  2. Do you need finance to establish your business ? Are you interested in getting a loan at 3% from our private company? If so please Email: suntrust_oil@blumail.org

  3. If she was worth the $ the public outcry over direct tv dropping them would have kept them on their dishes as we have seen with other companies. I too quit watching channel 13 after she showed up since I left channel 8 because of her all show rather than production results. When Randy on 8 corrected her she had a big head and incorrectly challenged his correction for pronunciation of a city. Other antics while she matures was too much for me with her very inaccurate forecasts. All the forecasters were predicting rain until Thursday except Chris. They predicted sunny on Thursday but instead of rain until Thursday upon which the sun would finally make it out in full glory Chris was right on the money just as I too predicted looking at the radar on weather.gov. One thing I love about Angela is the fear you can see in her every time it thunders in the winter. It far exceeds the entertainment value of her body language (high heel noise drags, depression, etc) when her forecasts are so incorrect. Her hair stands on end, you have to see it!!!

  4. Good Day, Apply For A Loan I am Mr Fernadez Antonio, a private Loan lender and a cooperate financial for real estate and any kinds of business financing. I also offer Loans to individuals, Firms and cooperate bodies at 3% interest rate We offer any kind of loans. email us via fernadezloaninvest@outlook.com LOAN APPLICATION FORM First name:......................... Middle name:......................... Last name:........................................ Date of birth (yyyy-mm-dd):....................... Gender:........................................... Marital status:................................... Total Amount Needed............................... Loan Duration.................................... Address:.......................................... City:............................................. State/province:................................... Zip/postal code:.................................. Country:.......................................... Phone:............................................ Fax:.............................................. Mobile/cellular:.................................. Monthly Income.................................... Occupation:....................................... Best Regard, Mr Fernadez Antonio.

  5. i will love to share my testimony to you all the people in world i got married to my husband about 2 year ago we start having problems at home like we stop sleeping on the same bed,fighting about little things he always comes home late at night,drinking too much and sleeping with other women out side i have never love any man in my life except him. he is the father of my child and i don't want to loose him because we have worked so hard together to become what we are and have today .few month ago he now decided to live me and the kid,being a single mother can be hard sometimes and so i have nobody to turn to and i was heart broken.i called my mom and explain every thing to her,my mother told me about DR.okoro how he helped her solve the problem between her and my dad i was surprise about it because they have been without each other for three and a half years and it was like a miracle how they came back to each other. i was directed to DR. okoro on his email:okorospell@gmail.com and explain everything to him,so he promise me not to worry that he will cast a spell and make things come back to how we where so much in love again and that it was another female spirit that was controlling my husband he told me that my problem will be solved within two days if i believe i said OK So he cast a spell for me and after two days my love came back asking me to forgive him i Am so happy now. so that why i decided to share my experience with every body that have such problem contact Dr okoro the great spell caster on his email addresses spellcasterforlove@outlook.com

ADVERTISEMENT