Pages

Showing posts with label NAEP. Show all posts
Showing posts with label NAEP. Show all posts

Thursday, November 12, 2015

Vic’s Statehouse Notes #236 – November 12, 2015

Dear Friends,

This is a crucial moment in the history of education in Indiana. Three developments are colliding:

1) The 2015 National Assessment scores recently announced have shown that Indiana schools have never performed better.
2) The new, more difficult ISTEP+ tests have produced some of the lowest pass rates ever seen since annual comparisons began in 1997.
3) Governor Pence faces a crucial decision about whether to punish Indiana schools with low letter grades due to the drop in pass rates during this transition to a more rigorous test.
Three historic story lines have converged to put Governor Pence’s education policies and the future of our teachers and schools in crisis mode. Here are details about each story.

Story #1: Student achievement has reached historically high levels in 2015.
  • According to the National Assessment of Educational Progressive, known as “the nation’s report card”, Indiana 4th and 8th graders have scored higher than ever in reading. The federal NAEP testing program first reported Indiana scores in 1992, and the 2015 results for Indiana are the best ever.
  • In 2015, 75% of Indiana 4th graders passed the basic standard in reading, compared to 68% in the US as a whole. On the proficient standard, 40% passed compared to a US mark of 35%. In 8th grade, 80% passed the basic standard compared to 75% nationally, and 37% passed the proficient standard compared to the national mark of 33%.
  • In math, the 2015 results for Indiana nearly matched the historically high marks set in 2013, and actually surpassed previous results on the proficient standard. On the basic standard, 89% of Indiana’s 4th graders passed compared to 81% in the US, and 50% passed the proficient standard compared to 39% nationally. In 8th grade, 77% passed the basic standard compared to the US mark of 70%, and 39% passed the proficient standard compared to 32%.
  • These high marks have improved Indiana’s ranking among states to historic highs: 10th in 4th grade reading (up from 15th) and 16th in 8th grade reading (up from 27th). In math, 4th graders remain 4th in the nation and 8th graders are now 11th (up from 19th).
  • The complete table showing all of Indiana’s NAEP results since 1990 can be seen in Table 6 in the attachment. It is worth a look and a moment of celebration for great work by our students and educators!
Story #2: The new ISTEP+ scores for 2014-15 show historically low passing rates due to the new cut scores just adopted for the more difficult ISTEP+ tests. Ironically, these historically low results come in the same month as the historically high results on the national NAEP exam.
  • In English, pass rates approved by the State Board on October 28th plunged by an average of 15% for grade 3-8 from the previous year (2013-14) in a year that NAEP declared to be a superb year of achievement in Indiana.
  • In math, pass rates dropped even more, by an average of 23% in grades 3-8 from the previous year.
  • The State Board approved adjusting cut scores to compensate for those taking ISTEP+ online, which has been found to be more difficult than paper and pencil tests. These adjustments will bring pass rates up a bit, but the historic drop in pass rates remains clear.
  • To get the full impact of the enormous and historic drop in pass rates in this transition, take a moment to examine the pass rates for each grade level in Tables 7 and 8 in the attachment, which show complete ISTEP results for each grade level going back to the first year, 1997. After reviewing these data, it is absolutely clear that this transition is unlike any year Indiana students and schools have ever experienced in this era of testing.
  • The new ISTEP+ results must be treated as a new baseline and must not be compared to the previous year. Comparisons to the previous year are simply not fair. Since A-F grades include comparisons to the previous year, they would not be fair. Educators must make every effort to help the public and to help politicians understand this concept.
Story #3: With record setting high achievement on NAEP proving to all observers that the dip in ISTEP+ pass rates is due to a tougher new ISTEP+ test and not due to poor teaching or poor performance, Governor Pence has been put on the spot to reverse his opposition to a transition year “hold harmless” plan which would prevent penalties to teachers or to schools due to higher expectations and low pass rates.
  • Under pressure to prevent these low pass rates from harming teachers, Governor Pence announced with great fanfare a letter on October 27th sent to the State Board of Education saying that at his request “legislation is being crafted to ensure that test results will not negatively impact teacher evaluations or performance bonuses this year.”
  • His letter did not directly say that school letter grades would be protected in the same way. The Indianapolis Star reported on November 12th (page 3A): “The Republican governor also said this week his administration is exploring ways A-F accountability grades could be modified because of the scores.”
  • Legislative leaders did not leap to quickly endorse the Governor’s plan for legislation. Indeed, some voucher-supporting legislative leaders wouldn’t mind seeing more schools get F’s because more students would then be eligible for private school vouchers in those F school attendance areas.
  • Representative Behning, chair of the House Education Committee, said in the same November 12th article in the Star regarding the A-F system: “It would be my personal opinion that we don’t totally suspend it, but maybe we have a position of where we minimize the amount of fall (a school) could have if they had a fall.”
  • State Superintendent Ritz has called for a “hold harmless” policy for over a year, but the Governor’s State Board of Education members control the policies. At one State Board meeting earlier this year, the Governor’s members curtly voted to take the subject off the agenda as the meeting opened to eliminate even a discussion of the problem.
  • Months ago, Secretary of Education Arne Duncan said that a one year pause in accountability due to the increase rigor of tests would be understandable to federal officials.
  • Dr. Gregory Cizek, a testing expert from North Caroline brought in by Representative Behning and Senator Kruse to the Interim Study Committee on Education on September 29, 2015 recommended that new tests should not used for accountability purposes for three years.
These three stories provide the context for three questions to be answered soon:

1) Will the General Assembly take action to protect teacher evaluations and teacher bonuses from the lower ISTEP+ passing scores, as the Governor has requested?
  • Action could be taken as early as Organization Day on November 17th as recommended in a proposal by State Senator Mark Stoops, described in the November 12th Star article. He states that the “law requires the state to send performance pay to school districts before December 5.”
  • Representative Behning, according to the same November 12th article, “plans to introduce a proposal that he feels is consistent with what Pence has outlined—but to expect it when the legislature returns in January.”
2) Will the General Assembly take action on Organization Day or in January to protect schools from sharply lower school letter grades based on the lower ISTEP+ passing scores, as the Governor has hinted but not directly requested?
  • Many do not realize that the school letter grade formula to be used again this year is the same flawed formula pushed in place by Dr. Bennett in 2012 and theoretically voided by a displeased General Assembly in 2013.
  • Despite the 2013 law and the consensus that the current A-F system is deeply flawed, it is still in use for this one more round of school letter grades.
  • One reason it was considered flawed was that it relied almost completely on the percent passing the test and gave only minor attention to year-to-year student growth. With the percentage passing falling precipitously this year as expected due to higher standards and a more difficult test, school letter grades are sure to drop as well, an artificial drop due to the reset of the test.
3) Will the Governor change his mind and finally agree with State Superintendent Ritz that this year should be treated as a transition year in testing with no negative consequences either for teachers or for schools?
  • For Statehouse posturing, there is no doubt that Governor Pence does not want to appear to be changing his mind to agree with State Superintendent Ritz on this.
  • His October 27th statement has already shown that he has changed his mind enough to agree with her regarding protecting teacher evaluations and teacher bonuses. He apparently did not want individual teachers to blame him for their failure to get a bonus.
  • If he doesn’t extend the same protection to school letter grades, he will be blamed for the low grades given to many schools and for helping private schools get more voucher students due to many schools receiving F’s for the first time. Under the voucher law, all students living in the attendance area of an F school, including those already enrolled in private schools, become eligible for a free voucher to attend private schools.
  • If he does extend the same protection to school letter grades, he will be chided for waiting for a full year before seeing the light and agreeing with the State Superintendent.
The Governor has painted himself into a corner on school letter grades. Regardless of that and now that the huge drops in passing rates are clear, he should do the right thing and endorse a transition year plan which will not hurt schools with an artificially low letter grade in a year when the National Assessment has told us that Indiana students are achieving higher than they have ever achieved on the highly respected “nation’s report card.”

I urge all public school advocates to communicate with Governor Pence and with their legislators or with all legislators to say that transition year test scores should not penalize teachers in their performance bonuses and also should not penalize schools in their letter grades.

The status of both teachers and schools should be held harmless while new baseline test scores are reset.

Thank you for your advocacy for public education!

Best wishes,

Vic Smith


“Vic’s Statehouse Notes” and ICPE received one of three Excellence in Media Awards presented by Delta Kappa Gamma Society International, an organization of over 85,000 women educators in seventeen countries. The award was presented on July 30, 2014 during the Delta Kappa Gamma International Convention held in Indianapolis. Thank you Delta Kappa Gamma!


ICPE has worked since 2011 to promote public education in the Statehouse and oppose the privatization of schools. We need your membership to help support ICPE lobbying efforts. As of July 1st, the start of our new membership year, it is time for all ICPE members to renew their membership.

Our lobbyist Joel Hand continues to represent ICPE during the interim study committee meetings. Our work in support of public education in the Statehouse goes on as we prepare for the short session beginning in January. We welcome additional members and additional donations. We need your help and the help of your colleagues who support public education! Please pass the word!

Go to www.icpe2011.com for membership and renewal information and for full information on ICPE efforts on behalf of public education. Thanks!


Some readers have asked about my background in Indiana public schools. Thanks for asking! Here is a brief bio:

I am a lifelong Hoosier and began teaching in 1969. I served as a social studies teacher, curriculum developer, state research and evaluation consultant, state social studies consultant, district social studies supervisor, assistant principal, principal, educational association staff member, and adjunct university professor. I worked for Garrett-Keyser-Butler Schools, the Indiana University Social Studies Development Center, the Indiana Department of Education, the Indianapolis Public Schools, IUPUI, and the Indiana Urban Schools Association, from which I retired as Associate Director in 2009. I hold three degrees: B.A. in Ed., Ball State University, 1969; M.S. in Ed., Indiana University, 1972; and Ed.D., Indiana University, 1977, along with a Teacher’s Life License and a Superintendent’s License, 1998. In 2013 I was honored to receive a Distinguished Alumni Award from the IU School of Education, and in 2014 I was honored to be named to the Teacher Education Hall of Fame by the Association for Teacher Education – Indiana.

###

Monday, December 9, 2013

Vic’s Statehouse Notes #161 – December 6, 2013

Dear Friends,

National Assessment test results released in November showed that Indiana students performed very well in comparison to national averages. This has happened several times before, a positive story that few have noticed. All in all, Indiana’s performance on NAEP (National Assessment of Educational Progress) has been an overlooked story of improvement in Indiana’s public schools over the past 20 years.

Politicians, including Dr. Bennett, have tried to claim this year’s NAEP success as evidence of the success of recent reform efforts, but the details below will show that improvement on NAEP reprises similar gains made in 1996, 2003 and 2007.

Data also clearly show a bigger gain among 4th graders than among 8th graders. This result is likely to be linked to data presented by Dr. Richard Hill to the State Board on September 4th that 2500 3rd graders were retained and tested again as 3rd graders due to retention rules pushed through by Dr. Bennett. Previously, about 600 were retained in 3rd grade each year. Taking approximately 2000 students who could not pass ISTEP out of the 4th grade cohort could go a long way to explain why 4th grade scores on the National Assessment noticeably went up.

Findings for 2013

Indiana began participation in the National Assessment in 1990. NAEP identifies a stratified random sample of students to take the test, generally given every two year. It is known as “the nation’s report card” from a time when politicians thought it would not be necessary to test every child to see how the schools were doing. National Assessment has survived as a respected measure while “No Child Left Behind” results initiated in 2002 have already faded in disrepute and waivers.

There was a time in the 1990’s when participation was optional at the local level, but that discretion ended when PL221 was passed and participation in NAEP testing was required by rules passed by the Indiana State Board of Education. The data below therefore show every result that Indiana has recorded in the NAEP testing program.

Diane Ravitch, in an article entitled “The Myth of Charter Schools,” has described the meaning of the basic, proficient and advanced standards used to report National Assessment results:
“I served as a member of the governing board for the national tests for seven years… The highest level of performance, “advanced,” is equivalent to an A+, representing the highest possible academic performance. The next level, “proficient,” is equivalent to an A or a very strong B. The next level is “basic,” which probably translates into a C grade.”
Since 2000, I have reported NAEP results at the basic and proficient level in my annual report on improvement in Indiana’s public schools. The most recent full report from June 2013 and a new update on NAEP data are both available for those who want all the data. With this background about the National Assessment, consider now the 2013 results for Indiana in their historical context.

Grade 4 Math – Basic Standard: % AT OR ABOVE BASIC

...............................................INDIANA..........US........IN:US GAP
Mathematics..Gr.4 1992.........60%...........57%...........+3
.........................Gr.4 1996.........72%...........61%...........+11
.........................Gr.4 2000.........77%...........64%...........+13
.........................Gr.4 2003.........82%...........76%...........+6
.........................Gr.4 2005.........84%...........79%...........+5
.........................Gr.4 2007.........89%...........81%...........+8
.........................Gr.4 2009.........87%...........81%...........+6
.........................Gr.4 2011.........87%...........82%...........+5
.........................Gr.4 2013.........90%...........82%...........+8

The 2013 Indiana math results showed a solid improvement of 3% among 4th graders on the basic standard. The historical record above shows that even bigger 5% gains were recorded in 2007, 2003 and 2000. In 1996, an eye-popping 12% gain was recorded in 1996 when Project Primetime was actively reducing class sizes in the early grades. Indiana’s advantage over the national average reached +8% in 2013, a level reached or exceeded previously in 2007, 2000 and 1996. Note that Indiana has been higher than the national average on every assessment on this table.

Grade 4 Reading – Basic Standard: % AT OR ABOVE BASIC

...............................................INDIANA..........US........IN:US GAP
Reading ....... Gr.4 1992.........68%...........60%........... +8
........................Gr.4 1994.........66%...........59%........... +7
........................Gr.4 2002.........68%...........62%........... +6
........................Gr.4 2003.........66%...........62%........... +4
........................Gr.4 2005.........64%...........62%........... +2
........................Gr.4 2007.........68%...........66%........... +2
........................Gr.4 2009.........70%...........66%........... +6
........................Gr.4 2011.........68%...........66%........... +2
........................Gr.4 2013.........73%...........67%........... +6

The 2013 Indiana reading results showed a 5% improvement over the previous test, 1% higher than the previous highest gain of 4% in 2007. Indiana’s advantage over the national average reached +6% in 2013, a level reached or exceeded previously in 2009, 2002, 1994 and 1992. Note that Indiana has been higher than the national average on every assessment on this table.

Grade 8 Math – Basic Standard: % AT OR ABOVE BASIC

...............................................INDIANA..........US........IN:US GAP
Mathematics..Gr.8 1990.........56%...........51% ...........  +5
.........................Gr.8 1992.........60%...........56% ...........  +4
.........................Gr.8 1996.........68%...........59% ...........  +9
.........................Gr.8 2000.........74%...........62% ...........  +12
.........................Gr.8 2003.........74%...........67% ...........  +7
.........................Gr.8 2005.........74%...........68% ...........  +6
.........................Gr.8 2007.........76%...........70% ...........  +6
.........................Gr.8 2009.........78%...........71% ...........  +7
.........................Gr.8 2011.........77%...........72% ...........  +5
.........................Gr.8 2013.........77%...........73% ...........  +4

The 2013 Indiana math results for Grade 8 showed no change from the previous test in 2011 on the basic standard. The historical record above shows that Indiana’s advantage over the national average was +4 in 2013, a figure equaled or exceeded in every test to date. In 2000, Indiana recorded a double digit advantage over the nation of +12. Note that Indiana has been higher than the national average on every assessment on this table.

Grade 8 Reading – Basic Standard: % AT OR ABOVE BASIC

...............................................INDIANA..........US........IN:US GAP
Reading ....... Gr.8 2002.........77%...........74%........... +3
........................Gr.8 2003.........77%...........72%........... +5
........................Gr.8 2005.........73%...........71%........... +2
........................Gr.8 2007.........76%...........73%........... +3
........................Gr.8 2009.........79%...........74%........... +5
........................Gr.8 2011.........78%...........75%........... +3
........................Gr.8 2013.........79%...........77%........... +2

The 2013 Indiana reading results for Grade 8 showed a 1% gain over the 2011 test on the basic standard, equaling the 79% level reached once before in 2009. The historical record above shows that Indiana’s advantage over the national average in 2013 was +2, a figure equaled or exceeded in every test to date. Note that Indiana has been higher than the national average on every assessment on this table.

Proficient Standard Attached

By now, if you are still reading, you have probably seen enough numbers for a while. The conclusions are clear. On the Basic standard, the one Diane Ravitch equated to a “C”, the Grade 4 scores jumped up noticeably, while the Grade 8 scores remained stable. On the Proficient standard, equated to “an A or a very strong B”, there is a similar set of numbers which show a higher gains in Grade 4 than in Grade 8. You can examine the attached NAEP results for the Proficient data if you are so inclined.

This raises a key question: Why are Grade 4 gains noticeably higher that Grade 8?

The ISTEP Report from Dr. Richard Hill

Dr. Richard Hill was the national testing expert retained by the Indiana Department of Education to review the CTB/McGraw online testing debacle last spring. His report to the General Assembly last summer and to the State Board of Education on September 4th revealed that Grade 4 ISTEP scores went up while Grade 3 scores went down. This Grade 3 result contradicted his finding that in general scores at every grade followed trends of previous years in support of his overall conclusion that the online disruptions did not invalidate the Spring ISTEP tests, so he looked more closely at the 3rd and 4th Grade data.

He reported that 2500 Grade 3 were retained and retested as Grade 3 students, whereas in past years approximately 600 had been retained. This, he said, could account for the drop in Grade 3 scores and the rise in Grade 4 scores unrelated to the online disruptions.

This documentation also could account for rising test scores on NAEP in Grade 4 and would explain why an equally strong gain was not seen in Grade 8 NAEP scores. If Indiana took nearly 2000 ISTEP-failing students out of the Grade 4 cohort of approximately 75,000 for the 2013 NAEP tests, anyone would expect the 4th grade tests to get a noticeable bump up. The same effect was not active for Grade 8 scores, which showed stable and only modest gains, as seen on the NAEP table attached. You can examine the scores and draw your own conclusion. I believe it is clear that a smaller Grade 4 cohort cleansed of IREAD-failing students would account for noticeable gains on NAEP in Grade 4 and much greater gains in Grade 4 than in Grade 8.

This analysis debunks the claims of those who say a reform agenda of private schools vouchers, 3rd grade reading promotion tests and merit pay created higher NAEP scores.

It Worked for Florida

Governor Daniels and State Superintendent Bennett invited Jeb Bush and other Florida leaders to the September 2009 meeting of the Indiana Education Roundtable to tout the reforms in Florida that Indiana might adopt, especially a reading test for promotion to 4th grade. The validation of the Florida program was entirely based on NAEP gains in 4th grade reading. Elaborate data graphs about Florida’s gains were presented, showing positive results for every subgroup.

No one mentioned that day that reducing the Grade 4 cohort by several thousand Grade 3 retentions had influenced the positive Florida results on Grade 4 NAEP.

No one mentioned that day that Indiana’s 4th graders have had a long record of consistently higher NAEP scores in math when compared to Florida’s 4th graders.

No one mentioned that day that Indiana’s 8th graders have had a long record of consistently higher NAEP scores in both reading and math when compared to Florida’s 8th graders.

A masterful marketing job was mounted using only 4th grade NAEP reading results, propelling passage in the 2010 session of the reading law which Dr. Bennett used to create IREAD tests to determine promotion to 4th grade. The program lives on. When Superintendent Ritz was presenting her proposed changes to the reading program in the July State Board meeting of this year, Dan Elsener interrupted her presentation and her plan was tabled, perhaps permanently.

One can well imagine that a plan to export Indiana’s reform package of vouchers, merit pay and 3rd grade reading tests based on NAEP success has been considered, following the model of Florida. That thought gives more importance to understanding NAEP results as I have presented them above in their complete historical context.

Thanks for your support and actions on behalf of public education!

Best wishes,

Vic Smith


ICPE is working to promote public education and oppose the privatization of schools in the Statehouse. We are preparing for the next session of the General Assembly beginning in January. Joel Hand will again serve as ICPE lobbyist for the session. We need your membership to help support his work. Many have renewed their memberships this fall, and we thank you! If you have not done so since July 1, the start of our new membership year, we urge you to renew by going to our website.

We need additional support to carry on our advocacy for public education. We need additional members and additional donations. We need your help!

Go to www.icpe2011.com for membership and renewal information and for full information on our three ICPE membership meetings this fall. Thanks!


Some readers have asked about my background in Indiana public schools. Thanks for asking! Here is a brief bio:

I am a lifelong Hoosier and began teaching in 1969. I served as a social studies teacher, curriculum developer, state research and evaluation consultant, state social studies consultant, district social studies supervisor, assistant principal, principal, educational association staff member, and adjunct university professor. I worked for Garrett-Keyser-Butler Schools, the Indiana University Social Studies Development Center, the Indiana Department of Education, the Indianapolis Public Schools, IUPUI, and the Indiana Urban Schools Association, from which I retired as Associate Director in 2009. I hold three degrees: B.A. in Ed., Ball State University, 1969; M.S. in Ed., Indiana University, 1972; and Ed.D., Indiana University, 1977, along with a Teacher’s Life License and a Superintendent’s License, 1998.

###