Kentucky’s ACT college entrance test scores edge up

The ACT scores for the Class of 2012 were released today. There is some good news for Kentucky.

The overall ACT Composite Score for all Kentucky students, including both public schools and students from other educational programs like home school and private schools, have edged up again for the second time since 2010.

What makes this news especially nice is the fact that Kentucky adopted policies (which the Bluegrass Institute supported) with Senate Bill 130 in 2006 that now test all public school students in the state with the ACT.

The policy first impacted the graduating class of 2009. As the table shows, this resulted in an immediate sharp increase in the number of Kentucky graduates who took the ACT.

The participation jump was accompanied by a notable, but expected, drop in the ACT Composite Score of 1.5 points. Similar drops were experienced in other states such as Colorado and Illinois which had adopted full testing of all students several years earlier.

However, the ACT Composite for Kentucky didn’t improve in 2010 as expected, and many held their breath about Kentucky’s policy change as a result.

Finally, in 2011, Senate Bill 130 and another bill, Senate Bill 1 from the 2009 Regular Legislative Session, started to take hold. The second bill dropped our poorly focused CATS assessments and set the state on course to emphasize college and careers in our schools.

The impact of these bills appeared to take hold in 2011 when the overall ACT Composite Score jumped up 0.2 point. Now, the trend is continued in 2012 with another 0.2 point increase, which indicates the improvement in 2011 is not a fluke.

While the improvement is important, it is also important to understand that Kentucky needs to make far more progress if we are going to achieve the goal of getting the vast majority of our students ready for college and careers. The new ACT reports also show how very far we are away from that goal.

The new ACT reports discuss the percentages of all Kentucky students who achieved the ACT Benchmark Scores. Reaching Benchmarks indicate good odds for success in college. The Benchmarks are based on an ACT survey of many colleges. Students who achieve at least the ACT Benchmark Score have about a 75 percent chance of earning a “C” and a 50 percent chance of earning a “B” in their first related course in a typical college.

We are far away from where we want to be. The graph below shows Kentucky’s Benchmark performance for all students, public and private averaged together.

Even in our best subject, English, little more than half of our 2012 graduates are college-ready. For other subjects, the rate of readiness drops rapidly.

So, much remains to be accomplished for our students, but the trend is now established in the right direction.

Stay tuned, because there will be more posted in the blog on the ACT performance, including the public school only and private school only results.

Tech Note: Data above come from multiple years of ACT score releases from the ACT Web Site.

How does college preparation in Kentucky compare to the rest of the nation?

We always get questions about how Kentucky’s education system compares to the rest of the nation. Often, that isn’t such a simple question to answer well.

However, here are some comparisons of the percentages of white and black high school graduates that scored above the college readiness benchmarks in all four ACT tested areas in 2011. To get a reasonably fair comparison, I only show states that had very high participation rates on the ACT (98 percent in North Dakota, 100 percent in the rest).

The first graph shows how our whites compare to whites in other high ACT participation states. Data in this and the next graph come from the individual ACT Profile Reports for each state.



Notice that even in top performing states like Illinois and Colorado only about one in three graduates was fully prepared to enter a liberal arts college program. In Kentucky, less than one in five graduates was adequately prepared for a liberal arts program in a typical US college.

Now, here is the depressing information on black preparation.



As you can see, even in the top performing states in this graph, fewer than one in 10 black high school graduates from the Class of 2011 was adequately prepared for a typical liberal arts college program.

In Kentucky, fewer than one out of 20 blacks were fully college-ready.

You might wonder why I only look at states with high participation rates on the ACT and why I break this out by race.

Click the “Read more” link below to find out.

Part of the problem in comparing education programs from state to state involves Kentucky’s very unique student demographics. Those can be extracted from several sources including the ACT, Incorporated’s “The Condition of College and Career Readiness” reports for each state.

We can get more information from the Data Explorer for the National Assessment of Educational Progress (NAEP).

These sources tell us that Kentucky is:

• Heavily white (about 79% per ACT in 2011),

• Very low minority population (about 9% black and very small percentages for other races per ACT) and

• Relatively high poverty (50% per the 2009 NAEP based on school lunch eligibility of fourth graders who took the reading assessment, though 14 states had even higher poverty, including Louisiana with 70% poverty).

Also, our former state testing program was Kentucky-unique – CATS could not be compared to results from any other state.

Even with the NAEP, demographic differences make valid comparisons challenging, as you can discover here.

There are additional issues to consider in comparing Kentucky’s performance from the ACT college entrance test to performance in other states. Aside from those cited above, all students in Kentucky’s public schools now take the ACT, while in other states participation in 2011 varied dramatically from a low of only nine percent in Maine to 100 percent in Kentucky and seven other states. Adding to that situation, the data available from the ACT, Incorporated averages together results for all students in each state: public, private and home school.

As I showed earlier with a Kentucky example, the public school only performance in any state could be different from the overall averages. This makes it more difficult to extract valid conclusions about KERA, for example, from the data released by ACT.

As a consequence of all of this, when the ACT, Incorporated compares college readiness information for Kentucky to the national averages, we need to consider that the comparison might put our state to a disadvantage. Nationwide, most students self-select to take the ACT, and only about half the Class of 2011 chose to do so. Comparing scores for only the top half of the class nationwide to scores for Kentucky where virtually all students took the assessment isn’t going to give us a highly accurate picture.

Still, if you still want to see those somewhat “apples to oranges” comparisons the ACT, Incorporated has assembled, you’ll find them in “The Condition of College and Career Readiness | 2011 – Kentucky.”

To reiterate, the presentations are interesting, but they must be considered with some caution.

I think there is more value in the presentations that only compare Kentucky to itself over time since 2009, the first year all of our graduates took the ACT. Here is one of those graphs, which covers only Kentucky, with the pre-100 percent participation years shaded out because that data isn’t fairly comparable to the more recent figures.



As you can see, the percentages here are all quite low, and these only show the percentages meeting three out of four – not all four – college readiness benchmarks.

Furthermore, the progress over time is very slow, as well.

Clearly, we need to do something to kick our schools into a higher gear.

How many Kentucky high school grads in 2011 were prepared for college and careers?

Not many

This graph, which I developed from data in the Kentucky Department of Education’s news release 11-067 about the 2011 ACT scores, tells the tale (click on it to enlarge).



Note that I only include years where Kentucky conducted 100 percent testing of all graduates.

Also, keep in mind that the benchmarks are developed by ACT after a survey of a number of colleges that use this assessment for admissions. Thus, the benchmarks represent an average level of rigor across a number of different colleges. Students with lower scores might survive in colleges with lower levels of rigor, but their educations will probably be of lesser quality, as well. On the other hand, students will need even higher performance to survive in more demanding schools.

Currently, a little more than half of our students are going on to postsecondary education. It looks like most of them are ready for a freshman college English composition course.

However, in math, only one in four Kentucky public high school graduates is ready for college algebra, generally the minimal math requirement for most degrees except elementary school teachers (and, that is a mistake I have often commented about before).

Only two out of five Kentucky public high school graduates read well enough to survive a freshman social studies course in a typical university.

Less than half of our college bound students are likely to survive in freshman biology or another science course.

Finally, only 14 percent of our graduates are fully prepared for a liberal arts education across all four areas.

As you examine the graph, you will see that progress so far is coming at a painfully slow rate, generally improving by only a percentage point or two over the past three years. We need to jump start this process if we are going to do justice to our kids, who are about to enter a very changed adult world where yesterday’s education simply will no longer do.