Category Archives: Research Insights

Do standards actually work?

Do standards work blog
Raise the bar and raise performance. For 20 years, that principle has guided school reform efforts in the United States and abroad. Since the early 90s, every U.S. state has developed systems standards, student testing on those standards, and accountability for results on those tests. More recently, 46 states have signed on to Common Core standards, which promise to raise the bar even higher.

A new report from Harvard University, however, may cast some doubt on whether tougher state standards actually raise student performance.

The study analyzed third-party ratings for state standards—and in particular, changes in those ratings—with changes in statewide student achievement data from 1994–2011.

One problem with this kind of analysis is that the two organizations that rate standards (Fordham Foundation and the American Federation of Teachers) don’t agree on much, including how they rate state standards. For example, AFT’s ratings appear to suggest that nationwide, mathematics standards rose in quality in the 90s, peaked around 2001, and then declined. Fordham’s ratings, on the other hand, suggest that mathematics standards nationwide flat-lined until about 2006, when they sharply improved.

Nonetheless, Harvard researchers found that irrespective of the ratings systems they used, no correlation existed between changes in ratings and student performance—even when allowing a three-year lag for better standards to translate into better learning.

The researchers offered two conclusions for the generally weak link between standards and achievement. First, it’s possible the ratings themselves are not terribly accurate measures of the quality or rigor of standards (after all, the two organizations can’t seem to agree on what good standards look like).

A second explanation, though, is that more rigorous standards don’t necessarily “translate into the pedagogical changes necessary to influence student achievement” (p. 7). In other words, simply because states adopt new standards, curriculum and textbooks don’t necessarily change, nor do teaching techniques.

One important bright spot did emerge in the analysis, though. When low-scoring states improved their standards, low-income, minority eighth graders in those states demonstrated higher levels of performance. So perhaps the better standards served as something of a “shock treatment,” raising if not the ceiling, at least the floor on student performance. That is, of course, a laudable outcome.

Yet it remains an open question whether standards have raised the performance of all students across the board, including top performers. As I’ll explore in my next blog, when we dig deeper into international comparisons of student performance data, an alarming picture emerges of how well America’s top-performing students stack up to their counterparts abroad.

How effective have standards been at raising expectations and student outcomes in your district, school, or classroom?

Bryan Goodwin, Vice President of Communications, Marketing and New Business Development

Early childhood obesity: What can educators do?

Obesity is the health epidemic of our time, and it seems that everyone—from the mayor of New York to the Walt Disney Company—is trying to do something about it. While trying to change the unhealthy habits of adults is often viewed as an infringement on personal freedom, there isn’t much argument against doing so for young children. When Disney decided it would no longer allow junk food advertising during its programming aimed at preschoolers, it was lauded by none other than First Lady Michelle Obama.

But it takes more than advertising to prevent obesity—and healthy habits include not only eating and drinking but also physical activity. Children ages 2‒5, according to guidelines put forth by the National Association for Sport and Physical Education in 2002, should be getting a minimum of two hours of exercise a day, including 60 minutes of structured physical activity and 60 minutes of unstructured physical activity. But the reality is that most of children’s time at preschool is not active, due to the school’s lack of space, equipment, time, or staff members with the right training.

Let Me Play is a comprehensive program implemented in Head Start classrooms across the country that offers training to teachers and provides them with developmentally appropriate activities that can be easily incorporated into existing curriculum. An evaluation of the program conducted by McREL found that it improved teachers’ knowledge of and attitudes toward physical education and health content and increased the levels of activity, skill, and motivation in children.

Preschools that want to incorporate developmentally appropriate physical activity in their curriculum should find ways for teachers to collaborate on ideas for activities and make sure they’re comfortable with implementation. Also, programs can monitor implementation using tools like the Physical Education Rating Scale (available for download from Amazon).

Do you think physical activity should be required in preschool? What else can schools do to encourage healthy habits?

Written by Heather Hein, writer and editor, and Sheila Arens, senior director, at McREL.

What I wish I had known about student motivation

Years later, while digging into research on student motivation, I realized what I had gotten wrong. Stanford psychologist Carol Dweck has shown that telling students they are smart actually lowers their motivation and achievement. In an experiment, Dweck and her colleagues treated two groups of students quite differently.

Read More

Teachers still want “apples”

When teachers enter the field, they have high expectations of making a difference. Too often, however, they quickly realize that they don’t have the professional support, feedback, resources, or modeling of what it takes to help their students succeed.

Read More

The American tradeoff: More teachers, lower salaries

According to a recent analysis, compared to an average teacher, a good teacher (in the 84th percentile) generates as much as $400,000 in increased future earnings for her class of 20 students. So if we define the benefits of teachers in financial terms alone, it would appear that paying six figures to attract and retain great teachers in the classroom might be defensible given the three- to four-fold return on that investment for society.

So why don’t we pay teachers more?

One might assume it’s because we invest too little in public education. The reality, though, is quite the opposite. As I note in my latest column in Educational Leadership, the Organisation for Economic Cooperation and Development reports that in the last 40 years the United States has more than doubled its spending on K–12 education and now outspends almost every other country in the world—devoting 4 percent of GDP to K–12 education compared with, for example, Japan’s 2.6 percent.

Strangely, though, while more dollars were funneled to education, average teacher salaries actually declined about 2 percent per year since 1970 when calculated in terms of per capita GDP. U.S. teacher salaries now rank fourth from the bottom among 34 competitor countries in terms of teachers’ relative spending power.

It’s probably no coincidence that this decline in salaries occurred at the same time that U.S. schools went on a hiring spree. Between 1980 and 2007, the number of teachers increased by 46 percent, more than twice the rate of student enrollment growth (21 percent). As a result, teacher-student ratios fell from 18.7 to 15.7. However, had they remained constant and funding increases had been funneled into teacher salaries, the average teacher would now make $78,574, instead of $52,578.

Class-size reduction initiatives have been one of the driving forces in creating our uniquely American teaching corps of low-salaried classroom teachers teaching smaller classes amid a supporting cast of higher-paid specialists. Yet as John Hattie notes in Visible Learning, reducing class sizes—from say, 25 to 15 students—still has only a small effect on student achievement. And even that small benefit assumes that teacher quality remains constant as districts scramble to fill vacancies for teachers.

Certainly, smaller classes make managing behavior and grading papers less burdensome for teachers. But when given the choice between having a few more students and making a few thousand dollars more per year, most rank-and-file teachers would gladly accept the larger classes and paychecks. As Marquerite Roza, a researcher at the University of Washington, reports in her book Educational Economics, a study in Washington State asked teachers if they preferred a $5,000 raise, class size reduction, a teacher’s aide, or increased preparation time (four investments of roughly equal value). Fully 83 percent of teachers said they preferred a raise over class-size reduction, 88 percent preferred a raise to a teacher’s aide, and 69 percent preferred the raise to increased preparation time.

While no one goes into teaching to get rich, it’s clear that great teachers are worth a great deal more than most are currently paid. So perhaps it’s time we re-think our approach to smaller classes (and smaller teacher salaries) so that we can find and reward great teachers with salaries that reflect their real benefit to students and society.

Easy antidote to grade inflation?

As I wrote recently in Educational Leadership, grade inflation appears to be a real phenomenon with costly consequences for students. From 1992–2006, the percentage of American high school students who reported earning an A or A-minus average nearly doubled (from 18.3%–32.8%). An analysis of student work in Oregon concluded that most high school students receiving Bs (and many receiving As) are not doing work on par with college expectations for entry-level students. Perhaps as a result, more than 30 percent of freshmen drop out of college each year, costing taxpayers in excess of $1 billion per year in wasted grants and state appropriations to colleges.

Is there any way to stop grade inflation? One solution, some offer, is to open up the “black box” of teacher grades, which can be as carefully guarded as secret recipes, making it difficult to determine what actually goes into a student grade. As a result, one teachers’ A can be another’s C grade.

More than 20 years ago, in Spain’s Basque Country, a small high school stumbled onto what appears to be a simple antidote to grade inflation. In 1990, a small school in the Gipuzkoa province purchased new software that began automatically placing on report cards, with little apparent forethought from school officials, information about where students stood relative to the average grade in their class. Immediately, student grades shot up 5 percent (an increase, according to researchers who later analyzed the school’s data, on par with lowering class sizes from 22 to 15). Presumably, as students and their parents began to understand that a grade of say, an 85, wasn’t all that special compared to other students in the class, they began to work harder. And as a whole, the entire school began to perform better on Spain’s national exam.

Incidentally, this sort of value-neutral information about students’ relative performance is exactly the kind of feedback that motivation researcher Edward Deci has noted strikes the perfect balance between providing information to guide performance while not diminishing motivation by coming across as coercing, such as saying to a student, “You should work harder in my class.” Reporting how students are doing relative to their peers seems to be a simple way to open up the black box of grades while inspiring students to work harder. It encourages a student to think, “If the average grade in my class is 85, surely I can do at least that well … if not better.”

For the school in Spain, though, there was one problem.

After just one year, parents and teachers complained that the information was creating too much competition among students. Average class grades were removed from report cards and student performance swiftly sank back to prior levels.

What do you think? Should revealing where students stand relative to their peers be encouraged … or shunned?


Killing with kindness?

For as long as letter grades have been around, so too, have fears of grade inflation. As far back as the 1890s, Harvard University professors were wringing their hands about students earning “sham” grades that would “seriously cheapen” the university’s reputation if the outside world were to learn of them.

Read More

The next frontier of education: Implementation

In my latest “research says” column in Educational Leadership, I report that a new slew of “gold-standard” studies has unearthed (somewhat inadvertently) that in a lot of cases, educators really aren’t very good at the whole implementation thing. The studies, commissioned by the Institute for Education Sciences within the U.S. Department of Education, were carefully constructed with impressive sample sizes and rigorous statistical analyses. They found little or no effects for several popular education programs, such as Odyseey Math and Rick Stiggins’ Classroom Assessment for Student Learning.

Yet, almost without exception, the programs in question were so poorly implemented that it’s difficult to determine if they—or the poor implementation—were the reason for the weak results. In other words, the programs might have actually worked had they only been implemented with fidelity.’

This may be true of many education approaches and reforms, which ultimately get thrown on the trash heap because we believe they don’t work, when in reality, they may work just fine when they’re implemented well.

On the upside, we have seen a lot of improvements in education (for example, great teaching and curricula that challenge and engage students, to name just two) that can have a tremendous impact on student success … when done well. In fact, most of the big impact approaches aren’t new at all. For decades, we’ve known that teachers setting high expectations, being a “warm demander,” and intentionally matching instructional strategies to learning goals really do work. We just need to do these things correctly and stick to them.

Educators might take some solace in knowing that they’re not alone in struggling to do what everyone knows must be done. Businesses have the same trouble. Everyone in the airline industry knows Southwest Airline’s open secrets of success, such as their “all aboard” seating; yet few, if any, competitors have been able to effectively follow Southwest’s formula. Doing things right, of course, is a thorny challenge. Yet, it’s not impossible—in fact, we know quite a lot about the keys to good implementation.

So the good news is this: we don’t need to wait for silver bullets, or Superman, or some yet-to-be invented innovation to improve our schools. As we show in the video below, we simply need to do better what decades of research says matters most to change the odds for student success.

Bryan Goodwin is the author of a new book from ASCD, Simply Better: Doing What Matters Most to Change the Odds for Student Success.

Saying no to fads—in dieting and education reform

Simply Better: What Matters Most to Change the Odds for Student Success offers not a new “fad diet” for education, but rather the education reform equivalent of a “healthy lifestyle”—those things that decades of research says are most likely to have a big effect on student achievement.

Read More