[mobile site, backup mobile]
[SoapBlox Help]
Menu & About Calitics

Make a New Account

Username:

Password:



Forget your username or password?

- About Calitics
- The Rules (Legal Stuff)
- Event Calendar
- Calitics' ActBlue Page
- Calitics RSS Feed
- Additional Advertisers


View All Calitics Tags Or Search with Google:
 
Web Calitics

Wire Services
Advertise Liberally Blue CA Ad Network

Teachers Take Issue With LA Times "Evaluations"

by: Robert Cruickshank

Mon Aug 16, 2010 at 14:30:00 PM PDT


In a major front-page story on Sunday, the Los Angeles Times rated teachers based on student test scores they'd obtained from the LAUSD:

Seeking to shed light on the problem, The Times obtained seven years of math and English test scores from the Los Angeles Unified School District and used the information to estimate the effectiveness of L.A. teachers - something the district could do but has not.

The Times used a statistical approach known as value-added analysis, which rates teachers based on their students' progress on standardized tests from year to year. Each student's performance is compared with his or her own in past years, which largely controls for outside influences often blamed for academic failure: poverty, prior learning and other factors.

Though controversial among teachers and others, the method has been increasingly embraced by education leaders and policymakers across the country, including the Obama administration.

Although the Times article later acknowledges the limitations of this method, they still plowed right ahead and are using it - with the names of actual LAUSD teachers - to evaluate teachers in a massively public way:

No one suggests using value-added analysis as the sole measure of a teacher. Many experts recommend that it count for half or less of a teacher's overall evaluation....

Nevertheless, value-added analysis offers the closest thing available to an objective assessment of teachers. And it might help in resolving the greater mystery of what makes for effective teaching, and whether such skills can be taught.

As most of you know, I was a teacher myself, teaching history and political science at the University of Washington and at Monterey Peninsula College from 2002 to 2009. I love teaching and hope to do more of it someday. I also taught a graduate seminar on pedagogy (the study of teaching), where we extensively examined the literature on student testing and teacher evaluation.

In both my experience as a teacher and my review of the literature on the topic, it is extremely clear that it is a very bad idea, highly likely to produce misleading results, to rely solely on test scores to evaluate either student learning or teacher effectiveness. Testing is very useful, but it is NOT the only way to evaluate a teacher.

That in turn is a primary reason why you haven't seen districts like LAUSD publish this information. They and teachers alike prefer to conduct more holistic reviews that don't reduce teaching to test scores. And that's why UTLA is slamming the LA Times article:

One of the biggest critics is the L.A. teachers union. The head of the union said Sunday he was organizing a "massive boycott" of The Times after the newspaper began publishing a series of articles that uses student test scores to estimate the effectiveness of district teachers.

"You're leading people in a dangerous direction, making it seem like you can judge the quality of a teacher by ... a test," said A.J. Duffy, president of United Teachers Los Angeles, which has more than 40,000 members.

Why would it be a "dangerous" direction? Because by naming teachers and providing a flawed ratings system for those teachers, it gives the public a deeply misleading view of teacher effectiveness. And it can undermine public support for teachers as a result.

The LA Times would have done better to not take into its own hands the making of education policy for the LAUSD. That's a matter more appropriately done by parents, teachers, and the school district, in collaboration with each other. So I share the UTLA's concerns with how this analysis is unfolding and proceeding.

Robert Cruickshank :: Teachers Take Issue With LA Times "Evaluations"
Tags: , (All Tags)
Print Friendly View Send As Email

Value Added Assessment (0.00 / 0)
Here's a really good blog post that discusses the limitations of value added assessment and the particular weaknesses with the analysis done by the LA Times.

http://schoolfinance101.wordpr...

This article and the follow up are disgraceful and ethically-challenged journalism.  Since when is a reporter qualified to evaluate teachers?


Thanks for linking that post (0.00 / 0)
It's a thorough and devastating deconstruction of the LA Times' reporting. Seriously, folks need to read it.

You can check out any time you like but you can never leave

[ Parent ]
This is my favorite quote from that article (0.00 / 0)
A compelling part of the analysis in Rothstein (2010) is the development of falsification tests, where future teachers are shown to have significant effects on current achievement. Although this could be driven in part by subsequent year classroom placement on based on current achievement, the analysis suggests the presence of additional unobserved differences..


Fry, don't be a hero! It's not covered by our health plan!

[ Parent ]
I thought it was a good article (0.00 / 0)
The Times acknowledged the limitations of the method, but it can still be a valuable piece of information in evaluating a teachers' effectiveness.  Holistic reviews sound nice, but the current teacher reviews done by LAUSD are a joke.

There is a disconnect between UTLA and the teachers themselves, it appears, based on their reactions.  The highlighted teachers in the article both desired to improve their teaching skills after learning that they scored low.  UTLA called for a boycott of the Times.  I think that says it all.

The teachers unions in California are just like the GOP when it comes to education reform: they are the party of No.


To be fair to the teacher's union (0.00 / 0)
When everything comes at you like a club, you're going to be on the defensive.

The whole tone of the article is "people could be doing this analysis but aren't"... implying too lazy; no doubt principals are knocking off after only 11 hours at work. Imagine if it said "LAUSD could be doing this analysis if it had the funding to carry it out."

As you note, the teacher reacted in a fairly positive way:

"Obviously what I need to do is to look at what I'm doing and take some steps to make sure something changes," he said.

Imagine if instead of "teachers suck, LAUSD sucks" the article had been, "Hey, here's a piece of information that we might use to help teachers find their weaknesses and find better ways to connect with kids." "Here's how we can get that information to principals."

I mean, check this line out:

and more than 90% of educators receive a passing grade, according to a survey of 12 districts in four states by the New Teacher Project, a New York-based nonprofit.

The subtext here is OBVIOUSLY, 90% is WAY TOO HIGH. But is it really? How would people react to an article that said "90% of doctors receive a passing grade"? I think they'd be appalled that 10% of practicing doctors weren't considered passing.

And, not mentioned is what happens with that other 10%. Some do lose their jobs. Some are mentored to become better. A few are shuffled between schools as lemons - and that should stop.

The whole article is anti-teacher and anti-union. It's not a surprise that they would react.

Fry, don't be a hero! It's not covered by our health plan!


[ Parent ]
And for example (0.00 / 0)
In an interview last week, A.J. Duffy, president of United Teachers Los Angeles, was adamant that value-added should not be used to evaluate teachers, citing concerns about its reliance on test scores and its tendency to encourage "teaching to the test." But Duffy said the data could provide useful feedback.

"I'm not opposed to standardized tests as one means to helping teachers look at what's happening in their classrooms," he said.

People don't like being evaluated solely using a metric that they don't believe they control. You might as well decide to evaluate a teacher based on the number of absences by their students.

Fry, don't be a hero! It's not covered by our health plan!


[ Parent ]
A different angle the Times could have taken (0.00 / 0)
- Why doesn't the State of California send this data to every school district?
- Why does it take so long after the tests are taken to return data?

These tests are taken in March/April. They are computer scored; imagine if the results were back before school ended for the year, before summer school decisions were made. There's no opportunity to 'mop up', to assess right then and there if this student is truly not following or if the test doesn't reflect the student's ability. If you want to use this data to make high stakes decisions, shouldn't it be handled like it actually matters - and for example make it available as a factor in deciding student retention, in terms of remediation, etc?

Fry, don't be a hero! It's not covered by our health plan!


[ Parent ]
Agree (0.00 / 0)
We deal with AJ Duffy here for our local school (not charter) he is literally a breathing testament to inertia. His first reaction to any change is "no" and he's unwilling to even discuss.

The teachers we have are joys and the school, despite Duffy, is thriving. But he and the union he represents are detestable.


[ Parent ]
I think it's a valuable analysis but used inapprorpriately (0.00 / 0)
I don't think, as the article suggests, that the analysis is itself a measure of a good teacher versus a bad, or indicative of who should be fired. But, I do think it's a great question generator and I think it would be valuable if this level of analysis was provided to school administrators. Currently, administrators try to develop this analysis themselves, which of course takes time away from other tasks.

When you see a result like this:

With Miguel Aguilar, students consistently have made striking gains on state standardized tests, many of them vaulting from the bottom third of students in Los Angeles schools to well above average, according to a Times analysis. John Smith's pupils next door have started out slightly ahead of Aguilar's but by the end of the year have been far behind.

it's a good opportunity to ask, Why? Not, "Hey, fire that second teacher and all will be swell" but why is the first teacher apparently getting better results? Is it that the kids are different, that the first teacher has some great technique that perhaps could be shared? Are the kids really coming out that different - ie do teachers in the next grade notice which kids came from which class?

When I went to school, kids were not randomly assigned to classrooms. Even though demographics might be similar, in fact the kids were different.

I watch test scores at my daughter's school and I see huge inconsistencies. In our case, there is one class per grade, so the kids mostly have the same path.   I can see that in nearly every class, there's an apparent spike in performance and an apparent regression over the 5 years of elementary testing, sometimes a significant one, but what I've seen is that it happens at different grades for different classes.

You also have to beware of the tyranny of small numbers. In a class of 20 students, each student is 5%. Thus, you might see a "huge bump" where in 2nd grade 45% were proficient or better and in 3rd 55% were proficient or better - but reality is, this is two students. Maybe they were two students who only missed "proficient" by one or two questions last year. Maybe this year they got lucky. Maybe last year they took the test sick. Maybe this year two new students moved in or out. Or maybe this is a real gain. The numbers themselves won't tell you.  

Fry, don't be a hero! It's not covered by our health plan!


Good comment from the LA Times site (0.00 / 0)

teacherm at 8:41 PM August 16, 2010
I am a nonunionized teacher who works at a charter school. This article is so shallow its ridiculous. Yes test scores are low district wide, yes its a problem, but to determine the "effectiveness" of a teacher based on one standardized test is completely preposterous! This test is only covers math and language arts. There are four other subjects elementary school teachers are still required to teach. In all the state mandated proffessional development I have participated in, I have been taught to assess the WHOLE child. I taught one second grader who was able to read at fourth grade reading level and consistently had high math test grades, yet he scored basic on the test. Should I retain him because of this? NO! How can teachers be assessed by just looking at test scores? The WHOLE teacher needs to be assessed. This article doesn't even come close to describing what an effective teacher is and how one should be evaluated.


Fry, don't be a hero! It's not covered by our health plan!

And another good comment (0.00 / 0)
tsdobbs at 10:37 AM August 17, 2010
If value added is following student performance longitudinally, does it also factor in student performance 2 or 3 years post teacher? In other words, a particular teacher may indeed be bringing up scores consistantly but do those scores hold up in subsequent years? A surge in scores, perhaps 5th grade, that drops again the following year might reflect wonderfully for the 5th grade teacher and poorly for the 6th grade teacher for all the wrong reasons...


Fry, don't be a hero! It's not covered by our health plan!

[ Parent ]
Another LA Times comment (0.00 / 0)

StacieHammes at 7:22 PM August 16, 2010
As a former teacher, who worked at the same school between 1998-2002, I knew John Smith.  During that time, it was known that John Smith enthusiastically took in the students who had the worst behavior problems on campus, and was frequently assigned them.  During their time with John Smith, these students became socially appropriate, and continued to demonstrate academic growth at the same time.  I am not saying that Mr. Aguilar is not a great teacher, but to bash Mr. Smith without knowing the whole picture of who his students are is irresponsible at best.


Fry, don't be a hero! It's not covered by our health plan!

[ Parent ]
Calitics in the Media
Archives & Bookings
The Calitics Radio Show
Calitics Premium Ads


Support Calitics:

Get discounted bestsellers at Barnes & Noble.com!

Advertisers


-->
California Friends
Shared Communities
Resources
California News
Progressive Organizations
The Big BlogRoll

Referrals
Technorati
Google Blogsearch

Daily Email Summary


Powered by: SoapBlox