At least, in terms of measuring how much students learn:
That conclusion invites another: students are, in essence, rewarding professors who award higher grades by giving them high ratings, and punishing professors who attempt to teach material in more depth by rating them poorly.
The article, from the Washington Post notes the most widespread alternative to evaluations, standardized tests:
In K-12 education, you have standardized tests, and those scores have never been more widely used in evaluating the value added by a teacher.
Because nothing ever goes wrong with those:
The district said the educators had distributed a detailed study guide after stealing a look at the state science test by “tubing” it — squeezing a test booklet, without breaking its paper seal, to form an open tube so that questions inside could be seen and used in the guide. The district invalidated students’ scores.


5 comments
June 13, 2010 at 2:06 pm
bitchphd
Teacher cheating aside, standardized tests are appalling.
June 13, 2010 at 2:14 pm
silbey
Agreed. I was reaching for the first thing I could use.
June 13, 2010 at 2:41 pm
bitchphd
Of course. It’s frustrating, isn’t it, that teaching is a profession in which everyone is sure that most of us are incompetent.
June 13, 2010 at 2:45 pm
rosmar
On that study of teaching evaluations, it seems possible to me that the Air Force Academy has a set of students who may be systematically different than most other students. Also, being able to create your own syllabus could potentially have a big effect on student evaluations. I’m not sure how applicable that study is to other environments.
June 27, 2010 at 1:40 pm
janetl
When I attended Michigan State University, I relied on the “Grading the Profs” booklets available for $1 at the bookstore. These were based on surveys that asked just a few questions. If a professor has the combination “much harder than average” and “knows the material better than average”, then I was usually assured of a good class. I can’t quite remember what comments were added about Professor Karson in the department of Economics, but it was something akin to sadistic. His class was great!