Take the 2-minute tour ×
Mathematics Educators Stack Exchange is a question and answer site for those involved in the field of teaching mathematics. It's 100% free, no registration required.

Educators are constantly evaluated by at least the following methods:

  • Anonymous evaluations collected from students by the school
  • Anonymous evaluations posted online by students
  • Grades or pass-rates of the students in the class

Experienced educators have all learned to not read too much into any of these.

So, if you would like to evaluate your own performance, what is an effective method?

I think some good answers may be specific to mathematics, otherwise I would post the question elsewhere.

share|improve this question
    
Okay: I have migrated my comments to serve as an answer. –  Benjamin Dickman Mar 28 at 0:48

3 Answers 3

up vote 8 down vote accepted

(Migrated from the comments at request of OP.)

One place to look is in the following source:

National Research Council. Evaluating and Improving Undergraduate Teaching in Science, Technology, Engineering, and Mathematics. Washington, DC: The National Academies Press, 2003.

There is free online access, and Chapter 5 (Evaluation Methodologies), includes a section specifically on Self-Evaluation for STEM instructors at the undergraduate level.

Chapter 6 (Evaluation of Individual Faculty: Criteria and Benchmarks) may be worth a read, as well.

For more information on the book, see the Executive Summary and Background on Committee Members.

share|improve this answer
    
Thanks! I think Jim's answer is the most fascinating and interesting, but I'm accepting this one as the one that best answers the question. –  Chris Cunningham Mar 28 at 20:43
    
The only thing I would add, if it is not listed in the sources above, is that the regular use of formative assessments can help you judge the effectiveness of your teaching before the end of the semester, which helps you make changes when they will make a difference for this group of students. –  David Wees Apr 7 at 10:44

Though faculty are often skeptical of student evaluations, research suggests that student evaluations are an effective tool for evaluating teaching. Here is a link to a meta-study that surveys the results of approximately 1500 other studies on student evaluations:

Cashin, "Student Ratings on Teaching: The Research Revisited"

Here are some of the major conclusions of the paper:

Correlation to Exam Scores

In courses with multiple sections and a common exam, there is between a 0.3 and 0.5 correlation between an instructor's evaluation scores and the students' scores on the common exams. The paper notes that it is rare to ever find correlations above 0.5 in the social sciences when studying complex phenomena.

Correlation to Instructor Self-Ratings

When instructors are asked to rate their own teaching effectiveness, the answers they give have approximately a 0.29 correlation with student evaluations. In addition, when instructors are asked to rate how their effectiveness varied over different courses they have taught, the instructor's answers have roughly a 0.45 correlation with student variation in evaluations across those courses.

Correlation to Ratings of Administrators and Colleagues

When instructors are rated by either their colleagues or by administrators, the scores they receive have between a 0.45 and 0.7 correlation with student evaluation scores. Of course, colleagues and administrators might be basing their score on student evaluation scores that they have seen.

However, ratings by trained classroom observers (who have not seen student evaluation scores) also have 0.5 correlation with student evaluation scores.

Further Discussion

Based on this research, I think that it is reasonable to take student evaluation scores into account when analyzing the effectiveness of your own teaching. From a particular instructor's point of view, the 0.45 correlation highlighted above has the most relevance: it means that you can tell which courses you did a good job in based on student evaluations.

Of course, there are some other effects that need to be taken into account. Classes full of highly motivated students tend to give higher ratings than classes of reluctant students. Students in advanced courses also tend to give higher ratings than students in introductory courses. If your abstract algebra students consistently rate you higher than your calculus students, that doesn't necessarily mean that you're doing a better job in abstract algebra.

Finally, it should be pointed out in any discussion of evaluating teaching that there is no universally accepted definition of good teaching. You may perceive advantages or disadvantages in your teaching style that the students do not see, and there's no objective way to determine whether you are right. Ultimately, it's part of every teacher's job to form their own opinions on what constitutes good teaching.

Edit: Who graded the exams?

dtldarek asks below whether the correlation between student evaluations and student exam scores might be due to instructors grading their own class's exams.

Cashin's study cites two other meta-studies for the results on exam scores: one by Cohen and one by Feldman. I haven't looked through the Feldman study, but Cohen's meta-study analyzes several methodological features, including who grades the exams. Of the 68 studies that Cohen analyzes, 10 had each teacher grade their own class's exam, 28 had some external evaluator grade all of the exams, and the remaining 30 had some other system (e.g. each instructor grades one question from all of the exams). From Cohen:

The only other methodological variable that correlated significantly with effect size was evaluation bias. The correlation between ratings and achievement was large when an external grader was used or when each instructor evaluated one part of the test for all students. For 10 studies in which achievement tests were evaluated by students' own instructors, the effect size was much smaller.

That is, the correlation between good evaluations and good exam scores is stronger when the exams are not graded by the teacher themselves.

share|improve this answer
3  
It's not clear for me, who graded the tests? Even if the evaluations are made before the exam and revealed afterwards, there still might be a third factor, e.g. how much teacher likes the students, which might be correlated both with his grading and how do students perceive him/her. –  dtldarek Mar 26 at 17:34
    
That's very useful information, could you make it a part of the answer? –  dtldarek Mar 26 at 18:14
1  
@dtldarek I have added this information to my answer, and deleted my comments about it. –  Jim Belk Mar 26 at 18:23
    
I found the correlation between an instructor's own ratings of their own classes to be compelling at first, but then highly suspect -- essentially, aren't you arguing that I should believe student evaluations because they correlate with my own self-evaluation? If this is the basis for deciding if ratings are "accurate," why not just use a self-evaluation to begin with? Or, instead, are you saying that student evaluations' correlation with all the other evaluations makes it likely that it does have intrinsic meaning? –  Chris Cunningham Mar 26 at 19:00
1  
@ChrisCunningham I also find it interesting that this correlation (.45) is so much higher than the correlation (.29) for overall teaching effectiveness. If you trust instructors' opinions, this means that the students are better at comparing different courses by the same instructor than they are at comparing different instructors. (Or you might trust students' opinions more, in which case this says that instructors are better at comparing their own courses than they are at comparing themselves with other instructors.) –  Jim Belk Mar 26 at 19:20

This is just a minor addition, but I talk to my students about it. In class I sometimes stop to take little show of hands surveys, e.g. "do you guys like it better if I start with an example and move on to the general formula, or vice versa?" After each exam and quiz I ask students personally how they felt about it, whether it was too hard or too easy, when they come up and turn it in. I don't mind criticism at all, and I encourage them to be honest with me about how things are going. And I have more lengthly discussions during office hours with those who show up. Of course this isn't a one hundred percent reliable way to quantify performance, but it helps me make little qualitative improvements to my teaching, with the side effect of making the students feel more empowered.

share|improve this answer

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.