Published March 27, 2024
Phyllis Blumberg, in Assessing and Improving Your Teaching: Strategies and Rubrics for Faculty Growth and Student Learning (2013), identifies two primary goals of assessing teaching effectiveness. The first is to increase student learning and to enhance or invigorate teaching, while the second emphasizes that when teaching improves, students learn more. Course evaluations provide one input data point of indirect data from students on their valuation of the course and the instructor.
However, course evaluations often get a bad rap in the teaching world. In conversations with instructors over the years regarding their perceptions of course evaluations I have received several eyerolls, heavy sighs, and declarations like “I don’t read them, they are biased”, and “I only hear from those that either really liked or hated the class.” My all-time favorite comment is “now that I have tenure, I no longer need to worry about course evaluations.” I can understand how demands on time and the priorities of instructors at a research university like ours are such that course evaluations may not be in the forefront. The benefit of course evaluations is in their timely and frequent review of the data each semester. Reviewing the information more regularly shows your consideration and respect for students and their success, as well as your own.
In a campus research study, we learned that UB students are actually very considerate of their instructors, and less biased than you might think. All instructors can utilize course evaluations for continuous improvement, as the student population continues to change in their learning needs. As evaluations are conducted every semester, it is possible to review them regularly and in a timely fashion to make changes prior to the next semester. Since the university provides the central service of administering course evaluations, why not use this indirect assessment data source as a tool to help gauge your teaching effectiveness?
To leverage course evaluation survey data, we first need to acknowledge that good teaching is hard work. It is a complex undertaking that is multidimensional in nature and no single criterion of effective teaching can measure it. Student and instructor interests, motivations, values and other situational factors all have a role to play. The goal of teaching effectiveness continuous improvement is to identify specific ways to change your teaching so that it fosters greater deep and intentional learning for your students [1].
How do course evaluation surveys provide specific feedback you can use? The global or overall ratings questions on evaluations may not provide the necessary specificity, but they can help point out global considerations about themes or patterns over time. The literature indicates that students can distinguish among factors related to teaching effectiveness, and students can differentially weight teaching behaviors when making overall evaluations of the instructor [2]. The instructor, not the course, is the primary determinant of students’ ratings [3].
UB’s Core Course and Instructor-Level Questions, as well as custom instructor questions, provide more dimensionality into student feedback on teaching effectiveness.
Here are some ideas on how to process and make sense out of the information you receive from your course evaluations.
First, acknowledge that the students are in the class with you when you are teaching and are therefore in an excellent position to provide feedback that no one else can give. Are you doing everything you can to create a mutual culture of respect and accountability for assessment in your classroom? Upon meaningful reflection, If you find that the feedback you are receiving lacks clarity or leaves you with more questions than answers, there are steps you can take to train them up to give quality input that you can use.
Next, take time to process the information that you are receiving. Be mindful of distractions, perceptions, and your own biases as you approach your evaluations. I suggest you complete an evaluation of the course yourself, as a self-reflective exercise, as to what you expect to see from both your perspective as the instructor, and that of the students. When you compare your evaluation to that of the students, look for differences and similarities.
Take your course evaluation in perspective. Did you garner a high response rate that make the results generalizable? Aim for a response rate of at least 75% of the class enrollment. Utilize techniques that are ethical and appropriate and encourage meaningful feedback from students.
For quantitative feedback, consider how you compare to peers in your department and division. Look at the distribution of scores for each question. Where are the highs, lows, and outliers? How might you explain each with evidence from your teaching?
In examining qualitative feedback, analyze using value labels and/or themes. For example, you might look at positive, negative, and neutral comments. More specifically to organization/clarity, knowledge/understanding, instructor-group interaction, instructor-student interaction, enthusiasm, assignments, workload, etc. Where are the comments reflective or contradictory of quantitative data?
In both the quantitative and qualitative data, you may find trends over time (semester to semester) and patterns that indicate how you are changing or staying the same. Do not be alarmed if you try something new and there is a learning curve. Make a note of this in the UB Course Evaluation SmartEvals system or your records to historically archive this information. Innovation often presents as variance in the data.
Once you have analyzed the data and know what it says, it is time to reflect on the data for continuous improvement of teaching effectiveness. What are your strengths and areas of weakness and how can these become opportunities in the future? For course development, what were your goals, and did you meet them? How did you meet them, and how well? For teaching behaviors, how satisfied are you with what you did and the feedback you received? Where there any new trends to address? Consider discussing the feedback and your reflection with a mentor or peer for their perspective(s).
Finally, it is time to act and potentially make changes. Prioritize opportunities to change. You might not necessarily make changes to the lowest area, or the easiest area to change, but the most important area for improving your teaching effectiveness to you, your course, and your students. Focus on behaviors and base it on the data. At the course level, make curricular adjustments. At the instructor level, make teaching methodology improvements. Develop a plan. You can even reach out to a mentor, peer, or learning designer for support. Many instructors have even shared their plans with students on how they have changed their teaching and courses to reflect feedback they have received from course evaluations. Follow-up with how this plan has impacted course evaluations (and other sources on teaching effectiveness) moving forward.
Course evaluations are only one source of information, from students, on how you can potentially improve your teaching effectiveness. Consider it as a data input, plan intentionally to collect the best data you can, reflect on the data, and improve your teaching effectiveness.
For more information on how the Office of Curriculum, Assessment and Teaching Transformation can support you, contact us at ubce@buffalo.edu or visit the UB Course Evaluation website.
Office of Curriculum, Assessment and Teaching Transformation
716-645-7700
ubcatt@buffalo.edu