Feedback and Reflection
Shreepad Karmalkar
Professor, EE Department
Member, TLC Executive Team
Indian Institute of Technology Madras
karmal@ee.iitm.ac.in
1
Learning outcomes
2
Learning outcomes
At the end of this session, you will be able to
• Recognize that teachers indeed play an important role
3
Learning outcomes
At the end of this session, you will be able to
• Recognize that teachers indeed play an important role
• Recognize the need for feedback and reflection
to improve teaching
4
Learning outcomes
At the end of this session, you will be able to
• Recognize that teachers indeed play an important role
• Recognize the need for feedback and reflection
to improve teaching
• Describe how to reflect on our teaching by collecting
feedback in different ways
5
Do I make a difference ?
“No nation can rise above the level of its teachers”
- Indian National Policy on Education
6
Do I make a difference ?
“No nation can rise above the level of its teachers”
- Indian National Policy on Education
Our students imbibe, to an extent, our attitudes and skills.
7
How do I make a difference ?
Teacher Quality Moderates the Genetic Effects on Early Reading
[Science, Apr. 23, 2010]
How do I make a difference ?
• Factors affecting student learning:
genes, teacher quality, classmates, resources.
Teacher Quality Moderates the Genetic Effects on Early Reading
[Science, Apr. 23, 2010]
How do I make a difference ?
• Factors affecting student learning:
genes, teacher quality, classmates, resources.
• Genes might set the bar for learning potential,
teachers play a leading role in helping kids reach it.
Teacher Quality Moderates the Genetic Effects on Early Reading
[Science, Apr. 23, 2010]
How do I make a difference ?
• Factors affecting student learning:
genes, teacher quality, classmates, resources.
• Genes might set the bar for learning potential,
teachers play a leading role in helping kids reach it.
• When teacher quality is low, genetic variance is constricted;
when teacher quality is high, genetic variance blooms.
Teacher Quality Moderates the Genetic Effects on Early Reading
[Science, Apr. 23, 2010]
How can I Improve Continuously
How can I Improve Continuously
R
P
F
A
Action Feedback Reflection Planning
Parts of this figure are adapted from
I. Plaza et. al., IEEE Trans. on Education, p. 308, 2013.
What is reflection ?
14
What is reflection ?
हभ उम्र बर एक खता करते रहे
धल
ू चेहरे ऩर थी आइना साप करते रहे
- मभर्ाा गामलफ
15
What is reflection ?
हभ उम्र बर एक खता करते रहे
धल
ू चेहरे ऩर थी आइना साप करते रहे
- मभर्ाा गामलफ
I committed a mistake all through my life;
the dust was on my face, yet I kept wiping the mirror.
- Mirza Galib
16
What is reflection ?
हभ उम्र बर एक खता करते रहे
धल
ू चेहरे ऩर थी आइना साप करते रहे
- मभर्ाा गामलफ
I committed a mistake all through my life;
the dust was on my face, yet I kept wiping the mirror.
- Mirza Galib
“Reflection” is about identifying
where is the dust, and how to remove it.
17
What is reflection ?
“During early semesters, my performance (i.e. student
feedback) was not good. I had a mind-set that students
were not interested in learning. Actually, the issue was
not with students. I did self-assessment and realized that
the issue was with me. The students were not excited by my
teaching. Mainly it was connected with my delivery method”.
- An IIT faculty appearing for selection to an “Assoc. Prof.” position
18
What is reflection ?
“During early semesters, my performance (i.e. student
feedback) was not good. I had a mind-set that students
were not interested in learning. Actually, the issue was
not with students. I did self-assessment and realized that
the issue was with me. The students were not excited by my
teaching. Mainly it was connected with my delivery method”.
- An IIT faculty appearing for selection to an “Assoc. Prof.” position
“Reflection” is about self-assessment
19
Interaction
20
Interaction
Consider changes that you have made in teaching a
course. Select a particularly significant change.
21
Interaction
Consider changes that you have made in teaching a
course. Select a particularly significant change.
• What was the change?
• What was your basis for making the change ?
22
Interaction
Consider changes that you have made in teaching a
course. Select a particularly significant change.
• What was the change?
• What was your basis for making the change ?
• How did you evaluate influences of the change?
23
Interaction
Consider changes that you have made in teaching a
course. Select a particularly significant change.
• What was the change?
• What was your basis for making the change ?
• How did you evaluate influences of the change?
• If possible, give examples where your intent was
not achieved.
24
What is reflection ?
25
What is reflection ?
• Our words and actions may not have the intended effect on
students; at times, the effect can be opposite to what we intended.
26
What is reflection ?
• Our words and actions may not have the intended effect on
students; at times, the effect can be opposite to what we intended.
• Often, our awareness of both our teaching and its effects is
only partial.
27
What is reflection ?
• Our words and actions may not have the intended effect on
students; at times, the effect can be opposite to what we intended.
• Often, our awareness of both our teaching and its effects is
only partial. Reflection is a mental process which expands this
awareness so as to improve our teaching.
28
Feedback
• Feedback from students and colleagues enables us to see our
teaching through others' eyes, and is a valuable input for reflection.
• It is important to see our teaching through others eyes, and seek
feedback in diverse ways. Else I may teach others the way I like
to be taught, and thereby, disregard learner diversity.
29
How to reflect ?
Inputs for Reflection
30
How to reflect ?
Inputs for Reflection
• Timely feedback from students and colleagues
31
How to reflect ?
Inputs for Reflection
• Timely feedback from students and colleagues
• Guiding questions and thoughts
32
Various forms of feedback
33
Activity Graph for a Classroom
Activities
Time
[K. L. Kumar, “Educational Technology”, New Age International Publishers, 1997]
Activity Graph for a Classroom
Student action
Student question
Student response
Teacher question
Teacher response
Teacher talk
Using chalkboard Time
Using charts
Using projections
Using multimedia
[K. L. Kumar, “Educational Technology”, New Age International Publishers, 1997]
Activity Graph for a Classroom
Student action
Student question
Student response
Teacher question
Teacher response
Teacher talk
Using chalkboard Time
Using charts
Using projections
Using multimedia
[K. L. Kumar, “Educational Technology”, New Age International Publishers, 1997]
Activity Graph for a Classroom
Student action
Student question
Student response
Teacher question
Teacher response
Teacher talk
Using chalkboard Time
Using charts
Using projections
Using multimedia
[K. L. Kumar, “Educational Technology”, New Age International Publishers, 1997]
Activity Graph for a Classroom
Student action
Student question
Student response
Teacher question
Teacher response
Teacher talk
Using chalkboard Time
Using charts
Using projections
Using multimedia
[K. L. Kumar, “Educational Technology”, New Age International Publishers, 1997]
Activity Graph for a Classroom
Student action
Student question
Student response
Teacher question
Teacher response
Teacher talk
Using chalkboard Time
Using charts
Using projections
Using multimedia
[K. L. Kumar, “Educational Technology”, New Age International Publishers, 1997]
Activity Graph for a Classroom
Student action
Student question
Student response
Teacher question
Teacher response
Teacher talk
Using chalkboard Time
Using charts
Using projections
Using multimedia A graph with high amplitude and frequency is an
indicator of a good teaching-learning process
[K. L. Kumar, “Educational Technology”, New Age International Publishers, 1997]
What I liked most about this course / teacher
Course Excellent / Good / Teacher Excellent / Good /
rating: Satisfactory / Poor rating: Satisfactory / Poor
Scope for improvement for this course / teacher
B.Tech/M.Tech My CGPA
Feedback Questionnaire
An example:
Is my Introduction to Semiconductor
Device Modeling Effective ?
[S. Karmalkar, “Introducing the Device Modeling Procedure
to Electrical Engineering Students”, IEEE Trans. Educ., vol.
50, no. 2, p.137, May 2007]. This article is attached.
43
Pre-lecture Assessment
Post-lecture Assessment
44
Pre-lecture Assessment
45
Pre-lecture Assessment
46
Post-lecture Assessment
47
Post-lecture Assessment
48
Post-lecture Assessment
49
Post-lecture Assessment
50
Survey conditions
• 21 UG students in the beginning of their 6th semester.
• The students have undergone a basic course on Solid
State Devices
• CGPA distributed uniformly in the range 6.79 - 9.23.
51
Survey conditions
• Surveys conducted during regular class hours devoted
to the device modeling course, without any advance
notice and without alerting the students to the actual
intent of the experiment, namely – assessment of the
impact of the introduction lecture.
52
Survey conditions
• Post-lecture survey was conducted 6 days after the
lecture to eliminate the effect of short-term memory;
no classes on semiconductor devices were held during
these 6 days which included a weekend and a public
holiday.
• Students were advised that writing something in the
descriptive response was not compulsory and that they
could leave these places blank if they wished.
53
Survey Results
Mean = _________100 x (2nSA+nA-nD-2nSD)________
(weight of SA = 2) x (nSA+nA +nN+nD+nSD = 21)
55
• The models for various devices such as diodes,
MOSFETs, and BJTs (66% of students)
• No response (34%)
• The models for various devices such as diodes,
MOSFETs, and BJTs (14% of students)
• The remaining got the answers right.
56
Post-lecture Assessment
57
Post-lecture Assessment
Expressing the model equation in a normalized form.
58
How to reflect ?
59
How to reflect ?
Begin with the right mental attitude
60
How to reflect ?
Begin with the right mental attitude
Reflection can be difficult, even threatening, because it
forces us to be honest with ourselves and recognize
not only our successes but areas needing improvement
Hence, openness to criticism is a must for reflection.
61
Guiding questions
• What are my assumptions about student behavior ?
• Why and how do I do things in the class?
• Is my teaching effective and efficient?
• Am I explaining complexity or revealing simplicity ?
62
Guiding thoughts
63
Guiding thoughts
It is the true nature of mankind to
learn from mistakes, not from examples.
Fred Hoyle
64
Guiding thoughts
It is the true nature of mankind to
learn from mistakes, not from examples.
Fred Hoyle
Education is not about
learning diverse subjects;
it is about learning
diverse ways to the same subject.
Aurobindo 65
Summary
66
Summary
Reflection is deliberate and structured self-critical
evaluation of our assumptions and practices,
directed towards improvement of our teaching
67
How to Improve Our Teaching Continuously
P
A
R
F
Action Feedback Reflection Planning
Parts of this figure are adapted from
I. Plaza et. al., IEEE Trans. on Education, p. 308, 2013. 68
Learning outcomes
At the end of this session, you will be able to
• Recognize the important role teachers can play
• Recognize the need for feedback and reflection to
improve teaching
• Describe how to collect feedback and reflect upon
our teaching
69
70
