Cognitive
Cognitive
Students often perceive cognitive psychology as an abstract and difficult subject with little intrinsic interest.
When student feedback identified problems with the traditional essay assessment in a cognitive psychology
module, action research led to the development of a forensic scenario-based assessment which successfully
increased student interest in cognitive psychology. Reflections on the meaning of assessment led to a reframing
of the purpose of the taught classes to serve the assignment, an approach favoured by students that staff had
previously resisted. The focus shifted from delivery of content to facilitating students in the assignment work.
The complexity and richness of the scenario guaranteed interesting class discussions, helped students practice
applying their knowledge of psychology, and inspired students to explore the literature creatively. Observation
and student feedback led to further refinements, eventually generating not just increased student enthusiasm
but also a significant increase in performance.
Keywords: Teaching cognitive psychology; scenario-based assessment.
Staff worried about how ‘assessment- The format for the assignment was influ-
focused’ the students were, seeming to show enced by the fourth annual Project LeAP
no interest in psychology beyond what they Summer Workshop on problem-based
were to be assessed on (a common cry of learning, which I had attended in 2006.
teachers, noted Biggs & Tang, 2011, p.37). Although I decided not to use a problem-
I too was baffled by students’ unwillingness based learning (PBL) approach, I was
to engage or even attend sessions if they impressed by the idea of using concrete
were not being assessed. I had started to scenarios in which students were encouraged
accept that if there was some content we felt to approach the problem by assuming the
students ‘ought’ to know, or some class we roles of professionals. Moust, van Berkel and
deemed essential to attend, then we would Schmidt (2005) argue that the benefits of PBL
have to assess it. are sabotaged by omitting any of the essential
However, I was also becoming increasingly elements, such as the small group sizes, or
uncomfortable with our approach to assess- steps in the learning process. So it would be
ment. By the time I was teaching my block on unlikely that using a concrete scenario alone
the module I already knew it was not being would have the same effect as using PBL.
assessed, but I had to conceal this knowledge However, there is an independent literature
from the students. I found my own enthu- on the benefits of using realistic scenarios, or
siasm dampened, as I too experienced the vignettes (e.g. Errington, 2011; Jeffries &
feeling that my teaching was ‘irrelevant’. Maeder, 2004 & 2005, 2006; Norton, 2004).
Students often perceive cognitive One benefit is that scenarios can prepare
psychology as difficult, dry and abstract, even students for employment by requiring them to
boring. All of us tried hard to bring the consider how they can put their academic
subject to life, however despite our efforts knowledge to practical use. Mair, Taylor and
only a minority of students were attracted to Hulme (2013) have emphasised the impor-
cognitive psychology as a subject for further tance of developing such psychological
study, with around a fifth of the cohort opting literacy skills, so students can apply their
for a final year option in cognitive psycho- knowledge of psychology within whatever
logy. As a supervisor of ‘cognitive’ final year work or personal situations they encounter.
projects I always had more places available The LeAP Summer Workshop on PBL
than students wishing to study with me. had mainly focused on engineering and
In early summer 2010, the module team physics, as illustrated in Savin-Baden (2008),
discussed these issues and could find no but I was struck by the description of the
immediate answer. Initial proposals to medical school at Manchester (O’Neill,
broaden the essay so that students would Morris & Baxter, 2000) where PBL was used
have to look across cognition as a whole were within a lecture and lab-based teaching envi-
rejected on the grounds that they would only ronment. The lecture course and laboratory
make the essay even more abstract and chal- activities were designed to be relevant to the
lenging for students. Some staff thought a PBL case materials. This gave me a new
solution was impossible. model for assessment, one where the assign-
ment task is the central defining focus of a
The development process module, with the taught classes designed to
I generated ideas by working through the serve the assignment.
areas of applied psychology students are Biggs and Tang (2011) wrote that, ‘From
most interested in, then using my knowledge the teacher’s perspective, summative assess-
of the literature in cognition to evaluate ment is at the end of the teaching-learning
whether there would be sufficient connec- sequence of events, but from the student’s
tions to draw upon. I decided to ground the perspective the assessment is at the begin-
assignment in forensic psychology. ning’ (p.198). I had shifted to the student’s
perspective. Instead of seeing the assessment experience as an amateur novelist. I set out
of the module as a problem to solve, I began to write a fictional case which would be as
to see the assessment as a solution for the realistic as possible, so I carried out extensive
module, as the purpose which would drive research into the literature including tran-
decisions about content and delivery. scripts of legal cases. Due to the amount of
time it took to design the scenario, I was
The design process writing the evidence as the module
I planned that students would be presented progressed. It was a dynamic process of
with evidence from a criminal trial which consultation with the module teaching team,
would build up throughout the course of the such that they adjusted their teaching to
module, filling out the story of an armed orient towards the scenario, and I edited the
robbery and its aftermath. The students evidence to incorporate their suggestions.
would take on the role of an expert witness
in cognitive psychology. Students would be The assignment
immersed in the task from the start, with The trigger for the scenario was a letter from
each taught session providing further a solicitor in London asking for help in
resources, ideas, or formative discussions preparing an appeal on behalf of her client
with peers and tutors, to build up a rich (Pedro), who was serving a 20-year sentence
understanding of the possibilities available for being an accomplice to armed robbery
to address the task. and murder. Pedro had been a ticket-seller at
I emphasised to the students how similar a cinema in 1998. He and four other cinema
an expert witness report is to a scientific staff had been in the manager’s office
essay or experimental report, forms of assess- counting up the day’s takings when a man
ment they were already familiar with. with a gun burst in and demanded the
I explained that an expert witness does not money. During the process the robber shot
have the same role as a lawyer. An expert the security guard dead. The police later
witness for the defence has a duty to be uncovered evidence suggesting that Pedro
scientific and objective, not to use persuasive had been the robber’s accomplice.
rhetoric. I read to the students parts of Bond I explained that the solicitor wanted an
et al.’s (2007) guide for expert witnesses, expert witness to look at five sets of trial
including their suggestion that expert evidence, to see whether the police interpre-
witnesses testify that: ‘I understand my duty tation could be questioned, which might give
as an expert witness to the court to provide Pedro grounds for appeal. For each of the
independent assistance by way of objective five pieces of evidence, the solicitor posed a
unbiased opinion in relation to matters question, for example, ‘How likely is it that
within my expertise’ (p.165). Another guide, the barmaid correctly identified the man she
Hall and Smith (2001), advises expert saw talking to the robber?’.
witnesses to ‘provide cross references to […] Rather than setting a single assignment,
any publishable material which supports the I split it into two half-length assignments, so
conclusions’ (p.142). This allowed me to that students would obtain feedback on this
insist on the use of APA-style citations and unfamiliar form of assessment before they
references, while still maintaining the started the second assignment. For the first
integrity of the scenario. assignment students chose whether to
I believe that good teachers make use of answer a question on attention or one on
their own individual quirks and skills to language, and for the second assignment
enhance their teaching (a view shared by they chose perception, memory or thinking.
others, see Kane, Sandretto & Heath, 2004, All the topics were interconnected, and each
pp.299–300). I have one talent which I had piece of evidence (outlined below) added
never before applied to my teaching: my more information to the case.
Memory: The solicitor asked students to look Thinking: This topic was set within the
at police interviews with the four eye- context of rationality and decision-making.
witnesses, to see if they resembled true The evidence was a series of interviews in
memories or showed any evidence of decep- which the police questioned Pedro about his
tion. Students were introduced to literature movements on the evening that the barmaid
thought she saw him talking to the robber. 85 per cent. Seventy-five per cent of students
Pedro denies having met the robber, but felt that there were sufficient opportunities
claims he suffers from alcoholic blackouts for formative assessment, up from 40 per
and eventually signs a confession, which he cent. However, the percentage of students
retracts a week later. Students were asked to who felt that the assessment task was clear
explore the literature on false confessions dropped from 85 per cent to 79 per cent,
and were encouraged to consider biases and there was also a slight drop in ratings on
which might elicit confessions, such as the clarity of assessment criteria. The main
temporal discounting and confirmation bias comment from students was that they would
on the part of the police. have liked more guidance on the assign-
ment.
Implementation The overall impression was that the
Lectures were largely unaltered, as students students enjoyed the scenario and felt that it
still needed to be introduced to the five areas was relevant, but had not entirely under-
of cognition and the lectures would provide stood what I wanted them to do in the write-
the theoretical background which students up. This corresponded with the impression
would draw upon for their assignment. from the marking: many students had
I re-designed almost all the seminars. Each described theory and empirical work, and
of the five topics had two associated semi- had also attempted to interpret the evidence
nars. In the first seminar students undertook to answer the solicitor’s question, but there
activities which consolidated the topic or was no real link between the two. This was
introduced relevant forensic areas (e.g. clearly a challenging task for them, perhaps
weapon focus, false confessions). In the more than they realised.
second seminar a group of students deliv-
ered a presentation suggesting how they Iterations
would apply the topic to the assignment In the 2011/12 academic year I included
scenario, which led to discussion and forma- more explicit written guidelines and more
tive feedback from the tutor. formative work in seminars.
Feedback ratings improved even more,
Evaluation of the assignment but there was a negligible improvement in
The scenario was very well received: students performance from the previous year (less
even debated on Facebook whether Pedro than two per cent), t(196.31)=2.29, p=.023,
was innocent or guilty. About twice as many d=.31, which was not significantly different
students chose a final year option in cogni- from performance in 2009/10, before the
tive psychology, and all my places as a project scenario was introduced, t(208.75)=1.28,
supervisor were filled for the first time in p=.203, d=.17. This time the main student
18 years. complaint was that the group presentation
The success of the assignment was evalu- work was stressful. We observed that groups
ated by looking at student performance and often arrived poorly prepared, or some
student feedback (both quantitative and members simply did not attend.
qualitative) compared with the previous year. In 2012/13 a new seminar tutor joined
Disappointingly, there was no improvement the module team, who was very enthusiastic
in student performance, t(215)=0.94, p=.350, about the assignment. We redesigned the
d=.13. However, there were striking improve- seminars so that they were tutor-led and
ments in student feedback on the module. students could prepare for them with indi-
Nearly all ratings on the module improved, vidual study. Group work activities took place
for example, the number of students who within the scheduled classes. Student feed-
felt they had a reasonable grasp of the back was very good, with student representa-
module topics rose from 70 per cent to tives commending the assessment.
a comparison, as the content area is compa- mark was the mean of the two half-size
rably difficult for students. Figure 1 shows assignments). Students who obtained zero
how the ratings for the two subjects have (usually a non-submission) in any unit of
fluctuated over the years. The rating repre- assessment were not included. The total
sents the mean percentage of students who numbers of included and excluded students
gave positive ratings across each criterion. can be seen in Table 1 (overleaf). In most
The scenario was introduced in the years the cognitive half of the module ran
2010/11 academic year. Figure 1 reveals that after the biological half, which is why non-
in the wider timescale, the increase in ratings submissions were higher, as cumulatively
the year the scenario was introduced actually more students had dropped out.
only served to return ratings to their 2008/09 Figure 2 shows student performance
levels, and the actual gain was only made in across the timescale of the study, with marks
2011/12, after more guidance had been from 50 to 59 per cent representing lower
introduced. The lower ratings on the biolog- second class attainment.
ical content in 2008/09 are probably because Analysis of variance was carried out but
it was assessed by an exam: since 2009/10 it due to violations of the assumption of homo-
has been assessed by a coursework essay. geneity of variance, results must be inter-
To calculate student performance, the preted cautiously. The interaction between
mean mark for the biological psychology subject and year was significant,
essay was compared with the mean mark on F(5,647)=7.73, p<.001, ηp2=.056. Tests of
the cognitive half of the module (in the first simple effects using the Bonferroni correc-
three years of the scenario the cognitive tion showed that in 2013/14 the cognitive
assignment resulted in significantly higher Kane, Sandretto and Heath (2004) advise
marks than in the previous year, an increase inexperienced lecturers to ‘try and be your-
of over six per cent (p<.001, d=0.55), and self… you’ve got to teach it your way and
also significantly higher marks than in there are lots of different ways’ (p.304). Like-
2008/09 (p=.009, d=0.40). In 2013/14 wise for students I encouraged them to be
students also obtained significantly higher themselves and emphasised that there were
marks (by eight per cent) on the cognitive many ways to answer the assignment. I found
assignment than they did on the biological it hard as a storyteller not to give them
essay (p<.001, d=0.72). closure by telling them if Pedro was guilty or
innocent, but I wanted it to resemble real
Reflections life, where the truth can only be guessed at,
Implementing the scenario generated many and I did not want to give the impression
surprises. The first surprise was that some there was a ‘right answer’. Some students
students believed the scenario was real, so we found this frustrating, as they wanted to
had to emphasise its fictional nature. It was ‘solve’ the crime.
the first time I had put so much of myself I was also surprised that ever since I intro-
into an assignment, which made me feel a duced the scenario, I have been oversub-
little vulnerable. But learning is all about scribed for project students. It is as if the
taking risks and being creative, and I was assignment produces a halo effect which not
very happy to see the students showing the only produces more positive ratings of the
same characteristics in their assignment teaching and the topics, but also of the
answers. The module team were careful to teacher. I am perceived differently as a
align the teaching and assessment, yet the person because students enjoyed the
exact alignment was actually left for the module.
students to create for themselves. While we Another surprise was that the popularity
encouraged students to find some of the of the assignment did not immediately cause
connections we saw, many students ingen- an improvement in performance. Deci et al.
iously found links that I had not made (1991) argued that to support intrinsic moti-
myself. This is the advantage of using a vation students need a feeling of compe-
realistic, ambiguous and open scenario. tence and control, which may have been
impaired by their lack of experience with the their own goals to reach the learning
format and the constraints of the word outcomes. Students can be inspired by the
count. module content, or by the teaching, but
I was also surprised that using one long most powerful is to inspire them with the
assignment rather than two short ones had assessment, where the concentration of
such a positive effect on performance. This effort gives such potential for deep learning.
may have been due to the greater freedom it Looking back I can see that I have
offered students. However, another hypoth- progressed through a series of different
esis is that dividing the assignment into two views. I began with the view that ‘students
short halves devalued it for students, such shouldn’t be so assessment-focused’, which
that they put more effort into full-size assign- I attempted to correct by trying to convey my
ments on other modules. Wormald et al. own views to them. Then I came to accept
(2009) and Cohall and Skeete (2014) found that ‘students are assessment focused so we
that when assessment weightings in a have to design that in’. Recently I have
module are changed, performance on newly shifted to a ‘systems’ view, where I think ‘of
higher-weighted assessments is higher and course students are assessment focused – it is
performance on lower-weighted assessments the rational outcome of the system they exist
is lower. It makes strategic sense that in’ and indeed that this is the way it should
students would apportion their effort more be, that assessment is the vision of what we
to assessments with a higher weighting want them to achieve, the representation of
(those worth 50 per cent of a module rather what we value, the embodiment of the
than 25 per cent of a module, for example), learning outcomes. Assessment is the
and it is also possible that the weighting of starting point for motivation.
an assessment affects perception of its value.
This action research has not only Acknowledgements
changed the student experience, but it has I thank the PSY240 module team who
also changed me. I used to believe that supported me and who participated in this
I chose interesting and intellectually chal- development: Ros Crawley, Etta Evans,
lenging essay titles which would lead Louise Delicato, Carole Carter, and Bethany
students to experience the excitement of Snow. Thanks also to Diane Westwood and
recent research in my topic area. I was Laurence Eagle for commenting on an
deluded. I was projecting my own interests earlier version of this paper.
onto students. It led me to devise assess-
ments of the type Biggs and Tang (2011) Correspondence
called ‘decontextualised’, those which assess Sophie Cormack
declarative knowledge but are not related to Department of Psychology,
a real life context. Faculty of Applied Sciences,
I believe that it is a priority to find assign- University of Sunderland,
ments which are intrinsically interesting to as David Goldman Informatics Centre,
many students as possible, which means Sir Tom Cowie Campus at St Peter’s,
choosing an assignment with value for them. St Peter’s Way,
This also usually means giving them Sunderland SR6 0DD.
freedom, within clearly defined bounds Email: sophie.cormack@sunderland.ac.uk
which give them enough direction to set
References
Biggs, J. & Tang, C. (2011). Teaching for quality learning Mair, C., Taylor, J. & Hulme, J. (2013). An introductory
at university: What the student does (4th ed.). guide to psychological literacy and psychologically literate
Maidenhead, Berks: The Society for Research into citizenship. Retrieved from the Higher Education
Higher Education and Open University Press. Academy website:
Bond, C., Solon, M., Harper, P. & Davies, G. (2007). http://www.heacademy.ac.uk/assets/documents/
The expert witness: A practical guide (3rd ed.). disciplines/psychology/mairtaylorhulme-
Crayford, Kent: Shaw & Sons. intro-psyc-lit.pdf
Deci, R.M., Vallerand, R.J., Pelletier, L.G. & Ryan, R.M. Moust, J.H.C., van Berkel, H.J.M. & Schmidt, H.G.
(1991). Motivation and education: The self- (2005). Signs of erosion: Reflections on three
determination perspective. Educational Psychology, decades of problem-based learning at Maastricht
26(3), 325–346. University. Higher Education, 50, 665–683.
Hall, J.G. & Smith, G.D. (2001). The expert witness Norton, L. (2004). Psychology Applied Learning Scenarios
(3rd ed.). St Albans: XPL Law. (PALS): A practical introduction to problem-based
Cohall, D.H. & Skeete, D.H-A. (2014). The impact of learning using vignettes for psychology lecturers. LTSN
a change in assessment weighting on the Psychology, York. Retrieved from The Higher
academic performance of first-year medical Education Academy website:
students. Caribbean Teaching Scholar, 4(1), 67–75. https://www.heacademy.ac.uk/sites/default/
Errington, E.P. (2011). Mission possible: Using near- files/psychology-applied-learning-scenarios.pdf
world scenarios to prepare graduates for the Olsson, J. (2008). Forensic linguistics (2nd ed.).
professions. International Journal of Teaching and London: Continuum.
Learning in Higher Education, 23(1), 84–91. O’Neill, P.A., Morris, J. & Baxter, C-M (2000).
Jeffries, C. & Maeder, D.W. (2004 & 2005). Using Evaluation of an integrated curriculum using
vignettes to build and assess teacher under- problem-based learning in a clinical environment:
standing of instructional strategies. The Professional The Manchester experience. Medical Education,
Educator, 27(1 & 2), 17–28. Retrieved from 34, 222–230.
The Professional Educator website: Savin-Baden, M. (2008). Problem-based learning in
http://www.theprofessionaleducator.org/ electronic engineering: Locating legends or
articles/archives/fall04spring05.pdf promising problems? International Journal of
Jeffries, C. & Maeder, D.W. (2006). Using instructional Electrical Engineering Education, 45(2), 96–109.
and assessment vignettes to promote recall, Wormald, B.W., Schoeman, S., Somasundaram, A. &
recognition, and transfer in educational psycho- Penn, M. (2009). Assessment drives learning:
logy courses. Teaching Educational Psychology, 1(2), An unavoidable truth? Anatomical Sciences
1–19. Education, 2(5), 199–204.
Kane, R., Sandretto, S. & Heath, C. (2004). An
investigation into excellent tertiary teaching:
Emphasising reflective practice. Higher Education,
47, 283–310.