Decolonising assessment in a clinical training programme within the Charlie Waller Institute

Decolonising assessment in a clinical training programme within the Charlie Waller Institute

By michaelkilmister Comment Closed

 

By: Natalie Meek, School of Psychology & Clinical Language Sciences, n.a.meek@reading.ac.uk
Four green leaves of varying sizes against a black background
Photo by Olia Bondarenko on Unsplash

Overview

Research within psychology has been largely conducted on a group that represent on 12% of the world’s population, those that are Western, educated, industrialised, rich and democratic (WEIRD) populations (Henrich et al., 2010). This colonial legacy, the centralising of the WEIRD population as representative of the human species, indicates a need to decolonise (Winter et al., 2022). The British Association for Behavioural & Cognitive Psychotherapies (BABCP) who accredit our High Intensity Child, and Adult Cognitive Behavioural Therapy (CBT) programmes centre decolonisation and inclusion within their updated curriculum. In response to this, and decolonisation efforts elsewhere in the higher education sector, the aim of the BABCP is to embed EDI within assessment. Assessment is also a focus of this case study as assessment drives learning in higher education (Boud, 1995).

Objectives

  • To change current assessment mark scheme to incorporate a section on EDI.
  • To ensure assessment is in line with BABCP EDI guidance.
  • To encourage student learning through assessment.

Context

The Charlie Waller Institute (CWI) offers graduate and post graduate clinical training courses. The training course discussed here is for High Intensity Adult CBT course, a  year-long post-graduate clinical training course run twice a year with intakes of up to 50 students. The ongoing effort of the University to decolonise is essential within training courses to ensure our trainees are equipped to deliver equitable psychological support to all.

Implementation

The extended case report (ERP) is an assessment used across two modules, a 5,000-word report which is set as part of paired assessment, was explored as a potential vehicle of change. There were some references to the identity of the client within the original mark scheme, however, little exploration of the client’s identity was required to pass the assessment. The High CBT Curriculum 4th Edition (NHS, 2022) states that trainees should be equipped with an understanding of EDI, and that we should support students to understand the needs of their clients in the context of protected characteristics. The curriculum (NHS, 2022) outlines the need for CBT therapists to achieve cultural competence, to be committed to anti-discriminatory clinical practice, and to have knowledge of research on CBT with minoritised groups. As assessment is an opportunity for learning (Sambell, et al., 2013), so this was a key opportunity to meet the BABCP curriculum.

Historically assessment has been neglected in the process of decolonisation within higher education (Godsell, 2021) and this was the case within our course. Changes had been made to lectures, but no changes had been made in assessment. To ensure assessment was aligned with BABCP curriculum (NHS, 2022) and Minimum Training Standards (BABCP, 2022) the method of assessment was not able to be changed, so changes to the original mark scheme were made in two ways. The first was to change what constituted a passing mark for each section of the mark scheme, so that a lack of considerations of power relations in the literature, or protected characteristics would equate to a failing mark (Figure 1). The second change was to redefine item 6, originally Reflection, to Diversity & Inclusion, which is worth 10% of marks (Figure 2). To pass this section students must demonstrate a satisfactory account of protected characteristics (such as age, disability, gender, race, sex and religion) through an exploration of aspects of their client’s identity in CBT literature, and a reflection of their own identity. To support the students in this new aspect of assessment a lecture on “Identity & Values” so the topic was introduced prior to the assessment.

Comparison table of a mark scheme with two columns titled "Original Mark Scheme" and "New Mark Scheme."Transcribed Text: Original Mark Scheme Relating case to relevant literature, displaying knowledge, and understanding of theories and concepts relevant to the case study. New Mark Scheme Relating case to relevant literature, displaying knowledge, and understanding of theories and concepts relevant to the case study, critically evaluating psychology literature. Consider power relationship in psychology literature, such as the colonial history of the subject. Explore existing literature regarding protected characteristics, or comment on the lack thereof. Explore how mental health may present differently in different groups e.g. culture, age, sexuality, gender, and whether interventions or theories are effective for the group that relates to your client.
Figure 1. A comparison between the ‘new’ and ‘old’ marking scheme
Alt-text:Table outlining assessment criteria for diversity and inclusion in clinical settings. Transcribed Text: Diversity & Inclusion – 10% Reflection on protected characteristics and differences between the client and clinician and how the client’s protected characteristics (e.g., session times discussed to be respectful of daily prayers, consideration of relevance of video feedback questions e.g., “redness” for Black clients). Inclusion of relevant literature relating to the protected characteristics of your client. Discussion around any differences in presentation within the client group you are working with, and therefore any adaptations to your treatment, or considerations going forward. Considerations to the colonial history of psychology and psychology literature. Distinction 70 – 100 Excellent account of the client which is comprehensive and provides clear information regarding their protected characteristics and how these have been considered with regards to difference in the therapy space and in terms of potential adaptations to assessment and/or treatment. Excellent reference to relevant literature around protected characteristics of the client. Merit 60 - 69 Good account of the client which is comprehensive and provides clear information regarding most of their protected characteristics and how these have been considered with regards to difference in the therapy space and in terms of potential adaptations to assessment and/or treatment. Good reference to relevant literature around protected characteristics of the client. Pass 50 – 59 Satisfactory account of the client which is comprehensive and provides some information regarding some of their protected characteristics and how these have been considered with regards to difference in the therapy space and in terms of potential adaptations to assessment and/or treatment. Some reference to relevant literature around protected characteristics of the client. Fail 0 - 49 Weak presentation of the client which is not comprehensive and provides little or no information regarding some of their protected characteristics and how these have been considered with regards to the difference in the therapy space and in terms of potential adaptations to assessment and/or treatment. Few reference to relevant literature around protected characteristics of the client.
Figure 2. New diversity and inclusion section in the marking scheme.

Impact

Student and marker feedback indicates the three objectives of this project have been met: the assessment and mark scheme incorporates EDI,  the changes are in line with BABCP guidance for EDI, and these changes have facilitated student learning. The changes to the mark scheme were rolled out for two modules of the HI CBT Adult course and adopted by the HI CBT Childrens course also. Feedback from markers indicate a noticeable increase in the student’s consideration of the client’s identity, and a diversification of CBT literature utilised for reports. In the Theory and Practice for Depression (PYMDEP) module evaluation, students’ ratings of “course content/examples/case studies selected (or used) offer a diversity perspective” has increased from an average of 3.5 to 4.4, where 5 means definitely agree. Although this feedback is not solely regarding changes to assessment, it does indicate change has been recognised and is having a positive impact.

Reflections

Decolonisation, and developing cultural competence are both ongoing processes, which require lifelong learning. This change in assessment has been one step in meeting BABCP curriculum guidance (NHS, 2022) and in training our therapy workforce to deliver anti-discriminatory, and effective therapy for diverse groups of people. This change has happened in line with lecture content changes, such as the introduction of teaching day on working with neurodivergence, gender & sexuality, and religion & spirituality.

Follow up

One change within an assessment does not end the ongoing process of decolonisation and of the integration of EDI within higher education. Going forward it would be good to get more feedback directly from students’ assessment, and any further work we can do to continue to decolonise the course and ensure all peoples can access equitable psychological support.

References

Exploring students’ sense of belonging in the Charlie Waller Institute

Exploring students’ sense of belonging in the Charlie Waller Institute

By michaelkilmister Comment Closed

 

By:
1. Denethri Gamagedara, Psychology Undergraduate and UROP student, d.gamagedara@reading.ac.uk;
2. Anjali Mehta Chandar, Lecturer, Charlie Waller Institute, a.m.chandar@reading.ac.uk;
3. Professor Allán Laville, Dean for Diversity and Inclusion, allan.laville@reading.ac.uk;
4. Hannah Raheja, Research Assistant, h.raheja@student.reading.ac.uk
Photo by Tim Mossholder on Unsplash
Overview

Following the University of Reading’s (UoR) Race Equality Review (UoR, 2021), this Undergraduate Research Opportunities Programme (UROP) project took place, consisting of a student survey and two student interviews conducted in the Charlie Waller Institute (CWI), a department within the School of Psychology and Clinical Language Sciences. The aim was to investigate students’ perception of staff racial representation and its impact on students’ sense of belonging. Students felt that diversity explicitly needed to be integrated into the teaching and learning environment. A range of recommendations are provided.

Objectives

The objectives of this pilot study were:

  • To understand how staff racial representation impacts CWI students’ sense of belonging.
  • To explore student sense of belonging in CWI, a department that consciously integrates diversity and inclusion into teaching.
  • To contribute towards diversifying teaching and learning material and maximising student-staff interactions.

Context

The Race Equality Review (UoR, 2021) underlined racial representation as a salient factor for fostering sense of in its students. As Strayhorn (2018) outlines, sense of belonging is broadly defined as “students’ perceived social support on campus, a feeling or sensation of connectedness, the experience of mattering or feeling cared about, accepted, respected, valued by, and important to the group (e.g., campus community) or others on campus (e.g., faculty, peers).” Focus groups within the review highlighted that a lack of staff from minor ethnicities reinforced students’ isolation and lack of belonging within the university. When present, sense of belonging promotes successful learning by improving student engagement, encouraging students to seek campus resources and acting as a buffer from mental health issues (Gopalan & Brady, 2019). This was consistent with comments made in focus groups, where inclusion and sense of belonging were seen as important to the student experience.

The primary reason for conducting this study within CWI was because of the institute’s particular interest in ensuring diversity and inclusion (D+I), and it has an award-winning D+I working group. An institute in the School of Psychology, CWI specialises in postgraduate, vocational training for mental health practitioners. Within the teaching material, students are taught to think about a therapy client’s protected characteristics and engage in conversations about their diverse cultural backgrounds. It was deemed interesting to see how students at an institute that overtly discusses diversity felt about their sense of belonging to the university (potentially based on their racial identity).

Denethri Gamagedara conducted this study as part of UROP. This study was particularly important to her because of the possible implications of institutional improvement for students similar to herself. The project had two supervisors: Anjali Mehta Chandar, a Lecturer in CWI with a keen interest in D+I, and Allán Laville, both a Professor in the department and the University’s Dean of Diversity and Inclusion. Hannah Raheja, a CWI undergraduate student, aided in the project in the role of a research assistant, particularly supporting with the thematic analysis and dissemination.

Implementation

The study involved conducting a survey and two individual participant interviews with the students of CWI. The questions were co-designed by Denethri and Anjali. Sixteen students responded to this survey while three students volunteered for the interview, however only two proceeded to be interviewed due to availability.  Responses were analysed using reflexive thematic analysis and discussed with Anjali and Allan. Coding and clustering were completed by Denethri and Hannah, with inter-coder agreement scores of 95.5% and 85.3%. Figure 1 and Figure 2 below outline the themes and sub-themes that emerged from the data.

Figure 1

Themes from the survey

PowerPoint slide with the following text: Themes from survey 1. Uncertainty & neutrality 2. Diversity and improvements 3. Majority 4. Connecting with staff 5. Benefits of having representation and sense of belonging Themes from the question: Please write 10 words which come to mind when thinking about ‘sense of belonging’ 1.Group sense of belonging 2. Individual sense of belonging 3. Positive feelings from sense of belonging

Figure 2

Themes (dark green) and sub-themes (light green) from the interviews

PowerPoint slide with the following text: Themes in the interviews 1. Belonging and its facets 2. Diversity and representation Holistic Diversity Characteristics Racial Majority 3. Teaching and learning environment Conversations on diversity Diversity in education 4.Feedback 5.Interactions with staff 6.Student experience Professional Practice Mental Health Barriers 7.Institutional awareness

Impact

The research team devised the following recommendations for teaching staff to foster a sense of belonging for students and address diversity.  

1 Openness in introductions: Lecturers to mention their own protected characteristics and routes to becoming an academic can be beneficial, particularly during their initial introduction to the cohort e.g. first teaching session. Students had perceptions that only individuals who fit certain criterion could become lecturers (e.g., majority ethnicity and higher socioeconomic status).

2 Showing cultural awareness: Acknowledging cultural events in lectures, Blackboard announcements or emails helps students feel accepted and valued. This allows for better student-staff connection.

3 A discussion blog: Implementing a blog where lecturers can talk about being a professional from a minoritised background is helpful. For example, departments might like to host this on Blackboard, with a new blog each month, or in the student newsletter which is sent out once a term. Students recognised the importance of holistic diversity and wished for more openness about this.

4 Teaching resources: Representation extends to teaching material. has conducted work into decolonising the curriculum, with a more recent publication in September about steps on how to achieve this.

5 Discussing belonging with academic tutees explicitly: Students reported that openness was crucial and belonging involved feeling comfortable and valued. Figure 3 (below) provides examples on how to address sense of belonging.

6 Discussing diversity, notably race, with tutees: Students mentioned that acceptance contributed to belonging. Creating a safe space for students may improve student-staff relationships. Figure 3 (below) has potential questions related to race.

Figure 3

Questions related to sense of belonging and diversity to ask tutees

PowerPoint slide displaying the following text: Discussing sense of belonging “Do you feel valued within the university? Do you feel valued within the department?” “Are you comfortable during lectures? Do you feel comfortable approaching lecturers after?” “Do you feel included and part of a group at university?” Discussing diversity and race “Do you feel we do enough as lecturers and/or as a university to ensure equal opportunities for everyone, especially from various ethnic backgrounds?” “Do you feel we do enough as lecturers and/or as a university to build cultural awareness where everyone can learn and be themselves?” “Do you feel the university is doing enough to acknowledge and ensure diversity?” “What would you like to see us do more of to further inclusion in the university and/or department?” “Has your identity characteristics affected your university experience?”

Reflections

Conducting the study was extremely beneficial as it created the opportunity to think about recommendations to improve student sense of belonging. The results showed that only 31% of students agreed to the statement “I feel a sense of belonging within CWI”, with 25% neither agreeing nor disagreeing, 18.8% disagreeing and 25% strongly disagreeing – this suggests that there is room for improvement.

The study was successful because of the efficient pedagogical partnerships that were formed. Anjali, who was the main supervisor during the project, created a creative space where Denethri and Hannah, as undergraduates, could openly express their opinions. Whilst having Allan’s perspective and expertise helped Denethri and Hannah cluster themes effectively and think about tangible recommendations that lecturers can implement. The positive outcomes, particularly the opportunity to conduct more thorough analysis with a variety of researchers, will hopefully encourage more students and lecturers to apply for the UROP scheme in subsequent years too.

The study may have been better implemented if there was an opportunity to hear from a group of students, such as in a focus group setting. This was part of the original methodology, however, only one student volunteered for this, which therefore had to become an individual interview instead. Focus groups and/or creative styles of evaluation and student voice (such as zine-making) could be incorporated into future replications of this study.

Follow up

The recommendations have been included in a screencast for dissemination to staff groups within CWI, which is viewable here for other UoR colleagues to also view. A reflective paper about the impact of pedagogical partnerships formed from the study is in the process of being published. A pre-print in the style of a lab report is also hoping to be published. It is likely that future projects will look into the effectiveness of the recommendations, perhaps in the form of student or staff feedback.

References

  • Gopalan, M., & Brady, S. T. (2020). College students’ sense of belonging: A national perspective. Educational Researcher, 49(2), 134-137.
  • Strayhorn, T. L. (2018). College Students’ Sense of Belonging: A Key to Educational Success for All Students. Routledge.
  • University of Reading (UoR). (2021). Race equality review. University of Reading. https://static.reading.ac.uk/content/PDFs/files/race-equality-review-report-2021.pdf

Links

Questions in Figure 1 are adapted from CIPD (2013)