Decolonising assessment in a clinical training programme within the Charlie Waller Institute

Decolonising assessment in a clinical training programme within the Charlie Waller Institute

By michaelkilmister Comment Closed

 

By: Natalie Meek, School of Psychology & Clinical Language Sciences, n.a.meek@reading.ac.uk
Four green leaves of varying sizes against a black background
Photo by Olia Bondarenko on Unsplash

Overview

Research within psychology has been largely conducted on a group that represent on 12% of the world’s population, those that are Western, educated, industrialised, rich and democratic (WEIRD) populations (Henrich et al., 2010). This colonial legacy, the centralising of the WEIRD population as representative of the human species, indicates a need to decolonise (Winter et al., 2022). The British Association for Behavioural & Cognitive Psychotherapies (BABCP) who accredit our High Intensity Child, and Adult Cognitive Behavioural Therapy (CBT) programmes centre decolonisation and inclusion within their updated curriculum. In response to this, and decolonisation efforts elsewhere in the higher education sector, the aim of the BABCP is to embed EDI within assessment. Assessment is also a focus of this case study as assessment drives learning in higher education (Boud, 1995).

Objectives

  • To change current assessment mark scheme to incorporate a section on EDI.
  • To ensure assessment is in line with BABCP EDI guidance.
  • To encourage student learning through assessment.

Context

The Charlie Waller Institute (CWI) offers graduate and post graduate clinical training courses. The training course discussed here is for High Intensity Adult CBT course, a  year-long post-graduate clinical training course run twice a year with intakes of up to 50 students. The ongoing effort of the University to decolonise is essential within training courses to ensure our trainees are equipped to deliver equitable psychological support to all.

Implementation

The extended case report (ERP) is an assessment used across two modules, a 5,000-word report which is set as part of paired assessment, was explored as a potential vehicle of change. There were some references to the identity of the client within the original mark scheme, however, little exploration of the client’s identity was required to pass the assessment. The High CBT Curriculum 4th Edition (NHS, 2022) states that trainees should be equipped with an understanding of EDI, and that we should support students to understand the needs of their clients in the context of protected characteristics. The curriculum (NHS, 2022) outlines the need for CBT therapists to achieve cultural competence, to be committed to anti-discriminatory clinical practice, and to have knowledge of research on CBT with minoritised groups. As assessment is an opportunity for learning (Sambell, et al., 2013), so this was a key opportunity to meet the BABCP curriculum.

Historically assessment has been neglected in the process of decolonisation within higher education (Godsell, 2021) and this was the case within our course. Changes had been made to lectures, but no changes had been made in assessment. To ensure assessment was aligned with BABCP curriculum (NHS, 2022) and Minimum Training Standards (BABCP, 2022) the method of assessment was not able to be changed, so changes to the original mark scheme were made in two ways. The first was to change what constituted a passing mark for each section of the mark scheme, so that a lack of considerations of power relations in the literature, or protected characteristics would equate to a failing mark (Figure 1). The second change was to redefine item 6, originally Reflection, to Diversity & Inclusion, which is worth 10% of marks (Figure 2). To pass this section students must demonstrate a satisfactory account of protected characteristics (such as age, disability, gender, race, sex and religion) through an exploration of aspects of their client’s identity in CBT literature, and a reflection of their own identity. To support the students in this new aspect of assessment a lecture on “Identity & Values” so the topic was introduced prior to the assessment.

Comparison table of a mark scheme with two columns titled "Original Mark Scheme" and "New Mark Scheme."Transcribed Text: Original Mark Scheme Relating case to relevant literature, displaying knowledge, and understanding of theories and concepts relevant to the case study. New Mark Scheme Relating case to relevant literature, displaying knowledge, and understanding of theories and concepts relevant to the case study, critically evaluating psychology literature. Consider power relationship in psychology literature, such as the colonial history of the subject. Explore existing literature regarding protected characteristics, or comment on the lack thereof. Explore how mental health may present differently in different groups e.g. culture, age, sexuality, gender, and whether interventions or theories are effective for the group that relates to your client.
Figure 1. A comparison between the ‘new’ and ‘old’ marking scheme
Alt-text:Table outlining assessment criteria for diversity and inclusion in clinical settings. Transcribed Text: Diversity & Inclusion – 10% Reflection on protected characteristics and differences between the client and clinician and how the client’s protected characteristics (e.g., session times discussed to be respectful of daily prayers, consideration of relevance of video feedback questions e.g., “redness” for Black clients). Inclusion of relevant literature relating to the protected characteristics of your client. Discussion around any differences in presentation within the client group you are working with, and therefore any adaptations to your treatment, or considerations going forward. Considerations to the colonial history of psychology and psychology literature. Distinction 70 – 100 Excellent account of the client which is comprehensive and provides clear information regarding their protected characteristics and how these have been considered with regards to difference in the therapy space and in terms of potential adaptations to assessment and/or treatment. Excellent reference to relevant literature around protected characteristics of the client. Merit 60 - 69 Good account of the client which is comprehensive and provides clear information regarding most of their protected characteristics and how these have been considered with regards to difference in the therapy space and in terms of potential adaptations to assessment and/or treatment. Good reference to relevant literature around protected characteristics of the client. Pass 50 – 59 Satisfactory account of the client which is comprehensive and provides some information regarding some of their protected characteristics and how these have been considered with regards to difference in the therapy space and in terms of potential adaptations to assessment and/or treatment. Some reference to relevant literature around protected characteristics of the client. Fail 0 - 49 Weak presentation of the client which is not comprehensive and provides little or no information regarding some of their protected characteristics and how these have been considered with regards to the difference in the therapy space and in terms of potential adaptations to assessment and/or treatment. Few reference to relevant literature around protected characteristics of the client.
Figure 2. New diversity and inclusion section in the marking scheme.

Impact

Student and marker feedback indicates the three objectives of this project have been met: the assessment and mark scheme incorporates EDI,  the changes are in line with BABCP guidance for EDI, and these changes have facilitated student learning. The changes to the mark scheme were rolled out for two modules of the HI CBT Adult course and adopted by the HI CBT Childrens course also. Feedback from markers indicate a noticeable increase in the student’s consideration of the client’s identity, and a diversification of CBT literature utilised for reports. In the Theory and Practice for Depression (PYMDEP) module evaluation, students’ ratings of “course content/examples/case studies selected (or used) offer a diversity perspective” has increased from an average of 3.5 to 4.4, where 5 means definitely agree. Although this feedback is not solely regarding changes to assessment, it does indicate change has been recognised and is having a positive impact.

Reflections

Decolonisation, and developing cultural competence are both ongoing processes, which require lifelong learning. This change in assessment has been one step in meeting BABCP curriculum guidance (NHS, 2022) and in training our therapy workforce to deliver anti-discriminatory, and effective therapy for diverse groups of people. This change has happened in line with lecture content changes, such as the introduction of teaching day on working with neurodivergence, gender & sexuality, and religion & spirituality.

Follow up

One change within an assessment does not end the ongoing process of decolonisation and of the integration of EDI within higher education. Going forward it would be good to get more feedback directly from students’ assessment, and any further work we can do to continue to decolonise the course and ensure all peoples can access equitable psychological support.

References

Blending problem-based learning (PBL) and real-world scenarios on foundation economics: IFP

Blending problem-based learning (PBL) and real-world scenarios on foundation economics: IFP

By michaelkilmister Comment Closed

 

By: Dr Veundjua Muruko-Jaezuruka, ISLI (International Study and Language Institute), v.muruko-jaezuruka@reading.ac.uk
stack of jigsaw puzzle pieces
Photo by Hans-Peter Gauster on Unsplash

Overview

This case study explores blending problem-based learning (PBL) and real-world scenarios on foundation economics. By embracing PBL, encourages deep learning, real-world application, and fosters a global perspective in students. In addition to enhancing academic achievement, it prepares students for further academic studies and future professional challenges in a globalised world.

Objectives

  • To build a deep understanding of foundational economic theories and concepts, while engaging students in practical applications that stimulate critical thinking and problem-solving skills.
  • The aim is to bridge the knowledge gap for international students who may face challenges transitioning into higher education systems.

Context

On the International Foundation Programme (IFP), we are committed to enhancing the student experience through creative and effective teaching strategies. An innovative approach I introduced on the Foundation Economics modules was the integration of Problem-Based Learning (PBL), in response to student feedback. With an average cohort size of 28, the module offers a supportive and interactive learning environment. Previously, students engaged mainly through quizzes, short-answer tasks, calculations, and textbook-based case studies, with limited real-world application. The shift to PBL marked a significant change, as students tackled real economic issues—such as market failures and government intervention in Microeconomics—through collaborative group work. They researched and critically analysed real-world problems, then proposed possible government intervention/solutions. This approach not only deepened engagement and critical thinking but also developed transferable academic and professional skills aligned with the expectations of higher education and future employment.

Implementation

  1. PBL: Each week, students were presented with real-world economic challenges, such as analysing global trade disputes, inflation crises, or the impact of taxation on different economies. This PBL approach moves beyond traditional lectures, prompting students to work in small groups to research, analyse, and propose solutions using core economic principles.
  2. To encourage more active participation, we adopted the flipped classroom approach. Students access lectures online at home and come to class prepared to engage in discussions, debates, and hands-on activities based on the theoretical content they’ve already absorbed. By shifting lower-order learning to independent study, resulted in more engagement, through interactive tasks. This change enhanced retention of complex economic concepts, and students reported feeling more confident in applying theory to practice.
  3. Cross-cultural perspectives: Given the international nature of the IFP, the module includes case studies from different countries, fostering discussions on how economic principles apply across diverse global contexts. Students were encouraged to draw on their own countries’ economic policies, enhancing relatability and relevance adding unique insights and enriching the learning experience.
  4. Interactive database technologies: Students were introduced to economic databases to analyse trends in GDP, inflation, and unemployment rates. These not only support the application of economic theory but also equip students with skills required in the modern data-driven world.

Impact

– Critical thinking and collaboration: Students developed critical thinking skills by working through ambiguous economic problems in teams -such as the impact of recent inflation on living standards and how this affects students’ daily lives, or the externalities of production and their environmental consequences, encouraging students to propose relevant policy solutions – learning to debate and defend their solutions. Student feedback indicated higher confidence in tackling complex economic problems, a skill crucial for their success in undergraduate studies.

– Global awareness: Students gained a global perspective on economics, appreciating the nuances of economic policies and their impacts in various regions around the world. By creating a learning community where students’ diverse experiences are valued (see Lave and Wenger’s Social Learning Theory, 1991), we fostered a collaborative and inclusive learning environment.

Reflections

Integrating PBL with digital tools (query interface built-in databases – like Statista, ONS and the World Bank Data Portal – transformed the classroom from a space for passive content delivery to a dynamic environment for exploration. One significant benefit was how it catered to different learning styles; students who excelled in independent research complemented those who thrived in group discussions, creating a holistic learning experience. These impacts were evident through classroom observations, where diverse strengths emerged during group tasks, as well as through end-of-seminar student surveys.

While the flipped classroom model was largely successful, there were some challenges, particularly in ensuring all students completed the pre-class materials. To address this going forward, short accountability measures, such as online quizzes, to track progress will be implemented. Some students also required more support transitioning to this self-directed learning model, so additional tutorials will be provided for those who need extra guidance.

I aim to develop a stronger feedback loop, where students regularly reflect on the flipped classroom model’s effectiveness, ensuring that the approach evolves in line with their learning needs.

Follow up

  • Expanding the use of PBL to cover all major topics in the curriculum
  • Introducing additional digital tools and simulations to further enrich the learning experience.
  • Providing continuous professional development for staff to adapt and refine these innovative teaching strategies.

Feedback on the effectiveness of PBL has been collected, and this approach will be incorporated (in seminars) into curriculum areas that students find challenging – identified through their own feedback.

References

  • Lave, J., & Wenger, E. (1991). Situated learning: Legitimate peripheral participation. Cambridge University Press.
Enhancing and developing the use of OneNote Class Notebook beyond the Covid-19 pandemic

Enhancing and developing the use of OneNote Class Notebook beyond the Covid-19 pandemic

By michaelkilmister Comment Closed

 

By: Rita Balestrini, Department of Languages and Cultures, r.balestrini@reading.ac.uk

Overview

The project built on T&L innovation embraced in the Department of Languages and Cultures (DLC), where Microsoft’s OneNote Class Notebook (CN) was trialled during the Covid-19 pandemic to overcome the constraints of teaching languages remotely. The outcomes provided knowledge of DLC students’ experience of CN and understanding of the type of support needed by CN users to staff users of CN, and to colleagues in Technology Enhanced Learning (TEL) and Digital Technology Services (DTS), and informed the development of technical and pedagogical support and guidance for CN users.

Objectives

The project aimed to enhance student learning by improving the use of CN, and had the objective to facilitate sharing of knowledge and expertise, gain insights into students’ experience of CN and inform TEL and DTS decision-making on the tool.

Context

CN is a digital T&L tool to store materials (e.g. text, images, handwritten notes, links, recorded voice, videos), where students and teachers can work interactively in and outside the classroom. It is organised into three parts:

  • ‘Content Library’ – where only the teacher can add, edit, and delete materials.
  • ‘Collaboration Space’ – a place to collaborate in groups open to everyone in the class, where multiple users can work on a page simultaneously or asynchronously.
  • ‘Teacher Only’ – a private space invisible to students.
  • ‘Student Notebook’ – a private area that only a student and their teacher can see and use, where they can interact directly on a page.

CN continues to be used in some language modules as it proved to be effective beyond a remote teaching environment and offered features that supported accessibility and inclusivity in language learning.

screenshot of the classroom notebook
Screenshot of a Class Notebook © Rita Balestrini

Implementation

  • In 2022–2023, I held three sessions with DLC staff users to share practice and ideas on using CN, and record information on what support would enhance teaching with CN. I also held in-person, small group meetings with DLC CN student users from all year groups to gain insights into their experience of CN. The feedback gathered informed the development of a branched MS Forms survey, which was completed by 28 (of 50) student CN users.
  • I facilitated a cross-School (DLC, Institute of Education, Law) ‘teaching conversation’ to reflect critically on the pedagogical value of CN.
  • I wrote a project report for DTS and TEL and shared with them the findings from the needs analysis.

Impact

  • The project created a ‘space’ for the sharing of practices, knowledge, experience and expertise, which in turn, enabled the enhancement of the use of CN.
  • It enhanced students’ learning and increased their engagement with CN learning activities – as evidenced by the students’ survey.
  • As part of ‘internal monitoring and review’ practice, the outcomes of the ‘teaching conversation’, informed the School of Literature and Languages (SLL) T&L enhancement process.
  • The project should inform the integration of CN with other applications (e.g. Teams), and the provision of technical and pedagogical support for CN users.

Reflections

CN offers a paperless learning environment and facilitates the organisation of T&L materials in a clear and, ‘potentially’ visually intuitive, hierarchical structure. Students evaluated CN positively as a useful ‘digital binder’ and ‘learning tool’ (Average Rating [AR] 4.15 and 4:00 respectively, on a scale of 1 to 5). Most of them felt that materials and resources were easy to access (AR 3.89), and it was easy to take notes within CN (AR 3.74).

CN users generally agreed that navigation in CN is quite ‘fluid’ compared to Blackboard. However, I think that for this fluidity to be fully meaningful pedagogically CN requires a thoroughly thought-out structure, with reasoned and transparent ‘labelling’ throughout the learning environment.

There can be issues in meeting current assessment policies when using CN for summative assessment. However, CN greatly facilitates the provision of feedback with a digital pen or by audio-recording on a page. Staff value the possibility of monitoring individual and group activities and providing private, individualised feedback in different formats; students appreciate highly receiving feedback directly in their personal notebook, which stands out as a noteworthy result of the survey (AR 4.26), especially considering that feedback in general ‘is often framed as the dimension of students’ experience with which they are least satisfied’ (Winstone & Carless, 2020, p. 5).

The ‘Collaboration Space’ can be used for class activities, collaborative projects, sharing resources, and a channel for students’ voice – additional uses of this area depend on the subject taught. CN allows students to take ownership of a shared area and use it for independently chosen purposes, which helps create a sense of ‘community’ and a feeling of ‘online connectedness’ (Hehir et al., 2021).

Regarding technical issues, 68% of respondents did not report any. The others mentioned a variety of problems (e.g. syncing issues, ‘handwriting’ and ‘highlighting’ not anchored to text). Many reported difficulties were linked to using different CN versions, devices, or operating systems, which suggests that improvements could come with advice from technical support specialists.

Follow up

In future, students’ experience of using CN could greatly benefit from:

  • staff sharing and discussing practices across different subjects to facilitate pedagogical enhancements (e.g., communities of practice, special interest groups, TEL forums);
  • making access to CN easier and facilitating its integration with Teams and Blackboard;
  • the availability of expert support from DTS and TEL (e.g. technical assistance, TEL resources and sessions for users).

References

  • Hehir, H., Zeller M., Luckhurst, J., & Chandler T. (2021) Developing student connectedness under remote learning using digital resources: a systematic review. Education and Information Technologies, 26, 6531-6548. https://doi.org/10.1007/s10639-021-10577-1
  • Winstone, N., & Carless, D. (2020) Designing effective feedback processes in higher education. Routledge.
Reframing success in a partnership project

Reframing success in a partnership project

By michaelkilmister Comment Closed

Associate Professor Amanda Millmore, School of Law, a.millmore@reading.ac.uk

Update June 2024

This submission is now a published journal article co-authored with student partners. The link is here and the complete reference can be found below: ‘Reframing Success in A Pivoting Partnership – Student Mentors Trying to Engage: A Tale of Trial and Error’.

Objectives

  • Curriculum development – reviewing & designing materials and the Blackboard framework for a new elective first year module.
  • Peer mentoring – student partners in Part 2 offering support to students on the module, embedded within the module by linking student partners directly with each seminar group and including them in online drop-ins and in-person teaching.

Context

During the Covid-19 pandemic, our students had struggled with their sense of belonging, not feeling part of the School of Law community due to lockdowns, online teaching and restrictions on gathering socially. We were creating a new elective, Part 1 law module called “Law and Society”, and we wanted to work with students to develop the module. We were also conscious that we needed to improve support for our new first-year students to ease their transition into university and their studies by enhancing their sense of belonging. We came up with the idea of supporting the new students by building bridges with the cohort in the year above.

Implementation

Curriculum Design – the student partners worked together with staff to review the materials we had prepared and giving their thoughts on what would be helpful and work for the new Part 1 students.

Peer Mentoring – we embedded student partners as mentors with individual seminar groups. We introduced them online  with a dedicated “Mentor” section on Blackboard, hosted a “Q&A” Padlet board for students to interact anonymously if they wished. The module was designed with the mentors embedded into it. Student partners were each paired with one of the teaching academics on the module to provide support. Mentors were timetabled to join online optional drop-in sessions  (and the session was headed “Meet the Mentors”) and compulsory seminars to offer support with groupwork and formative activities. Academic staff highlighted the benefits of peer support and promoted the mentors and how they could help, while mentors encouraged formal and informal contact with the students in their designated classes.

When student mentees did not attend the optional drop-in (we had more student partners attending than we did students enrolled on the module) we pivoted to the student partners sharing their advice for new students, which we recorded in a document that we shared on Blackboard.

Impact

Curriculum Design – this aspect of the project was very successful, with student partners feeding into the design of the Blackboard module, reviewing the module materials to ensure that they were engaging and pitched at the appropriate level and on student recommendation we ensured the provision of clickable Talis reading lists.

Peer Mentoring – this aspect fell flat, as the Part 1 students did not want to be mentored. They did not attend sessions where the mentors were offering support, declined offers of help (even when they volunteered to join a WhatsApp group) and the student partners felt that we were flogging a dead horse trying to mentor first-year students who did not want to be mentored. Student partners then pivoted to carry out some research to find out what the barriers to engagement with the project were; beset with difficulties in seeking feedback from the Part 1 students who did not respond to questionnaires, offers of coffee and cake or focus groups, the few who did participate explained that they just did not feel the need for that kind of peer support.

Reflection

Whilst the mentoring aspect of the project did not land successfully with the Part 1 students, it was not due to problems with the partnership or even the design of the project, it was just that the Part 1 cohort did not want the support that we were offering. This may be peculiar to this particular cohort, who had been significantly affected by Covid at school, but it was not for want of trying.

Whilst not one of our explicit aims, the notable success of our partnership is the value to the student partners who worked as module designers, mentors and researchers, these students have had the opportunity to disseminate their experiences at conferences and in writing and can see real benefits to their partnership experiences, and they have developed tangible employability attributes, not least a high degree of resilience.

a group of women in business attire standing in front of a white and wood panelled wall

Amanda Millmore and student partners before presenting at the Change Agents’ Network conference 2022

Follow-up

Student partners co-presented this project at the CAN (Change Agents’ Network) conference at UCL in summer 2022 and we have now co-authored a journal article sharing our experiences.

We have continued with the good curriculum developments in the module, which continues to grow from strength to strength. The mentoring aspect of the project has not continued, but instead we ensure to signpost our students to their STaR mentors and PAL leaders for peer support.

Partnership working in the School of Law continues to be business as usual, and the hiccups on this project have not deterred us from trying new things with our student partners, ensuring that we see the benefits of partnership as part of the process and the positives for the partners.

References and links

We contributed to a blog after the CAN conference: CAN Case Study: A Pivoting Partnership – Student Mentors Trying to Engage: a Tale of Trial & Error | CAN 2022 (ucl.ac.uk)

Millmore, A., Collyer, B., Delbridge, E., Khan, A., Patil, I. and Williams, M. (2024) Reframing success in a pivoting partnership – student mentors trying to engage: a tale of trial and error. The Journal of Educational Innovation, Partnership and Change, 9(1). https://journals.studentengagement.org.uk/index.php/studentchangeagents/article/view/1208 

If you’d like to know more about staff-student partnership in the School of Law, you can reach me at a.millmore@reading.ac.uk

 

Using student feedback to make university-directed learning on placement more engaging

By aaroncooper Comment Closed

Anjali Mehta Chandar: a.m.chandar@reading.ac.uk

Charlie Waller Institute, School of Psychology and Clinical Language Sciences

 

Overview

Our vocational postgraduate courses in Cognitive Behavioural Therapy include University Directed Learning (UDL) days that are completed within the placement setting (e.g. their NHS trust). A qualitative student feedback survey allowed us to collaboratively adapt this format, with favourable outcomes in how interesting, enjoyable and useful the students found the day.

Objectives

Our objectives were as follows:

-To ascertain how interesting, enjoyable and useful the UDL days were, as perceived by the students, based on pedagogical findings that students engage best and are most satisfied, if these characteristics are met (e.g. Ramsden, 2003).

-To make improvements to the UDL days based on qualitative student feedback.

-To ascertain whether our improvements had made the UDL days more interesting, enjoyable and useful, as perceived by the next cohort of students.

Context

The Educational Mental Health Practitioner (EMHP) and Children’s Wellbeing Practitioner (CWP) programmes are one-year vocational postgraduate courses. The students are employed by an NHS trust, local authority or charity, and study at UoR to become qualified mental health practitioners.

UDL days make up a small proportion of the teaching days. They are self-guided teaching days, usually containing elements of e-learning, designed to complement and consolidate face to face teaching (live or remote). A combination of learning methods, including e-learning, is shown to be effective in increasing clinical skills (e.g. Sheikhaboumasoudi et al., 2018).

UDL days had been poorly received by our two 2019/2020 cohorts, according to feedback in the student rep meetings and Mentimeter feedback after each UDL e.g.  comments included: ‘there was too much [content] for one day’, ‘I felt pressured to fill [the form] out rather than focussing on the readings themselves’ and ‘[the reflective form] was too long and too detailed’. Whilst this gave us some ideas on changes to make, I was aware of the low completion rates of the Mentimeter feedback. Therefore, to hear from more voices, we decided to create a specific feedback survey about the UDLs to help us make amendments in a collaborative way.

Implementation

We started by creating a survey for the current students to ascertain their views on how interesting, enjoyable and useful the UDL days were. We also had qualitative questions regarding what they liked and disliked and ideas for specific improvements.

I then led a meeting with my course team to explore the key findings. We agreed to make several changes based on the specific feedback, such as:

– variety of activities (not purely e-learning, but roleplays, videos, self-practice self-reflection tasks, group seminars run by lecturers, etc, to provide a more engaging day)
– fewer activities (we aimed for one main activity for every 1-1.5 hours to manage workload demands)
– an option to complete the programme’s reflective form (designed to be more simple, by asking them to provide their own notes on each task) or provide their notes in a format of their choice (e.g. mindmaps, vlogs, etc) to increase accessibility.
– share these reflections on a discussion board for other students and the lecturer to comment on.

We were unable to implement these changes to the current cohort as they had finished all their UDL days in the timetable, so made the changes for the following cohorts in 2020/2021.

We then sought their feedback via a new survey to ascertain their views on how interesting, enjoyable and useful the UDLs are, with additional questions relating to specific feedback on the new elements.

Impact

The survey results for the newer cohorts were much more positive than the original cohort, after changes were made to the UDL format.

There was a significant increase in how interesting, enjoyable and useful the students found the days.

The trainees also largely agreed that the UDLs had an appropriate workload, e.g. one task per 1-1.5 hours.

They also largely agreed that UDLs included interactive and varied tasks. This finding is in contrast to some of the aforementioned literature of the importance of e-learning, and it must be remembered that too much e-learning can be less engaging for trainees.

The students also praised the simple reflective form as a helpful tool, and many appreciated the option to submit notes in their own preferred way.

Although we neglected to explore the role of the lecturer feedback in the new UDL survey, research shows that this makes for a more engaging e-learning session (Dixson, 2010), and may explain why the UDLs were now more favourable.

Moreover, the process of collecting data from the students via a feedback form seemed effective, in that we used feedback to adapt the specific teaching method, thus improving student satisfaction. Pedagogical research shows the importance of using qualitative questions (instead of, or as well as, quantitative methods) to elicit student feedback (Steyn et al., 2019).

Reflection

Overall, this redesign was successful, which may be down to the fact we used the student voice to make meaningful changes. This is in line with Floden’s (2017) research that student feedback can help to improve courses.

Furthermore, the changes we have made are in line with effective practice amongst other courses and universities, e.g. appropriate workload (Ginn et al., 2007), student choice of discussion format (Lin & Overbaugh, 2007), accessibility of resources (Mahmood et al., 2012) and lecturer interaction (Dixson, 2010).

There is a possible limitation in this case study, in that our more recent cohorts are generally happier on the course, and therefore may be more positive about the UDL. In future projects, it would be useful if we can notice themes within module evaluation/student rep meetings earlier, to then elicit specific survey feedback earlier in the course and make amendments sooner, allowing feedback from the same cohort.

In future variations of the survey, I would also wish to explicitly ask how trainees find sharing reflections on the Blackboard discussion groups, as this is one change we had not elicited feedback on.

Follow Ups

We have continued to utilise these changes in the UDL format with future cohorts,  e.g. reduced workload, variety of activities, simplified forms, choice of discussion format and lecturer interaction. We no longer receive concerns about these days in the student rep meetings since the original cohort. The Mentimeter feedback at the end of each UDL is generally positive, with one person recently commenting: ‘this was a very engaging day’.

References

References:

Dixson, M. D. (2010). Creating effective student engagement in online courses: What do students find engaging?. Journal of the Scholarship of Teaching and Learning, 1-13.

Flodén, J. (2017). The impact of student feedback on teaching in higher education. Assessment & Evaluation in Higher Education, 42(7), 1054-1068.

Ginns, P., Prosser, M., & Barrie, S. (2007). Students’ perceptions of teaching quality in higher education: The perspective of currently enrolled students. Studies in higher education, 32(5), 603-615.

Lin, S. Y., & Overbaugh, R. C. (2007). The effect of student choice of online discussion format on tiered achievement and student satisfaction. Journal of Research on technology in Education, 39(4), 399-415.

Mahmood, A., Mahmood, S. T., & Malik, A. B. (2012). A comparative study of student satisfaction level in distance learning and live classroom at higher education level. Turkish Online Journal of Distance Education, 13(1), 128-136.

Ramsden, P. (2003). Learning to teach in higher education. Routledge.

Sheikhaboumasoudi, R., Bagheri, M., Hosseini, S. A., Ashouri, E., & Elahi, N. (2018). Improving nursing students’ learning outcomes in fundamentals of nursing course through combination of traditional and e-learning methods. Iranian journal of nursing and midwifery research, 23(3), 217.

Steyn, C., Davies, C., & Sambo, A. (2019). Eliciting student feedback for course development: the application of a qualitative course evaluation tool among business research students. Assessment & Evaluation in Higher Education, 44(1), 11-24.

Links

CWI website: https://sites.reading.ac.uk/charlie-waller-institute/

The One Where a Timetable Merger Gives Rise to a Curriculum Implementation Review

By aaroncooper Comment Closed

Emma-Jayne Conway, James Kachellek and Tamara Wiehe

t.wiehe@reading.ac.uk

Link back to case studies on the T and L Exchange website

Overview

Staff and students in CWI collaborated on a project initially designed to merge two timetables of sister programmes to aid cross programme working (objective 1) but gave rise to the perfect opportunity to review the way our PWP curriculum is implemented following the pandemic (objective 2). In this blog, we reflect on achieving both objectives within our original timeframe!

Objectives

1.     To create a single timetable to aid cross-programme working for teaching and administrative staff.

2.     To review curriculum implementation including structure and modality on a modular and programme level with all key stakeholders.

Context

In response to a departmental restructure, we required more efficient ways of working across programmes starting with a uniform timetable. Early on, the project evolved to also review the structure and modality of the curriculum. Our two sister PWP training programmes (one undergraduate and one postgraduate) are virtually identical with a few exceptions but historically had been managed separately.

Over the course of 2021, we planned, designed, and implemented a timetable merger for our September cohorts. This impacted on 3 modules (4 for undergraduates) that form the PWP training year for the MSci Applied Psychology (Clinical) students and the Postgraduate/graduate Certificate in Evidence-Based Psychological Treatments (IAPT Pathway).

Taking both Higher Education and Mental Health Care processes into consideration was no easy feat, including those specific to University of Reading (e.g., term dates), our national PWP curriculum specifying the content and learning outcomes for our 26 teaching days and 19 study days, and British Psychological Society (BPS) accreditation requirements. Modality was a particularly important topic throughout this project, taking key learnings from remote delivery during the pandemic as well as awaiting guidance from our professional accrediting body.

Overall, it served as an excellent opportunity to work collaboratively with staff and students to review the implementation of PWP training at the University of Reading.

Implementation

  1. Early 2021: The PWP team met on several occasions to discuss the possibility of merging the two timetables, including transitioning to a “blended” format of online and face-to-face teaching post-Covid. We set out a timeline for planning, designing, and implementing the project.
  2. Advice was sought from the Director of Training in CWI and colleagues in Academic Development, CQSD based on their experience of timetable mergers and a green light was given based on our draft plans!
  3. Several options were considered before the final format was arrived at: Face-to-face teaching is weighted towards the first module/term with progressive increase to the online taught content as the course progresses. (Rationale supplied elsewhere in this blog).
  4. The educator team were able to draw on feedback from online teaching to gauge the attitude of the student body to online learning, as well as expectations and concerns related to a return to the classroom (see Impact, below). The student voice was important in terms of utilising partnership to create meaningful change to curriculum implementation. However, engaging professional practice students via the course reps was a challenge due to time constraints, therefore, we were able to engage graduate instead. This is something we would consider earlier on in future projects.
  5. The educator team unanimously agreed that the externally taught content of the VEC module could be effectively taught with mixed cohorts from the Core-PWP and MSci cohorts using an online approach.
  6. Information on the changes was disseminated to Program Administrators to enable efficient implementation. External Educators were made aware of the retention of online lecture sessions, and the mixed-cohort approach, by the VEC module convenor.
  7. Timetables were updated by the Program Director, in collaboration with Module Convenors; consideration has been given to the potential Workflow impact of closely aligning multiple cohorts (see below). Timetables have been looked at by the team ‘side-by-side,’ to ensure that Workflow balance is maintained for educators across all cohorts. We can continue to monitor the impact on workload while adjustments are made to teaching (such as with the Working Document mentioned in the Follow-Up section, below).
  8. IAPT Services were made aware of the changes to the timetables

Impact

As of October 2021, the merged timetables are proving effective, with no major barriers, having been detected. Predicted barriers included those to effective teaching of (previously face-to-face) content, student/staff dissatisfaction with a blended approach, and significant administrative/technical difficulties.

Face-to-Face teaching resumed in September 2021 and has been a successful return to the classroom. Educators report being able to switch between live sessions and face-to-face teaching days without significant barriers.

The educator team plan to continue to gather feedback on the student experience of the blended and merged approach. We will be able to assess feedback when the first cohorts fully complete in June 2022.

Feedback will be sought from module convenors, educators, and program administrators using “menti” feedback forms, bi-weekly team meetings and informal qualitative discussion, to gauge the impact of the changes on workflow. Student feedback will also be monitored through end-of-module feedback collated by the School.

Reflection

  • The challenge of engaging professional practice students and utilising graduates to overcome this. We will consider setting up graduate/patient advisory group for future projects.
  • Using feedback from a MSci graduate led to timetable changes to ensure readability and clarity for students. This included points such as colour coding F2F v online teaching days, explaining acronyms, etc.
  • Involving all members of the team (especially Module Convenors) felt like a much more meaningful and collaborative process than Programme Director decisions alone. It gave Module Convenors autonomy over their modules as well as aligning learning outcomes across the 3 modules of the programme which is particularly important for clinical training. Other courses may wish to replicate this approach to build team cohesion and allow all colleagues to make meaningful contributions to programme changes and delivery.

Follow up

  • Working document has been created for the educator team to comment on the teaching they have just delivered i.e., was there enough time to deliver all content? This has allowed changes to be made within a matter of weeks as the same day is delivered across the programmes. As a result, we can fine-tune the timetable and delivery of the programme quicky and efficiently to improve the student experience.
  • We will review module by module and at the end of each cohort to continue making any necessary adjustments. Module and programme evaluations, student-staff rep meetings and any feedback from individual teaching days will also help to inform this.

 

Driving programme development in the IOE: student focus groups and paper writing

By aaroncooper Comment Closed

Jo Anna Reed Johnson – Institute of Education

j.a.reedjohnson@reading.ac.uk

Link back to case studies on the T and L Exchange website

Overview

This article outlines the thinking to drive programme development through student focus groups across three IOE programmes.  The outcome to write a paper and present at a conference helped me to frame this project with a team of academics focusing on changes made during Covid-19 (2020-2021).  This article will share reflections on setting up and running of the focus groups, the delivery of the conference presentation and the final paper writing.  Finally, it will discuss what we have learnt from this and what we will continue to do.

Objectives

  • Share 4 academic perspectives on the redesigning of three modules (SKE, STEAM, PGCE Sec Science) that all have practical elements (laboratory or school), due to Covid-19, by sharing what we did and exploring the student perspectives
  • Show how we designed opportunities for discussion and collaboration when conducting practical work or school related work online
  • Consider the use of student focus groups for programme co-development
  • Reflect on the collaborative nature of paper writing and co-programme reflections

Context

At the IOE there are a range of teacher education programmes, with a practical focus.  The four colleagues engaged in this article were involved with Skills in Schools (ED2TS1 – March to July 2020), SKE (IESKEP and PFTZSKEMATHSA– March to Aug 2020) and PGCE Secondary Science (GFSTSCIENCE – September 2020 to June 2021).  These programmes all require students to work in schools and engage in a science laboratory (if science focused).  As COVID hit in March 2020 we had to think quickly and imaginatively, transforming our provision to be online where required.  Having worked across all three programmes I felt it was pedagogically appropriate to engage our students in the ways we had throughout their learning during the pandemic, where they worked in online communities of practice to reflect.  Thus, we decided to set up a series of focus groups with students reflecting on the impact of the changes and to provide insights for future programme innovations.  This culminated in a conference presentation and paper.

Implementation

The focus was to drive programme development through reflections and shared experiences of academics and students.  I set up a project timeline and MS Team to manage and drive the deliverables, with the end goal to engage students as co-programme developers and to culminate in a conference presentation and paper.  It required framing the project, seeking ethical approval and funding, setting up focus groups to collect data, then reflections and writing up.

Framing the project allowed me to maintain the focus for the redesigning of three modules that all had practical elements (laboratory or school), due to Covid-19.  And then exploring how that had impacted on students through focus groups. It was the conference and paper deadlines that drove this activity and timeline.  At first colleagues wondered why we were writing a paper for a submission related to the School of Architecture (Manchester and Manchester Metropolitan University), but in fact it was because it was about ‘place’.  The remit was a paper related to ‘online education: teaching in a time of change’.

Seeking ethical approval and funding all required knowing where to go and what to do.  Ethical approval required submission of an ethical approval form (including consent form, interview schedule, focus group details) to the IOE ethics committee.  Then applying for funding through the University Travel Grants Scheme – Tasha Easton – e.saxon@reading.ac.uk

Data Collection was initially carried out using MS Forms, for the initial feedback request.  Consent was also required, so where this could not be achieved in person, there was a need to have consent approval attached to the top of the MS Form.  Once participants had consented and those who were willing had indicated taking part in the focus groups, I could set up a series of focus groups across the three programmes, to take place on MS Teams.  We decided to split the four sets of interviews into subject specific groups so that the conversations and reflections could be driven by the students.  One student was nominated as the chair, and they had a template of questions to guide their discussions.

Paper Writing was a challenge as we needed to fit this around our Teaching Focused roles.  I created a writing template after attending an IOE Research and Scholarship Writing Workshop with Professor Alan Floyd.  I scheduled meetings to review, discuss and allocate sections of writing.

The whole process began in December 2020 and continued through to 30 May 2021, with the conference in 21-23 April 2021 (July 2021- Paper Publication).

 

Impact

There were several elements of impact:

  • Working collaboratively with colleagues to reflect on programme development
  • Engaging students as co-programme developers
  • Attending a conference (where funding allowed)
  • Conference paper presentation
  • Conference paper publication

Reflection

In terms of the setting up of focus groups and driving data collection, we learnt that we needed to be organised, and the timeline/plan really helped to keep that focus.  There were times where we were too busy, but we had to create time as we had deliverables to meet.  If we had not have had those deliverables of a conference presentation and paper, we may have let this slip and do it ‘next year’.

Writing the paper was a challenge in that we had not done this together before, and some colleagues had not written an academic paper in a very long time, or even an educational one.  So, creating that writing template and allocating tasks worked.

Gaining conference funding can always be a challenge.  But reaching out and asking was the first thing to do. Then finding out what could be offered at the University/School Level.  Next time, we would all like to attend the conference.  Being an online conference made it more difficult to engage, and I think next time we would plan to all get funding an attend a face-to-face conference so that we too can benefit from being part of the Community of Practice.

What we will continue to do….

  • Develop students as programme co-developers through focus groups, engaging them in the paper writing.
  • Use focus groups to help us (academics) reflect on our own practice and discuss developments across programmes.
  • Drive programme development through the sharing of practices, building communities of practice with timelines and deliverables.

What else will we do…

  • Engage students in the paper writing and conference process.
  • Seek funding to attend a F2F conference with colleagues to allows us time and space to continue to reflect on practice.

Links

Research and Travel Grants Committee: https://www.reading.ac.uk/closed/research/committees/res-researchtravelgrantsubcommittee.aspx

AMPS Conference 21-23 April 2021 – https://architecturemps.com/online-ed-conference/

Online Delivery of Practical Learning Elements for SKE

By edwardwhite Comment Closed

Jo Anna Reed Johnson, Gaynor Bradley, Chris Turner

j.a.reedjohnson@reading.ac.uk

Overview

This article outlines the re-thinking of how to deliver the science practical elements of the subject knowledge enhancement programme (SKE) due to the impact of Covid-19 in March 2020 and a move online.  This focuses on what we learnt from the practical elements of the programme delivery online as it required students to engage in laboratory activities to develop their subject knowledge skills in Physics, Chemistry and Biology related to school national curriculum over two weeks in June and July 2021.  Whilst there are some elements of the programme we will continue to deliver online post Covid-19, there are aspects of practical work our students would still benefit from hands on experience in the laboratory, with the online resources enhancing that experience.

Objectives

  • Redesign IESKEP-19-0SUP: Subject Knowledge Enhancement Programmes so it was COVID-safe and fulfilled the programme objectives in terms of Practical work
  • Redesign how students could access the school science practical work with no access to laboratories. This relates to Required Practical work for GCSE and A’Levels
  • Ensure opportunities for discussion and collaboration when conducting practical work
  • Provide students with access to resources (posted and shopping list)

Review student perspectives related to the response to online provision

Context

In June 2020 there was no access to the science laboratories at the Institute of Education (L10) due to the Covid pandemic. The Subject Knowledge Enhancement Programme (SKE) is a pre-PGCE requirement for applicants who want to train to be a teacher but may be at risk of not meeting the right level of subject knowledge (Teacher Standard 3) by the end of their PGCE year (one-year postgraduate teacher training programme).  We had 21 SKE Science (Physics, Chemistry, Biology) students on the programme, 3 academic staff, one senior technician and two practical weeks to run.  We had to think quickly and imaginatively.  With a plethora of school resources available online for school practical science we set about reviewing these and deciding what we might use to provide our students with the experience they needed.  In addition, in terms of the programme content for the practical weeks we streamlined our provision, as working online requires more time.

Implementation

In May 2020, the senior science technician was allowed access to the labs.  With a lot of work, she prepared a small resource pack with some basic equipment that was posted to each student.  This was supplemented with a shopping list that students would prepare in advance of the practical weeks.  For the practical week programme, we focused on making use of free videos that are available on YouTube and the Web (https://www.youtube.com/watch?v=jBVxo5T-ZQM

and https://www.youtube.com/watch?v=SsKVA88oG-M&list=PLAd0MSIZBSsHL8ol8E-a-xgdcyQCkGnGt&index=12).

Having been part of an online lab research project at the University of Leicester I introduced this to students for simulations along with PHET (https://www.golabz.eu/ and https://phet.colorado.edu/).

 

 

 

 

 

 

 

We also wanted students to still feel some sense of ‘doing practical work’ and set up the home labs for those topics we deemed suitable e.g. heart dissection, quadrats, making indicators.

 

 

Powerpoints were narrated or streamed.  We set up regular meetings with colleagues to meet in the morning before each practical day started.  We did live introductions to the students to outline the work to be covered that day.  In addition, we organised drop-in sessions such as mid-morning breaks and end of day reviews with the students for discussion.  Throughout, students worked in groups where they would meet, discuss questions and share insights.  This was through MS Teams meetings/channels where we were able to build communities of practice.

Impact

End of programme feedback was received via our usual emailed evaluation sheet at the end of the practical weeks and end of the programme.  5/21 responses.  The overall feedback was that students had enjoyed the collaboration and thought the programme was well structured.

‘I particularly enjoyed the collaborative engagement with both my colleagues and our tutors. Given that these were unusual circumstances, it was important to maintain a strong team spirit as I felt that this gave us all mechanisms to cope with those times where things were daunting, confusing etc but also it gave us all moments to share successes and achievements, all of which helped progression through the course. I felt that we had the right blend of help and support from our tutors, with good input balancing space for us to collaborate effectively.’

Student Feedback initial evaluation

‘I enjoyed “meeting” my SKE buddies and getting to know my new colleagues. I enjoyed A Level Practical Week and found some of the online tools for experimentation and demonstrating experiments very helpful’

Student Feedback initial evaluation

To supplement this feedback, as part of a small-scale scholarly activity across three programmes, we also sent out a MS Form for students to complete to allow us to gain some deeper insights into the transition to online learning.  22/100 responses.  For example, the students’ excitement of doing practical work, and the experience of using things online that they could then use in their own teaching practice:

‘…the excitement of receiving the pack of goodies through the post was real and I enjoyed that element of the program and it’s been genuinely useful. I’ve used some of those experiments that we did in the classroom and as PERSON B said virtually as well.’

Student Feedback MS Form

‘…some of the online simulators that we used in our SKE we’ve used. I certainly have used while we’ve been doing online learning last half term, like the PHET simulators and things like that…’

Student Feedback MS Form

The students who consented to take part engaged in four discussion groups (5 participants per group = 20 participants).  These took place on MS Teams and this once again highlighted the benefits of the online group engagement, as well as still being able to meet the programme objectives:

‘I just wanted to say, really. It was it was a credit to the team that delivered the SKE that it got my subject knowledge to a level where it needed to be, so I know that the people had to react quickly to deliver the program in a different way…’

Student Feedback Focus Group

There was some feedback that helped us to review and feedback into our programme development such as surprise at how much independent learning there is on the programme, and the amount of resources or other materials (e.g. exam questions).

Reflections

We adopted an integrated learning model:

 

We learnt that you do not have to reinvent the wheel.  With the plethora of tools online we just needed to be selective… asking ‘did the tool achieve the purpose or learning outcome?’.  In terms of planning and running online activities we engaged with Gilly Salmon’s (2004) 5 stage model of e-learning.   This provides structure and we would apply this to our general planning in the use of Blackboard or other TEL tools in the future.  We will continue to use the tools we used.  These are useful T&L experiences for our trainees as schools move more and more towards engagement with technology.

However, it was still thought by the students that nothing can replace actually practical work in the labs:

‘I liked the online approach to SKE but feel that lab work face-to-face should still be part of the course if possible. There are two reasons for this: skills acquisition/ familiarity with experiments and also networking and discussion with other SKE students.’                                                                                      Student Feedback MS Form

Where possible we will do practical work in the labs but supplement these with the online resources, videos and simulation applications.  We will make sure that the course structure prioritises the practical work but also incorporates aspects of online learning.

We will continue to provide collaborative opportunities and engage students online for group work and tutorials in future years.  We also found the ways in which we collaborated through communities of practice, on MS Teams Channels, was very effective.  We set up groups, who continued to work in similar ways throughout the course, who were able to share ideas by posting evidence, then engage in a discussion.  Again, this is something we will continue to do so that when our students are dispersed across the school partnership, in different locations, they can still be in touch and work on things collaboratively.

Links and References

Online Lab case Studies

https://www.golabz.eu/

https://phet.colorado.edu/

Practical week Free Videos

https://www.youtube.com/watch?v=jBVxo5T-ZQM

https://www.youtube.com/watch?v=SsKVA88oG-M&list=PLAd0MSIZBSsHL8ol8E-a-xgdcyQCkGnGt&index=12).

The impact of COVID upon practical classes in Part 1 chemistry – an opportunity to redevelop a core module

By aaroncooper Comment Closed

Philippa Cranwell p.b.cranwell@reading.ac.uk, Jenny Eyley, Jessica Gusthart, Kevin Lovelock and Michael Piperakis

Overview

This article outlines a re-design that was undertaken for the Part 1 autumn/spring chemistry module, CH1PRA, which services approximately 45 students per year. All students complete practical work over 20 weeks of the year. There are four blocks of five weeks of practical work in rotation (introductory, inorganic, organic and physical) and students spend one afternoon (4 hours) in the laboratory per week. The re-design was partly due to COVID, as we were forced to critically look at the experiments the students completed to ensure that the practical skills students developed during the COVID pandemic were relevant for Part 2 and beyond, and to ensure that the assessments students completed could also be stand-alone exercises if COVID prevented the completion of practical work. COVID actually provided us with an opportunity to re-invigorate the course and critically appraise whether the skills that students were developing, and how they were assessed, were still relevant for employers and later study.

Objectives

• Redesign CH1PRA so it was COVID-safe and fulfilled strict accreditation criteria.
• Redesign the experiments so as many students as possible could complete practical work by converting some experiments so they were suitable for completion on the open bench to maximise laboratory capacity
• Redesign assessments so if students missed sessions due to COVID they could still collect credit
• Minimise assessment load on academic staff and students
• Move to a more skills-based assessment paradigm, away from the traditional laboratory report.

Context

As mentioned earlier, the COVID pandemic led to significant difficulties in the provision of a practical class due to restrictions on the number of students allowed within the laboratory; 12 students in the fumehoods and 12 students on the open bench (rather than up to 74 students all using fumehoods previously). Prior to the redesign, each student completed four or five assessments per 5-week block and all of the assessments related to a laboratory-based experiment. In addition, the majority of the assessments required students to complete a pro-forma or a technical report. We noticed that the pro-formas did not encourage students to engage with the experiments as we intended, therefore execution of the experiment was passive. The technical reports placed a significant marking burden upon the academic staff and each rotation had different requirements for the content of the report, leading to confusion and frustration among the students. The reliance of the assessments upon completion of a practical experiment was also deemed high-risk with the advent of COVID, therefore we had to re-think our assessment and practical experiment regime.

Implementation

In most cases, the COVID-safe bench experiments were adapted from existing procedures, allowing processing of 24 students per week (12 on the bench and 12 in the fumehood), with students completing two practical sessions every five weeks. This meant that technical staff did not have to familiarise themselves with new experimental procedures while implementing COVID guidelines. In addition, three online exercises per rotation were developed, requiring the same amount of time as the practical class to complete therefore fulfilling our accreditation requirements. The majority of assessments were linked to the ‘online practicals’, with opportunities for feedback during online drop-in sessions. This meant that if a student had to self-isolate they could still complete the assessments within the deadline, reducing the likelihood of ECF submissions and ensuring all Learning Outcomes would still be met. To reduce assessment burden on staff and students, each 5-week block had three assessment points and where possible one of these assessments was marked automatically, e.g. using a Blackboard quiz. The assessments themselves were designed to be more skills-based, developing the softer skills students would require upon employment or during a placement. To encourage active learning, the use of reflection was embedded into the assessment regime; it was hoped that by critically appraising performance in the laboratory students would remember the skills and techniques that they had learnt better rather than the “see, do, forget” mentality that is prevalent within practical classes.

Examples of assessments include: undertaking data analysis, focussing on clear presentation of data; critical self-reflection of the skills developed during a practical class i.e. “what went well”, “what didn’t go so well”, “what would I do differently?”; critically engaging with a published scientific procedure; and giving a three-minute presentation about a practical scientific technique commonly-encountered in the laboratory.

Impact

Mid-module evaluation was completed using an online form, providing some useful feedback that will be used to improve the student experience next term. The majority of students agreed, or strongly agreed, that staff were friendly and approachable, face-to-face practicals were useful and enjoyable, the course was well-run and the supporting materials were useful. This was heartening to read, as it meant that the adjustments that we had to make to the delivery of laboratory based practicals did not have a negative impact upon the students’ experience and that the re-design was, for the most part, working well. Staff enjoyed marking the varied assessments and the workload was significantly reduced by using Blackboard functionality.

Reflections

To claim that all is perfect with this redesign would be disingenuous, and there was a slight disconnect between what we expected students to achieve from the online practicals and what students were achieving. A number of the students polled disliked the online practical work, with the main reason being that the assessment requirements were unclear. We have addressed by providing additional videos explicitly outlining expectations for the assessments, and ensuring that all students are aware of the drop-in sessions. In addition, we amended the assessments so they are aligned more closely with the face-to-face practical sessions giving students opportunity for informal feedback during the practical class.

In summary, we are happy that the assessments are now more varied and provide students with the skills they will need throughout their degree and upon graduation. In addition, the assessment burden on staff and students has been reduced. Looking forward, we will now consider the experiments themselves and in 2021/22 we will extend the number of hours of practical work that Part 1 students complete and further embed our skill-based approach into the programme.

Follow up

 

Links and References

Considering wellbeing within the placement module assessment

By edwardwhite Comment Closed

Allán Laville (Dean for D&I and Lecturer in Clinical Psychology) and Libby Adams (Research Assistant), SPCLS

Overview

This project aimed to design a new alternative assessment to form a part of the MSci Applied Psychology course which puts emphasis on the practical sides of training as a Psychological Wellbeing Practitioner (PWP). This included utilising problem-solving skills and wellbeing strategies.

Objectives

  • This project was funded by SPCLS Teaching & Learning Enhancement Fund and aimed to design an alternative assessment to be used as a part of the MSci Applied Psychology course to support student wellbeing.
  • The project aimed to incorporate an assignment into the curriculum which provides students with transferable problem-solving and wellbeing management strategies which can be used in future mental health support/clinical roles.

Context

The above project was undertaken as within IAPT, Psychological Wellbeing Practitioners (PWPs) are required to work in a fast-paced environment seeing multiple patients back-to-back throughout the day. Students on the MSci Applied Psychology course are required in their third year to undertake a work placement 1 day a week in the first term increasing to 2 days a week in the second term. Students are also required to undertake 1 full day of training per week. The aim of the project was to embed an assignment which focusses on managing wellbeing within the curriculum.

Implementation

Allán Laville (Dean for Diversity and Inclusion) brought to light the concept of incorporating wellbeing within the curriculum and contacted Libby Adams (Part 4 MSci Student) to see whether she would take part in the development of the new assessment. Libby Adams was included here as she previously trained as a Psychological Wellbeing Practitioner and first-hand experienced challenges managing the demands of the PWP role as a trainee and in turn managing her wellbeing.

Libby Adams’ experience

The project was developed with my own challenges in mind, to build upon this we then met with current and past MSci students to gain insight into the challenges they faced. We were then able to condense information and incorporate them within our concept of a wellbeing blog. We then considered how we could problem-solve ways around the areas that could not be included in the blog. At the second stage we met with clinical staff and educators to share our idea and gain feedback on the feasibility of implementation within IAPT services. The final project design was then formed with the above feedback in mind.

Impact

Views from current MSci students on the benefits of the project:

“I think maintaining our own wellbeing is such a critical part of caring professions, and I think that making it a clear and mandatory part of the course you’re not only helping students look after themselves for this year, but also for their future careers as well.”

Relating to the outlined objectives the project successfully designed a prototype assessment which considers the importance of maintaining wellbeing and utilising problem-solving skills. The project will have a positive impact on the individual not only in their placement year but also if they choose to go into a clinical career after university as skills are transferable.

Traffic Light Mood Tracker

Students are required to complete the traffic light system to indicate how they are currently managing their wellbeing. They are required to complete these three times for each blog, once before the reflection, after they have built an action plan based on their reflection and then in the last term of the academic year reflecting on their progress.

Reflections

Allán Laville’s reflections:

The project addressed a key consideration within both University training as well as within the psychological workforce, namely, the importance of explicitly considering the wellbeing of our practitioners and therapists. I am delighted with the outcome of the project and it would not have been possible without Libby. Her commitment to psychological therapies and intrinsic motivation to support others, always shines through!

Libby Adams’ reflections:

The student-staff partnership is key to improving the overall teaching and learning experience. The partnership allows the member of staff to lead as the expert by knowledge and the student to lead as the expert by experience. Such partnerships allow the development of concepts and improvements in teaching and learning which enhance the student and staff experience.

Follow up

In the future we aim to share our findings with other MSci courses and IAPT services with an aim to increase conversations about practitioner wellbeing and highlight its importance within clinical roles. We hope that strategies used in this project can extend beyond students and be used across IAPT services to maintain wellbeing, improve performance and decrease stress and burnout.