Diversity and the curriculum

By edwardwhite Comment Closed

Dr Richard Harris, Institute of Education
r.j.harris@reading.ac.uk

Overview

LLA

The focus of this work is on what I do and how I try to ensure that the curriculum I create reflects the diversity in society; this in turn impacts on the trainee teachers I work with and how confident they are in teaching a more diverse curriculum.

Objectives

  • To identify how far my curriculum actually reflected diversity in society.
  • To examine reasons why this might be and therefore what could I do about it.

Context

I have to train history teachers and therefore they need to be able to address issues of diversity within their teaching. However I am from a white, middle class background, so how confident and comfortable was I in supporting my trainee teachers in this goal?

In addition I am aware that some students from BAME backgrounds do not perform as well as their white peers. The reasons for this are complex but one issue appears to be the curriculum and the absence of people from BAME backgrounds from much of the curriculum.

Implementation

The first step was to analyse my practice and myself. There is a lot of useful literature on ‘whiteness’ and the privilege that comes with ‘whiteness’ in our society that is largely taken for granted and unnoticed by those who part of the white majority.

Critical Race Theory was helpful in examining the curriculum I actually taught and for making me reassess my own beliefs and prejudices.

It is only by understanding ourselves that we can understand the unconscious messages that we send out, which portray our values, attitudes and beliefs.

For me, the following had a profound impact on how I thought about the curriculum: “Knowledge taught in schools is a form of cultural capital and is a social construction that reflects the values, perspectives, and experiences of the dominant ethnic group. It systematically ignores or diminishes the validity and significance of the life experiences and contributions of ethnic and cultural groups that historically have been vanquished, marginalized, and silenced.” Gay, G. (2004) ‘Curriculum Theory and Multicultural Education’ in J. A. Banks and C. A. McGee Banks (eds.) Handbook of Research on Multicultural Education. San Francisco, CA: Jossey-Bass. 30-49.

Impact

Having done a Critical Race analysis of my curriculum content I was able to see how ‘white’ it was, and therefore realised that I needed to find other curriculum content that could be included within my teaching. In addition it was important that this was not simply ‘bolted-on’ but was part and parcel of what I would do. Creating a focus on ‘black’ history, for example, simply serves to make it appear different, rather than looking at ‘history’ in all its diverse forms. Instead I have been able to incorporate a range of topics within my workshops, so that diversity is embedded and part of the ‘background noise’, rather than being something that has to be squeezed into the course. There are sessions on teaching diversity but these are much more geared towards raising trainee teachers awareness of what they need to be consider.

Working to develop trainee teachers is a complex business but it is important that they feel confident in what they need to do. Raising awareness of the issues over the curriculum and exploring their perspectives and what has shaped them allows them the opportunity to think differently. In many ways they have to go through the same process that I have been through. In particular it is important that they do not adopt a ‘colour-blind’ approach to curriculum development. We need to see who is in front of us before we make decisions – for example if we had someone with some form of additional need, such as dyslexia, we would take that into account in our work – and as Linda Valli, an American researcher argues, we need to see ‘colour’, so we
can do something about it, and then let the ‘colour fade’. We should then be in a position where we have constructed a more diverse and inclusive curriculum.

Reflections

This approach is not itself a one-off T&L activity, but rather a process of deep reflection to understand and address a specific issue.

It is also potentially unsettling as the problem often rests with us, and we have to accept that. It is very easy to blame students for failing to engage with a curriculum or some form of support provided, whereas in fact the real issue is much more to do with the unintended messages we often send out about what is and is not considered valuable. If our curricula are not inclusive, why should we expect students from particular backgrounds to engage with what we teach?

Diversifying a core skills module (English Literature)

By edwardwhite Comment Closed

Dr Nicola Abram, Literature and Languages
n.l.abram@reading.ac.uk
Year of activity: 2015-6

Overview

11176

This entry describes the diversification of a core Part One English Literature module, Research & Criticism (EN1RC). As a result of the changes outlined here, every graduate of English Literature at the University of Reading will have encountered Anglophone texts from across the world, and considered critical issues around ‘race’, ethnicity, gender and sexuality.

Objectives

  • To construct a diverse curriculum that is representative of a wide range of identities and experiences.
  • To expose students to the rich variety of global literatures in English.
  • To promote critical thinking about processes of canon formation.

Context

Over 200 students enter English Literature programmes at the University of Reading each year, from a range of educational backgrounds. To ensure they all have the key skills and theoretical understanding needed to succeed throughout their degrees, we run a compulsory module in the first year called ‘Research & Criticism’. I was tasked with convening this module from 2014/15.

The module’s priorities of delivering skills training and theoretical literacy – rather than focussing on a particular period, author, or literary genre – produce the freedom to draw on diverse texts. I recognised in this an opportunity to redress the Eurocentrist and white supremacist organisation of the established literary canon.

This reform was timely: a student-led campaign called ‘Why is my curriculum white?’ began at UCL in November 2014 and spread across various higher education institutions, questioning the narrow and exclusionary nature of a range of degree programmes. At a subject-specific level, the QAA Subject Benchmark Statement was revised to describe the duty attendant on literary studies to represent the subject’s diversity: “The geographical, historical and social varieties of written and spoken English, and the range of world literatures written in or translated into English, enrich the subject and its study”.

Implementation

The first step was to consider the existing course content and assess it for diversity and inclusivity. I found it useful to ask the question: ‘What kind of student does this module imagine?’. Alternatively, you might look at how many of the works cited are authored by women or non-white people, or published in the Global South. In the sciences and social sciences, you might consider how far your case studies prioritise Eurocentric concerns or population samples – and whether this is intellectually necessary. If not, from where else could you source your material?

My own research in postcolonial and feminist literature meant I was familiar with a pool of texts that could be drawn on. The final reading list included texts that engage with black British, African American, Indo-Canadian, Nigerian, and Palestinian contexts, as well as those raising issues of imperialism, heteronormativity, and gender performativity. Other academics searching for equivalent materials could consult relevant subject associations for colleagues’ suggestions (such as the Postcolonial Studies Association, Feminist and Women’s Studies Association, etc.).

I chose to limit the set texts to short stories and critical essays, continuing the model I inherited with the module. I felt a series of manageable readings would promote students’ sustained engagement, given that the content was likely to be unfamiliar to many of them. I would encourage others to think similarly about the context in which students will encounter this material, and plan accordingly.

I drafted a proposed reading list and lecture schedule, which was circulated to colleagues in the Department of English Literature. The communications that followed helped to refine the plans, producing a module that would be appropriate for new entrants – who are facing significant personal and educational transitions – as well as sufficiently challenging.

At the end of the first year that the module ran, a meeting with the teaching team helped to further polish its content and organisation.

Impact

Students’ feedback has affirmed that: “The content of this course made me raise questions about the way I read and how I understand a text”, “Everything I thought I knew was challenged by what was talked about”, and “Although at times it made your head hurt, once you got around the idea it linked brilliantly to everything else and made you question everything else you ever read”.

Colleagues have commented that students’ sophistication has demonstrably improved in other modules, as they apply the skills of critical thinking learned in ‘Research & Criticism’ to enrich coursework that does not explicitly require – but nonetheless benefits from – such theoretical scaffolding.

It has been an unexpected pleasure to signpost forward from this module to options available later in the degree, and to potential dissertation topics. This will be formalised with the development of Pathways on the English Literature degree programmes. A Pathway consists of linked modules on a particular topic, such as Creative Writing; participating students receive acknowledgement of this specialism on their degree transcript. There are several junctures at which students can opt in: they may enrol from the beginning as a Pathway student, or join at the end of Part One or Part Two, which allows for those who come to consciousness of a topic later or feel able to commit to it only after some initial study.

Reflections

The revisions to the module successfully reflected a wide range of identities and experiences, and exposed students to the rich variety of global literatures in English. It is vital that this material sits at the core of the degree programme, to ensure that all students are exposed to it and to avoid the subject being devalued as peripheral or ‘minor’. However, the effort to integrate and embed this material into the curriculum may unwittingly render its differences invisible, and reduce its oppositional potency. For this reason the module works especially well as the foundation for a Pathway; later in the degree, in more specialist modules, more time can be given to establishing the relevant contexts necessary for mature interpretation.

Perhaps most successfully met was the aim to promote critical thinking about what literatures are valued, and why. By centring non-canonical writers, this module actively encourages norm-critical thinking. It foregrounds the importance of questioning the canon rather than simply adding to or updating it.

Follow up

The module continues to run as part of our compulsory offering for new entrants to English Literature programmes. It has been presented as a model of good practice at RUSU’s Black, Asian, and Minority Ethnic conference (1 June 2015) and at a University of Reading Teaching and Learning Showcase on ‘Diversifying the Curriculum’ (18 January 2016).

To flag up how students might continue their learning on ‘Research & Criticism’ into future optional modules, we have since designed posters which formally indicate connections: ‘Critical Issues’, and ‘Writing, Gender & Identity’ in Part Two, and ‘Class Matters’ and ‘Psychoanalysis and Text’ at Part Three. These posters are displayed to prospective students at Open Days, and within the Department throughout the year.

Links

Universities Scotland Race Equality Toolkit:
http://www.universities-scotland.ac.uk/raceequalitytoolkit/

‘Why Is My Curriculum White?’, UCL, November 2014:
http://www.youtube.com/watch?v=Dscx4h2l-Pk

‘Why Is My Curriculum White?’, LSE, February 2015 http://www.youtube.com/watch?v=xGbxLPbetvo

Flipping the classroom in Meteorology

By edwardwhite Comment Closed

Dr. Andrew Charlton-Perez, School of Mathematical and Physical Sciences
a.j.charlton-perez@reading.ac.uk
Year of activity: 2015/16

Overview

12484A flipped learning approach to teaching the part 3 and part 4 module, ‘The Global Circulation’ (MT38A/4YA) in Meteorology was developed and tested. This approach was very successful, encouraging students to apply complex ideas to real-world problems.

Objectives

  • Develop a new set of learning resources which could be used both in a flipped learning or traditional lecture based delivery.
  • Test and evaluate if teaching in a ‘flipped learning’ style improved student engagement and higher-level learning.
  • Implement authentic assessment that models the real-world process of enquiry and peer-feedback.

Context

I’ve been teaching this module for eight years adding some enquiry-based learning elements around four years ago. While it has always received good student feedback, a colleague who moderated my exam scripts last year made me consider if students were as actively engaged with the module as I had previously thought. Looking at student work it was clear that while students could remember and reproduce sophisticated concepts and mathematical derivations, their ability to apply this knowledge to unfamiliar situations was limited.

Implementation

Prior to the course I developed a significant new set of learning resources for the course:

  • 21 short videos (between 4 and 6 minutes long) targeted at difficult concepts.
  • 13 online quizzes of ten questions in Blackboard Learn.
  • 24 new learning activities linked to the research literature which students completed during class. 12 of these activities were supported by simple numerical models developed from scratch in open-source Python code.

The course was delivered to students in Spring 2016. The first time the class met as a group I explained the flipped classroom idea and we negotiated an approach to learning.

Following this first meeting, the class operated in three, three-week units. During the first two weeks of each unit, students studied notes and videos in their own time and then completed the on-line quizzes (with instant feedback) prior to attending the next class. In class, students had a choice of two learning activities. Students worked with each other in small teams and with me to complete the problems, writing notes in a rough lab book.

In the third week of each unit, students prepared a more formal write-up of one of the problems as summative assessment for that unit. In extracting information from their lab book, students needed to think about how to frame the problem by stating a hypothesis they wished to test and put the work they had done in the context of the current research literature.

In class, students exchanged their work and gave peer-feedback to each other, before completing the formal write-up with the chance to ask additional clarification questions.

Impact

The change to a flipped learning style had a transformative impact on the module; Student feedback highlighted the benefits of the investment in a number of ways including that they enjoyed the flipped learning approach:

  • ‘The structure of the module was the best out of my three years of university, flipped classroom should be done more’
  • ‘Always felt engaged with the lectures thanks to a different learning style’
  • ‘… I could run over the tricky concepts in more detail on a 1-to-1 basis with the lecturer. Often the same question applied to others and the class environment allowed group discussions which really enhanced the learning in a relaxed and productive way.’

And that their learning was improved:

  • ‘…brought my attention to active research areas at the front of study – it got me very interested in the exercises.’
  • ‘Class room discussions made me learn more than in a lecture style class’
  • ‘It isn’t an easy module, but it is very rewarding’

Reflections

Teaching in a flipped learning style also had a significant impact on my own enthusiasm for teaching the course because the improvement in student learning and engagement was tangible. The image shows an example of student work produced on a white board by a small group during one of the class sessions, applying ideas from the core course material to a recent research paper. It was extremely exciting to see students applying complex ideas in this way and succeeding in writing high-quality research reports on their work.

The flipped learning approach also challenged me to think more deeply about the material because I needed to produce engaging and manageable problems for students to work on.

It was also very rewarding to see how much students made use of the new teaching materials I developed. By monitoring the use of the videos on Blackboard I could see that typically the videos were viewed between 100 and 150 times by the ten students on the course, indicating how important these videos were for student learning. Based on student feedback, short and engaging videos encouraged repeated viewing. I also included music in the videos, often with an oblique reference to the content and students commented that they enjoyed this element of fun! At the end of the course, students requested the ability to download and keep copies of the videos (this functionality is currently not available in Blackboard).

An important part of producing the videos was to also provide transcripts to ensure they were accessible for all students and this took quite a bit of time in addition to video production (which was relatively straight-forward).

The on-line quizzes had a completion rate of 80% with average marks above 70% for most students. As with the videos, the high level of engagement with these materials suggests that they were of an appropriate length and level of challenge for students (pitched so that a student who had studied the notes and videos could answer most questions without further detailed application).

Are we doing enough for our BTEC entrants? Authored by Dr Michelle Reid (Study Advice)

By edwardwhite Comment Closed

Transition to university is often geared towards students from an A-level background, so are we doing enough for students with vocational qualifications starting at Reading?

Recent research from UCAS shows that one in four university entrants has done a BTEC (Havergal, 2016). Issues such as culture shock, work/life balance, different assessment methods, and the perception that A-level entrants may be better equipped to study at university are some of the concerns BTEC students can have when starting their degree (Clark, 2011). As Study Advisers, we observed similar concerns when working with former BTEC students here at Reading, particularly in relation to learning from lectures and taking exams, as these are not teaching and assessment methods used on BTEC courses. With these transition issues in mind, and also in light of the increased focus on widening participation, we conducted a short survey to gauge the views of current Reading students with BTEC qualifications on their readiness for university. We wanted to assess whether it would be beneficial to host a pre-entry event for BTEC entrants before they start here in the autumn, following the model of our well-established and successful pre-entry day for mature students.

We sent the questionnaire to all current Reading undergraduate and taught postgraduate students who had taken a BTEC (over 800 students) and received 173 replies. The results confirmed the previous research and our own observations. 45% of respondents described themselves as ‘fairly well prepared’ for university. However when this was explored further, 41.8% also felt that studying at university was ‘fairly different’ to the style of learning they were used to with the main difference being the style of assessments. Respondents pinpointed referencing, preparing for exams and academic reading as the areas they most wished they had known more about before starting university, again reflecting a concern with assessment and the style of academic learning at university. Similar to more general research findings (Clark, 2011; Reidy, 2015) our own former BTEC students identified their studying strengths as coursework, independence, subject knowledge and motivation. This suggests that BTECs give a good foundation in independent learning and indicates that students are likely to be motivated to attend a pre-entry event. However, the results also suggest there are gaps in transition guidance, especially around some assessment methods. Indeed, it is concerning that a wider HEA study has shown that students who went to university with vocational qualifications were less likely to achieve a first or 2:1 (Havergal, 2016). This indicates that we should be doing more to prepare BTEC students for the culture of HE assessment and to foster the potential of BTEC students.

Based on the survey findings, Study Advice is now investigating the possibility of hosting a pre-entry event for BTEC students this summer. We would be very interested in talking to others looking at transition and support for BTEC entrants.

 

References:

Clark, W. (2011). ‘Transitions in action? Exploring vocational learner progression into and out of higher education’. Educational Developments, 12.2, pp.9-12.

Havergal, C. (2016). ‘One in four university entrants has a BTEC, Ucas study finds’. Times Higher Education, 28 January 2016. Online at https://www.timeshighereducation.com/news/one-in-four-university-entrants-has-a-btec-ucas-study-finds  Accessed 05/04/16.

Reidy, T. (2015). ‘Will taking a BTec help or hinder your university application?’ The Guardian, Education section, 21 July 2015. Online at http://www.theguardian.com/education/2015/jul/21/will-taking-a-btec-help-or-hinder-your-university-application  Accessed 05/04/16.

Development of the Cole Museum resources for outreach and teaching and learning.

By edwardwhite Comment Closed

 Dr Amanda Callaghan, School of Biological Sciences
a.callaghan@reading.ac.uk

Overview

Cole Zoology Museum300The Cole Museum of Zoology (the Cole) houses a number of satellite collections for use in outreach, teaching and learning. In 2014 we transferred 50% of the School of Archaeology, Geography and Environmental Science (SAGES) fossil collection to the Cole and in 2015 acquired the other half. As a result of this Teaching and Learning Development Fund project, most of the fossils and many more Cole specimens and archives have been catalogued and photographed and are now being transferred onto AdLib (a database for the cataloguing and publishing of information on collection objects) for wider use.

Objectives

  • To improve the use of SAGES fossil/SBS zoology collections in outreach, T&L and research through improved access.
  • To catalogue and organise material, photograph where required and upload onto AdLib.

Context

Around 50% of the University fossil collection was moved to the Cole in the School of Biological Sciences in 2014. This resource is used for teaching palaeontology and is still used by staff in Archaeology (GV2M5 Quaternary Global Climate Change). SBS are now increasingly using this resource in teaching and recently it has been used to teach BI1EZ1 Introduction to Zoology, BI1EAB1 Animal Diversity, BI2BS5 Vertebrate Zoology and BI3EAB8 Palaeozoology. The remaining 50% was moved in 2015 and required cataloguing, along with archival materials. Many of the Cole specimens and all of its archives have not been photographed and were therefore unavailable as images online.

Implementation

Two UG students and one PhD student were employed, with the added value of two additional volunteers and two academic members of staff to supervise students. Remaining fossil specimens were transferred to the Cole, identified, labelled, photographed, catalogued and stored. Specimen photographs and details are now being uploaded onto the AdLib database by a volunteer. AdLib is used by collections across the University to catalogue and publish information on collection objects. It is accessible to students and staff through the Library website Enterprise.

Impact

This will allow staff and students across the university access to the collection.  Because the collection is organized and the catalogue available online, we now have a team of 8 undergraduate volunteers and enthusiasts who are able to work on proofreading and identifying specimens in the catalogue.  In addition to improving access to the collection for use in classes by students of Archaeology and SBS, an added impact of the work is that students are gaining skills in palaeontological curation and a certain level of expertise in zoology and fossil identification. A number of our students are interested in careers in the museum sector and this experience will put them in good stead for a job in this area.

Outcomes

At the end of the project all the fossils have been transferred, photographed and the digital catalogue was transferred online.  Considerable progress was made in identifying specimens and filling in missing taxonomic information. In addition to the fossil work, the opportunity to work in the museum during the summer with a dedicated team allowed us to photograph Cole specimens whilst the photography system was set up. We also engaged a PhD student, Verity Burke, to catalogue and organise the archival material. As a result she instigated a twitter exhibition #ColeEx.

Reflections

The Cole is an accredited museum praised by the accrediting body (Museums and Libraries and Archives Council – it is now administered by the Arts Council England) for our collection management and collection care. We will now manage the fossil collection appropriately to make it more readily accessible for use and to bring it back to a good curatorial standard. The collection is now available for use in outreach, by colleagues in SBS and Archaeology for classes, for research, as well as by students on school placements to allow the development of new projects.

As a result of this project, we now are able to use the collection in new ways:

  1. Teaching and Learning. The entire fossil teaching collection is now used in teaching BI3EAB1, with students in the class able to use the online catalogue during practicals.
  2.  Research. A third year student is researching our ichthyosaur material for her final year project.
  3.  Engagement. The fossil collection is very popular among our students who are keen to be able to work with the fossils and help us to improve the information associated with each specimen.
  4. Outreach. The fossil collection is available for School visits and has already been used in University outreach activities.

 

 

 

 

 

Development of an online learning environment to enhance field trip communication

By edwardwhite Comment Closed

Dr Robert Jackson, School of Biological Sciences
r.w.jackson@reading.ac.uk

Overview

An online learning environment was developed for a module, Microbiology Field Course (BI3B67), within the School of Biological Sciences (SBS). This online learning environment was used to facilitate staff and student communication while on a field trip, and was greatly successful, with students responding well to the use of technology to enhance their learning.

Objectives

  • Provide digital learning support.
  • Facilitate communication before, during and after the fieldtrip.
  • Provide a supportive and collaborative learning environment.
  • Encourage students to reflect on their experiences and think critically, in order to inform their study.
  • Encourage students to consider their social media and internet usage in terms of developing their professional identities.

Context

A field trip within the SBS has been in place since 2012, travelling to Iceland between 2012 and 2014, and Colombia in 2015. While the 2012 field trip to Iceland was a successful experience, it lacked an effective communication system, and students had independently created online communications facilities. As the 2014 trip was to be larger in scope, it was imperative that effective communication was implemented.

Implementation

The development of an online learning environment was made possible by the collaborative work of staff across the SBS and the School of Agriculture, Policy and Development. Dr Alice Mauchline was able to contribute expertise in using mobile technology for field research, and she and Dr Becky Thomas had previously collaborated on investigating how students use the internet to engage with their learning.

Students were provided with iPads so that they all had equal access to the digital learning facilities that were to be used. In order to ensure that all students were equally proficient in the use of these technologies, iPad teaching sessions were created before the field trip, providing students with training in how to use the specific applications which would be utilised on the field trip. Additionally, support was provided on the field trip, with all teaching fellows available to provide guidance on the use of the technology. As a result of this training, students were able to use the iPads to take photographs and video, these being used to create a video presentation as a legacy of their work, with these videos then being posted to a field trip blog. Students also used the iPads as a tool for their lab work, for note-taking, for editing and for communication.

A private group within the social media platform Facebook was set up, providing staff and students with a supportive online learning environment. On the trip, the Facebook group was used to direct student learning and promote critical thinking: questions were posed to students on Facebook, with students encouraged to consider their response before discussing these in class, thus flipping the classroom; students then posted their answers to Facebook, allowing further discussion to take place after class.

Students taking BI3B67 are assessed in four ways. While on the field trip itself, students undertake data collection through field and lab work. Using these results, in groups they create a presentation, which is then given at a symposium held during the field trip. Students also create a blog, in which they give a lay account of the data collection methods used during the field trip. After the field trip, students submit the lab book, which collates their results from field and lab work. Finally, 50% of the module’s final mark is weighted toward the writing of a dissertation, which includes a background introduction to the topic, materials and methods utilised, results and discussion thereof.

Impact

Both students and staff responded well to the use of technology on the field trip, especially the development of the online learning environment. Students commented in post-field trip questionnaires that they found having questions posed to them before classes valuable, and that they were encouraged to learn in a deeper manner.

Reflections

Using Facebook to flip the classroom saw students’ responses to the questions being asked of them improve. By using a platform with which the majority of students were already familiar, less training was required. As a result, staff and student communication were significantly improved.

Having the students produce a blog with videos was of great value, as this work is made available online for students to use for their professional identity when applying for jobs, thus demonstrating of their talents and enhancing their employability.

Setting up an online learning environment through Facebook is something that would be possible for others at the University to implement. As there are a number of experienced staff members at the University, expertise is not hard to come by.

Using an enquiry-based learning assessed work activity to enhance assessment and feedback

By edwardwhite Comment Closed

Professor Paul Almond, School of Law
p.j.almond@reading.ac.uk

Overview

9367A project to encourage students enrolled on a Part Three module within the School of Law, Criminology (LW3CRY), to develop a more sophisticated understanding of the links between criminological theory and policy, through a redesign of the Assessed Work project contained within the module. Results have suggested that the project was successful in achieving its objectives, and there were additional, unexpected benefits.

Objectives

  • Rework the assessment for the module so that students are better able to gain an understanding of the links between criminological theory and policy.
  • Utilise the principles of enquiry-based learning.

Context

One of the established learning outcomes for LW3CRY requires students to: ‘Apply theoretical criminological concepts to practical issues within the field of crime, law and social control’. Students had in the past tended to struggle to make meaningful connections between these two things, and to take a very simplistic view of the theory-policy relationship.

Implementation

The assessment project for the module was reworked so that it utilised principles of enquiry-based learning and required students to do something with the substantive material that they engaged with during the course. Students were set the task of producing a report for a fictional client, the ‘Minster for Justice’, recommending how a budget of £100m should be spent (on policy choices drawn from a list of available options). This open-ended requirement forced students to define their own terms for answering the question, in that they had to construct and apply the theoretical framework that explained and justified their choices, and settle on a series of recommendations that they put forward. As there is no ‘right answer’ students engage with the process of choosing and justifying rather than reaching a specified ‘correct’ conclusion. The report produced at the end of the project had to clearly explain choices with reference to theory and evidence.

The problem given to the students as the basis of the project was ‘client-centred’, in that they were supposed to be working for the Minister. To this end, the launch document and project materials were formatted in the style of official Government documents and the launch was in the form of a video podcast from the Minister (played by an actor). Project updates were also in the form of video and audio podcasts on Blackboard Learn, and the Minister had his own email address from which to send updates and respond to enquiries. Finally, in order to provide some realism in the ‘client-facing’ research relationship, some details and features of the project were staged so as to be changed or updated as the project progressed.

Impact

The average mark for the assessed work project rose from 60.9% in the previous year to 62.8% when the Project was implemented. In addition, subsequent performance in the examination for the module also improved from 60.1% to 61.2%, demonstrating that the gains in terms of the learning outcomes had carried across from the initial assessment activity.

Reflections

In order to allow this assessment change, the module convenor created the materials and released them via Blackboard Learn, responded to enquiries and provided updates, and then assessed the assessed work reports. Although this involved quite a lot of initial work, the materials and design are reusable meaning that there is a diminishing workload attached to the Project as it is reused in subsequent years.

A couple of problems arose in relation to implementing the project. Firstly, some students were unclear as to what the requirements of a ‘report’ were, and how this should differ in style, structure, and approach from an essay. Despite reassurances that ‘report’ simply meant ‘focused on providing a take-home message about the recommended policies’, they found this terminology confusing. In subsequent versions of the project, more guidance has been provided on what this requires. Secondly, the scope of the project was quite broad (in that students could end up writing small amounts about a large number of policy items), meaning that they were not able to demonstrate the depth of understanding required. Tweaks in the costs of individual items have been introduced to combat this.

Overall, this was successful, and has been utilised in subsequent academic years. It is effectively ‘future-proofed’ in that minor changes to costs, policy choices, and details allow for the materials and project to be reused again. It also involves a very specific problem, reducing opportunities for plagiarism and ‘essay-buying’. An unexpected benefit was the way that this assessment could dovetail with the rest of the course; the use of Blackboard Learn to communicate and store materials increased through-traffic on the course page generally, and it also gave a good focus to subsequent revision classes (the Minister delivers generic feedback and gives suggestions for improvement). The feedback available for this project is easily adaptable in terms of explaining the specific criteria and requirements of the examination; the style of exam question set has been altered in order to achieve ‘constructive alignment’ and ensure that the skills learned in this project are of use in the subsequent assessment.

Improved Neural Network assessment by staged laboratory practicals

By edwardwhite Comment Closed

Professor Richard Mitchell, School of Systems Engineering
r.j.mitchell@reading.ac.uk

Overview

6470Adjustments were made to teaching, assessment, and feedback in a Part Two module within the School of Systems Engineering, Neural Networks (SE2NN11), successfully using three-staged laboratory practicals in order to encourage students to use neural networks on a ‘real world’ application. Making these changes saw an increase in the number of students successfully producing a neural network.

Objectives

  • Increase the number of students successfully producing a neural network.
  • Provide greater and prompter feedback to students.

Context

The major assessment for SE2NN11 requires students to write a program to implement a particular neural network and to then use that network on a ‘real world’ application. The students demonstrated their network by the end of the autumn term, where verbal feedback was given, and they then applied it to the real world problem of their choice in the next term. Previously, students had difficulty with the first stage, and so fewer moved on to the (more interesting) second stage, with only around 75% of students submitting a report.

Implementation

During the pilot year (2009), the tasks associated with writing the neural network were carefully divided into three, and three associated 90 minute lab sessions were organised, two weeks apart, for the work. The lecturer plus two laboratory demonstrators were available to provide help to the students at these sessions.

For each session, a Microsoft Word template file was provided, and the students copied and pasted relevant program output or small parts of the program (functions) into the appropriate parts of the template. A simple marking scheme was associated with each part, worth 30 marks: typically students could get 0, 1 or 2 for a piece of code plus 0 or 1 for comments; or a student could get 0 or 1 depending on whether the program output was correct. There was also space for comments to be written.

These files were then submitted to the lecturer who circled the relevant mark for each part and added relevant comments. Detailed feedback was thereby generated very easily and very quickly. The aim was to give feedback within a week of the session, allowing the student a further week to make any necessary corrections on one part before starting the next part of the program. In fact, the first week’s work was marked within two days.

Impact

Each year since this scheme has been introduced, around 95% of students have been able to produce a neural network, a significant increase in submissions.

Reflections

The impression obtained in the pilot was that a greater proportion of students had a working neural network compared with previous years, suggesting a great success of this scenario. As such the scenario has been used each year since with some changes to the templates (and to the program to help reduce plagiarism between years).

One problem is that the structure of the program is so tightly defined that there is little scope for variation in code – hence copying is difficult to detect. This is partly addressed by requiring the student to comment their code and to discuss the object-oriented aspects of their program in the final report. In addition students were expected to do experiments in their own time to investigate the effects of changing specific parameters in the program. The instructions for the final report were made clearer to try to ensure this happens.

One disadvantage of the approach is that it discourages independent thought more than is ideal. The much increased submission rate, however, is encouraging.

The important aspects of this scheme are the division of the project into suitable, easily marked sub-tasks, the extra support provided in the development of the program and the inherent feedback between sessions.

Follow up

Following the pilot year, it was realised that some functions were more complex than others, so the marking scheme was changed so that an appropriate number of marks for the code and comments was available for each function.

From 2015, with the move to online submission, students upload their document to Blackboard Learn, where the work is readily marked. Rather than circling the marks, the ‘insert text’ option is used to allow the marks to be entered. Comments on errors or suggestions for improvements are also easily added in an appropriate context.

The second part of the assessment requires the student to apply their neural network to a ‘real world’ problem of their choice, to see if the network can learn that problem. In effect the students are researching whether a neural network is appropriate. Given that, rather than asking the students to write a report on their work, they are now asked to present their research in the form of a four page conference paper. This tests them with a new skill, complementing the report writing skills they use elsewhere. This innovation has also proved successful.

Use of a modified problem-based learning approach in aphasia therapy teaching

By edwardwhite Comment Closed

Dr Arpita Bose, School of Psychology and Clinical Language Sciences
a.bose@reading.ac.uk
Year of activity: 2011/12

Overview

9254A modified problem-based learning approach was developed and implemented in Communication Impairment 3 (PL2CI3/PLMCI3) within the School of Psychology and Clinical Language Sciences.  While the adoption of this approach was unpopular with students on the module, there was a notable improvement in the marks achieved in exams, and this suggests that subtle modification may provide a problem-based learning approach to which students respond well, and that provides for the achievement of improved grades.

Objectives

  • Implement a problem-based learning approach in aphasia therapy teaching.
  • Enable students to apply knowledge obtained through study to be applied to real world clinical cases.
  • Through use of problem-based learning, prepare students for the workplace by allowing them to experience and practise decision making skills and processes.

Context

Speech and Language Therapies programmes taught at the University of Reading aim to prepare evidence-based practitioners, able to apply their knowledge to clinical problems, and make effective decisions in their practice. The problem-based learning approach has been widely adopted within a wide range of academic contexts and professional disciplines, including for Speech and Language Therapy. Under the problem-based learning approach in Speech and Language Therapy, students are encouraged to solve problems that are set in the real world, enabling them to use specific knowledge obtained through self-directed learning with the support of their lecturer to make clinical decisions.

Implementation

The initial task was to create a raft of fictional case studies. The creation of good ‘problems’ is the essence of successful problem-based learning approaches, and so several weeks were spent modifying each case so that students would be able to understand the content area that needed to be taught. Additionally, it was necessary to find appropriate resources that could go with the case studies.

Several resources were generated in order to support the students in solving the case studies, and specific pointers were provided towards the thinking about the case studies (in class), literature (detailed reference list), web-based resources, and resources from the department and library. The module convenor was available for discussion to the assigned group during module-specific office hours.

At the beginning of the problem-based aspect of the module, classes were divided into groups of between five and six students. Each week, the groups chose one of the two cases within the week’s topic, and determined the therapy for a fictional client based on the questions for each case.

Each group was required to give a presentation on their assigned case study, answering questions in five sections. Following this there were two to three minutes available for the audience to critique the answers, and for other possible solutions to be discussed, with students basing their critiques upon their own reading. This allowed various methods to be discussed using different cases. Following this, each group updated their slides and submitted a report, with both of these being uploaded to Blackboard Learn, allowing all students on the module access to the slides and information relating to a particular case, which they could use for their own learning and have available for future clinical practice. In addition, students working on a case study received formative feedback from the seminar leader and their peers.

Having built up their ability to respond to theoretical clinical cases during the teaching of the module, in the module’s examination one of the two questions on the therapy section was modeled on solving a case based on available information, with students being required to attempt one of the two questions.

Impact

In the pilot year, in the examination the problem-based question was attempted by more of both the undergraduate and postgraduate cohorts, and the mean marks were higher for students attempting the problem-based question than those that did not. Additionally, individual students expressed interest in doing aphasia topic for their theses, and module evaluation revealed that students felt better prepared for aphasia therapy in their placements.

Reflections

While the results obtained by students in examinations and engagement suggested value in the implementation of the problem-based learning approach, this was not without its difficulties. The principal difficulty experienced was a poor reaction to the introduction of problem-based learning approach on the part of the students on the module. The introduction of problem-based learning approaches increased the workload upon students, who also had to fit the workload around their placements, and students were unappreciative of the benefits that this increased workload might bring. This may also have resulted from the fact that the undergraduate students on the module were in their third year of study, and so had difficulty adjusting to the expectations of the problem-based approach.

The second issue was that developing a problem-based learning approach necessarily increases the workload of the module convenor. It takes a considerable amount of time to write the cases and generate the resources for the students. As Dr Bose felt that developing teaching in this manner would help students learn the material better, she was willing to put the time and effort in, but this should be a consideration for others looking to adopt a problem-based learning approach.

As a result of these issues, changes were planned to and enacted upon the module in order to get students on board with the problem-based learning approach, and prepare them early on for the demands of the approach, with the workload expectations being somewhat adjusted in order to better respond to the existing workload of students. Additionally, as the delivery of a problem-based learning approach was workload-intensive, arrangements were made to provide co-teaching staff, allowing the workload to be made more manageable.

Follow up

Following the pilot year of using a modified problem-based learning approach in aphasia therapy teaching, problem-based learning has continued to form part of the delivery of this module. Following student feedback in the pilot year, the problem-based elements of the course had been stripped back somewhat in order to respond to this, and student feedback has improved: recent examination results and student feedback, however, suggest that minimal use of a problem-based learning approach is not sufficient if one wishes to see the benefits of such an approach, and that therefore the amount of problem-based learning that is required should now be increased.

Thanks to the effort put in during the first years of running the module using the modified problem-based learning approach, there now exist a number of suitable case studies for use in this approach, and thus the workload is not as intensive as it once was, and only minimal amounts of work are required to ensure that the case studies are current and relevant.

Improving student engagement with assessment and feedback through peer review

By edwardwhite Comment Closed

Professor Helen Parish, School of Humanities
h.l.parish@reading.ac.uk

Year of activity: 2014-15

Overview

9070

The project investigated recent research and practice in peer assessment and feedback in order to implement a peer assessment model for use within History, and develop a framework for the adoption of said model in cognate disciplines where evaluation of substantial text-based assignments is an important part of assessment.

Objectives

  • Present students with well-managed opportunities to engage in feedback and assessment and learn from it.
  • Present staff with access to tried and tested models for implementation that can be used and tailored across disciplines.

Context

The importance of increasing the impact of assessment in feedback and learning is recognised by the University’s teaching and learning enhancement priorities, and is evident in the ‘Engage in Assessment’ and ‘Engage in Feedback’ materials.  The requirement to pursue an agenda for feedback is also highlighted by the expectations of employers that graduates of the University of Reading will be able to assess and evaluate the work of others, by comments on feedback made by University of Reading students in the National Student Survey, and by discussions with potential students on Open Days.

Implementation

There were five stages to the project:

  1. A literature search on the topic and detailed engagement with recent scholarship, undertaken by the Principal Investigator.
  2. A ‘competitor analysis’, undertaken by a research assistant, looking at the extent that peer feedback is present on Humanities curricula at other institutions.
  3. Development of a model for the trial of peer assessment informed by the previous two stages.
  4. Implementation of this model as a ‘pilot project’ in the Department of History.
  5. Obtaining student feedback on the process and reflection by the Principal Investigator.

The feedback gained during the early stages of the project revealed that students were reluctant to allow their work to be reviewed by their peers, even when anonymised.   This necessitated the envisaged model to be altered, whereby the written work being ‘peer reviewed’ was either from previous cohorts within the Department or alternative sources.

Once the pilot project was developed, there were three stages:

  1. Development of an understanding of marking and assessment criteria. Students read the assessment criteria of their module, and were then tasked with rewriting these in their own words.
  2. Applying these criteria to written work. Students then read a sample essay (not taken from the group), and with reference to the marking criteria, were asked to give a mark to the essay, with a summary of reasons they had come to this judgment.  This was followed by a discussion of the written feedback provided.
  3. Focus group and project review.  It was intended that students would meet to talk about the project, and more general issues to do with assessment and feedback, in the presence of an experienced observer external to the department.

Impact

One of the principal benefits of the project was that students became more aware of the marking criteria by which their assignments were assessed, as although they found these clear, few students had actually taken the time to read these before. An additional benefit was that the activity helped develop students’ academic confidence, as they were impelled to adopt a critical attitude to writing within scholarship, and gained experience of promoting their point of view to their peers.

Reflections

Feedback from questionnaires suggested that students enjoyed the project; that they now had a better understanding of assessment and feedback; that the project had been helpful with the preparation of their own written work; and that they were now more confident in the assessment of their own work prior to submission.

The reluctance of students to submit their own work to review by their peers meant that there was a less direct link between the peer feedback provided and the specific assignment for each module.  By using work from previous cohorts or alternative sources, however, it was possible to get students to engage more willingly with the process of peer review.

The main disappointment was that it proved impossible to gather a large enough group of students to participate in the focus group stage of the project.  This may have been due to the proposed scheduling of the focus groups at a time when students had recently participated in a Departmental Periodic Review and submitted their final coursework of the academic year.  Nevertheless, valuable feedback on the pilot was provided through questionnaires and verbal communication.

It was interesting to observe that students held broad spectrum of ideas about what constituted good work, arising from a lack of understanding about the criteria against which work is marked. From this perspective, the project was valuable, as students were familiarised with the marking criteria and how these applied to written pieces Students were able to look ‘behind the scenes’ at the marking process, with student applying the marking criteria as individuals, but then needing to decide as a group upon a final mark for pieces they were reviewing.

Follow up

Following the pilot project, the use of peer review to engage students in assessment and feedback has been used by other members of staff within the Department of History, with similar success. Other than the specific pieces of work and criteria used for peer review purposes, there was nothing within this project that was specific to the Department of History or School of Humanities, and so this activity could easily be adapted for use in other Departments and Schools across the University.

The peer review approach has been successfully applied within the Department of History to student presentations in seminars. As student presentations are more ‘in the moment’ and designed with a peer audience in mind, students have not expressed the same reticence to have their peers review their work, and those presenting have appreciated receiving immediate feedback.