Flipping the classroom in Meteorology

By edwardwhite Comment Closed

Dr. Andrew Charlton-Perez, School of Mathematical and Physical Sciences
a.j.charlton-perez@reading.ac.uk
Year of activity: 2015/16

Overview

12484A flipped learning approach to teaching the part 3 and part 4 module, ‘The Global Circulation’ (MT38A/4YA) in Meteorology was developed and tested. This approach was very successful, encouraging students to apply complex ideas to real-world problems.

Objectives

  • Develop a new set of learning resources which could be used both in a flipped learning or traditional lecture based delivery.
  • Test and evaluate if teaching in a ‘flipped learning’ style improved student engagement and higher-level learning.
  • Implement authentic assessment that models the real-world process of enquiry and peer-feedback.

Context

I’ve been teaching this module for eight years adding some enquiry-based learning elements around four years ago. While it has always received good student feedback, a colleague who moderated my exam scripts last year made me consider if students were as actively engaged with the module as I had previously thought. Looking at student work it was clear that while students could remember and reproduce sophisticated concepts and mathematical derivations, their ability to apply this knowledge to unfamiliar situations was limited.

Implementation

Prior to the course I developed a significant new set of learning resources for the course:

  • 21 short videos (between 4 and 6 minutes long) targeted at difficult concepts.
  • 13 online quizzes of ten questions in Blackboard Learn.
  • 24 new learning activities linked to the research literature which students completed during class. 12 of these activities were supported by simple numerical models developed from scratch in open-source Python code.

The course was delivered to students in Spring 2016. The first time the class met as a group I explained the flipped classroom idea and we negotiated an approach to learning.

Following this first meeting, the class operated in three, three-week units. During the first two weeks of each unit, students studied notes and videos in their own time and then completed the on-line quizzes (with instant feedback) prior to attending the next class. In class, students had a choice of two learning activities. Students worked with each other in small teams and with me to complete the problems, writing notes in a rough lab book.

In the third week of each unit, students prepared a more formal write-up of one of the problems as summative assessment for that unit. In extracting information from their lab book, students needed to think about how to frame the problem by stating a hypothesis they wished to test and put the work they had done in the context of the current research literature.

In class, students exchanged their work and gave peer-feedback to each other, before completing the formal write-up with the chance to ask additional clarification questions.

Impact

The change to a flipped learning style had a transformative impact on the module; Student feedback highlighted the benefits of the investment in a number of ways including that they enjoyed the flipped learning approach:

  • ‘The structure of the module was the best out of my three years of university, flipped classroom should be done more’
  • ‘Always felt engaged with the lectures thanks to a different learning style’
  • ‘… I could run over the tricky concepts in more detail on a 1-to-1 basis with the lecturer. Often the same question applied to others and the class environment allowed group discussions which really enhanced the learning in a relaxed and productive way.’

And that their learning was improved:

  • ‘…brought my attention to active research areas at the front of study – it got me very interested in the exercises.’
  • ‘Class room discussions made me learn more than in a lecture style class’
  • ‘It isn’t an easy module, but it is very rewarding’

Reflections

Teaching in a flipped learning style also had a significant impact on my own enthusiasm for teaching the course because the improvement in student learning and engagement was tangible. The image shows an example of student work produced on a white board by a small group during one of the class sessions, applying ideas from the core course material to a recent research paper. It was extremely exciting to see students applying complex ideas in this way and succeeding in writing high-quality research reports on their work.

The flipped learning approach also challenged me to think more deeply about the material because I needed to produce engaging and manageable problems for students to work on.

It was also very rewarding to see how much students made use of the new teaching materials I developed. By monitoring the use of the videos on Blackboard I could see that typically the videos were viewed between 100 and 150 times by the ten students on the course, indicating how important these videos were for student learning. Based on student feedback, short and engaging videos encouraged repeated viewing. I also included music in the videos, often with an oblique reference to the content and students commented that they enjoyed this element of fun! At the end of the course, students requested the ability to download and keep copies of the videos (this functionality is currently not available in Blackboard).

An important part of producing the videos was to also provide transcripts to ensure they were accessible for all students and this took quite a bit of time in addition to video production (which was relatively straight-forward).

The on-line quizzes had a completion rate of 80% with average marks above 70% for most students. As with the videos, the high level of engagement with these materials suggests that they were of an appropriate length and level of challenge for students (pitched so that a student who had studied the notes and videos could answer most questions without further detailed application).

Are we doing enough for our BTEC entrants? Authored by Dr Michelle Reid (Study Advice)

By edwardwhite Comment Closed

Transition to university is often geared towards students from an A-level background, so are we doing enough for students with vocational qualifications starting at Reading?

Recent research from UCAS shows that one in four university entrants has done a BTEC (Havergal, 2016). Issues such as culture shock, work/life balance, different assessment methods, and the perception that A-level entrants may be better equipped to study at university are some of the concerns BTEC students can have when starting their degree (Clark, 2011). As Study Advisers, we observed similar concerns when working with former BTEC students here at Reading, particularly in relation to learning from lectures and taking exams, as these are not teaching and assessment methods used on BTEC courses. With these transition issues in mind, and also in light of the increased focus on widening participation, we conducted a short survey to gauge the views of current Reading students with BTEC qualifications on their readiness for university. We wanted to assess whether it would be beneficial to host a pre-entry event for BTEC entrants before they start here in the autumn, following the model of our well-established and successful pre-entry day for mature students.

We sent the questionnaire to all current Reading undergraduate and taught postgraduate students who had taken a BTEC (over 800 students) and received 173 replies. The results confirmed the previous research and our own observations. 45% of respondents described themselves as ‘fairly well prepared’ for university. However when this was explored further, 41.8% also felt that studying at university was ‘fairly different’ to the style of learning they were used to with the main difference being the style of assessments. Respondents pinpointed referencing, preparing for exams and academic reading as the areas they most wished they had known more about before starting university, again reflecting a concern with assessment and the style of academic learning at university. Similar to more general research findings (Clark, 2011; Reidy, 2015) our own former BTEC students identified their studying strengths as coursework, independence, subject knowledge and motivation. This suggests that BTECs give a good foundation in independent learning and indicates that students are likely to be motivated to attend a pre-entry event. However, the results also suggest there are gaps in transition guidance, especially around some assessment methods. Indeed, it is concerning that a wider HEA study has shown that students who went to university with vocational qualifications were less likely to achieve a first or 2:1 (Havergal, 2016). This indicates that we should be doing more to prepare BTEC students for the culture of HE assessment and to foster the potential of BTEC students.

Based on the survey findings, Study Advice is now investigating the possibility of hosting a pre-entry event for BTEC students this summer. We would be very interested in talking to others looking at transition and support for BTEC entrants.

 

References:

Clark, W. (2011). ‘Transitions in action? Exploring vocational learner progression into and out of higher education’. Educational Developments, 12.2, pp.9-12.

Havergal, C. (2016). ‘One in four university entrants has a BTEC, Ucas study finds’. Times Higher Education, 28 January 2016. Online at https://www.timeshighereducation.com/news/one-in-four-university-entrants-has-a-btec-ucas-study-finds  Accessed 05/04/16.

Reidy, T. (2015). ‘Will taking a BTec help or hinder your university application?’ The Guardian, Education section, 21 July 2015. Online at http://www.theguardian.com/education/2015/jul/21/will-taking-a-btec-help-or-hinder-your-university-application  Accessed 05/04/16.

Development of the Cole Museum resources for outreach and teaching and learning.

By edwardwhite Comment Closed

 Dr Amanda Callaghan, School of Biological Sciences
a.callaghan@reading.ac.uk

Overview

Cole Zoology Museum300The Cole Museum of Zoology (the Cole) houses a number of satellite collections for use in outreach, teaching and learning. In 2014 we transferred 50% of the School of Archaeology, Geography and Environmental Science (SAGES) fossil collection to the Cole and in 2015 acquired the other half. As a result of this Teaching and Learning Development Fund project, most of the fossils and many more Cole specimens and archives have been catalogued and photographed and are now being transferred onto AdLib (a database for the cataloguing and publishing of information on collection objects) for wider use.

Objectives

  • To improve the use of SAGES fossil/SBS zoology collections in outreach, T&L and research through improved access.
  • To catalogue and organise material, photograph where required and upload onto AdLib.

Context

Around 50% of the University fossil collection was moved to the Cole in the School of Biological Sciences in 2014. This resource is used for teaching palaeontology and is still used by staff in Archaeology (GV2M5 Quaternary Global Climate Change). SBS are now increasingly using this resource in teaching and recently it has been used to teach BI1EZ1 Introduction to Zoology, BI1EAB1 Animal Diversity, BI2BS5 Vertebrate Zoology and BI3EAB8 Palaeozoology. The remaining 50% was moved in 2015 and required cataloguing, along with archival materials. Many of the Cole specimens and all of its archives have not been photographed and were therefore unavailable as images online.

Implementation

Two UG students and one PhD student were employed, with the added value of two additional volunteers and two academic members of staff to supervise students. Remaining fossil specimens were transferred to the Cole, identified, labelled, photographed, catalogued and stored. Specimen photographs and details are now being uploaded onto the AdLib database by a volunteer. AdLib is used by collections across the University to catalogue and publish information on collection objects. It is accessible to students and staff through the Library website Enterprise.

Impact

This will allow staff and students across the university access to the collection.  Because the collection is organized and the catalogue available online, we now have a team of 8 undergraduate volunteers and enthusiasts who are able to work on proofreading and identifying specimens in the catalogue.  In addition to improving access to the collection for use in classes by students of Archaeology and SBS, an added impact of the work is that students are gaining skills in palaeontological curation and a certain level of expertise in zoology and fossil identification. A number of our students are interested in careers in the museum sector and this experience will put them in good stead for a job in this area.

Outcomes

At the end of the project all the fossils have been transferred, photographed and the digital catalogue was transferred online.  Considerable progress was made in identifying specimens and filling in missing taxonomic information. In addition to the fossil work, the opportunity to work in the museum during the summer with a dedicated team allowed us to photograph Cole specimens whilst the photography system was set up. We also engaged a PhD student, Verity Burke, to catalogue and organise the archival material. As a result she instigated a twitter exhibition #ColeEx.

Reflections

The Cole is an accredited museum praised by the accrediting body (Museums and Libraries and Archives Council – it is now administered by the Arts Council England) for our collection management and collection care. We will now manage the fossil collection appropriately to make it more readily accessible for use and to bring it back to a good curatorial standard. The collection is now available for use in outreach, by colleagues in SBS and Archaeology for classes, for research, as well as by students on school placements to allow the development of new projects.

As a result of this project, we now are able to use the collection in new ways:

  1. Teaching and Learning. The entire fossil teaching collection is now used in teaching BI3EAB1, with students in the class able to use the online catalogue during practicals.
  2.  Research. A third year student is researching our ichthyosaur material for her final year project.
  3.  Engagement. The fossil collection is very popular among our students who are keen to be able to work with the fossils and help us to improve the information associated with each specimen.
  4. Outreach. The fossil collection is available for School visits and has already been used in University outreach activities.

 

 

 

 

 

Development of an online learning environment to enhance field trip communication

By edwardwhite Comment Closed

Dr Robert Jackson, School of Biological Sciences
r.w.jackson@reading.ac.uk

Overview

An online learning environment was developed for a module, Microbiology Field Course (BI3B67), within the School of Biological Sciences (SBS). This online learning environment was used to facilitate staff and student communication while on a field trip, and was greatly successful, with students responding well to the use of technology to enhance their learning.

Objectives

  • Provide digital learning support.
  • Facilitate communication before, during and after the fieldtrip.
  • Provide a supportive and collaborative learning environment.
  • Encourage students to reflect on their experiences and think critically, in order to inform their study.
  • Encourage students to consider their social media and internet usage in terms of developing their professional identities.

Context

A field trip within the SBS has been in place since 2012, travelling to Iceland between 2012 and 2014, and Colombia in 2015. While the 2012 field trip to Iceland was a successful experience, it lacked an effective communication system, and students had independently created online communications facilities. As the 2014 trip was to be larger in scope, it was imperative that effective communication was implemented.

Implementation

The development of an online learning environment was made possible by the collaborative work of staff across the SBS and the School of Agriculture, Policy and Development. Dr Alice Mauchline was able to contribute expertise in using mobile technology for field research, and she and Dr Becky Thomas had previously collaborated on investigating how students use the internet to engage with their learning.

Students were provided with iPads so that they all had equal access to the digital learning facilities that were to be used. In order to ensure that all students were equally proficient in the use of these technologies, iPad teaching sessions were created before the field trip, providing students with training in how to use the specific applications which would be utilised on the field trip. Additionally, support was provided on the field trip, with all teaching fellows available to provide guidance on the use of the technology. As a result of this training, students were able to use the iPads to take photographs and video, these being used to create a video presentation as a legacy of their work, with these videos then being posted to a field trip blog. Students also used the iPads as a tool for their lab work, for note-taking, for editing and for communication.

A private group within the social media platform Facebook was set up, providing staff and students with a supportive online learning environment. On the trip, the Facebook group was used to direct student learning and promote critical thinking: questions were posed to students on Facebook, with students encouraged to consider their response before discussing these in class, thus flipping the classroom; students then posted their answers to Facebook, allowing further discussion to take place after class.

Students taking BI3B67 are assessed in four ways. While on the field trip itself, students undertake data collection through field and lab work. Using these results, in groups they create a presentation, which is then given at a symposium held during the field trip. Students also create a blog, in which they give a lay account of the data collection methods used during the field trip. After the field trip, students submit the lab book, which collates their results from field and lab work. Finally, 50% of the module’s final mark is weighted toward the writing of a dissertation, which includes a background introduction to the topic, materials and methods utilised, results and discussion thereof.

Impact

Both students and staff responded well to the use of technology on the field trip, especially the development of the online learning environment. Students commented in post-field trip questionnaires that they found having questions posed to them before classes valuable, and that they were encouraged to learn in a deeper manner.

Reflections

Using Facebook to flip the classroom saw students’ responses to the questions being asked of them improve. By using a platform with which the majority of students were already familiar, less training was required. As a result, staff and student communication were significantly improved.

Having the students produce a blog with videos was of great value, as this work is made available online for students to use for their professional identity when applying for jobs, thus demonstrating of their talents and enhancing their employability.

Setting up an online learning environment through Facebook is something that would be possible for others at the University to implement. As there are a number of experienced staff members at the University, expertise is not hard to come by.

Using an enquiry-based learning assessed work activity to enhance assessment and feedback

By edwardwhite Comment Closed

Professor Paul Almond, School of Law
p.j.almond@reading.ac.uk

Overview

9367A project to encourage students enrolled on a Part Three module within the School of Law, Criminology (LW3CRY), to develop a more sophisticated understanding of the links between criminological theory and policy, through a redesign of the Assessed Work project contained within the module. Results have suggested that the project was successful in achieving its objectives, and there were additional, unexpected benefits.

Objectives

  • Rework the assessment for the module so that students are better able to gain an understanding of the links between criminological theory and policy.
  • Utilise the principles of enquiry-based learning.

Context

One of the established learning outcomes for LW3CRY requires students to: ‘Apply theoretical criminological concepts to practical issues within the field of crime, law and social control’. Students had in the past tended to struggle to make meaningful connections between these two things, and to take a very simplistic view of the theory-policy relationship.

Implementation

The assessment project for the module was reworked so that it utilised principles of enquiry-based learning and required students to do something with the substantive material that they engaged with during the course. Students were set the task of producing a report for a fictional client, the ‘Minster for Justice’, recommending how a budget of £100m should be spent (on policy choices drawn from a list of available options). This open-ended requirement forced students to define their own terms for answering the question, in that they had to construct and apply the theoretical framework that explained and justified their choices, and settle on a series of recommendations that they put forward. As there is no ‘right answer’ students engage with the process of choosing and justifying rather than reaching a specified ‘correct’ conclusion. The report produced at the end of the project had to clearly explain choices with reference to theory and evidence.

The problem given to the students as the basis of the project was ‘client-centred’, in that they were supposed to be working for the Minister. To this end, the launch document and project materials were formatted in the style of official Government documents and the launch was in the form of a video podcast from the Minister (played by an actor). Project updates were also in the form of video and audio podcasts on Blackboard Learn, and the Minister had his own email address from which to send updates and respond to enquiries. Finally, in order to provide some realism in the ‘client-facing’ research relationship, some details and features of the project were staged so as to be changed or updated as the project progressed.

Impact

The average mark for the assessed work project rose from 60.9% in the previous year to 62.8% when the Project was implemented. In addition, subsequent performance in the examination for the module also improved from 60.1% to 61.2%, demonstrating that the gains in terms of the learning outcomes had carried across from the initial assessment activity.

Reflections

In order to allow this assessment change, the module convenor created the materials and released them via Blackboard Learn, responded to enquiries and provided updates, and then assessed the assessed work reports. Although this involved quite a lot of initial work, the materials and design are reusable meaning that there is a diminishing workload attached to the Project as it is reused in subsequent years.

A couple of problems arose in relation to implementing the project. Firstly, some students were unclear as to what the requirements of a ‘report’ were, and how this should differ in style, structure, and approach from an essay. Despite reassurances that ‘report’ simply meant ‘focused on providing a take-home message about the recommended policies’, they found this terminology confusing. In subsequent versions of the project, more guidance has been provided on what this requires. Secondly, the scope of the project was quite broad (in that students could end up writing small amounts about a large number of policy items), meaning that they were not able to demonstrate the depth of understanding required. Tweaks in the costs of individual items have been introduced to combat this.

Overall, this was successful, and has been utilised in subsequent academic years. It is effectively ‘future-proofed’ in that minor changes to costs, policy choices, and details allow for the materials and project to be reused again. It also involves a very specific problem, reducing opportunities for plagiarism and ‘essay-buying’. An unexpected benefit was the way that this assessment could dovetail with the rest of the course; the use of Blackboard Learn to communicate and store materials increased through-traffic on the course page generally, and it also gave a good focus to subsequent revision classes (the Minister delivers generic feedback and gives suggestions for improvement). The feedback available for this project is easily adaptable in terms of explaining the specific criteria and requirements of the examination; the style of exam question set has been altered in order to achieve ‘constructive alignment’ and ensure that the skills learned in this project are of use in the subsequent assessment.

Improved Neural Network assessment by staged laboratory practicals

By edwardwhite Comment Closed

Professor Richard Mitchell, School of Systems Engineering
r.j.mitchell@reading.ac.uk

Overview

6470Adjustments were made to teaching, assessment, and feedback in a Part Two module within the School of Systems Engineering, Neural Networks (SE2NN11), successfully using three-staged laboratory practicals in order to encourage students to use neural networks on a ‘real world’ application. Making these changes saw an increase in the number of students successfully producing a neural network.

Objectives

  • Increase the number of students successfully producing a neural network.
  • Provide greater and prompter feedback to students.

Context

The major assessment for SE2NN11 requires students to write a program to implement a particular neural network and to then use that network on a ‘real world’ application. The students demonstrated their network by the end of the autumn term, where verbal feedback was given, and they then applied it to the real world problem of their choice in the next term. Previously, students had difficulty with the first stage, and so fewer moved on to the (more interesting) second stage, with only around 75% of students submitting a report.

Implementation

During the pilot year (2009), the tasks associated with writing the neural network were carefully divided into three, and three associated 90 minute lab sessions were organised, two weeks apart, for the work. The lecturer plus two laboratory demonstrators were available to provide help to the students at these sessions.

For each session, a Microsoft Word template file was provided, and the students copied and pasted relevant program output or small parts of the program (functions) into the appropriate parts of the template. A simple marking scheme was associated with each part, worth 30 marks: typically students could get 0, 1 or 2 for a piece of code plus 0 or 1 for comments; or a student could get 0 or 1 depending on whether the program output was correct. There was also space for comments to be written.

These files were then submitted to the lecturer who circled the relevant mark for each part and added relevant comments. Detailed feedback was thereby generated very easily and very quickly. The aim was to give feedback within a week of the session, allowing the student a further week to make any necessary corrections on one part before starting the next part of the program. In fact, the first week’s work was marked within two days.

Impact

Each year since this scheme has been introduced, around 95% of students have been able to produce a neural network, a significant increase in submissions.

Reflections

The impression obtained in the pilot was that a greater proportion of students had a working neural network compared with previous years, suggesting a great success of this scenario. As such the scenario has been used each year since with some changes to the templates (and to the program to help reduce plagiarism between years).

One problem is that the structure of the program is so tightly defined that there is little scope for variation in code – hence copying is difficult to detect. This is partly addressed by requiring the student to comment their code and to discuss the object-oriented aspects of their program in the final report. In addition students were expected to do experiments in their own time to investigate the effects of changing specific parameters in the program. The instructions for the final report were made clearer to try to ensure this happens.

One disadvantage of the approach is that it discourages independent thought more than is ideal. The much increased submission rate, however, is encouraging.

The important aspects of this scheme are the division of the project into suitable, easily marked sub-tasks, the extra support provided in the development of the program and the inherent feedback between sessions.

Follow up

Following the pilot year, it was realised that some functions were more complex than others, so the marking scheme was changed so that an appropriate number of marks for the code and comments was available for each function.

From 2015, with the move to online submission, students upload their document to Blackboard Learn, where the work is readily marked. Rather than circling the marks, the ‘insert text’ option is used to allow the marks to be entered. Comments on errors or suggestions for improvements are also easily added in an appropriate context.

The second part of the assessment requires the student to apply their neural network to a ‘real world’ problem of their choice, to see if the network can learn that problem. In effect the students are researching whether a neural network is appropriate. Given that, rather than asking the students to write a report on their work, they are now asked to present their research in the form of a four page conference paper. This tests them with a new skill, complementing the report writing skills they use elsewhere. This innovation has also proved successful.

Use of a modified problem-based learning approach in aphasia therapy teaching

By edwardwhite Comment Closed

Dr Arpita Bose, School of Psychology and Clinical Language Sciences
a.bose@reading.ac.uk
Year of activity: 2011/12

Overview

9254A modified problem-based learning approach was developed and implemented in Communication Impairment 3 (PL2CI3/PLMCI3) within the School of Psychology and Clinical Language Sciences.  While the adoption of this approach was unpopular with students on the module, there was a notable improvement in the marks achieved in exams, and this suggests that subtle modification may provide a problem-based learning approach to which students respond well, and that provides for the achievement of improved grades.

Objectives

  • Implement a problem-based learning approach in aphasia therapy teaching.
  • Enable students to apply knowledge obtained through study to be applied to real world clinical cases.
  • Through use of problem-based learning, prepare students for the workplace by allowing them to experience and practise decision making skills and processes.

Context

Speech and Language Therapies programmes taught at the University of Reading aim to prepare evidence-based practitioners, able to apply their knowledge to clinical problems, and make effective decisions in their practice. The problem-based learning approach has been widely adopted within a wide range of academic contexts and professional disciplines, including for Speech and Language Therapy. Under the problem-based learning approach in Speech and Language Therapy, students are encouraged to solve problems that are set in the real world, enabling them to use specific knowledge obtained through self-directed learning with the support of their lecturer to make clinical decisions.

Implementation

The initial task was to create a raft of fictional case studies. The creation of good ‘problems’ is the essence of successful problem-based learning approaches, and so several weeks were spent modifying each case so that students would be able to understand the content area that needed to be taught. Additionally, it was necessary to find appropriate resources that could go with the case studies.

Several resources were generated in order to support the students in solving the case studies, and specific pointers were provided towards the thinking about the case studies (in class), literature (detailed reference list), web-based resources, and resources from the department and library. The module convenor was available for discussion to the assigned group during module-specific office hours.

At the beginning of the problem-based aspect of the module, classes were divided into groups of between five and six students. Each week, the groups chose one of the two cases within the week’s topic, and determined the therapy for a fictional client based on the questions for each case.

Each group was required to give a presentation on their assigned case study, answering questions in five sections. Following this there were two to three minutes available for the audience to critique the answers, and for other possible solutions to be discussed, with students basing their critiques upon their own reading. This allowed various methods to be discussed using different cases. Following this, each group updated their slides and submitted a report, with both of these being uploaded to Blackboard Learn, allowing all students on the module access to the slides and information relating to a particular case, which they could use for their own learning and have available for future clinical practice. In addition, students working on a case study received formative feedback from the seminar leader and their peers.

Having built up their ability to respond to theoretical clinical cases during the teaching of the module, in the module’s examination one of the two questions on the therapy section was modeled on solving a case based on available information, with students being required to attempt one of the two questions.

Impact

In the pilot year, in the examination the problem-based question was attempted by more of both the undergraduate and postgraduate cohorts, and the mean marks were higher for students attempting the problem-based question than those that did not. Additionally, individual students expressed interest in doing aphasia topic for their theses, and module evaluation revealed that students felt better prepared for aphasia therapy in their placements.

Reflections

While the results obtained by students in examinations and engagement suggested value in the implementation of the problem-based learning approach, this was not without its difficulties. The principal difficulty experienced was a poor reaction to the introduction of problem-based learning approach on the part of the students on the module. The introduction of problem-based learning approaches increased the workload upon students, who also had to fit the workload around their placements, and students were unappreciative of the benefits that this increased workload might bring. This may also have resulted from the fact that the undergraduate students on the module were in their third year of study, and so had difficulty adjusting to the expectations of the problem-based approach.

The second issue was that developing a problem-based learning approach necessarily increases the workload of the module convenor. It takes a considerable amount of time to write the cases and generate the resources for the students. As Dr Bose felt that developing teaching in this manner would help students learn the material better, she was willing to put the time and effort in, but this should be a consideration for others looking to adopt a problem-based learning approach.

As a result of these issues, changes were planned to and enacted upon the module in order to get students on board with the problem-based learning approach, and prepare them early on for the demands of the approach, with the workload expectations being somewhat adjusted in order to better respond to the existing workload of students. Additionally, as the delivery of a problem-based learning approach was workload-intensive, arrangements were made to provide co-teaching staff, allowing the workload to be made more manageable.

Follow up

Following the pilot year of using a modified problem-based learning approach in aphasia therapy teaching, problem-based learning has continued to form part of the delivery of this module. Following student feedback in the pilot year, the problem-based elements of the course had been stripped back somewhat in order to respond to this, and student feedback has improved: recent examination results and student feedback, however, suggest that minimal use of a problem-based learning approach is not sufficient if one wishes to see the benefits of such an approach, and that therefore the amount of problem-based learning that is required should now be increased.

Thanks to the effort put in during the first years of running the module using the modified problem-based learning approach, there now exist a number of suitable case studies for use in this approach, and thus the workload is not as intensive as it once was, and only minimal amounts of work are required to ensure that the case studies are current and relevant.

Improving student engagement with assessment and feedback through peer review

By edwardwhite Comment Closed

Professor Helen Parish, School of Humanities
h.l.parish@reading.ac.uk

Year of activity: 2014-15

Overview

9070

The project investigated recent research and practice in peer assessment and feedback in order to implement a peer assessment model for use within History, and develop a framework for the adoption of said model in cognate disciplines where evaluation of substantial text-based assignments is an important part of assessment.

Objectives

  • Present students with well-managed opportunities to engage in feedback and assessment and learn from it.
  • Present staff with access to tried and tested models for implementation that can be used and tailored across disciplines.

Context

The importance of increasing the impact of assessment in feedback and learning is recognised by the University’s teaching and learning enhancement priorities, and is evident in the ‘Engage in Assessment’ and ‘Engage in Feedback’ materials.  The requirement to pursue an agenda for feedback is also highlighted by the expectations of employers that graduates of the University of Reading will be able to assess and evaluate the work of others, by comments on feedback made by University of Reading students in the National Student Survey, and by discussions with potential students on Open Days.

Implementation

There were five stages to the project:

  1. A literature search on the topic and detailed engagement with recent scholarship, undertaken by the Principal Investigator.
  2. A ‘competitor analysis’, undertaken by a research assistant, looking at the extent that peer feedback is present on Humanities curricula at other institutions.
  3. Development of a model for the trial of peer assessment informed by the previous two stages.
  4. Implementation of this model as a ‘pilot project’ in the Department of History.
  5. Obtaining student feedback on the process and reflection by the Principal Investigator.

The feedback gained during the early stages of the project revealed that students were reluctant to allow their work to be reviewed by their peers, even when anonymised.   This necessitated the envisaged model to be altered, whereby the written work being ‘peer reviewed’ was either from previous cohorts within the Department or alternative sources.

Once the pilot project was developed, there were three stages:

  1. Development of an understanding of marking and assessment criteria. Students read the assessment criteria of their module, and were then tasked with rewriting these in their own words.
  2. Applying these criteria to written work. Students then read a sample essay (not taken from the group), and with reference to the marking criteria, were asked to give a mark to the essay, with a summary of reasons they had come to this judgment.  This was followed by a discussion of the written feedback provided.
  3. Focus group and project review.  It was intended that students would meet to talk about the project, and more general issues to do with assessment and feedback, in the presence of an experienced observer external to the department.

Impact

One of the principal benefits of the project was that students became more aware of the marking criteria by which their assignments were assessed, as although they found these clear, few students had actually taken the time to read these before. An additional benefit was that the activity helped develop students’ academic confidence, as they were impelled to adopt a critical attitude to writing within scholarship, and gained experience of promoting their point of view to their peers.

Reflections

Feedback from questionnaires suggested that students enjoyed the project; that they now had a better understanding of assessment and feedback; that the project had been helpful with the preparation of their own written work; and that they were now more confident in the assessment of their own work prior to submission.

The reluctance of students to submit their own work to review by their peers meant that there was a less direct link between the peer feedback provided and the specific assignment for each module.  By using work from previous cohorts or alternative sources, however, it was possible to get students to engage more willingly with the process of peer review.

The main disappointment was that it proved impossible to gather a large enough group of students to participate in the focus group stage of the project.  This may have been due to the proposed scheduling of the focus groups at a time when students had recently participated in a Departmental Periodic Review and submitted their final coursework of the academic year.  Nevertheless, valuable feedback on the pilot was provided through questionnaires and verbal communication.

It was interesting to observe that students held broad spectrum of ideas about what constituted good work, arising from a lack of understanding about the criteria against which work is marked. From this perspective, the project was valuable, as students were familiarised with the marking criteria and how these applied to written pieces Students were able to look ‘behind the scenes’ at the marking process, with student applying the marking criteria as individuals, but then needing to decide as a group upon a final mark for pieces they were reviewing.

Follow up

Following the pilot project, the use of peer review to engage students in assessment and feedback has been used by other members of staff within the Department of History, with similar success. Other than the specific pieces of work and criteria used for peer review purposes, there was nothing within this project that was specific to the Department of History or School of Humanities, and so this activity could easily be adapted for use in other Departments and Schools across the University.

The peer review approach has been successfully applied within the Department of History to student presentations in seminars. As student presentations are more ‘in the moment’ and designed with a peer audience in mind, students have not expressed the same reticence to have their peers review their work, and those presenting have appreciated receiving immediate feedback.

Digital Performance Lab: the application of tablet technologies in the teaching of contemporary performance

By edwardwhite Comment Closed

Professor Lib Taylor, School of Arts and Communication Design
l.j.taylor@reading.ac.uk

Year of activity: 2012-13

Overview

DPLThe project explored how tablet technologies can be applied for teaching contemporary performance, through the creation of a Digital Performance Lab for use as part of the optional Part Three Contemporary Performance modules (FT3COA and FT3COB).

Objectives

  • Develop student employability and professionalism through creative research, group work and proficiency in digital media.
  • Encourage sophisticated student engagement with the creative industries’ use of digital media.
  • Enable students to explore issues of performance through practical, creative experimentation.
  • Provide students with the means to experiment in a creative way in the Contemporary Performance module, and in their individual research projects.
  • Set up a Digital Performance Lab for use as part of Part Three Contemporary Performance modules.

Context

The project to incorporate the use of tablet technologies into FT3COA and FT3COB grew out of a previous project which had experimented with the use of Bluetooth technologies. Much current experimental performance makes use of digital technologies, so it was imperative that students were provided with the opportunity to study this aspect of contemporary performance, and it was felt that the versatility of tablet technology would allow students to explore issues of performance through practical, creative experimentation.

Implementation

To aid in the set up of the Digital Performance Lab, Dr Lisa Purse, who has expertise in the use of digital technology, acted as an adviser on the project.

The Department acquired seven 32 GB iPads and covers.  These were loaded with a number of appropriate apps, which were added to over the course of the academic year as familiarity with what was available increased, with students also making suggestions for apps that they had found useful.  Several connectors were also acquired for projects to allow the screening of several images simultaneously.

To allow them to make best use of the technology, students were trained in the basic use of the equipment and the apps most appropriate to the early stage of the work.  Once trained, students were able to use the tablets for a number of module-related activities, including:

  • Collecting material for class workshops.
  • Filming and editing material for multimedia experimentation
  • Accessing performances available via digital technologies in class workshop to assist in the analysis of performance
  • Developing individual and small group presentations.
  • Recording performances in class.
  • Experimenting with ways that tablet technology might enhance the experience of a performance for the audience.
  • Developing methodologies to enhance the documentation of performances.

In order to encourage the use of the tablets, their use was incorporated into some student assessments:

  • In Autumn Term all students were required to participate in a group assessment in which at least one iPad was used.
  • In Autumn Term all students were required to collect gestures, sounds, and potential performance sites using the visual and sound facilities of the tablets.
  • In Autumn and Spring Terms all students were required to give a presentation on a defined topic using an iPad.
  • In Spring Term all students were required to complete an application for arts funding on their iPad.
  • In Summer Term students had the opportunity to make use of the tablets as they wished in their final performance assessments.

Impact

On the whole the project exceeded plans. The project objectives were achieved and the tablets became an integral part of most seminars and workshops as students became more adept in manipulating the resource. As students became more confident in the use of tablets, they were able to use the technology in a sophisticated way to support their work, experimenting with functionality and this being disseminated across the group.

Student attainment on the module was high, and the use of the Digital Performance Lab contributed to this. Presentations in seminars improved as students became more adept in their use of presentational tools. Documentation and analysis of work was improved by the opportunity to capture and record practice in development. The Lab enhanced student experimentation with the potential of the digital in performance, and enabled greater understanding of the theories and practices that are central to contemporary performance art.

Reflections

While it had been anticipated that the tablets would primarily be used for the Part Three Contemporary Performance modules, students also used tablets for the development of other areas of their study, in particular their Independent Projects.  Independent Project supervisors noted that students with access to this facility brought research for their performances to tutorials on their tablets which they could manipulate to demonstrate their ideas and plans in a very effective way.

The benefit of using tablet technology for the teaching and learning of Contemporary Performance was that it allowed students to get quick results: for eample, students found that they could create sound effects or add music for a performance piece in a matter of seconds. By opening up opportunities to students, tablet technologies enhanced their creativity.

Follow up

Since the conclusion of the project, the Digital Performance Lab has continued to be utilised for the delivery of the Contemporary Performance modules. Beyond the Contemporary Performance modules, tablet technology is now used across the Department of Film, Theatre and Television in a number of contexts, including use in interviews for prospective students, and in outreach events such as summer schools held within the Department. Student response to the use of tablet technology continues to be overwhelmingly positive.

Tablet technologies have also been used by students with Theatre Royal Stratford East’s Home Theatre project, in which University of Reading students work with artists from the Theatre Royal Stratford East to develop a show to be performed in the home of a London resident.

Embedding a virtual placement and professional mentoring in an MSc module to support student employability

By edwardwhite Comment Closed

Dr Sarah Cardey, School of Agriculture, Policy and Development
s.p.cardey@reading.ac.uk
Year(s) of case study activity: 2012-13

Overview

9397A virtual placement was created with the C4D Network, allowing student taking Communication for Innovation and Development within the Graduate School for International Development and Applied Economics (GIIDAE) to benefit from professional mentoring and networking, improving their employability as a direct result.

Objectives

  • Set up a placement opportunity for students taking Communication for Innovation and Development.
  • Enhance the employability of students after graduation through developing their skills.
  • Give students experience of networking with professionals in the field.

Context

Students on degrees within GIIDAE had asked for internships and opportunities to gain experience with development practice, which would in turn enhance their employability after graduation. While this was a goal shared by GIIDAE, the workload of students and logistical factors with regards development practice made it difficult to implement a physical placement scheme. As a result, a virtual placement and access to professional mentoring were sought as a practicable alternative.

Implementation

The C4D Network is a community of professionals working in the field of communication for development. Through the C4D Network a “virtual placement” was created, with a communication portal run out of Oxford, allowing students to collaborate on development projects and network with communication for development professionals.

Prior to the mentoring sessions, a focus group discussion was held with students to assess what they were hoping to get out of the mentoring sessions so these could be tailored to best meet student needs and expectations. In the sessions with Jackie Davies, the founder and Executive Director of the C4D Network, students were assisted with the creation of profiles on LinkedIn and the C4D Network, and also in tailoring CVs for certain roles or organisations, reflecting the needs students had oriented.

The students also attended a networking event, and were given specific tasks so that they were active participants in the event. Students were specifically introduced to people, giving them the opportunity to learn how to network and present themselves in a professional light.

The final activity was for students to create material that could be featured on the C4D Network website. Two creative pieces were set as assignments, with the idea being that once these had received feedback they would be revised to make the pieces suitable for online publication.

Impact

Student employability was definitely improved by the scheme, with many students having received employment in communication and development roles, and one student having been headhunted through the LinkedIn profile they created as a result of the scheme. Incorporating a professional mentoring and virtual placement scheme has allowed students to develop skills in areas which central to their finding employment beyond graduation.

Reflections

Students provided positive feedback on the scheme, and responded particularly well to the mentoring sessions. Beyond the direct benefits to students, the monitoring sessions were beneficial as they allowed skills that students developed in the classroom to be highlighted as skills that should be presented on their CVs, and also identified areas in which the curriculum could be enhanced in order to better develop these employability skills.

The networking event was valuable, as in feedback students expressed appreciation of the opportunity to meet people who worked in organisations in which they were interested. There was, however, a reticence among students to introduce themselves and make connections, and during the debrief session students reflected that it was difficult to network, and that they had missed good connections because of their reticence. While learning that they needed to be more proactive when networking was an important lesson for the students, this suggested that more networking support was required.

The creation of material to be featured on the C4D Network website was ultimately unsuccessful. The nature of the class makeup was such that students did not have experience of writing a blog post, and the final content of the assignments reflected this. Whilst, from an academic perspective, having students conduct an unfamiliar task was beneficial, for the goal of publishing material on the C4D Network website the assignments were of insufficient quality. With student workload within GIIDAE being high, it was not feasible to have students make necessary revisions while expecting them to complete other assignments. As a result, it would be necessary to make changes to this aspect of the scheme.

Follow up

The virtual placement and mentoring scheme has continued to be offered within GIIDAE. In addition to the virtual placement, there are now a number of physical placements in Oxford with the C4D Network available to students.

As a result of having run the scheme more than once, it has been possible to make changes to the curriculum to reflect student needs that were made apparent during the pilot year, and has brought forward the inclusion of material. To overcome student reticence, networking has become a more focal aspect of the curriculum, as has engagement with different forms of media, including social media.

Assessment on the course has been better adapted to the workload of the students. Rather than having students produce blog posts, students now produce a research paper, with the opportunity for developing this for external publication.

Running the scheme has made it more apparent which skills industry requires from University of Reading graduates in the field of international development. As a result, it has been possible to create workshops to improve these skills, and ensure that Communication for Innovation and Development remains a relevant and current degree programme.