Exploring value co-creation (CCV) in the Law Feedback Project at ESLTIS 2016 by Imogen Moore and Laura Bennett, School of Law

By edwardwhite Comment Closed

Introduction

As joint staff leaders (together with Dr Nora Honkala) on the current Law Feedback Project, we recently presented a paper exploring aspects of the project to the second annual Enhancing Student Learning Through Innovative Scholarship Conference, held at University College London on 28-29 June 2016.  This blog post explains a little about the Law Feedback Project, how (and why) value co-creation principles were incorporated within it, and what we found useful at the 2016 ESLTIS conference.

The Law Feedback Project and Value Co-Creation

The Law Feedback Project was set up in September 2015, in response to Periodic Review recommendations and student feedback in the NSS and elsewhere, which while generally positive, indicated some room for improvement. Periodic Review had recommended involving students in development of feedback (and other) strategies, and this provided us with the impetus to put students at the heart of the project, supported by our Head of School, Professor Susan Breau. Rather than simply seeking student views on assessment and feedback in a way potentially driven and limited by staff preconceptions and preferences, we set up the project drawing on principles of value co-creation, as espoused by writers such as Catherine Bovill and Alison Cook-Sather (Bovill et al, 2012 & 2014; see also McWilliam, 2008; Mihans et al, 2008;  Tabrizi & Ackfeldt, 2013) .

CCV envisages students acting as partners in learning, moving beyond a consumer-oriented role, and has been successfully used with a wide range of teaching and learning projects. For the Law Feedback Project this would mean involving students from the start and throughout the project – in scoping, designing and running the project, and ultimately creating and implementing changes to policies and practice. Students were recruited on a voluntary basis, via the SSLC, to co-lead the project working group (alongside the three staff members). Additional students participated in focus groups which explored more widely and deeply the issues identified within the working group.

Our primary aim in using CCV was to lead to more meaningful assessment and feedback practice that better met student needs, while still recognising system and staffing constraints. The project showed that students had quite clear views on what they needed and what they liked and disliked. While often their views matched staff expectations, this was not always the case. Fears of some staff that students will always demand more feedback were somewhat unfounded – quality and specificity were favoured over quantity (although quantity mattered too). Importantly the project indicated that students did not always understand and share the language of assessment and feedback, suggesting student dissatisfaction with feedback is sometimes due to miscommunication rather than deeper failings. Involving students through CCV will assist in finding a common language for our discourse with students and allow us to identify ways to improve their assessment literacy.

ESLTIS Conference 2016

The paper was well received at the ESLTIS conference, and was followed by some interesting discussion relating to our experiences and the challenges and benefits presented by CCV. It was valuable to have the input of fellow teaching-intensive colleagues from a wide variety of institutions and disciplines, in such a supportive and thoughtful atmosphere. In total the conference was attended by well over 100 teaching focused staff from institutions across the UK and further afield, with representation from all career levels.

There were two excellent keynote speeches. The first was given by from Dr Dilly Fung of UCL, who spoke around her recent HEA publication ‘Rewarding educators and education leaders in research-intensive universities’. Her vision of what education means – and its depth and breadth beyond ‘just’ teaching – was particularly interesting. Professor Carol Evans of the University of Southampton gave the keynote address on the second day: ‘Developing and implementing holistic assessment practice’. Professor Evans looked at bringing together different aspects of good assessment practice, including the importance of students understanding the assessment and feedback – something with obvious links to our own project. The rest of the two days offered a multitude of papers under themes of assessment and feedback, scholarship of teaching and learning, supporting students, and the role of teaching-focused academics – so many stimulating ideas and new approaches to old (and new) problems. We were also treated to an entertaining panel discussion which gave insights into different institutions’ attitudes to teaching-focused staff.

Conclusion

The experience of running the project, and presenting at the conference, has been very rewarding. Following a CCV approach has taken us out of our comfort zone and added another dimension to our teaching and learning, and it was interesting to explore with others how to successfully involve students further in teaching design. As far as the project is concerned, it is hoped this will continue into 2016-7 (with some change of membership due to staff changes and student graduations), to develop and implement policies and assessment criteria in partnership with students. As for ESLTIS – well, the next conference, which is organised through the Teaching Focussed Academic Network, will be held in Newcastle in the summer of 2017; hope to see you there!

Peer Assisted Learning: how did the PAL pilots go in 2015-16 at Reading? by Caroline Crolla

By edwardwhite Comment Closed

I’ve gained more knowledge regarding the module & find it easier to ask for help. (Maths PAL participant)

[PAL] is a more interactive way of working, more group work, some sharing about 4th year placement and the usefulness of this module for next year (S&L Therapy PAL participant)

It’s great to see people leave sessions feeling like they understand what they were struggling with. (PAL Leader, Creative Writing)

It’s great, [PAL] really helps with understanding work. (PAL Leader, Art)

Peer Assisted Learning (PAL) was introduced at the University of Reading in 2015-16 in a few departments as pilot schemes, with the longer term aim of establishing the scheme across the university. Five departments took part in the first pilot which ran from November 2015 to May 2016.  The pilot schemes have now been evaluated and here are some of the findings.

Participating departments in 2015-16

Economics

Mathematics and Statistics

Speech and Language Therapy

Fine Art

English Literature: Creative writing

What is Peer Assisted Learning?

Peer Assisted Learning is a scheme where students in the same subject learn together with their peers. PAL sessions are run by experienced student who have been trained as facilitators, also known as PAL Leaders, who are regularly debriefed by programme academics.

HEIs with experience of PAL have found that the scheme contributes to improved retention, engagement and performance through shared learning, engendering stronger links between academics and students as well as providing an additional form of feedback.

The principles underpinning Peer Assisted Learning include:

  • the PAL scheme should target high risk modules or courses, not high risk students
  • student participation should be voluntary and it should supplement not replace core teaching
  • student PAL Leaders are facilitators and not quasi-lecturer

What are PAL positives?

Academics reported that introducing PAL was not time consuming but that they did need to endorse and promote their PAL scheme more in order to increase attendance of at PAL sessions. All academics involved in PAL described how the scheme influenced their pedagogy.  They mentioned how much the PAL leaders had developed in the process.

Nothing additional to prepare; I am developing my teaching material because I have changed aspects of the module and my prep is being helpfully informed by having the two PAL Leaders and their sessions in mind.

I have had to think about my teaching materials more closely, because I have PAL in mind. I have reviewed what I am putting in the lectures and what not; what I want the PAL Leader to have or do, or not. This has been good for me…and the students I hope.

I am very impressed with [the PAL Leaders].   I think they are doing so well and really benefiting. 

To maximise effectiveness

The pilots have flagged up three key factors that influence the effectiveness of PAL

Attendance

To maximise attendance Departments need to ensure that PAL sessions appear on students’ timetables and are roomed and timetabled at appropriate times within the module so that participants can attend. PAL is voluntary and for students to benefit from attending sessions access needs to be made possible.

PAL Leaders and participants understand the benefit of collaborative learning

Leaders, participants and academic staff need to be clear about the benefits of working collaboratively on cognitively difficult material. Peer assisted learning is a structured way of peers learning together.  It is not remedial support. One hour of PAL can equal to three hours of working alone.

Increasing engagement by academics

If peer assisted learning is part of a subject’s offer, then it needs regular endorsement by academic contacts and the PAL leaders need regular reviews with the academic contact throughout the term. Increased publicity and visibility of the PAL sessions within departments will help with attendance.

What next?

  1. In 2016-17, more modules will be supported by Peer Assisted Learning sessions in Psychology, Classics as well as in Art, Speech and Language Therapy, English Literature and Mathematics.
  2. From the 14 PAL Leaders who trained to facilitate learning of their peers in 2015-16, 34 prospective PAL leaders will be trained in 2016-17 to support a range of modules.
  3. Academics in Mathematics, who have been enthusiastic early adopters of PAL, have decided to offer PAL in Mathematics as an optional Part 3 module and 9 students have been successfully selected to become PAL Leaders to support the Part 1 core module ‘Real Analysis’.

Would you like to get involved?

PAL at Reading had a great first year because of the enthusiasm of staff and students who had a deep commitment to learning and who saw the positive and holistic benefits of PAL. However, there is a lot more scope to deploy peer assisted learning in many contexts, so if you are an academic interested in adopting PAL for one or more of your modules or you would like to find out more, please contact: Caroline Crolla, PAL Coordinator, c.s.crolla@reading.ac.uk  | pal@reading.ac.uk or phone 0118 378 6593.   I work in the Student Success Team which is located in Blandford Lodge, G17, Whiteknights campus.

Are we doing enough for our BTEC entrants? Authored by Dr Michelle Reid (Study Advice)

By edwardwhite Comment Closed

Transition to university is often geared towards students from an A-level background, so are we doing enough for students with vocational qualifications starting at Reading?

Recent research from UCAS shows that one in four university entrants has done a BTEC (Havergal, 2016). Issues such as culture shock, work/life balance, different assessment methods, and the perception that A-level entrants may be better equipped to study at university are some of the concerns BTEC students can have when starting their degree (Clark, 2011). As Study Advisers, we observed similar concerns when working with former BTEC students here at Reading, particularly in relation to learning from lectures and taking exams, as these are not teaching and assessment methods used on BTEC courses. With these transition issues in mind, and also in light of the increased focus on widening participation, we conducted a short survey to gauge the views of current Reading students with BTEC qualifications on their readiness for university. We wanted to assess whether it would be beneficial to host a pre-entry event for BTEC entrants before they start here in the autumn, following the model of our well-established and successful pre-entry day for mature students.

We sent the questionnaire to all current Reading undergraduate and taught postgraduate students who had taken a BTEC (over 800 students) and received 173 replies. The results confirmed the previous research and our own observations. 45% of respondents described themselves as ‘fairly well prepared’ for university. However when this was explored further, 41.8% also felt that studying at university was ‘fairly different’ to the style of learning they were used to with the main difference being the style of assessments. Respondents pinpointed referencing, preparing for exams and academic reading as the areas they most wished they had known more about before starting university, again reflecting a concern with assessment and the style of academic learning at university. Similar to more general research findings (Clark, 2011; Reidy, 2015) our own former BTEC students identified their studying strengths as coursework, independence, subject knowledge and motivation. This suggests that BTECs give a good foundation in independent learning and indicates that students are likely to be motivated to attend a pre-entry event. However, the results also suggest there are gaps in transition guidance, especially around some assessment methods. Indeed, it is concerning that a wider HEA study has shown that students who went to university with vocational qualifications were less likely to achieve a first or 2:1 (Havergal, 2016). This indicates that we should be doing more to prepare BTEC students for the culture of HE assessment and to foster the potential of BTEC students.

Based on the survey findings, Study Advice is now investigating the possibility of hosting a pre-entry event for BTEC students this summer. We would be very interested in talking to others looking at transition and support for BTEC entrants.

 

References:

Clark, W. (2011). ‘Transitions in action? Exploring vocational learner progression into and out of higher education’. Educational Developments, 12.2, pp.9-12.

Havergal, C. (2016). ‘One in four university entrants has a BTEC, Ucas study finds’. Times Higher Education, 28 January 2016. Online at https://www.timeshighereducation.com/news/one-in-four-university-entrants-has-a-btec-ucas-study-finds  Accessed 05/04/16.

Reidy, T. (2015). ‘Will taking a BTec help or hinder your university application?’ The Guardian, Education section, 21 July 2015. Online at http://www.theguardian.com/education/2015/jul/21/will-taking-a-btec-help-or-hinder-your-university-application  Accessed 05/04/16.

Development of an online learning environment to enhance field trip communication

By edwardwhite Comment Closed

Dr Robert Jackson, School of Biological Sciences
r.w.jackson@reading.ac.uk

Overview

An online learning environment was developed for a module, Microbiology Field Course (BI3B67), within the School of Biological Sciences (SBS). This online learning environment was used to facilitate staff and student communication while on a field trip, and was greatly successful, with students responding well to the use of technology to enhance their learning.

Objectives

  • Provide digital learning support.
  • Facilitate communication before, during and after the fieldtrip.
  • Provide a supportive and collaborative learning environment.
  • Encourage students to reflect on their experiences and think critically, in order to inform their study.
  • Encourage students to consider their social media and internet usage in terms of developing their professional identities.

Context

A field trip within the SBS has been in place since 2012, travelling to Iceland between 2012 and 2014, and Colombia in 2015. While the 2012 field trip to Iceland was a successful experience, it lacked an effective communication system, and students had independently created online communications facilities. As the 2014 trip was to be larger in scope, it was imperative that effective communication was implemented.

Implementation

The development of an online learning environment was made possible by the collaborative work of staff across the SBS and the School of Agriculture, Policy and Development. Dr Alice Mauchline was able to contribute expertise in using mobile technology for field research, and she and Dr Becky Thomas had previously collaborated on investigating how students use the internet to engage with their learning.

Students were provided with iPads so that they all had equal access to the digital learning facilities that were to be used. In order to ensure that all students were equally proficient in the use of these technologies, iPad teaching sessions were created before the field trip, providing students with training in how to use the specific applications which would be utilised on the field trip. Additionally, support was provided on the field trip, with all teaching fellows available to provide guidance on the use of the technology. As a result of this training, students were able to use the iPads to take photographs and video, these being used to create a video presentation as a legacy of their work, with these videos then being posted to a field trip blog. Students also used the iPads as a tool for their lab work, for note-taking, for editing and for communication.

A private group within the social media platform Facebook was set up, providing staff and students with a supportive online learning environment. On the trip, the Facebook group was used to direct student learning and promote critical thinking: questions were posed to students on Facebook, with students encouraged to consider their response before discussing these in class, thus flipping the classroom; students then posted their answers to Facebook, allowing further discussion to take place after class.

Students taking BI3B67 are assessed in four ways. While on the field trip itself, students undertake data collection through field and lab work. Using these results, in groups they create a presentation, which is then given at a symposium held during the field trip. Students also create a blog, in which they give a lay account of the data collection methods used during the field trip. After the field trip, students submit the lab book, which collates their results from field and lab work. Finally, 50% of the module’s final mark is weighted toward the writing of a dissertation, which includes a background introduction to the topic, materials and methods utilised, results and discussion thereof.

Impact

Both students and staff responded well to the use of technology on the field trip, especially the development of the online learning environment. Students commented in post-field trip questionnaires that they found having questions posed to them before classes valuable, and that they were encouraged to learn in a deeper manner.

Reflections

Using Facebook to flip the classroom saw students’ responses to the questions being asked of them improve. By using a platform with which the majority of students were already familiar, less training was required. As a result, staff and student communication were significantly improved.

Having the students produce a blog with videos was of great value, as this work is made available online for students to use for their professional identity when applying for jobs, thus demonstrating of their talents and enhancing their employability.

Setting up an online learning environment through Facebook is something that would be possible for others at the University to implement. As there are a number of experienced staff members at the University, expertise is not hard to come by.

Improved Neural Network assessment by staged laboratory practicals

By edwardwhite Comment Closed

Professor Richard Mitchell, School of Systems Engineering
r.j.mitchell@reading.ac.uk

Overview

6470Adjustments were made to teaching, assessment, and feedback in a Part Two module within the School of Systems Engineering, Neural Networks (SE2NN11), successfully using three-staged laboratory practicals in order to encourage students to use neural networks on a ‘real world’ application. Making these changes saw an increase in the number of students successfully producing a neural network.

Objectives

  • Increase the number of students successfully producing a neural network.
  • Provide greater and prompter feedback to students.

Context

The major assessment for SE2NN11 requires students to write a program to implement a particular neural network and to then use that network on a ‘real world’ application. The students demonstrated their network by the end of the autumn term, where verbal feedback was given, and they then applied it to the real world problem of their choice in the next term. Previously, students had difficulty with the first stage, and so fewer moved on to the (more interesting) second stage, with only around 75% of students submitting a report.

Implementation

During the pilot year (2009), the tasks associated with writing the neural network were carefully divided into three, and three associated 90 minute lab sessions were organised, two weeks apart, for the work. The lecturer plus two laboratory demonstrators were available to provide help to the students at these sessions.

For each session, a Microsoft Word template file was provided, and the students copied and pasted relevant program output or small parts of the program (functions) into the appropriate parts of the template. A simple marking scheme was associated with each part, worth 30 marks: typically students could get 0, 1 or 2 for a piece of code plus 0 or 1 for comments; or a student could get 0 or 1 depending on whether the program output was correct. There was also space for comments to be written.

These files were then submitted to the lecturer who circled the relevant mark for each part and added relevant comments. Detailed feedback was thereby generated very easily and very quickly. The aim was to give feedback within a week of the session, allowing the student a further week to make any necessary corrections on one part before starting the next part of the program. In fact, the first week’s work was marked within two days.

Impact

Each year since this scheme has been introduced, around 95% of students have been able to produce a neural network, a significant increase in submissions.

Reflections

The impression obtained in the pilot was that a greater proportion of students had a working neural network compared with previous years, suggesting a great success of this scenario. As such the scenario has been used each year since with some changes to the templates (and to the program to help reduce plagiarism between years).

One problem is that the structure of the program is so tightly defined that there is little scope for variation in code – hence copying is difficult to detect. This is partly addressed by requiring the student to comment their code and to discuss the object-oriented aspects of their program in the final report. In addition students were expected to do experiments in their own time to investigate the effects of changing specific parameters in the program. The instructions for the final report were made clearer to try to ensure this happens.

One disadvantage of the approach is that it discourages independent thought more than is ideal. The much increased submission rate, however, is encouraging.

The important aspects of this scheme are the division of the project into suitable, easily marked sub-tasks, the extra support provided in the development of the program and the inherent feedback between sessions.

Follow up

Following the pilot year, it was realised that some functions were more complex than others, so the marking scheme was changed so that an appropriate number of marks for the code and comments was available for each function.

From 2015, with the move to online submission, students upload their document to Blackboard Learn, where the work is readily marked. Rather than circling the marks, the ‘insert text’ option is used to allow the marks to be entered. Comments on errors or suggestions for improvements are also easily added in an appropriate context.

The second part of the assessment requires the student to apply their neural network to a ‘real world’ problem of their choice, to see if the network can learn that problem. In effect the students are researching whether a neural network is appropriate. Given that, rather than asking the students to write a report on their work, they are now asked to present their research in the form of a four page conference paper. This tests them with a new skill, complementing the report writing skills they use elsewhere. This innovation has also proved successful.

Use of a modified problem-based learning approach in aphasia therapy teaching

By edwardwhite Comment Closed

Dr Arpita Bose, School of Psychology and Clinical Language Sciences
a.bose@reading.ac.uk
Year of activity: 2011/12

Overview

9254A modified problem-based learning approach was developed and implemented in Communication Impairment 3 (PL2CI3/PLMCI3) within the School of Psychology and Clinical Language Sciences.  While the adoption of this approach was unpopular with students on the module, there was a notable improvement in the marks achieved in exams, and this suggests that subtle modification may provide a problem-based learning approach to which students respond well, and that provides for the achievement of improved grades.

Objectives

  • Implement a problem-based learning approach in aphasia therapy teaching.
  • Enable students to apply knowledge obtained through study to be applied to real world clinical cases.
  • Through use of problem-based learning, prepare students for the workplace by allowing them to experience and practise decision making skills and processes.

Context

Speech and Language Therapies programmes taught at the University of Reading aim to prepare evidence-based practitioners, able to apply their knowledge to clinical problems, and make effective decisions in their practice. The problem-based learning approach has been widely adopted within a wide range of academic contexts and professional disciplines, including for Speech and Language Therapy. Under the problem-based learning approach in Speech and Language Therapy, students are encouraged to solve problems that are set in the real world, enabling them to use specific knowledge obtained through self-directed learning with the support of their lecturer to make clinical decisions.

Implementation

The initial task was to create a raft of fictional case studies. The creation of good ‘problems’ is the essence of successful problem-based learning approaches, and so several weeks were spent modifying each case so that students would be able to understand the content area that needed to be taught. Additionally, it was necessary to find appropriate resources that could go with the case studies.

Several resources were generated in order to support the students in solving the case studies, and specific pointers were provided towards the thinking about the case studies (in class), literature (detailed reference list), web-based resources, and resources from the department and library. The module convenor was available for discussion to the assigned group during module-specific office hours.

At the beginning of the problem-based aspect of the module, classes were divided into groups of between five and six students. Each week, the groups chose one of the two cases within the week’s topic, and determined the therapy for a fictional client based on the questions for each case.

Each group was required to give a presentation on their assigned case study, answering questions in five sections. Following this there were two to three minutes available for the audience to critique the answers, and for other possible solutions to be discussed, with students basing their critiques upon their own reading. This allowed various methods to be discussed using different cases. Following this, each group updated their slides and submitted a report, with both of these being uploaded to Blackboard Learn, allowing all students on the module access to the slides and information relating to a particular case, which they could use for their own learning and have available for future clinical practice. In addition, students working on a case study received formative feedback from the seminar leader and their peers.

Having built up their ability to respond to theoretical clinical cases during the teaching of the module, in the module’s examination one of the two questions on the therapy section was modeled on solving a case based on available information, with students being required to attempt one of the two questions.

Impact

In the pilot year, in the examination the problem-based question was attempted by more of both the undergraduate and postgraduate cohorts, and the mean marks were higher for students attempting the problem-based question than those that did not. Additionally, individual students expressed interest in doing aphasia topic for their theses, and module evaluation revealed that students felt better prepared for aphasia therapy in their placements.

Reflections

While the results obtained by students in examinations and engagement suggested value in the implementation of the problem-based learning approach, this was not without its difficulties. The principal difficulty experienced was a poor reaction to the introduction of problem-based learning approach on the part of the students on the module. The introduction of problem-based learning approaches increased the workload upon students, who also had to fit the workload around their placements, and students were unappreciative of the benefits that this increased workload might bring. This may also have resulted from the fact that the undergraduate students on the module were in their third year of study, and so had difficulty adjusting to the expectations of the problem-based approach.

The second issue was that developing a problem-based learning approach necessarily increases the workload of the module convenor. It takes a considerable amount of time to write the cases and generate the resources for the students. As Dr Bose felt that developing teaching in this manner would help students learn the material better, she was willing to put the time and effort in, but this should be a consideration for others looking to adopt a problem-based learning approach.

As a result of these issues, changes were planned to and enacted upon the module in order to get students on board with the problem-based learning approach, and prepare them early on for the demands of the approach, with the workload expectations being somewhat adjusted in order to better respond to the existing workload of students. Additionally, as the delivery of a problem-based learning approach was workload-intensive, arrangements were made to provide co-teaching staff, allowing the workload to be made more manageable.

Follow up

Following the pilot year of using a modified problem-based learning approach in aphasia therapy teaching, problem-based learning has continued to form part of the delivery of this module. Following student feedback in the pilot year, the problem-based elements of the course had been stripped back somewhat in order to respond to this, and student feedback has improved: recent examination results and student feedback, however, suggest that minimal use of a problem-based learning approach is not sufficient if one wishes to see the benefits of such an approach, and that therefore the amount of problem-based learning that is required should now be increased.

Thanks to the effort put in during the first years of running the module using the modified problem-based learning approach, there now exist a number of suitable case studies for use in this approach, and thus the workload is not as intensive as it once was, and only minimal amounts of work are required to ensure that the case studies are current and relevant.

Improving student engagement with assessment and feedback through peer review

By edwardwhite Comment Closed

Professor Helen Parish, School of Humanities
h.l.parish@reading.ac.uk

Year of activity: 2014-15

Overview

9070

The project investigated recent research and practice in peer assessment and feedback in order to implement a peer assessment model for use within History, and develop a framework for the adoption of said model in cognate disciplines where evaluation of substantial text-based assignments is an important part of assessment.

Objectives

  • Present students with well-managed opportunities to engage in feedback and assessment and learn from it.
  • Present staff with access to tried and tested models for implementation that can be used and tailored across disciplines.

Context

The importance of increasing the impact of assessment in feedback and learning is recognised by the University’s teaching and learning enhancement priorities, and is evident in the ‘Engage in Assessment’ and ‘Engage in Feedback’ materials.  The requirement to pursue an agenda for feedback is also highlighted by the expectations of employers that graduates of the University of Reading will be able to assess and evaluate the work of others, by comments on feedback made by University of Reading students in the National Student Survey, and by discussions with potential students on Open Days.

Implementation

There were five stages to the project:

  1. A literature search on the topic and detailed engagement with recent scholarship, undertaken by the Principal Investigator.
  2. A ‘competitor analysis’, undertaken by a research assistant, looking at the extent that peer feedback is present on Humanities curricula at other institutions.
  3. Development of a model for the trial of peer assessment informed by the previous two stages.
  4. Implementation of this model as a ‘pilot project’ in the Department of History.
  5. Obtaining student feedback on the process and reflection by the Principal Investigator.

The feedback gained during the early stages of the project revealed that students were reluctant to allow their work to be reviewed by their peers, even when anonymised.   This necessitated the envisaged model to be altered, whereby the written work being ‘peer reviewed’ was either from previous cohorts within the Department or alternative sources.

Once the pilot project was developed, there were three stages:

  1. Development of an understanding of marking and assessment criteria. Students read the assessment criteria of their module, and were then tasked with rewriting these in their own words.
  2. Applying these criteria to written work. Students then read a sample essay (not taken from the group), and with reference to the marking criteria, were asked to give a mark to the essay, with a summary of reasons they had come to this judgment.  This was followed by a discussion of the written feedback provided.
  3. Focus group and project review.  It was intended that students would meet to talk about the project, and more general issues to do with assessment and feedback, in the presence of an experienced observer external to the department.

Impact

One of the principal benefits of the project was that students became more aware of the marking criteria by which their assignments were assessed, as although they found these clear, few students had actually taken the time to read these before. An additional benefit was that the activity helped develop students’ academic confidence, as they were impelled to adopt a critical attitude to writing within scholarship, and gained experience of promoting their point of view to their peers.

Reflections

Feedback from questionnaires suggested that students enjoyed the project; that they now had a better understanding of assessment and feedback; that the project had been helpful with the preparation of their own written work; and that they were now more confident in the assessment of their own work prior to submission.

The reluctance of students to submit their own work to review by their peers meant that there was a less direct link between the peer feedback provided and the specific assignment for each module.  By using work from previous cohorts or alternative sources, however, it was possible to get students to engage more willingly with the process of peer review.

The main disappointment was that it proved impossible to gather a large enough group of students to participate in the focus group stage of the project.  This may have been due to the proposed scheduling of the focus groups at a time when students had recently participated in a Departmental Periodic Review and submitted their final coursework of the academic year.  Nevertheless, valuable feedback on the pilot was provided through questionnaires and verbal communication.

It was interesting to observe that students held broad spectrum of ideas about what constituted good work, arising from a lack of understanding about the criteria against which work is marked. From this perspective, the project was valuable, as students were familiarised with the marking criteria and how these applied to written pieces Students were able to look ‘behind the scenes’ at the marking process, with student applying the marking criteria as individuals, but then needing to decide as a group upon a final mark for pieces they were reviewing.

Follow up

Following the pilot project, the use of peer review to engage students in assessment and feedback has been used by other members of staff within the Department of History, with similar success. Other than the specific pieces of work and criteria used for peer review purposes, there was nothing within this project that was specific to the Department of History or School of Humanities, and so this activity could easily be adapted for use in other Departments and Schools across the University.

The peer review approach has been successfully applied within the Department of History to student presentations in seminars. As student presentations are more ‘in the moment’ and designed with a peer audience in mind, students have not expressed the same reticence to have their peers review their work, and those presenting have appreciated receiving immediate feedback.

Digital Performance Lab: the application of tablet technologies in the teaching of contemporary performance

By edwardwhite Comment Closed

Professor Lib Taylor, School of Arts and Communication Design
l.j.taylor@reading.ac.uk

Year of activity: 2012-13

Overview

DPLThe project explored how tablet technologies can be applied for teaching contemporary performance, through the creation of a Digital Performance Lab for use as part of the optional Part Three Contemporary Performance modules (FT3COA and FT3COB).

Objectives

  • Develop student employability and professionalism through creative research, group work and proficiency in digital media.
  • Encourage sophisticated student engagement with the creative industries’ use of digital media.
  • Enable students to explore issues of performance through practical, creative experimentation.
  • Provide students with the means to experiment in a creative way in the Contemporary Performance module, and in their individual research projects.
  • Set up a Digital Performance Lab for use as part of Part Three Contemporary Performance modules.

Context

The project to incorporate the use of tablet technologies into FT3COA and FT3COB grew out of a previous project which had experimented with the use of Bluetooth technologies. Much current experimental performance makes use of digital technologies, so it was imperative that students were provided with the opportunity to study this aspect of contemporary performance, and it was felt that the versatility of tablet technology would allow students to explore issues of performance through practical, creative experimentation.

Implementation

To aid in the set up of the Digital Performance Lab, Dr Lisa Purse, who has expertise in the use of digital technology, acted as an adviser on the project.

The Department acquired seven 32 GB iPads and covers.  These were loaded with a number of appropriate apps, which were added to over the course of the academic year as familiarity with what was available increased, with students also making suggestions for apps that they had found useful.  Several connectors were also acquired for projects to allow the screening of several images simultaneously.

To allow them to make best use of the technology, students were trained in the basic use of the equipment and the apps most appropriate to the early stage of the work.  Once trained, students were able to use the tablets for a number of module-related activities, including:

  • Collecting material for class workshops.
  • Filming and editing material for multimedia experimentation
  • Accessing performances available via digital technologies in class workshop to assist in the analysis of performance
  • Developing individual and small group presentations.
  • Recording performances in class.
  • Experimenting with ways that tablet technology might enhance the experience of a performance for the audience.
  • Developing methodologies to enhance the documentation of performances.

In order to encourage the use of the tablets, their use was incorporated into some student assessments:

  • In Autumn Term all students were required to participate in a group assessment in which at least one iPad was used.
  • In Autumn Term all students were required to collect gestures, sounds, and potential performance sites using the visual and sound facilities of the tablets.
  • In Autumn and Spring Terms all students were required to give a presentation on a defined topic using an iPad.
  • In Spring Term all students were required to complete an application for arts funding on their iPad.
  • In Summer Term students had the opportunity to make use of the tablets as they wished in their final performance assessments.

Impact

On the whole the project exceeded plans. The project objectives were achieved and the tablets became an integral part of most seminars and workshops as students became more adept in manipulating the resource. As students became more confident in the use of tablets, they were able to use the technology in a sophisticated way to support their work, experimenting with functionality and this being disseminated across the group.

Student attainment on the module was high, and the use of the Digital Performance Lab contributed to this. Presentations in seminars improved as students became more adept in their use of presentational tools. Documentation and analysis of work was improved by the opportunity to capture and record practice in development. The Lab enhanced student experimentation with the potential of the digital in performance, and enabled greater understanding of the theories and practices that are central to contemporary performance art.

Reflections

While it had been anticipated that the tablets would primarily be used for the Part Three Contemporary Performance modules, students also used tablets for the development of other areas of their study, in particular their Independent Projects.  Independent Project supervisors noted that students with access to this facility brought research for their performances to tutorials on their tablets which they could manipulate to demonstrate their ideas and plans in a very effective way.

The benefit of using tablet technology for the teaching and learning of Contemporary Performance was that it allowed students to get quick results: for eample, students found that they could create sound effects or add music for a performance piece in a matter of seconds. By opening up opportunities to students, tablet technologies enhanced their creativity.

Follow up

Since the conclusion of the project, the Digital Performance Lab has continued to be utilised for the delivery of the Contemporary Performance modules. Beyond the Contemporary Performance modules, tablet technology is now used across the Department of Film, Theatre and Television in a number of contexts, including use in interviews for prospective students, and in outreach events such as summer schools held within the Department. Student response to the use of tablet technology continues to be overwhelmingly positive.

Tablet technologies have also been used by students with Theatre Royal Stratford East’s Home Theatre project, in which University of Reading students work with artists from the Theatre Royal Stratford East to develop a show to be performed in the home of a London resident.

Incorporating research seminar series into teaching and learning

By edwardwhite Comment Closed

Dr Louise Johnson, School of Biological Sciences
l.j.johnson@reading.ac.uk

Overview

4258In the School of Biological Studies a module, Seminars in Biology (BI3S78) was created, utilising the existing research seminar series within the School to structure assessment. The module is easily adaptable for other subject areas, and has proved very popular with students, and has aided in their development of academic and personal skills.

Objectives

  • Better utilise the School’s existing research seminar series.
  • Develop a number of students’ skills, including report writing, writing for different audiences, experimental design, literature searching, and referencing.

Context

The School of Biological Sciences had long held research seminars, with speakers conducting innovative research in the biological sciences being invited to deliver a seminar on their research. Despite these research seminars being an available resource for students to engage with new research in their field of study, and advertisement of the seminars within the school, attendance was disappointing, with many students failing to utilise such a valuable resource. Within the School of Chemistry, Pharmacy, and Food a Part Four module, Current Topics in Chemical Research, exists, having students attend research seminars and creating assessed reports upon these. This provided the inspiration for the creation of a similar module in the School of Biological Sciences.

Implementation

The School holds around 20 research seminars a year on current research in life sciences. On each seminar attended, students complete a Seminar Report Form with a summary of the seminar topic, three things they learned from the seminar, a comment on the quantitative methods used, references (one scientific review article and two primary research papers) for someone who wished to research the topic, and their justification for these sources. This ensures not only that students attend the research seminars, but also actively engage in note-taking during the seminar. Commenting on the quantitative methods used by the seminar speaker encourages students to reflect upon their own use of quantitative methods. By providing references for someone else to research the topic, students develop their skills in referencing and literature searching. The reports are marked on a pass/fail basis, and students must have achieved passes on at least 10 reports. This forms 20% of the module grade.

At the beginning of the module, students take an online test on statistics and experimental design, in order to develop their understanding of these subjects, as well as to highlight common mistakes. The test constitutes 10% of the module grade.

The first written assignment is to write a summary paragraph of between 200 and 300 words on a seminar, suitable for publication in the scientific journal Nature. The marking criteria for this are based upon the publication guidelines of Nature, as well as the usual University marking criteria. This develops the ability to convey the importance and context of research findings. This assignment constitutes 15% of the module grade.

The second written assignment is a 1500 word critical analysis of research presented in a seminar. This assignment encourages students to engage with the ideas, evidence and techniques presented in a chosen seminar. Students consider the strengths and weaknesses of the research, and suggest ways in which the research might be improved. This assignment constitutes 40% of the module grade. Students are not permitted to write their critical analysis on the research seminar on which they wrote their summary paragraph.

The final assignment is to write a 500 word news article suitable for inclusion in a popular science publication, for an audience of non-specialists, on one of the seminars. As with the critical analysis, students are not permitted to write their article on either research seminar on which they completed their summary paragraph or critical analysis. This assignment provides students with experience of writing for a non-specialist audience, promoting clarity of expression and an ability to select what areas of research will be of appeal to a broad audience.

Impact

Student feedback, both formal and informal, has demonstrated that the module is very popular. Students have reported that the assignments helped them develop skills that they were able to use in other areas of their study, and students have referenced the seminars in their examinations, suggesting that they engage well with the module and the seminar topics. Students make special reference to how attending the seminar series have helped them refine their own interests within life sciences, and some students have actually found PhD places as a result of their attendance of research seminars.

Reflections

Students find the module challenging, because it draws upon different skills to other modules within the School. Having students operate outside their academic comfort zone, however, is a valuable learning exercise, and there has been no desire to alter the course to any great extent, as student feedback does not justify this.

The greatest challenge involved in running this module is the varied topics upon which seminars may be held, as this requires markers of the reports to be specialists within the area. With the popularity of the module resulting in large student numbers, this can create a large workload for markers.

There is great value in running this module, as it develops a number of skills in students, including report writing, statistics, referencing, literature searching, writing for different audiences, and experimental design.

From a traditional classroom to a flipped classroom

By edwardwhite Comment Closed

Dr Karsten O. Lundqvist, School of Systems Engineering
k.o.lundqvist@reading.ac.uk
Year(s) of activity: 2013-14

Overview

6477A flipped classroom approach was trialed for the Part Two Java module (SE2JA11) taught in the School of Systems Engineering. 

Objectives

  • Encourage students on the module to become deep-level learners, as they analyse, evaluate and create, rather than simply remembering and understanding.
  • Introduce a flexible teaching and learning style that students will find enjoyable.
  • Introduce flexibility that allows students to manage their time in a better way, giving them more opportunities to study the materials in a deeper manner.
  • Improve attendance and engagement with practicals.

Implementation

In the summer of 2013 videos were created for the module.  New slides to present the content were designed, with the fonts improved to make them easier to read on a computer screen.  While the content was based on that of the old slides that were available to students, practical screencasts were introduced in the video, whereby the students can see how the code behaves and how they are supposed to develop it practically.  Some slides were altered so that they presented difficult concepts in more easily understood ways, such as through use of analogies to the restaurant business and the automobile industry.

Feedback and feedforward videos were introduced to explain the progress through the course.  One of the feedforward videos was used to make the students aware of the object-orient programming (OOP) nature of the code, and that the weekly practicals would be building upon previous material.  Students were told that they could use the weekly practicals as a gauge to measure if they had problems with OOP, and should ask the teaching staff for help.

The videos were created using Camtasia, an tool for creating videos and screencasts from webcams and computer screens.  The software suite also has simple post-production tools, which allowed zooming to ensure that the small text of development environments could be viewed easily.  These videos were then embedded as items on the Blackboard Virtual Learning Environment.  Uploading the videos to a streaming service external to the University was considered, but was decided against in order to create a classroom feeling to the videos.

The flipped classroom method generally recommends that videos be simply bite-sized chunks of around 4 to 6 minutes long.  Several of the videos created for the module, however, were over 1 hour long, as a result of the amount of material that needed too be covered, the adherence to the lecturing paradigm, and the lack of time available to transform the material as much as would have been necessary in order to make 6 to 20 minute videos.

Impact

To obtain feedback from the students, two voluntary bespoke surveys were shared with the students, one available in weeks 2-3 of the Autumn Term, and one available in week 1 of the Spring Term. The first survey showed that 84% of students preferred videos over lectures, and that only 4% of students did not expect to watch the videos more than once. In the second survey, 100% of students now preferred videos to lectures, and 100% expected to watch the videos more than once.

Reflections

Flipping the classroom has been of great benefit. As the act of flipping cannot just be a case of replicating old teaching methods digitally, it promotes reflection on course content and teaching methods, and requires thorough planning. The initial investment pays off in the long term as the teaching materials produced can be reused, not only from year to year, but between different modules that have some overlapping content. While the creation of teaching materials may consume more time than the traditional delivery of content, it is flexible as it can be done when time allows, and does not require being present at an appointed time and location.

Despite concerns about the length of the videos, on the whole students expressed satisfaction about this.  The general response was that students expected the videos to be long, as they were replacing 2 hour lectures, and therefore students would feel cheated if the videos were not long and with a lot of content.  While it was agreed that students might benefit from having chapters within the videos to make them easier to search, none wanted the videos to be shorter.

In order to improve how the module is taught using the flipped classroom model in the future, the following recommendations were made:

  • Include a more self-regulated learning approach to the coursework, allowing students more flexibility over the weeks, and removing some of the summative pressures that might induce surface-level learning.
  • Change the module so that 100% of assessment is carried out through coursework. This should make students focus more on the practical work throughout the year, and help them focus more on the relevant material and learning it in a deeper way.
  • Introduce a level of self-regulated learning to the practicals, by introducing a logbook instead of weekly sign-off sheets. Students will need a number of signatures in their logbook to get 10% of their practical marks. The signatures will be given after a short formative discussion of progress provifnng useful feedback and suggestions of further work.

Follow up

The flipped classroom approach continues to be used for the teaching of SE2JA11, and has now been introduced for other modules within the School of Systems Engineering. In particular, videos on general coding theory are able to be utilised within many modules. Dr Lundqvist was able to draw upon the experience of flipping the classroom when creating the Open Online Course Begin Programming: Build Your First Mobile Game.

The recommendations generated by the pilot year have been carried out, with the exception of the introduction of a logbook, which proved impractical. While students still complete weekly sign-off sheets, the sheets are now 50% questions on the video, to ensure that students have viewed the videos and retained the information, and 50% questions on progress in their own learning, with the intention that students will reflect upon their own learning, and staff will be aware of students who are having difficulties.