Learning to Interpret and Assess Complex and Incomplete Environmental Data

Andrew Wade a.j.wade@reading.ac.uk

Department of Geography and Environmental Sciences

Overview

Field work is well known to improve student confidence and enhance skills and knowledge, yet there is evidence for a decline in field work in Secondary Education, especially amongst A-level Geography students. This is problematic as students are entering Geography and Environmental Science degree programmes with reduced skills and confidence around field-based data collection and interpretation, and this appears to be leading to an apprehension around data collection for dissertations. A simple field-based practical where 47 Part 2 Geography and Environmental Science students tested their own hypotheses about factors that control water infiltration into soils was developed. Improved confidence and appreciation of critical thinking around environmental data was reported in a survey of the student experience. Student coursework demonstrated that attainment was very good, and that skills and critical thinking can be recovered and enhanced with relatively simple, low-cost field-based practical classes that can be readily embedded to scaffold subsequent modules, including the dissertation.

Context

The importance of field work is well established in Geography and Environmental Science as a means of active and peer-to-peer learning. However, students appear to have little confidence in designing their own field work for hypotheses testing when they arrive for Part 1, probably due to a decline in field work in Secondary Education (Kinder 2016, Lambert and Reiss 2014). Within the Geography and Environmental Science programmes, there is a part two, 20 credit ‘Research Training’ module that develops the same skills. However, this research training module and the dissertation are seen by the students as being of high risk in that they perceive a low mark will have a significant negative impact on the overall degree classification. Consequently, students are seemingly risk adverse around field-based projects. The idea here is to make field-based training more commonplace throughout multiple modules through inclusion of relatively simple practical training, so that hypotheses testing, critical thinking and confidence with ‘messy’ environmental data become intuitive and students are at ease with these concepts. In parallel, GES module cohorts have increased in recent years and this is an additional reason to develop simple, low-cost practical classes.

Objectives

The aim of the project was to determine if a simple, field-based practical would help boost student confidence around field data collection and interpretation, and hypotheses testing. The objective was to give the students a safe and supportive environment in which to develop their own hypotheses and method for field data collection, and to learn to interpret often ‘messy’ and ‘complex’ environmental data.

Figure 1: The practical class took place on the hill-slope on campus between the Atmospheric Observatory and Whiteknights Lake on the 28 October 2019 over 4 hours in total.

 

Figure 2: Students used a Decagon Devices Mini-Disc Infiltrometer to measure unsaturated hydraulic conductivity to test their own hypotheses about the factors controlling infiltration

Implementation

A practical was designed where 47 Part 2 students, working in groups of four or five, developed their own hypotheses around the factors controlling rainfall infiltration on a hill-slope in the class room following an in-class briefing, and then tested these hypotheses in the field using Mini Disc infiltrometers (Figs. 1, 2 and 3). There was a further follow-up session where each student spent two hours processing the data collected and was briefed on the coursework write-up.

Figure 3: The students tested hypotheses around distance from the lake, vegetation and soil type, soil moisture and soil compaction. Each student group spent two hours in the field.

Impact

Of 40 students who responded to an on-line survey:

  • 37 agreed the practical helped develop their critical thinking skills around complex and incomplete environmental data;
  • 36 agreed they were now better able to deal with uncertainty in field-based measurements;
    and 38 feel more confident working in the field.

Student quotes included:

  • “The practical was very useful in helping to understand the processes happening as well as being more confident in using the equipment.”
  • “I thought the practical was good as it was another way to process information which tends to work better for me, doing and seeing how it works allows me to gain a higher understanding in the processes”

The majority of students gained first class and upper second-class marks for the project write-up and the reports submitted demonstrated good critical thinking skills in the interpretation of the infiltration measurements. There has been a noticeable increase in the number of students opting for hydrology-based dissertations.

Reflections

Confidence and critical thinking skills can be enhanced with relatively simple, low-cost field-based practicals that scaffold subsequent modules including Research Training for Geographers and Environmental Science, and the dissertation, and focus on hypotheses testing in addition to knowledge acquisition. Each student spent 2 hours in the field on campus and 2 hours processing their data, with further time on the coursework write-up. This seems a reasonable investment in time given the benefits in confidence, skills and knowledge. Embedding such practicals should not replace the larger skills-based modules, such as Research Training, nor should such practical classes replace entirely those that focus more on knowledge acquisition, but these practical classes, where students explore their own ideas, appear to be a useful means to boost student confidence and critical thinking skills at an early stage. The practical was also an excellent means of encouraging peer to peer interaction and learning, and this and similar practical classes have good potential for the integration of home and NUIST students.

Follow up

Embed similar practical classes in part one modules to build confidence at the outset of the degree programme and, at part three, to further enable integration of home and NUIST students.

Links and References

Kinder A. 2016. Geography: The future of fieldwork in schools. Online: http://www.sec-ed.co.uk/best-practice/geography-the-future-of-fieldwork-in-schools/ (Last accessed: 03 Jan 2020).

Lambert D and Reiss MJ. 2014, The place of fieldwork in geography and science qualifications, Institute of Education, University of London. ISBN: 978-1-78277-095-4. pp. 20

Exploring different types of video cameras for use in practical classes and outreach By Dr Philippa Cranwell, Mrs Susan Mayes and Dr Jenny Eyley

A successful TLDF application in April provided us with funds to explore the use of different lapel-mounted cameras to look into student-student and student-staff interactions within a practical laboratory environment. This work is still ongoing, but we have learnt some interesting lessons about buying lapel-mounted cameras along the way, and have also used them successfully in outreach initiatives.

Cameras trialled

In total, four types of camera were trialled that cost between £49.95 and £120 (RRP; correct as of August 2017). With all the cameras we purchased additional memory cards, although some were supplied with small memory cards.

The first three were of a similar design; a camera, shaped like a USB stick, with a clip on the back to allow it to be mounted on a pocket. The cameras trialled were: the Veho VCC-003-MUVI-BLK MUVI Micro Digital Camcorder (RRP £39.95); the Conbrov® Spy Cameras DV12 720P (RRP £59.99); and the Conbrov® WF92 1080P (RRP £69.99). All arrived quickly and were very easy to set-up, although none had a screen so it was not possible to see the recording without putting the images onto a computer. We quickly realised that mounting these cameras on a lab-coat pocket was not satisfactory because they were quite weighty and fell forwards, resulting in a great deal of footage of the floor. A body harness was available for the Veho camera (RRP £39.95), which would have addressed this problem, but it was decided not to continue with this style of camera due to the lack of screen resulting in no real-time feedback of recording quality.

L to R: Veho VCC-003-MUVI-BLK MUVI Micro Digital Camcorder; Conbrov® Spy Cameras DV12 720P; Conbrov® WF92 1080P

The camera that was most suitable for our needs was the Apeman Underwater Action Camera Wi-Fi 1080P 14MP Full HD Action Cam Sports Camera 2.0 (RRP £119.90). This camera came with 2 batteries, each recording up to 90 minutes of footage. We purchased micro SD cards separately; cards over 32MB are not supported by this camera. In addition to the camera we purchased a Togetherone Essential Accessories Bundle Kit (RRP £59.99) that provided a large number of additional items to mount the camera as required. Some of the most useful items in the pack included a “selfie-stick” that was used by school children on an outreach visit, a body harness and a head-mounted harness. The camera itself arrived in a plastic container, which is waterproof and protects the camera, but when recording dialogue it is less useful as the sound is muffled. However, there are alternative holders so the camera can be mounted on the body or head in an open case allowing clear dialogue to be captured.

The Apeman Underwater Action Camera Wi-Fi 1080P 14MP Full HD Action Cam Sports Camera 2.0 and the Togetherone Essential Accessories Bundle Kit

Use in outreach

The cameras were successfully used by secondary school students who took part in a trip to Thames Water sewage treatment works. This trip was organised by the chemistry outreach team as part of the Chemistry for All project, in order to show students how chemistry is used in all parts of their daily life. The number of students able to have this experience was limited by the space on the observation platforms, therefore the students used the cameras to film their experience and produce a video diary of the day. The videos will be edited and shared with other students on return to school, widening the reach of the activity beyond the students who attended. The teacher who was in attendance with the students commented that “having the Apeman cameras during the tour meant they were more excited and enjoyed it more”

 

        

Photographs taken by the students at the Thames Water sewage treatment works

Outlook

The Apeman cameras have been a useful addition to the Department, particularly for outreach purposes. We will continue to use the cameras for outreach, and also to undertake some observations of students undertaking practical work for the TLDF-funded project and another internationalisation project in conjunction with ISLI.

 

 

Supporting Diversity through Targeted Skills Development: Helping Students to Speak a New Language by Alison Fenner SFHEA (Institution Wide Language Programme, ISLI)

Context

As the student population becomes increasingly international, the IWLP language class cohorts are becoming ever more diverse. It has become evident to tutors in IWLP (as throughout the University) that the linguistic, educational and cultural aspects of a student’s background can play an important role in their language acquisition, often helping some aspects while hindering others. In language learning, they may experience varying success in the development of the four language skills of listening, reading, speaking and writing, performing well in some skills while experiencing difficulty in others.

The Language Learning Advisor scheme and the development of a PLanT project

With this in mind, in the Autumn Term of 2016 I successfully applied for PLanT (Partnerships in Learning & Teaching) funding to provide targeted support sessions in oral work and pronunciation for those students who found these areas more challenging. The aim of the project was to improve their performance, motivation and, crucially, confidence. PLanT funding is awarded by CQSD and RUSU for projects involving both staff and students, and I invited three Language Learning Advisors (two undergraduates from the Department of Modern Languages and European Studies and one multi-lingual undergraduate from Psychology and Clinical Language Sciences) to deliver the sessions. Since these sessions had a particular focus, they were delivered on a small-group basis rather than the one-to-one basis more usual for Language Learning Advisors. They were delivered to students studying German at beginner level.

The three Language Learning Advisors were part of the peer-to-peer Language Learning Advisors scheme, which I have run since 2012. In the scheme, I train students who are successful language learners (usually languages undergraduates in the DMLES or students from the higher stages of IWLP) to advise their peers in DMLES and IWLP on the acquisition of effective language learning strategies, including the development of particular language skills and independent learning. The Advisors help students to develop effective self-evaluation, to reflect on their learning styles and to set achievable long-term and short-term goals in their language learning. Students also benefit from the support and encouragement offered by their Advisors in the continued dialogue of follow-up sessions in which progress is monitored.

Before the PLanT-funded sessions began, I and the Advisors discussed the needs and strategies involved. I monitored the progress of the sessions, and at the end of the academic year the Advisors submitted records of activities completed and materials used, and reflections on their experience. Two Advisors worked with me on preparing a presentation for the LTRF (Learning and Teaching Research Forum) of the International Study and Language Institute in June; the third had already left the University by then but helpfully recorded her contribution on video. The presentation met with a positive response and was a valuable experience for the Advisors, enabling us to inform a wider audience about the PLanT project and about the Language Learning Advisor scheme in general. It also gave the Advisors the opportunity to present at a staff forum.

Project outcomes

This project was a very positive experience. I was able to harness the enthusiasm and creativity of the three Advisors to develop a new student-based initiative which, in at least one case, confirmed an Advisor’s choice of teaching as a career path. The students receiving the support benefited through increased fluency, improved pronunciation and greater confidence; this was clear from their feedback comments, which included: ‘The small-group oral session is helping me a lot, [X] is very kind and patient’, ‘The [tutor] is very friendly. There is an obvious improvement in my pronunciation.’

I intend to continue to run these small-group skills-based sessions in future years, since I believe that they address a clearly-perceived and increasing need. The experience gained this year, together with the Advisors’ reflections and information about materials and activities employed, will be of great value in achieving this end.

The Commercial Law LLM Programmes – Engaging PGT Law students as equal partners in the redesign of a core programme module with the support of a UoR T&L grant By Dr Despoina (Deni) Mantzari (School of Law)

Introduction: Students as Partners

In recent years, there has been an increased appetite in higher education to explore and enhance the ways in which students can become more involved in the design and delivery of their own learning experiences. A prominent way of doing so is engaging students as equal partners in a range of practices and pedagogies. Dubbed as ‘Students as Partners’ (‘SaPs) in the academic literature, this specific practice, or, perhaps, better put ‘ethos’, embraces students and staff working together on teaching and learning in higher education.

Context

The re-design of the LLM in International Commercial Law, in which I was actively involved, presented an excellent opportunity to explore in further detail the usefulness of this practice. Hence, in June 1016 I was awarded with a small UoR Teaching and Learning grant (£250) with the objective to involve a group of ten PGT students from the School of Law as equal partners in the process of redesigning the curriculum of a core PGT module. The PGT LLM module is entitled LWMTAI-Advanced International Commercial Law Issues (20 credits), and is one of the core mandatory modules of the new ‘LLM in International Commercial Law’.

Motivation

What motivated me in particular was the need to listen to the ‘student voice’ by actively and directly engaging students in the design of the curriculum. So far, ‘student voice’ is largely heard ex post; following the completion of the taught component of the module, e.g. on a Module Evaluation Form. I wanted to go beyond existing practice and listen to the ‘student voice’ ex ante; before delivery, by proactively engaging students/learners as equal partners in the redesign of the module. This does not only reflect a current, strategic Teaching and Learning Enhancement Priority of the University, but it is also vital to the success and effective delivery of the module and subsequently to the new LLM Programme. The broader aim was to promote partnership in teaching and learning, building a collective vision of the future of PGT commercial law subjects and programme.

Implementation

Both current and revised MDF forms of the module were circulated to a group of ten PGT students in the School of Law along with a questionnaire. Five of them were students that had completed the module in its pre-revised form and five were students that were not enrolled on the module. The latter group of students was valuable in offering a ‘naïve perception’ to the design of the module. Students were asked to reflect on the strengths and weaknesses of the module, as reflected in the MDF forms. Their answers to the different questions posed, along with other concerns/recommendations they wished to share, were discussed in a two-hour event, open to all staff involved in PGT Law teaching. Each participating student to the project was paid with vouchers that could be spent in in the Blackwell bookstore on campus.

Currently, as part of my EDMAP 3 project, I have extended the scope of this project by involving currently enrolled PGT Law students, who were the first to be taught the module in its revised form.

Beneficiaries

There are several beneficiaries of this project; direct and indirect. The project delivered considerable benefits to the students who took part in the process; they gained a better understanding of the teaching and learning process, and, furthermore, engaging students as equal partners fostered a sense of belonging and promoted inclusive learning. Secondly, future students will also benefit from a module that has been partly redesigned by students-partners. Thirdly, the insights gained through this project, and shared in the two-hour event, may potentially inform the design and delivery of other, future or existing, PGT modules. Finally, it is hoped that the project will inspire and motivate all staff involved in teaching and learning to think beyond the limiting ‘customer satisfaction’ model that tends to dominate Higher Education nowadays and towards a more challenging and rewarding relationship with our students based on genuine cooperation and trust.

 

 

 

 

 

It’s time! Viva Day – By Heike Bruton, Research Assistant and PhD Researcher

There can’t be many more nerve-wracking oral exams than the PhD viva. A several-year build-up –and then… what? To give research students an impression of what’s it actually like on the day, Dr Carol Fuller from the Institute of Education has produced a short, entertaining and informative video. Using some Teaching and Learning Development Fund (TLDF) money, Carol, who is Director of the Institute’s EdD Programme, has teamed up with film maker Henry Steddman – a UoR alumni — to provide reassurance to potentially anxious candidates. Starring some IoE colleagues as well as professional actors, the video thankfully stays clear of vague and meaningless advice often found in self-help type viva-survivor tips, such as ‘just be yourself’ (which is fine if your self is a confident academic on top of your game, not so much if it’s a nervous wreck. As Father Ted says to Dougal: never be yourself! That’s just something people say!)

So how should you be, then? First, let’s remember the cornerstones of the situation you’re in here:

  • You’re the expert on your thesis
  • The examiners have read your work thoroughly…
  • ….and they’re keen to discuss it with you.

On viva day:

  • dress smartly
  • refer to your thesis
  • keep eye contact
  • if unsure, ask questions
  • stay hydrated
  • ….try to relax!
  • at the end, if you’re asked whether you’d like to add anything, take the opportunity.

Then, you’ve done all you can for now, and there’s no more to than just wait, until… it’s time!

Hopefully, you’ll get the desired result, and will be awarded the degree of Doctor of Philosophy! Congratulations!

If UoR PhD’ers and EdD’ers find the video useful, Carol is keen to hear their feedback – via any means possible, be it the YouTube comment box, on Facebook or twitter, or via email.” It’s a good way to give students access to an easy-to-use resource”, says Carol. “If students tell us they like this video clip, we can make the case for funding to make more such short films, for example on epistemology or methodology.”

What do you and your students think of Carol’s video? Have a watch here:

https://www.youtube.com/watch?v=a3hnu2aq8P4

post authored by:

Heike Bruton | Research Assistant and PhD Researcher | University of Reading, Institute of Education, London Road Campus, building L33 room 115, 4 Redlands Road, Reading, RG1 5EX | + 44(0) 118 378 2645 | h.bruton@reading.ac.ukhttp://germanintheuk.com/about/  | https://twitter.com/HeikeBruton

“Does size matter” or “how large is large”? by Katja Strohfeldt

Teaching of large cohort sizes is becoming more and more prominent at Universities. Many colleagues will have experienced this and also faced the challenges which come with teaching large class sizes. I am delighted that the University decided to support our research into large class size teaching with the special aspect of diversity. Rachel Pye (Psychology) and myself (SCFP) busily started to gather data and information. There was one question I raised quite early after starting this Teaching and Learning Development funded project: “How large is large?” Looking back at my own experience of being an undergraduate student in Germany, I attended my Part 1 lectures with around 800 other students. Is this a large class size? One aspect of these lectures became quite clear to me: Whilst we certainly started with 800 students at the beginning of the semester, by the end only a fraction were regularly attending lectures.

Objectives:

  • What are the students’ expectations on class size at University?
  • Explore the students’ experience within large class sizes especially in diverse cohorts.
  • Develop a toolkit, which provides easy access to tools and tricks to help with large class size teaching.

How large is large?

Everyone will have their own opinion on how many students you would expect to teach in a large class size at the University. This is probably very much dependant on your own experience and your subject area. I would suggest you think for a moment about your own experience before continuing to read this blog…

We wanted to know what the students think, especially from those who had just newly started the University. We have surveyed around 800 students in our first year of the project. The Part 1 students were asked to fill in the questionnaires shortly after they arrived at University, Part 2 and 3/4 students followed. We also run some focus groups with Pharmacy and Psychology students, as both courses have a very interesting diversity profile.

It was very interesting that the Part 1 student gave very similar answers, independent of their course. Part 1 students defined a large class size with around 100 students. In contrast to this our focus groups showed that small classes were expected to accommodate around 6 students, similar to their A-level teaching groups. It is very interesting to see that Part 2 and 3/4 students consistently gave a lower answer for large class sizes. The more experienced students defined a large class size accommodating around 80 students. Again, this number was independent of the course the students were studying.

In summary, it was interesting to see that Part 1 students expected a higher number of students in their large class size teaching, than Part2/3/4 students. We hypothesize that experience of the latter group of students at University level being exposed to seminars, tutorials etc influenced their perception.

Does size matter?

The answer is probably yes and no. Our preliminary data has clearly shown that students expect being taught in large lecture theatres with many others when they come to University. Even looking at diversity as a factor does not change this expectation significantly. This would mean size doesn’t matter. Nevertheless, our preliminary data has also shown that size matters, in regards to teaching styles. Investigating expectations, anxiety levels and other aspects, indicate that students are prone to disengage easier in large classes. Students feel less noticed, more anonymous and have less of a chance to ask questions. Understanding and acoustics can also be a hurdle.

Quo vadis?

The next steps we have planned is to undertake interviews with staff members and undertaking the questionnaires with students in Parts 1, 2 and 3/4, especially focussing on students from the previous cohort who entered Part 2 now and expanding the study to other courses. The main aim is to develop a toolkit, which will be easily accessible to everyone.

More information will follow shortly. No doubt we will be in touch with many of you again and really hope you can support us. If you have any questions in the meantime, please email us (k.strohfeldt@reading.ac.uk) or follow us on Twitter @largeclassHE.

Goodbye Word; hello floating islands, dolphins and rainbows by Dr Emma Mayhew

So you’re a lecturer at Reading and you find yourself going over and over information in handbooks, course outlines, books and journals with students-anything from tricky academic concepts to essay writing and ECFs. Of course it’s difficult in an age of information overload. Really important stuff gets lost and sometimes it’s hard to make our voice heard amongst all of the noise surrounding students. What’s the solution? Maybe written information isn’t the only vehicle of choice. We know that students respond brilliantly to visual information. A few of us at Reading have been focusing on exactly that. We’ve started using incredibly simple and entirely free ‘screencapture’ software, like Jing, to record what we’re doing on our screens. We’ve added audio to these short videos and occasionally even webcam footage of our Emma Mayhew1faces. Some of us have even moved beyond PowerPoint and had a huge amount of fun (yes….fun!) with new, massively eye-catching and versatile presentation tools like Prezi (and this is where the floating islands, dolphins and rainbows come in) or Powtoon-and the makers really aren’t overselling their product when they describe it as “awesome”.

 

But will students engage with information delivered in this way? Yes they will and I know this because last Autumn I made a suite of ten 3-5 minute screencasts using Prezi on a whole range of topics-writing a great essay, marking criteria, academic and pastoral help, pre-arrival information and more. They have been viewed over 2,300 times by our students and I’m not even counting my staff training screencasts, one minute module summaries, animated quizzes, video essay feedback and conference paper summaries which bring my views to nearly 4,000 in the last 12 months…and it’s not just me! Cindy Becker and David Nutt have also seen a great response.

We’re so passionate about screencapture that the three of us have just launched the TLDF funded ‘GRASS’ project to support colleagues who would like to try this out for themselves. If you’d like to know more please click on the floating island below to watch our 90 second clip, visit or subscribe to our new website which is full of examples and ‘how to’ videos http://blogs.reading.ac.uk/grass/ , come along and see us all speaking at the CQSD showcase on 19th November at 13:00 but most importantly, book on our first ‘Lunch and Learn’ session via Employee Self Service on Friday 28th November at 13:00 in Palmer 103. We’ll be outlining our experiences and offering training at this event which includes a free buffet lunch and range of our own HOMEMADE CAKES! Goodbye Word and hello exciting, creative possibilities.

Emma Mayhew2

Are you interested in biological recording & monitoring with your students? By Dr Alice Mauchline

KS logo small scaleThe University of Reading now has ‘KiteSite’ – a free, bespoke mobile app for biodiversity recording on the Whiteknights campus. KiteSite has been designed as a generic tool to support field training in biodiversity and taxonomy at the University and it can be used in any module for field data collection. There is a supporting website available at:www.reading.ac.uk/herbarium/kitesite

KiteSite was developed in 2014 by a multidisciplinary team of undergraduates and staff with funding from the University’s Teaching and Learning Development Fund. It is available for Android devices from the Play Store and the iOS version is available through the host app EpiCollect. Full instructions on how to download and use the app are available on the project website along with links to online identification guides and ideas of how to use KiteSite to support teaching activities.

Features

IMG_0122 (640x480)KiteSite automatically records time, date and geolocation data; meaning that the first piece of data captured is a photograph of the specimen. The subsequent data headings can be filled in to the level of knowledge known about the organism (Organism group, Common name, Species name). They can be completed with all known information if the recorder has some idea of the identity of the organism or left blank if the organism can’t be identified. A confidence rating is asked for at the end of the data sheet which can be used for confirmation of correct identification. A notes section has also been included to provide a space to record any further information about the sighting.

Two sections of the data form have been customised to allow for groups to add their ‘Project Code’ and for individual recorders to identify themselves with a unique ‘User code’ (e.g. their student number). This allows for easy data extraction from a single teaching excursion and for students to submit their own data for assessment.

Data storage

IMG_0111 (800x600)The data are stored in a central database which is publically available and constantly updated. These data can be used in a multitude of ways to support teaching & learning; for example, they can be analysed to ensure that the students made correct species identifications; time series data can be examined for temporal patterns; spatial data can reveal species movements across campus; phenology data can be examined etc.

As the database grows, these data will become a valuable record of campus biodiversity. The records will supplement the activities of the Whiteknights Biodiversity Blog which collates records of all organisms found living on campus.

Mobile devices available

Several field-ready mobile devices (10 iPad minis and 4 Google Nexus 7s) are available to borrow to support the use of this app in fieldwork teaching. Please get in touch if you would like to borrow these devices or if you’d like to discuss ways to integrate the use of this app and the database in your teaching. I would also be very interested to hear via email (a.l.mauchline@reading.ac.uk), Twitter @UniRdg_KiteSite or via the Whiteknights Biodiversity Blog of your experiences of using KiteSite in teaching & learning activities on campus.

Online peer assessment of group work tools: yes, but which one? By Heike Bruton (a TLDF project)

A short while ago I wrote the post “Group work: sure, but what about assessment? This outlines a TLDF- funded project in which Cathy Hughes and I investigated tools for the peer assessment of group work. Cathy and I have now produced a full report, which is available for download here (Cathy Hughes and Heike Bruton TLDF peer assessment report 2014 07 02), and summarised below.

 

Aim and methods

The aim of the project was to evaluate available online systems for the assessment of students’ contribution to group work. In order to establish our criteria for evaluation of these systems, we conducted a series of interviews with academics across the university. This allowed us an understanding of how peer assessment (PA) is used in a range of subjects, and what the different perspectives on the requirements for a computer-based system are.

 

Systems in use and evaluation criteria

Among our eleven interviewees we found five different separate PA systems (including Cathy’s own system) in use by six departments. Notably, Cathy’s tool appeared to be the only entirely computer-based system. Based on the insights gained from the interviews, we developed a set of criteria against which we evaluated available PA systems. These criteria are pedagogy, flexibility, control, ease of use, incorporation of evidence, technical integration and support, and security.

 

Available online systems

We identified three online tools not in use at the university at the moment, which implement PA specifically to the process, not the product, of group work. These three systems are iPeer, SPARKplus and WebPA. In addition we also critically assessed Cathy’s own system, which is already being used in several departments across the university. After investigating PA systems currently in use at Reading and applying the above-named criteria to the four PA system under investigation, we came to a number of conclusions, which resulted in a recommendation.

 

Conclusion

There is a strong sense of commitment among staff to using group work in teaching and learning across the university. PA can serve as a mechanism to recognise hard work by students and also to provide feedback aimed at encouraging students’ to improve their involvement with group work. Whilst any PA system is simply a tool, which can never replace the need for active engagement by academics in their group work projects, such a tool can make PA more effective and manageable, especially for large groups.

 

Recommendation

Our recommendation then is that WebPA should be considered for use within the university. Our research suggests that it could be adopted with relative ease, particularly given the strong and active community surrounding this open-source software.   While it may not be appropriate for everyone, we believe it could be a useful tool to enhance teaching and learning, potentially improving the experience of group work assessment for both staff and students.

Cathy and I will be delivering a number of Teaching and Learning seminars on PA of group work in the near future. To download the full report, click here (Cathy Hughes and Heike Bruton TLDF peer assessment report 2014 07 02). To try out a stand-alone demo version of WebPA, follow this link: http://webpaos.lboro.ac.uk/login.php

Cathy and Heike will be presenting their project in a TEL Showcase event in the spring term. Please check http://www.reading.ac.uk/cqsd/TandLEvents/cqsd-ComingSoon.aspx.

TLDF-funded project gets off to a flying start… by Dr Cindy Becker

The GRASS (Generating Resources and Access to Screen capture Software) project aims to enable, enhance and support access to screen capture technology across the University. It is a Teaching and Learning Development Fund (TLDF) maxi-project which will run for two years and, although the official launch is in September, we are already excited by what is happening. We have produced this newsletter to give you an idea of how things are likely to develop…watch this space! GRASS newsletter pdf #1 June 2014