Using screencasts to deliver skills training: a Part One English Literature module

By laurenmccann Comment Closed

Dr. Nicola Abram, Literature and Languages
n.l.abram@reading.ac.uk

Year of activity: 2015-6

Overview

camtasia-in-action

This entry describes the use of screencasts to deliver skills training on a compulsory Part One English Literature module. As a result of the changes outlined here, every student taking English Literature at the University of Reading will have access throughout their degree to a bank of online resources teaching key skills.

Objectives

  • To train students in the practical skills needed to succeed in an English Literature degree.
  • To induct students into the independent learning required for an English Literature degree.
  • To increase students’ engagement in skills training.
  • To improve students’ understanding of and adherence to academic conventions.
  • To make best use of the contact time (lectures and seminars) on the module.

Context

Over 200 students enter English Literature programmes at the University of Reading each year, from a range of educational backgrounds. To ensure they all have the key skills and theoretical understanding needed to succeed throughout their degrees, we run a compulsory module in Part One (first year) called ‘Research & Criticism’ (EN1RC).

In the previous incarnation of the module, the Autumn Term had been used for a series of 50 minute lectures on research methods, such as ‘Using online sources’, ‘Using published sources’, ‘Citations and referencing’, and ‘Academic writing’. Students also attended a 50 minute seminar each week, the content of which was determined by the seminar tutor. The Spring Term lectures and seminars then inducted students into foundational critical ideas like ‘narrative’, ‘reader’ and ‘author’, as well as issues such as ‘gender and sexuality’, and ‘race and empire’, via a series of set texts.

I was tasked with convening this module from 2014/15. On my appointment, I sought to engage students as more active participants in the skills training component.

Implementation

The process for developing this module began with an informal conversation with another tutor. We identified a disparity between the module content and the mode of delivery: the traditional lecture format did not seem to be the best vehicle for delivering skills training.

Believing that skills training is most effectively conducted through practical and interactive activities, I set about constructing a series of short formative tasks that would enable students to learn by doing. These were designed to break down the process of research and writing into its component parts, so that students could amass the necessary skills bit by bit. Feedback would be given quickly – usually the following week – by their seminar tutor, meaning changes could be implemented prior to attempting a summative (assessed) essay. The specific formative tasks set were: assembling a bibliography, integrating quotation into a short critical commentary, preparing an essay plan, summarising a fiction text, précising a critical text, and drafting an essay introduction.

Students were supported to undertake each task by a screencast: a short (3-5 minute) animation giving the key information about a particular skill and signposting further resources, which students could watch at their own pace and return to at leisure. Screencasts were released to students on a controlled basis via a dedicated area on the module’s Blackboard pages, accompanying the instructions for each formative task. Upon completion of the module, students had therefore engaged with a bank of ten different screencasts. They retain access to this throughout their degrees, via Blackboard.

Most of the screencasts were prepared using the screen capture programme, Camtasia, for which we have multiple departmental licenses. Colleagues who had previously delivered the skills lectures were given the technical support (where necessary) to repurpose that material into a screencast, and others were invited to volunteer new material. A colleague in Study Advice also contributed a screencast tailored to the needs of English Literature students. This collaborative approach produced a welcome range of different outcomes. Some colleagues used PowerPoint to present written and visual content, while others used Prezi, which better represents the spatial arrangement of the material. Some recorded a voiceover, which provided a welcome sense of connection with an individual tutor, while others chose to use a musical soundtrack downloaded from a royalty-free website such as www.incompetech.com. A few colleagues used the animation tools PowToon and VideoScribe, rather than simply recording a presentation onscreen.

A meeting with staff teaching on the module was held at the end of its first term and after its first full year. Their reflections on students’ submitted tasks and classroom engagement proved invaluable for the module’s iterative design.

Impact

As a result of this module, students are evidently more alert to the many components of professional writing and are better equipped to perform good academic practice. Selected comments from qualitative module evaluations affirmed the usefulness of this immersive model of skills training: “The first [formative] tasks such as the bibliography were very useful to bridge the gap into HE”, “All the feedback I received was very helpful and helped me improve my work”, and “The screencasts were also a fantastic idea”.

The screencasts have been watched multiple times by students, suggesting that they are a useful resource that can be returned to and referred to repeatedly. The current most-watched is ‘Incorporating quotations’, which has had 969 views since it was uploaded in January 2015.

Using screencasts as a teaching delivery tool has also provided the opportunity to develop the content of the course. Removing the skills content from lectures freed up contact time to be given to important theoretical material and set texts.

Reflections

The model of interactive skills training harnesses the power of constructive alignment, where teaching process and assessment method are calculated to maximise students’ engagement with the subject and/or skills being taught. Even for a discursive discipline like English, the QAA Subject Benchmark Statement encourages assessments “aimed at the development of specific skills (including IT and bibliographical exercises)”.

Although I did not have a particular student demographic in mind when making these changes, the staged development of writing skills seems to offer specific support to international students and English as additional language (EAL) learners, who may be unfamiliar with UK academic conventions and benefit from an atomised approach to writing with regular formative feedback. However, all students benefit from this formal induction to academic literacy. Running a core skills module has an equalising effect on the cohort, compensating for disparities in prior educational contexts and attainment.

Embedding the screencasts to view on Blackboard Learn was awkward since they could not be watched inline by users whose devices did not support a specific plugin. Screencasts were therefore hosted on www.screencast.com, with stable links provided in Blackboard Learn. Both uploading and viewing were easy and effective, but the cap on bandwidth (2GB per month) meant a need to upgrade to a paid-for subscription (currently £8.36 per month) in months where traffic was particularly high. In future I will consider using YouTube, with appropriate privacy settings, to continue the periodic release of screencasts through link-only access.

Follow up

As of 2016-17, the module continues to run using screencasts as a key teaching method. Additional screencasts have been added to the suite as need arose, for instance to support students’ use of Turnitin as a formative tool, in line with University of Reading strategy. Some screencasts have been replaced as a result of staff turnover. But most remain in use, meaning that the initial work to prepare the content and conduct the screen capture continues to pay off.

Various colleagues in the Department of English Literature have found screencasts to be a useful method for wider skills training. We are now preparing a suite of screencasts to support prospective students and new entrants with the transition to higher education, on topics like ‘What is a lecture?’ and ‘How should I communicate with my tutors?’. We also use screencasts more widely, including as a student assessment method: some of these, along with our public-facing promotional videos, have been given British Sign Language interpretation (contact Dr Cindy Becker for details).

Work is now being undertaken to enhance the training component of the module further through Technology Enhanced Learning, by using quizzes on Blackboard Learn to provide students with immediate feedback on their understanding of skills like proper referencing practice.

Links

Academic Writing: Essay presentation & proof-reading:http://www.screencast.com/t/EXn2au7r8Wj7

Writing a critical precis: http://www.screencast.com/t/83Wz0I4rA

Citations and referencing: http://www.screencast.com/t/aT8PolyDuH

English Literature at the University of Reading YouTube Channel: https://www.youtube.com/user/EnglishAtReading

Closing the ‘feedback loop’ using Unitu: Student uptake, usage and impact of a new online student feedback platform

By laurenmccann Comment Closed

Dr Emma Mayhew, Politics, Economics and International Relations
e.a.mayhew@reading.ac.uk
Year of activity: 2015/16

Overview

PLanT funding was used to research the impact of a new student feedback platform in Politics. Unitu creates an online student forum from which representatives pull issues onto a separate departmental board. Academics can then add responses and show if an issue has been actioned or closed by dragging between columns.

Objectives

  • To monitor student uptake and usage figures across the year.
  • To increase our understanding of the impact of the platform on the student experience.
  • To look more deeply at the effect of continuous feedback, via Unitu, on teaching and learning provision within the Department.

Context

Increasingly, providers are looking for alternative ways to encourage more continuous student engagement by opening channels of communication between staff and students to target further improvements to the student experience. This is particularly timely given the Teaching Excellence Framework and changes to National Student Survey questions which stress the importance of the student voice.

Implementation

In order to investigate student uptake, usage and impact of Unitu, the project team adopted a three stage approach:

  1. To survey students to assess their knowledge and experiences of Unitu. 120 questionnaires were received from students across all parts of the Department.
  2. To conduct a focus group of between 8 and 10 students to help draw out themes surrounding the student experience of using Unitu and impact of the platform on provision and satisfaction.
  3. To research the experiences of the University of Roehampton to look at how this provider raised awareness of the platform, how they encouraged student engagement and what kind of impact they had seen.

Impact

We now have easily accessible sign up and usage figures across the year. We can see how sign up figures respond to our promotional activity. We have a much better understanding of why some students were not aware of the platform, how some students encountered initial technical difficulties with sign up, why some purposefully prefer not to engage with Unitu and, for those that have, which features are of particular use and which are not. This data has led to changes in our approach to student communications and liaison with the software provider to amend some of the features offered.

Reflections

Although some features were problematic, such as numerous ‘new post’ email notifications, the overall response was positive. 58% of students enrolled onto the platform. 55 issues, questions or praise were posted, prompting 5,500 student views of follow on discussion. 52% found Unitu increased student representative profiles. 61% felt it improved the student voice. 75% felt it showed exactly how the Department responded to student feedback. Some changes were made to teaching provision in response to student feedback including addressing deadline clusters and balancing assessed and non-assessed presentations. Notably the platform offers academic colleagues the opportunity to explore the pedagogical rationale behind curriculum design and assessment decisions. But we do remain mindful of the way in which Unitu might lead to difficulties managing student expectations in terms of the timing and nature of responses as well as the impact of adopting a very open discussion forum which does require clear rules of engagement.

Follow up

We have started work on broader dissemination of our experiences. In September 2016 a Part Two student, Jack Gillum, presented as part of a broader University of Reading symposium at the Researching, Advancing & Inspiring Student Engagement (RAISE) conference in Loughborough. Unitu is now being considered by Computer Science and the School of Construction Management and Engineering. We would like to continue to share our experiences with new adopters.sp

Game-based learning using social media

By laurenmccann Comment Closed

Dr Stanimira Milcheva, Henley Business School
stani.milcheva@henley.reading.ac.uk
Year of activity: 2015/16

Overview

We designed a simple game (called the REFinGame) which was aligned with the course material and launched it on Facebook. This approach, which could easily be applied to other discipline areas, was successfully used to enhance student learning and engagement with modules related to real estate finance.

Objectives

  • Allow students to develop transferable skills.
  • Allow students to apply course material in a real-world scenario.
  • Provide immediate and personalised feedback.
  • Improve interactions among students and between students and the lecturer.
  • Help make the module more interactive and enjoyable for students.

Context

Real Estate Finance and Debt Markets (REMF41), is a master’s module within Henley Business School. During the module students gain an awareness of the financing process for real estate from both a borrower’s and a lender’s point of view. The game was designed so that students could apply course material and learn to assess the risks associated with financing decisions.

Implementation

First, together with Professor Charles Ward, the REFinGame was designed before the beginning of the module. The design had to take into account the course material and make simplifying assumptions so that the game could be modelled to best represent reality. The idea was that students would play the game over the course of the module outside the classroom. The game is about making financing decisions. Students are split into property developers (investors) and lenders (banks). The developers make decisions on how many properties to develop depending on how much money they have and how much finding they need from the bank. Moreover, they decide on the type of the properties, the location and other characteristics. The banks decide how much funding to provide to each developer. The game is played on Facebook on a weekly basis as information is introduced on the Facebook Wall each week. Students advertise properties on the Wall, and a decision is made by the game coordinator on the transaction price of the buildings, based on the total supply by developers and the macroeconomic situation in that period. The main idea is that students learn to assess the risks associated with financing decisions as they can lose the virtual money they have available by making the wrong decisions. The game is won by the student who accumulates the greatest amount of money.

A closed Facebook group was created for the module, a logo was created for the game, and students were briefed how to play the game. The developers and lenders had to negotiate loan conditions using Facebook messages. They then advertised the properties they developed by putting pictures and information on the Wall. The purchase prices are then communicated to the developers by private message. Information about the economy and the markets us distributed as a post on the Wall. Students have to fill in a spreadsheet each week and send this to the game instructor. The game instructor then provides feedback to each student. At the end of the game, students shared their experience of the game by giving a presentation in which they presented their strategy and performance throughout the game and compared it to their peers. These presentations are assessed.

Impact

A significant relationship was found between the students who performed well in the game and their overall module mark. Less tangible outcomes are that the game can help students develop skills such as problem solving, creativity, and strategic behaviour, and also increases the interaction among students and between the students and the lecturer. In particular we found that playing a game on Facebook helped to better integrate students who might be more reticent in class discussions. The lecturer can develop a better idea of each student’s performance leading to students receiving tailored and regular feedback and being able to improve throughout the game. This is one of the main advantages that students identified, along with the playfulness of the game, and the ease with which the game is played on Facebook. The major issues students faced were the perception that course material is not directly applied in the game. This demonstrates that it is important to manage student expectations as well as have a structured approach when it comes to game design. Ultimately, our goal is to create guidelines for using self-designed simple games incorporating Facebook, and improve student learning.

Reflection

The novelty of our approach is that we did not design a video game or a digital game using special software, but instead designed a simple game to be played online using Facebook as a platform. We wanted to show how with limited resources and time an instructor can construct a game and engage students with it, as Facebook is free and widely used by students. We have observed that the main challenge in the design of the game is to ensure that it aligns with the course material and to manage student expectations. For this purpose the instructor should very clearly explain how the game can benefit the students and how they will be assessed. Also, it is crucial to communicate how the course material can be used within the game to make decisions. For this purpose, the game designer needs to make sure that the students see the direct link between the course material and the learning outcomes of the game.

Blackboard Collaborate cross-campus tutorials as a useful tool to enhance the Part One Pharmacy student experience at the University of Reading Malaysia

By laurenmccann Comment Closed

Dr Darius Widera, School of Chemistry, Food and Pharmacy
d.widera@reading.ac.uk

Overview

After a successful application to act as one of the early adopters of Blackboard Collaborate at the University of Reading, this technology platform was used for a series of cross-campus tutorials within the Fundamentals of Physiology (PM1AM) module between the University of Reading’s Whiteknights and Malaysia campuses. The format was well-received, and contributed to an enhanced student experience.

Context

The official inauguration of the University of Reading Malaysia (UoRM) campus in EduCity, Johor Bahru, in early 2017 and the start of the MPharm (Malaysia) programme in the academic year 2016/17 offer excellent opportunities for further internationalisation of the University of Reading and specifically within Pharmacy education.

The University of Reading Malaysia offers a double accredited (UK and Malaysia) 2+2 MPharm (Hons) degree where the students study for two years at the Malaysia campus followed by two consecutive years in Reading.

The PM1A module and its UoRM counterpart, PM1AM, cover the basics of biology and human physiology including genetics, biochemistry and cell biology. According to student feedback, these topics tend to be challenging for the students, especially in light of the fact that significant numbers of Pharmacy students do not have A-level biology to provide background knowledge.

In response to this feedback, several tutorials have been introduced to provide students with interactive opportunities to revise the content of lectures and practical sessions and to close any potential knowledge gaps.

Thus, there was a need for the development of a cross-campus solution to ensure that both MPharm cohorts (UoR and UoRM) are provided with a similar form of tutorials.

Objectives

  • To explore if Blackboard Collaborate can be used for cross-campus delivery of tutorials covering the content of the genetics lecture series within the PM1A/PM1AM module.
  • To investigate if cross-campus virtual classroom/teleconference represents an appropriate pedagogical tool for delivery of tutorials in Pharmacy and how this deliver method affects student engagement and interactivity.
  • To assess if these sessions could help 2+2 MPharm students to prepare for their two years of study in Reading.

Implementation

The Blackboard Collaborate platform was used to develop a series of tutorials in genetics. The online sessions were led by Dr Widera (live video capture via a webcam) at the University of Reading’s Whiteknights campus and streamed to students at the UoRM. The student group was composed of 11 Malaysian Part One MPharm students. The content of the tutorials was covered in the respective lecturees. It was expected that students would have factual knowledge of the topic, although at heterogeneous levels.

All students were equipped with PCs with headsets and webcams. Blackboard Collaborate functions including ‘raise hand’, virtual whiteboard, chat, and direct interaction with all or individual students (either via audio or video) were used. In addition, external tools (e.g. Microsoft PowerPoint presentations and the Poll Everywhere app) were used via the ‘share screen’ function of Blackboard Collaborate. For the tutorial, an introductory PowerPoint presentation was designed and a screencast deposited on YouTube as a contingency plan. Multiple choice questionnaires (MCQs) were set up on the Poll Everywhere platform, and short answer questions (SAQs) were included in an additional PowerPoint presentation. After each MCQ/SAQ, students were given time to decide on an answer (individually via Poll Everywhere), followed by an interactive discussion.

The overall length of each tutorial session was 50 minutes. Individual anonymous post-hoc feedback was collected to evaluate student opinions on the usefulness, overall style, and delivery. In addition, a technical report and an experience log was collated and submitted to the Technology Enhanced Learning team. Finally, the content, deliver and potential changes were discussed with students and peers during a visit to the UoRM.

Impact

During the tutorials no serious technical issues were encountered, although students at UoRM did experience slight lagging in their connections (with video and audio becoming slightly out of sync). Students showed high levels of interaction and successfully used most of the Blackboard Collaborate features. Importantly, other than in UoR in-class tutorials, students engaged and interacted early on. This is reflected in the feedback collected after the first session (“I like how it is interactive and fun”). The tutorial format also seemed to help students to revise the content of the lectures (“Useful to enhance my biology knowledge”, “It helps me to revise”, “It helps me to find out my difficulties with previous lectures”). Moreover, students appreciated that the session was different compared to conventional lectures (“It was different from just sitting in the classroom and listening to lecturers”, “it was another way of learning outside the classroom”). Last but not least, it was appreciated that the tutorials were run by Reading-based staff that the 2+2 students would meet during their two years in Reading (“can meet Dr Widera and learn from him”). No negative feedback was received.

Follow up

Following the feedback received, further tutorials involving other lecturers teaching on the PM1A module will be developed and implemented.

Reading University Observatory: A web-based resource for 21st century teaching and learning

By laurenmccann Comment Closed

Dr Andrew Gabey,

School of Mathematical, Physical and Computation Sciences

a.m.gabey@reading.ac.uk

Year of activity: 2016/17

Overview

The University’s Atmospheric Observatory continuously collects high-quality environmental data, which is used heavily in teaching courses – particularly in Meteorology.  A new web-based system, due to go into service for the Autumn semester, has been developed under this project so that the data is (i) more easily accessed by students, and (ii) pulled automatically into other software applications, such as interactive websites, for either teaching or outreach. Alongside these impacts, the system represents a more manageable way to disseminate data, and is a helpful case study for developing digital offerings using Cloud technologies supported by University IT Services.

Objectives

We aimed to build a modern environmental data service based on data from the University Atmospheric Observatory that:

  • Provides an improved user experience for students in the various classes using this data.
  • Can be accessed by anybody with permission, on or off-campus.
  • Supports development of data-driven applications, including interactive websites, that help explain the environment and climate.

Context

Meteorology departments generally teach with data from their own atmospheric observatories, often using clunky methods. Our school website provides an on-campus-only service for students to access data needed for Meteorology, Sustainability, Biology and Geography classes, but the software for this has grown organically and has reached a point where the user experience is somewhat overwhelming. This technologies used are also unsuitable for modern applications such as interactive data-driven websites that could showcase the university’s facilities.

Implementation

Stakeholder input and co-ordination: Meetings were held with the departmental data manager, laboratory technicians, other research staff interested in sharing data efficiently, and the HoD responsible for funding the on-going computing cost for operating the service. As they were engaged during the proposal writing, these discussions were broadly positive and yielded useful considerations such as the need for legal wording on the website.

Design and implementation of software: The proposal document was used to inform technical requirements passed to the programmers. These focussed on the different journeys taken by service users and administrators, and feedback between the programmers and I helped smooth interpretation.

Standing up the service: University IT Services were happy to explore ways of helping people to deliver services using cloud-based approaches, and even covered the first few months of running costs while we determined how things should work in terms of finance and support.

Documentation and support: The completed code is stored on the GitHub website, along with installation and administration instructions for system maintenance and, hopefully, the addition of more data holdings and users as time goes on.

Impact

Expected outcomes

To ensure successful outcomes, we established technical requirements based on the planned benefits to teaching and learning: Improved user experience through a better user interface; accessibility from anywhere; allowing the data manager to tailor data for classes/individuals, and employing more modern web technologies.

Based on these technical criteria, these have all been solidly realised, and the system is being stood up to be used by Meteorology students as the new academic year begins (subject to ITS support). Initial user feedback has been positive, with test users able to extract data without needing much help. When help was required it was mostly caused by bugs, which have been resolved (see follow-up for more feedback).

Unexpected outcomes

IT Services: We employed Microsoft Cloud technologies to power the service, and this in turn has allowed IT Services to determine how they can support groups within the university keen to innovate in this way.

Technological development within the department: This software has formed the basis of a similar tool to share research data elsewhere in the department, and can in theory be applied to many such datasets.

Reflections

As this was fundamentally a software project, it was essential to have well-developed requirements and criteria for success. These were worked through in detail at the start, and left enough room at the end that small extra tasks could be completed to refine the finished product.

The hardest part was spending the money: Although the University Careers centre were very helpful we were unable to secure any suitable interns, having advertised it as a summer project. An email to the departmental PhD students yielded a pair with the perfect background, and the work was completed within the increasingly tight deadline, and to budget, paid via ad-hoc work forms. Appealing to PhD students first rather than holding out for a summer intern would have been the wiser course.

A more impactful result would have been achieved if we had built some demonstrations of how the new system could be applied. For example, web-based data visualisation would show how accessible the data is; and negotiating with the University to make some of the archive available to the public would have been helpful for outreach. Public datasets are supported in the software, so a decision to make data available is easy to implement.

Follow up

Initial feedback was positive from teaching support staff, and constructive criticism was taken on board. For example, a test user was able to choose invalid dates like 31 April, which resulted in errors. Concerns were also raised about it being hard to go back and change options when a mistake was made. Refinements were made (reflected in images below) to address these.

Links

Atmospheric Observatory

sample webpage from the online database

Service homepage showing information on its use and how to get access to data.

sample webpage from the online database

Some of the options presented to the student user for data download. They are only presented with relevant information, and interface elements such as interactive date pickers are employed to make the experience more intuitive.

sample webpage from the online database

One of the administration screens allowing specific parts of the University’s large data archive to be assigned to a student, rather than presenting all possible options to them.

Virtual teaching collections in Archaeology and Classics: turning artefacts into 3D models

By laurenmccann Comment Closed

Dr Robert Hosfield, School of Archaeology, Geography and Environmental Science

r.hosfield@reading.ac.uk

Year of activity: 2015/16

Sample image

Lykethos

Overview

The project tested different methods for producing and disseminating 3D models of existing artefacts in the teaching collections of Classics and Archaeology. 3D scanning was labour intensive and struggled to accurately represent some of the raw materials. By contrast photogrammetry was more cost and time effective and produced better quality results (see attached figure). Sketchfab was an effective, user-friendly platform for disseminating the models (https://sketchfab.com/uremuseum), and student feedback was positive.

Objectives

  1. Produce and evaluate 3D laser scans of 10 lithic artefacts and 5 ceramic artefacts from the teaching collections of Classics and Archaeology, with analysis of 3D model resolution, cost, and time requirements, and dissemination options;
  2. Document student evaluations of the new resources.

Context

Archaeology and Classics have wide ranging teaching collections of objects, both genuine and replica, from the human past (e.g. Greek and Roman ceramics). While students have access to this material in practical classes and seminars, out-of-class access is more difficult, due to (i) the intensive use of the teaching spaces holding the collections, and (ii) the fragility of selected specimens. The project explored methods that could enable students to engage with this material evidence through digital models.

Implementation

The project was primarily undertaken by four Reading students, both postgraduate and undergraduate: Rosie-May Howard (Bsc Archaeology, Part 2), Matthew Abel (BA Museum Studies & Archaeology, Part 1), Daniel O’Brien (BA Ancient History & Archaeology, Part 3), and James Lloyd (Classics, PGR). Supervision and support was provided by Prof. Amy Smith (Classics), Dr Rob Hosfield (Archaeology) and Dr Stuart Black (Archaeology). The four students undertook the following tasks:

(i) Testing the URE Museum’s NextengineTM HD 3D scanner and associated processing software ScanStudioTM to produce 3D laser scan models of selected artefacts (ceramics from the Ure Museum and stone tools from the Archaeology teaching collections).

(ii) Testing 3D printing of the laser scan models using the URE museum’s CubeProTM 3D printer.

(iii) Testing the digital representation of the same range of artefacts through photogrammetry, using memento by Autodesk.

(iv) Trialing the use of Sketchfab as a remote site for posting, storing and accessing the 3D models.

(v) Assessing student responses to the models through a Surveymonkey questionnaire.

Impact

(i) The 3D laser scan models provided volumetric data (unlike the photogrammetry models), but struggled with the regular shapes and repeating patterns which were characteristic of many of the ceramics. The laser scanning process was also time-intensive.

(ii) The laser scanner struggled to represent some of the stone artefacts, with the resulting models characterised by poorly defined edges and ‘holes’, due to the material properties of the flint raw material.

(iii) Photogrammetry was used successfully to create 3D models of ceramics from the Ure museum collection.

(iv) Sketchfab was a flexible interface for ‘touching up’ and annotating the models, and was more user-friendly than other options (e.g. scanstudio).

The quality of the 3D printing was mixed, leading to a decision during the project to focus on digital models that could be accessed on-line.

(v) Students responded positively to the virtual models, and would like to see more in future!

Sample survey questions and responses:

Q: What (if any) other objects/material types would you like to see as 3D models?

A: It would be interesting to see 3D models of smaller, more dainty objects as these can often be difficult to look at on such a small scale.

Q: Do you have any other comments?

A: This is a great project that should keep going! P.S. A scale will be helpful for accurately describing the objects. There’s a Part 2 Archaeology module called Artefacts in Archaeology and the scans could be used as an at-home resource by students.

Reflections

The project was successful in clearly highlighting the relative strengths and weaknesses of the 3D laser scan and photogrammetry methods for creating digital models of artefacts. In terms of cost and time it was clear that photogrammetry was a more effective method, while the experiments with 3D printing emphasised on-line hosts such as Sketchfab as the most effective way of disseminating the models.

More specifically, exploring the photogrammetry option highlighted the potential of the Agisoft PhotoScan software as an effective method for Museums or HEIs wishing to capture large collections for teaching and/or archiving purposes.

Student responses emphasised the importance of providing a wide range of models if these sorts of teaching resources are to be further developed.

Follow up

Archaeology has purchased copies of the Agisoft PhotoScan software and is currently looking to develop a photogrammetry-based digital database of its teaching collections.

At the Ure Museum 3D scans are being made available via Sketchfab and more thorough use of photogrammetry is being considered; virtual models of the vases scanned for CL1GH are being used in seminars this term.

Links

https://sketchfab.com/uremuseum

Flipping Earth Science practicals and the use of digital specimens

By laurenmccann Comment Closed

Dr Hazel McGoff, School of Archaeology, Geography and Environmental Science

h.j.mcgoff@reading.ac.uk

Year of activity: 2016/17

Overview

This project established a library of digital images of our key mineral and rock specimens. Annotated explanatory labels were added to the images to create a resource that can be used to help students familiarise themselves with the specimens before laboratory practical sessions and for reinforcement and revision afterwards.

Objectives

The aim of this project was to establish a digital resource that could be used alongside practical specimen-based teaching and learning.

Context

While students can handle and see (as well as sometimes smell and taste!) specimens in practical classes, gaining skills in mineral and rock identification takes practice and time. The use of annotated digital images allows participants to gain familiarity with the specimens and their key characteristics before each practical class, thus allowing them to use their time in the laboratory more effectively.  Relevant modules include GV1DE Our Dynamic Earth, GV2GRE Geological Resources as well as some Archaeology teaching.

Implementation

Three students and a photographer were key to the success of this project.  George Biddulph, a Part 2 Geography student selected specimens to be photographed and we were able to have a large number of high quality digital images taken by a semi-professional photographer. Two final year students Emma Warner (Geography) and Chloe Knight (Environmental Science) used Powerpoint to add annotations and explanatory labels to the specimen images.

Impact

This activity was successful in terms of producing the images and using Powerpoint to add labels and annotations. These will be used in 2017-18 taught modules. The project has also been useful in ‘kick starting’ the use of the collections in modules such as GV2MPL Summer Microplacement and also setting up volunteer sessions one afternoon a week during term. These give students the opportunity to identify and catalogue more of the collections.

Reflections

This project will be used in teaching in 2017-18 so additional reflection will be needed later in the session. Due to time constraints the photography of the specimens was contracted to someone outside the University. Ideally this would also have been allocated to a student.

Links

The information will be made available on Blackboard later in term. Selected specimens are being featured on the Geography and Environmental Science at the University of Reading Facebook page.

 

Example image of rock sample

Example image of rock sample

Using wikis for assessed group work in new history modules

By laurenmccann Comment Closed

Shirin Irvine – TEL Adviser, CQSD

Image of Shirin Irvine

Overview

For the academic year 2015/16, the Department of History offered a brand-new Part 1 programme as part of the History Project. This resulted in the development of three new core modules.

Dr Mara Oliva transformed common practice by using technology to carry out full electronic assessment for her module. This project included multiple aspects of digital pedagogy, using Blackboard to perform engaging assessment.  This was achieved through innovative and effective use of Blackboard Groups in combination with Blackboard Wikis and Turnitin Assignments, in addition to the Grade Centre for administering students’ marks.

What is a wiki?

A wiki is a collaborative tool that allows students to work as a group on one project and write shared content in the form of a website. They can create a series of web pages that can include images, web links and videos, collectively responding to a theme.

Dr Mara Oliva – Lecturer in Modern American History (20th century)

Image of Mara Olive

Mara explains how she used the wiki tool within Blackboard as a new tool for summative assessment.

The Culture Wiki

Journeys through History 2 aims to introduce students to major historical ideas, concepts, beliefs and knowledge systems, and to show how these are exemplified in material culture, with reference to artefacts, buildings, paintings and other works of art, literature and media.

We wanted the assessment tools we chose to reflect the cultural and visual elements of the module. Therefore we decided to use a group wiki of 2,000 words (50% of the module mark), which we called the Culture Wiki, and an individual 2,000-word essay on one of the historical concepts.

The Culture Wiki allowed students to create and contribute to several web pages of course-related material. They were expected to display their research, analytical and communication skills by building a website meant for public consumption. In small groups, students created their wikis based on a theme discussed during lectures. Lecturers provided themes in the module handbook and on Blackboard.

Our aims for using this form of assessment were to teach students the importance of teamwork and how to write in a concise and accessible way in order to develop an understanding of public history, which offers many employability opportunities to history graduates.

Impact – great results! 

Overall, the exercise was very successful! According to the feedback, both students and staff enjoyed working on the Culture Wiki. Students said it gave them a chance to look at history from a different angle and realise how many flexible and transferable skills they can gain through studying history.

We then decided to take this a step further and extend full electronic assessment to the individual assay, using Turnitin Assignments. This was received very enthusiastically by the students, who appreciated the immediacy and flexible, 24/7 access technology can offer.

The project, however, would have never taken off without the invaluable support of the TEL team, in particular Shirin Irvine, Lauren McCann and Maria Papaefthimiou. With their help we arranged training and guidance for the department staff on creating and assessing wikis, using Turnitin for e-assessment, and using the Grade Centre.

To support students, we provided a separate handbook with “how to build a wiki” guidelines, which was uploaded on Blackboard. I then dedicated part of the first lecture to introducing the exercise and answering the questions. Overall, students did not need much support and were very quick at learning – their questions were mainly content related.

We are very pleased with the outcome of the project, so we have decided to continue for the foreseeable future!

Sharing the ‘secrets’: Involving students in the use (and design?) of marking schemes

By peteandrews Comment Closed

Rita Balestrini, School of Literature and Languages, r.balestrini@reading.ac.uk

Overview

Between 2016 and 2018, I led a project aiming to enhance the process of assessing foreign language skills in the Department of Modern Languages and European Studies (MLES). The project was supported by the Teaching and Learning Development Fund. Its scope involved two levels of intervention: a pilot within one Part I language module (Beginners Italian Language) and other activities involving colleagues in all language sections and students from each year of study. The project enabled the start of a bank of exemplars for the assessment of a Part I language module; promoted discussion on marking and marking schemes within the department; and made possible a teacher-learner collaborative appraisal of rubrics.

Objectives

  • To enhance Beginners Italian Language students’ understanding of rubrics and their assessment literacy
  • To increase their engagement with the assessment process and their uptake of feedback
  • To engage MLES students as agents of change in the assessment culture of the department
  • To stimulate innovation in the design of rubrics within the MLES Language Team and contribute to develop a shared discourse on assessment criteria and standards informed by the scholarship of assessment

Context

In recent years, there has been an increasing demand to articulate explicitly the standards of assessment and to make them transparent in marking schemes in the form of rubrics, especially in Foreign Languages. It is widely held that the use of rubrics increases the reliability of assessment and fosters autonomy and self-regulation in students. However, it is not uncommon that students do not engage with the feedback that rubrics are supposed to provide. In 2016, the language team of the Department of Modern Languages and European Studies started to work at the standardisation and enhancement of marking schemes used to assess language skills. The aim of this multi-layered project was to make a positive contribution to this process and to pilot a series of activities for the enhancement of foreign language assessment.

Implementation

  • Review of research literature and scholarly articles on the use of standard-based assessment, assessment rubrics, and students-derived marking criteria.
  • Presentation on some of the issues emerged from the review at a School T&L Away Day on assessment attended by the MLES language team (April 2017) and at a meeting of the Language Teaching Community of Practice (November 2017).
  • Organisation of a ‘professional conversation’ on language assessment, evaluation and marking schemes as a peer review activity in the School of Literature and Languages (SLL). The meeting was attended by colleagues from MLES and CQSD (February 2018).
  • 2016-17 – Two groups of students on the Beginners Italian Language module were asked for permission to use exemplars of their written and oral work for pedagogic practice and research. Ten students gave their informed consent.
  • Collection of written and oral work, double-marked by a colleague teaching one of the groups.
  • 2017-2018 – Organization of two two-hour workshops on assessment for a new cohort of students. Aim: To clarify the link between marking criteria, learning outcomes and definitions of standards of achievement of the module. An anonymised selection of the exemplars collected the previous year was used a) ‘to show’ the quality of the standards described in the marking schemes and b) for marking exercises.
  • 2017 – Organisation of three focus groups with students – one for each year of study – to gain insights into their perspectives on the assessment process and understanding of marking criteria. The discussions were recorded and fully transcribed.
  • The transcriptions were analysed by using a discourse analysis framework.
  • Some issues emerged from the analysis: atomistic approach of rubrics; vagueness of the standards; subjectivity of the evaluation; problematic measuring of different aspects of achievement; rating scales anchoring (for a more comprehensive account of the focus groups see the Engage in T&L Blog post Involving students in the appraisal of rubrics for performance-based in Foreign Languages).
  • Developed, in collaboration with three students from the focus groups, a questionnaire on the use of rubrics. The questionnaire was intended to gather future students’ views on marking schemes and their use.

Impact

This multi-layered project contributed to enhance the process of assessing foreign language skills in MLES in different ways.

  • The collection of exemplars for the Beginners Italian Language module proved to be a useful resource that can also be used with future cohorts. The workshops were not attended by all students, but those who did attend engaged in the activities proposed and asked several interesting questions about the standards of achievement described in the marking schemes (e.g. grade definitions; use of terms and phrases).
  • The systematic analysis of the focus groups provided valuable insights into students’ disengagement with marking schemes. It also brought to light some issues that would need to be addressed before designing new rubrics.
  • The literature review provided research and critical perspectives on marking schemes as a tool of evaluation and a tool for learning. It suggested new ways of thinking about marking and rubrics and provided a scholarly basis for potential wider projects. The discussion it stimulated, however different the opinions, was an important starting point for the development of a shared discourse on assessment.

Reflections

The fuzziness of marking students’ complex performance cannot be overcome by simply linking numerical marks to qualitative standard descriptors. As mentioned in a HEA document, even the most detailed rubrics cannot catch all the aspects of ‘quality’ (HEA, 2012) and standards can be better communicated by discussing exemplars. There is also an issue with fixing the boundaries between grades on a linear scale (Sadler, 2013) and the fact that, as Race warns, the dialogue between learners and assessors (Race, HEA) can easily be broken down by the evaluative terms typically used to pin down different standards of achievement. Despite all these pitfalls, in the current HE context, rubrics, if constructed thoughtfully and involving all stakeholders, can benefit learning and teaching.

By offering opportunities to discuss criteria and standards with students, rubrics can help to build a common understanding of how marks are assigned and so foster students’ literacy, especially if their use is supported by relevant exemplars.

The belief that rubrics need to be standardised across modules, levels and years of study makes designing rubrics particularly difficult for ‘foreign languages’. Cultural changes require time and the involvement of all stakeholders, especially where the changes concern key issues that are difficult to address without a shared view on language, language learning and assessment. A thorough discussion of rubrics can provide chances to share ideas on marking, assessment and language development not only between students and staff but also within a team of assessors.

I have tried to engage students in the appraisal of rubrics and to avoid a market research approach to focus groups. It is clear that, if we are committed to make any assessment experience a learning experience and to avoid the potential uneasiness that rubrics can cause students, we need to explore new ways of defining the standards of achievement in foreign languages. Establishing pedagogical partnerships with students seems a good way to start.

Follow up

I will encourage a differentiation of rubrics based on level of language proficiency and a collection of exemplars for other language modules. The natural follow up to this project would be to continue enhancing the rubrics used for evaluation and feedback in languages in the light of the analysis of the focus group discussions and the review of the literature on assessment, ideally with the collaboration of students. Possible connections between the marking schemes used to assess language modules and cultural modules will be explored.

References

HEA, 2012. A Marked Improvement. Transforming assessment in HE. York: Higher Education Academy.

Race, P. Using feedback to help students to learn [online] Available at https://www.heacademy.ac.uk/knowledge-hub/using-feedback-help-students-learn   [accessed on 15/8/2018]

Sadler, D. R. 2013. The futility of attempting to codify academic achievement standards. Higher Education 67 (3): 273-288.

 

Links to related posts

‘How did I do?’ Finding new ways to describe the standards of foreign language performance. A follow-up project on the redesign of two marking schemes (DLC)

Working in partnership with our lecturers to redesign language marking schemes 

Involving students in the appraisal of rubrics for performance-based assessment in Foreign Languages By Dott. Rita Balestrini