Improved Neural Network assessment by staged laboratory practicals

By edwardwhite Comment Closed

Professor Richard Mitchell, School of Systems Engineering
r.j.mitchell@reading.ac.uk

Overview

6470Adjustments were made to teaching, assessment, and feedback in a Part Two module within the School of Systems Engineering, Neural Networks (SE2NN11), successfully using three-staged laboratory practicals in order to encourage students to use neural networks on a ‘real world’ application. Making these changes saw an increase in the number of students successfully producing a neural network.

Objectives

  • Increase the number of students successfully producing a neural network.
  • Provide greater and prompter feedback to students.

Context

The major assessment for SE2NN11 requires students to write a program to implement a particular neural network and to then use that network on a ‘real world’ application. The students demonstrated their network by the end of the autumn term, where verbal feedback was given, and they then applied it to the real world problem of their choice in the next term. Previously, students had difficulty with the first stage, and so fewer moved on to the (more interesting) second stage, with only around 75% of students submitting a report.

Implementation

During the pilot year (2009), the tasks associated with writing the neural network were carefully divided into three, and three associated 90 minute lab sessions were organised, two weeks apart, for the work. The lecturer plus two laboratory demonstrators were available to provide help to the students at these sessions.

For each session, a Microsoft Word template file was provided, and the students copied and pasted relevant program output or small parts of the program (functions) into the appropriate parts of the template. A simple marking scheme was associated with each part, worth 30 marks: typically students could get 0, 1 or 2 for a piece of code plus 0 or 1 for comments; or a student could get 0 or 1 depending on whether the program output was correct. There was also space for comments to be written.

These files were then submitted to the lecturer who circled the relevant mark for each part and added relevant comments. Detailed feedback was thereby generated very easily and very quickly. The aim was to give feedback within a week of the session, allowing the student a further week to make any necessary corrections on one part before starting the next part of the program. In fact, the first week’s work was marked within two days.

Impact

Each year since this scheme has been introduced, around 95% of students have been able to produce a neural network, a significant increase in submissions.

Reflections

The impression obtained in the pilot was that a greater proportion of students had a working neural network compared with previous years, suggesting a great success of this scenario. As such the scenario has been used each year since with some changes to the templates (and to the program to help reduce plagiarism between years).

One problem is that the structure of the program is so tightly defined that there is little scope for variation in code – hence copying is difficult to detect. This is partly addressed by requiring the student to comment their code and to discuss the object-oriented aspects of their program in the final report. In addition students were expected to do experiments in their own time to investigate the effects of changing specific parameters in the program. The instructions for the final report were made clearer to try to ensure this happens.

One disadvantage of the approach is that it discourages independent thought more than is ideal. The much increased submission rate, however, is encouraging.

The important aspects of this scheme are the division of the project into suitable, easily marked sub-tasks, the extra support provided in the development of the program and the inherent feedback between sessions.

Follow up

Following the pilot year, it was realised that some functions were more complex than others, so the marking scheme was changed so that an appropriate number of marks for the code and comments was available for each function.

From 2015, with the move to online submission, students upload their document to Blackboard Learn, where the work is readily marked. Rather than circling the marks, the ‘insert text’ option is used to allow the marks to be entered. Comments on errors or suggestions for improvements are also easily added in an appropriate context.

The second part of the assessment requires the student to apply their neural network to a ‘real world’ problem of their choice, to see if the network can learn that problem. In effect the students are researching whether a neural network is appropriate. Given that, rather than asking the students to write a report on their work, they are now asked to present their research in the form of a four page conference paper. This tests them with a new skill, complementing the report writing skills they use elsewhere. This innovation has also proved successful.

Use of a modified problem-based learning approach in aphasia therapy teaching

By edwardwhite Comment Closed

Dr Arpita Bose, School of Psychology and Clinical Language Sciences
a.bose@reading.ac.uk
Year of activity: 2011/12

Overview

9254A modified problem-based learning approach was developed and implemented in Communication Impairment 3 (PL2CI3/PLMCI3) within the School of Psychology and Clinical Language Sciences.  While the adoption of this approach was unpopular with students on the module, there was a notable improvement in the marks achieved in exams, and this suggests that subtle modification may provide a problem-based learning approach to which students respond well, and that provides for the achievement of improved grades.

Objectives

  • Implement a problem-based learning approach in aphasia therapy teaching.
  • Enable students to apply knowledge obtained through study to be applied to real world clinical cases.
  • Through use of problem-based learning, prepare students for the workplace by allowing them to experience and practise decision making skills and processes.

Context

Speech and Language Therapies programmes taught at the University of Reading aim to prepare evidence-based practitioners, able to apply their knowledge to clinical problems, and make effective decisions in their practice. The problem-based learning approach has been widely adopted within a wide range of academic contexts and professional disciplines, including for Speech and Language Therapy. Under the problem-based learning approach in Speech and Language Therapy, students are encouraged to solve problems that are set in the real world, enabling them to use specific knowledge obtained through self-directed learning with the support of their lecturer to make clinical decisions.

Implementation

The initial task was to create a raft of fictional case studies. The creation of good ‘problems’ is the essence of successful problem-based learning approaches, and so several weeks were spent modifying each case so that students would be able to understand the content area that needed to be taught. Additionally, it was necessary to find appropriate resources that could go with the case studies.

Several resources were generated in order to support the students in solving the case studies, and specific pointers were provided towards the thinking about the case studies (in class), literature (detailed reference list), web-based resources, and resources from the department and library. The module convenor was available for discussion to the assigned group during module-specific office hours.

At the beginning of the problem-based aspect of the module, classes were divided into groups of between five and six students. Each week, the groups chose one of the two cases within the week’s topic, and determined the therapy for a fictional client based on the questions for each case.

Each group was required to give a presentation on their assigned case study, answering questions in five sections. Following this there were two to three minutes available for the audience to critique the answers, and for other possible solutions to be discussed, with students basing their critiques upon their own reading. This allowed various methods to be discussed using different cases. Following this, each group updated their slides and submitted a report, with both of these being uploaded to Blackboard Learn, allowing all students on the module access to the slides and information relating to a particular case, which they could use for their own learning and have available for future clinical practice. In addition, students working on a case study received formative feedback from the seminar leader and their peers.

Having built up their ability to respond to theoretical clinical cases during the teaching of the module, in the module’s examination one of the two questions on the therapy section was modeled on solving a case based on available information, with students being required to attempt one of the two questions.

Impact

In the pilot year, in the examination the problem-based question was attempted by more of both the undergraduate and postgraduate cohorts, and the mean marks were higher for students attempting the problem-based question than those that did not. Additionally, individual students expressed interest in doing aphasia topic for their theses, and module evaluation revealed that students felt better prepared for aphasia therapy in their placements.

Reflections

While the results obtained by students in examinations and engagement suggested value in the implementation of the problem-based learning approach, this was not without its difficulties. The principal difficulty experienced was a poor reaction to the introduction of problem-based learning approach on the part of the students on the module. The introduction of problem-based learning approaches increased the workload upon students, who also had to fit the workload around their placements, and students were unappreciative of the benefits that this increased workload might bring. This may also have resulted from the fact that the undergraduate students on the module were in their third year of study, and so had difficulty adjusting to the expectations of the problem-based approach.

The second issue was that developing a problem-based learning approach necessarily increases the workload of the module convenor. It takes a considerable amount of time to write the cases and generate the resources for the students. As Dr Bose felt that developing teaching in this manner would help students learn the material better, she was willing to put the time and effort in, but this should be a consideration for others looking to adopt a problem-based learning approach.

As a result of these issues, changes were planned to and enacted upon the module in order to get students on board with the problem-based learning approach, and prepare them early on for the demands of the approach, with the workload expectations being somewhat adjusted in order to better respond to the existing workload of students. Additionally, as the delivery of a problem-based learning approach was workload-intensive, arrangements were made to provide co-teaching staff, allowing the workload to be made more manageable.

Follow up

Following the pilot year of using a modified problem-based learning approach in aphasia therapy teaching, problem-based learning has continued to form part of the delivery of this module. Following student feedback in the pilot year, the problem-based elements of the course had been stripped back somewhat in order to respond to this, and student feedback has improved: recent examination results and student feedback, however, suggest that minimal use of a problem-based learning approach is not sufficient if one wishes to see the benefits of such an approach, and that therefore the amount of problem-based learning that is required should now be increased.

Thanks to the effort put in during the first years of running the module using the modified problem-based learning approach, there now exist a number of suitable case studies for use in this approach, and thus the workload is not as intensive as it once was, and only minimal amounts of work are required to ensure that the case studies are current and relevant.

Improving student engagement with assessment and feedback through peer review

By edwardwhite Comment Closed

Professor Helen Parish, School of Humanities
h.l.parish@reading.ac.uk

Year of activity: 2014-15

Overview

9070

The project investigated recent research and practice in peer assessment and feedback in order to implement a peer assessment model for use within History, and develop a framework for the adoption of said model in cognate disciplines where evaluation of substantial text-based assignments is an important part of assessment.

Objectives

  • Present students with well-managed opportunities to engage in feedback and assessment and learn from it.
  • Present staff with access to tried and tested models for implementation that can be used and tailored across disciplines.

Context

The importance of increasing the impact of assessment in feedback and learning is recognised by the University’s teaching and learning enhancement priorities, and is evident in the ‘Engage in Assessment’ and ‘Engage in Feedback’ materials.  The requirement to pursue an agenda for feedback is also highlighted by the expectations of employers that graduates of the University of Reading will be able to assess and evaluate the work of others, by comments on feedback made by University of Reading students in the National Student Survey, and by discussions with potential students on Open Days.

Implementation

There were five stages to the project:

  1. A literature search on the topic and detailed engagement with recent scholarship, undertaken by the Principal Investigator.
  2. A ‘competitor analysis’, undertaken by a research assistant, looking at the extent that peer feedback is present on Humanities curricula at other institutions.
  3. Development of a model for the trial of peer assessment informed by the previous two stages.
  4. Implementation of this model as a ‘pilot project’ in the Department of History.
  5. Obtaining student feedback on the process and reflection by the Principal Investigator.

The feedback gained during the early stages of the project revealed that students were reluctant to allow their work to be reviewed by their peers, even when anonymised.   This necessitated the envisaged model to be altered, whereby the written work being ‘peer reviewed’ was either from previous cohorts within the Department or alternative sources.

Once the pilot project was developed, there were three stages:

  1. Development of an understanding of marking and assessment criteria. Students read the assessment criteria of their module, and were then tasked with rewriting these in their own words.
  2. Applying these criteria to written work. Students then read a sample essay (not taken from the group), and with reference to the marking criteria, were asked to give a mark to the essay, with a summary of reasons they had come to this judgment.  This was followed by a discussion of the written feedback provided.
  3. Focus group and project review.  It was intended that students would meet to talk about the project, and more general issues to do with assessment and feedback, in the presence of an experienced observer external to the department.

Impact

One of the principal benefits of the project was that students became more aware of the marking criteria by which their assignments were assessed, as although they found these clear, few students had actually taken the time to read these before. An additional benefit was that the activity helped develop students’ academic confidence, as they were impelled to adopt a critical attitude to writing within scholarship, and gained experience of promoting their point of view to their peers.

Reflections

Feedback from questionnaires suggested that students enjoyed the project; that they now had a better understanding of assessment and feedback; that the project had been helpful with the preparation of their own written work; and that they were now more confident in the assessment of their own work prior to submission.

The reluctance of students to submit their own work to review by their peers meant that there was a less direct link between the peer feedback provided and the specific assignment for each module.  By using work from previous cohorts or alternative sources, however, it was possible to get students to engage more willingly with the process of peer review.

The main disappointment was that it proved impossible to gather a large enough group of students to participate in the focus group stage of the project.  This may have been due to the proposed scheduling of the focus groups at a time when students had recently participated in a Departmental Periodic Review and submitted their final coursework of the academic year.  Nevertheless, valuable feedback on the pilot was provided through questionnaires and verbal communication.

It was interesting to observe that students held broad spectrum of ideas about what constituted good work, arising from a lack of understanding about the criteria against which work is marked. From this perspective, the project was valuable, as students were familiarised with the marking criteria and how these applied to written pieces Students were able to look ‘behind the scenes’ at the marking process, with student applying the marking criteria as individuals, but then needing to decide as a group upon a final mark for pieces they were reviewing.

Follow up

Following the pilot project, the use of peer review to engage students in assessment and feedback has been used by other members of staff within the Department of History, with similar success. Other than the specific pieces of work and criteria used for peer review purposes, there was nothing within this project that was specific to the Department of History or School of Humanities, and so this activity could easily be adapted for use in other Departments and Schools across the University.

The peer review approach has been successfully applied within the Department of History to student presentations in seminars. As student presentations are more ‘in the moment’ and designed with a peer audience in mind, students have not expressed the same reticence to have their peers review their work, and those presenting have appreciated receiving immediate feedback.

Digital Performance Lab: the application of tablet technologies in the teaching of contemporary performance

By edwardwhite Comment Closed

Professor Lib Taylor, School of Arts and Communication Design
l.j.taylor@reading.ac.uk

Year of activity: 2012-13

Overview

DPLThe project explored how tablet technologies can be applied for teaching contemporary performance, through the creation of a Digital Performance Lab for use as part of the optional Part Three Contemporary Performance modules (FT3COA and FT3COB).

Objectives

  • Develop student employability and professionalism through creative research, group work and proficiency in digital media.
  • Encourage sophisticated student engagement with the creative industries’ use of digital media.
  • Enable students to explore issues of performance through practical, creative experimentation.
  • Provide students with the means to experiment in a creative way in the Contemporary Performance module, and in their individual research projects.
  • Set up a Digital Performance Lab for use as part of Part Three Contemporary Performance modules.

Context

The project to incorporate the use of tablet technologies into FT3COA and FT3COB grew out of a previous project which had experimented with the use of Bluetooth technologies. Much current experimental performance makes use of digital technologies, so it was imperative that students were provided with the opportunity to study this aspect of contemporary performance, and it was felt that the versatility of tablet technology would allow students to explore issues of performance through practical, creative experimentation.

Implementation

To aid in the set up of the Digital Performance Lab, Dr Lisa Purse, who has expertise in the use of digital technology, acted as an adviser on the project.

The Department acquired seven 32 GB iPads and covers.  These were loaded with a number of appropriate apps, which were added to over the course of the academic year as familiarity with what was available increased, with students also making suggestions for apps that they had found useful.  Several connectors were also acquired for projects to allow the screening of several images simultaneously.

To allow them to make best use of the technology, students were trained in the basic use of the equipment and the apps most appropriate to the early stage of the work.  Once trained, students were able to use the tablets for a number of module-related activities, including:

  • Collecting material for class workshops.
  • Filming and editing material for multimedia experimentation
  • Accessing performances available via digital technologies in class workshop to assist in the analysis of performance
  • Developing individual and small group presentations.
  • Recording performances in class.
  • Experimenting with ways that tablet technology might enhance the experience of a performance for the audience.
  • Developing methodologies to enhance the documentation of performances.

In order to encourage the use of the tablets, their use was incorporated into some student assessments:

  • In Autumn Term all students were required to participate in a group assessment in which at least one iPad was used.
  • In Autumn Term all students were required to collect gestures, sounds, and potential performance sites using the visual and sound facilities of the tablets.
  • In Autumn and Spring Terms all students were required to give a presentation on a defined topic using an iPad.
  • In Spring Term all students were required to complete an application for arts funding on their iPad.
  • In Summer Term students had the opportunity to make use of the tablets as they wished in their final performance assessments.

Impact

On the whole the project exceeded plans. The project objectives were achieved and the tablets became an integral part of most seminars and workshops as students became more adept in manipulating the resource. As students became more confident in the use of tablets, they were able to use the technology in a sophisticated way to support their work, experimenting with functionality and this being disseminated across the group.

Student attainment on the module was high, and the use of the Digital Performance Lab contributed to this. Presentations in seminars improved as students became more adept in their use of presentational tools. Documentation and analysis of work was improved by the opportunity to capture and record practice in development. The Lab enhanced student experimentation with the potential of the digital in performance, and enabled greater understanding of the theories and practices that are central to contemporary performance art.

Reflections

While it had been anticipated that the tablets would primarily be used for the Part Three Contemporary Performance modules, students also used tablets for the development of other areas of their study, in particular their Independent Projects.  Independent Project supervisors noted that students with access to this facility brought research for their performances to tutorials on their tablets which they could manipulate to demonstrate their ideas and plans in a very effective way.

The benefit of using tablet technology for the teaching and learning of Contemporary Performance was that it allowed students to get quick results: for eample, students found that they could create sound effects or add music for a performance piece in a matter of seconds. By opening up opportunities to students, tablet technologies enhanced their creativity.

Follow up

Since the conclusion of the project, the Digital Performance Lab has continued to be utilised for the delivery of the Contemporary Performance modules. Beyond the Contemporary Performance modules, tablet technology is now used across the Department of Film, Theatre and Television in a number of contexts, including use in interviews for prospective students, and in outreach events such as summer schools held within the Department. Student response to the use of tablet technology continues to be overwhelmingly positive.

Tablet technologies have also been used by students with Theatre Royal Stratford East’s Home Theatre project, in which University of Reading students work with artists from the Theatre Royal Stratford East to develop a show to be performed in the home of a London resident.

Embedding a virtual placement and professional mentoring in an MSc module to support student employability

By edwardwhite Comment Closed

Dr Sarah Cardey, School of Agriculture, Policy and Development
s.p.cardey@reading.ac.uk
Year(s) of case study activity: 2012-13

Overview

9397A virtual placement was created with the C4D Network, allowing student taking Communication for Innovation and Development within the Graduate School for International Development and Applied Economics (GIIDAE) to benefit from professional mentoring and networking, improving their employability as a direct result.

Objectives

  • Set up a placement opportunity for students taking Communication for Innovation and Development.
  • Enhance the employability of students after graduation through developing their skills.
  • Give students experience of networking with professionals in the field.

Context

Students on degrees within GIIDAE had asked for internships and opportunities to gain experience with development practice, which would in turn enhance their employability after graduation. While this was a goal shared by GIIDAE, the workload of students and logistical factors with regards development practice made it difficult to implement a physical placement scheme. As a result, a virtual placement and access to professional mentoring were sought as a practicable alternative.

Implementation

The C4D Network is a community of professionals working in the field of communication for development. Through the C4D Network a “virtual placement” was created, with a communication portal run out of Oxford, allowing students to collaborate on development projects and network with communication for development professionals.

Prior to the mentoring sessions, a focus group discussion was held with students to assess what they were hoping to get out of the mentoring sessions so these could be tailored to best meet student needs and expectations. In the sessions with Jackie Davies, the founder and Executive Director of the C4D Network, students were assisted with the creation of profiles on LinkedIn and the C4D Network, and also in tailoring CVs for certain roles or organisations, reflecting the needs students had oriented.

The students also attended a networking event, and were given specific tasks so that they were active participants in the event. Students were specifically introduced to people, giving them the opportunity to learn how to network and present themselves in a professional light.

The final activity was for students to create material that could be featured on the C4D Network website. Two creative pieces were set as assignments, with the idea being that once these had received feedback they would be revised to make the pieces suitable for online publication.

Impact

Student employability was definitely improved by the scheme, with many students having received employment in communication and development roles, and one student having been headhunted through the LinkedIn profile they created as a result of the scheme. Incorporating a professional mentoring and virtual placement scheme has allowed students to develop skills in areas which central to their finding employment beyond graduation.

Reflections

Students provided positive feedback on the scheme, and responded particularly well to the mentoring sessions. Beyond the direct benefits to students, the monitoring sessions were beneficial as they allowed skills that students developed in the classroom to be highlighted as skills that should be presented on their CVs, and also identified areas in which the curriculum could be enhanced in order to better develop these employability skills.

The networking event was valuable, as in feedback students expressed appreciation of the opportunity to meet people who worked in organisations in which they were interested. There was, however, a reticence among students to introduce themselves and make connections, and during the debrief session students reflected that it was difficult to network, and that they had missed good connections because of their reticence. While learning that they needed to be more proactive when networking was an important lesson for the students, this suggested that more networking support was required.

The creation of material to be featured on the C4D Network website was ultimately unsuccessful. The nature of the class makeup was such that students did not have experience of writing a blog post, and the final content of the assignments reflected this. Whilst, from an academic perspective, having students conduct an unfamiliar task was beneficial, for the goal of publishing material on the C4D Network website the assignments were of insufficient quality. With student workload within GIIDAE being high, it was not feasible to have students make necessary revisions while expecting them to complete other assignments. As a result, it would be necessary to make changes to this aspect of the scheme.

Follow up

The virtual placement and mentoring scheme has continued to be offered within GIIDAE. In addition to the virtual placement, there are now a number of physical placements in Oxford with the C4D Network available to students.

As a result of having run the scheme more than once, it has been possible to make changes to the curriculum to reflect student needs that were made apparent during the pilot year, and has brought forward the inclusion of material. To overcome student reticence, networking has become a more focal aspect of the curriculum, as has engagement with different forms of media, including social media.

Assessment on the course has been better adapted to the workload of the students. Rather than having students produce blog posts, students now produce a research paper, with the opportunity for developing this for external publication.

Running the scheme has made it more apparent which skills industry requires from University of Reading graduates in the field of international development. As a result, it has been possible to create workshops to improve these skills, and ensure that Communication for Innovation and Development remains a relevant and current degree programme.

A welcome website for the newborn National Network of Teaching-Focussed Academics by Rita Balestrini and Chiara Cirillo

By edwardwhite Comment Closed

The Teaching-Focussed Academic Staff Network, whose inaugural conference was hosted by the University of Durham on 16th and 17th July, now has a dedicated website.

When we read the call for papers of the conference, entitled ‘Enhancing Student Learning Through Innovative Scholarship’, we realised that besides providing an opportunity to share innovative scholarly activities across disciplines for the enhancement of student learning, the conference also intended to address the issue of the career progression of staff on teaching-focussed contracts. Quoting a study by the Higher Education Statistics Agency, the call for papers drew attention to the ‘predominance of teaching-only contracts among part-time academics’ and the existing ‘gap between policy and implementation regarding promotion policies’ in UK universities. It also stressed the importance of raising the profile of teaching-focussed academics in order to enhance teaching and the scholarship of L&T across the HE sector.

In recent years, contributing to raising the profile of language L&T at the University of Reading  has been one of our objectives and, together with colleagues of the Department of Modern Languages and European Studies (MLES) and of the International Study and Language Institute (ISLI), we pursued this aim in various ways. For this reason, we decided to participate in the conference and give a presentation on the place that the scholarship of language L&T can have, and should have, in British universities. We addressed some issues specific to the tradition of languages as a university subject which hinder the scholarship of language L&T, and affect the academic identity and career development of language professionals on teaching-focussed contracts. We talked about the organisation of the discipline around  binary divisions such as ‘language’ and ‘content’, ‘language skills’ and ‘cultural knowledge’;  we illustrated the multifaceted nature of language teaching and the theoretical and practical competence it requires. We ended our presentation by pointing out the lower status and casualisation of language teachers in higher education as acknowledged and lamented by several authors (Coleman, 1999; Gieve and Cunico, 2012; Klapper, 2005; Quist, 2000; Worton, 2009), but we also highlighted the beginnings of some positive changes.

In general, from the plenary talks and the sessions we attended (‘Embedding and Enhancing Scholarship’, and ‘Career Pathways for Teaching Focused Academic Staff’), it emerged that there is still a way to go to transform the current hierarchy between teaching and research into a balanced relationship, although some progress has been made. The teaching-only academic role, in fact, seems to be still characterised by a lower status, a high degree of casualisation, and a gender imbalance (with more women in teaching-focussed roles, compared to teaching and research roles and more women on the low grades of the teaching-focussed roles).  It has been stressed that fellowships and awards are not sufficient recognition in themselves, and that a better way to enhance teaching in HE is to create a credible career path based on promotion criteria which actually reward excellence in teaching.  The lack of transparent criteria for progression seemed to be a common issue, and the need for a review of teaching roles undertaken by a national body was highlighted.

In our view, one of the most thought-provoking aspects of the talks we attended was the reflection on the necessity of a reconceptualisation of teaching and research in relation to each other which goes beyond the current perceived hierarchy. The idea of a learning culture in which the student researcher and the learning teacher are both submerged was offered as a possibility, together with the notion of ‘research’ as part of a wider concept of ‘scholarship’. The need for a re-imagined academic role appeared as a running thread in many presentations. In this sense, important innovations mentioned at the conference were the introduction of a ‘Study leave’ and a ‘Personal Scholarship Plan review’ for teaching-focussed academics already embraced by some enlightened institutions.

As was noted, ‘faculty-based cultures’ differ slightly. It seems, for example, that among STEM disciplines, the role of the teaching-focussed academic is more established.  There seems to be a higher awareness of the value of the scholarship of L&T and, in some cases, career progression is more likely to occur. For example, at one Scottish university, Teaching Fellows recruited by the School of Biology are now attaining senior positions not just at School, but also at Faculty and University level. In general, across the sector, the support of PVCs and senior managers and the creation of local networks of teaching-focussed academics have proved to be enabling factors for the recognition of the scholarship of L&T and for the establishment of a successful promotion culture.

Where do we stand at the UoR? Does our research-intensive University promote and support the scholarship of L&T and parity of esteem and opportunities for the staff delivering teaching excellence?  The current University Learning and Teaching Strategy suggests a positive answer, with ‘scholarship’ and ‘staff recognition’ stressed as a key priority.

It is also encouraging to see an active and growing Community of Practice of University Teaching Fellows (UTF), ‘teaching enthusiasts who are not only committed to teaching innovation and excellence, but to continuing professional development of themselves and their colleagues’ (see ‘University Teaching Fellows – A Growing Community‘ blog)

The University clearly recognises and rewards staff for their outstanding contributions to L&T through a number of schemes. However, in our view, even more could be done. For example, the career progression of Teaching Fellows could be better supported. At the moment, in the University Framework of Academic and Research (A&R) Role Profiles, * Teaching Fellows are placed on grade 6 regardless of their academic background and level of expertise. They are included in the A&R job family for illustrative purposes, but this does not make them ‘academics’. The ‘proper’ academic role profiles start at grade 7 and include both T&R activities, while the profile for grade 6 is split into Research Fellow and Teaching Fellow roles. Rather than delving here into the implications of this approach with regard to career progression of Teaching and Research Fellows, we refer to two documents. The first is a recent report of the HEA, ‘Rebalancing promotion in the HE sector: is teaching excellence being rewarded?’, which critically analyses promotion policies in British universities; and the second is the ‘National Library of Academic Role Profiles’, set up by the Universities and Colleges Employers Association (UCEA) – of which the UoR is a member – that outlines  five levels for the teaching-only career path**.

We wonder if, at the UoR, alongside a Community of Practice of University Teaching Fellows (UTF), there might also be the need for a similar – informal, loosely structured – yet wider and open network of colleagues with teaching-focussed roles interested in not only enhancing student learning through excellent teaching and sharing of good practice, but also in discussing and developing the concept and the practice of ‘scholarship’, including its operationalisation and recognition, and the role of teaching-focussed academics at the UoR. This local network could link up with the wider national network that has emerged from the Durham conference and would naturally be an interlocutor for those engaged with L&T at strategic and operational level. We trust that our initiative would receive support from our senior colleagues, as this would be a further demonstration of the University’s commitment to L&T.

To learn more about the Teaching-Focussed Academic Staff Network, visit:  http://community.dur.ac.uk/teachingfellow.network/

If you are interested in joining a Teaching-Focussed Academic Network at Reading, contact: r.balestrini@reading.ac.uk or c.cirillo@reading.ac.uk

 

* These role profiles were created by the UoR in 2014.

** The ‘National Library of Academic Role Profiles is part of the 2006 Framework  Agreement for the Modernisation of Pay Structures, agreed by the Association of Universities and Colleges Employers, and Associations of Universities and Colleges Unions.

Incorporating research seminar series into teaching and learning

By edwardwhite Comment Closed

Dr Louise Johnson, School of Biological Sciences
l.j.johnson@reading.ac.uk

Overview

4258In the School of Biological Studies a module, Seminars in Biology (BI3S78) was created, utilising the existing research seminar series within the School to structure assessment. The module is easily adaptable for other subject areas, and has proved very popular with students, and has aided in their development of academic and personal skills.

Objectives

  • Better utilise the School’s existing research seminar series.
  • Develop a number of students’ skills, including report writing, writing for different audiences, experimental design, literature searching, and referencing.

Context

The School of Biological Sciences had long held research seminars, with speakers conducting innovative research in the biological sciences being invited to deliver a seminar on their research. Despite these research seminars being an available resource for students to engage with new research in their field of study, and advertisement of the seminars within the school, attendance was disappointing, with many students failing to utilise such a valuable resource. Within the School of Chemistry, Pharmacy, and Food a Part Four module, Current Topics in Chemical Research, exists, having students attend research seminars and creating assessed reports upon these. This provided the inspiration for the creation of a similar module in the School of Biological Sciences.

Implementation

The School holds around 20 research seminars a year on current research in life sciences. On each seminar attended, students complete a Seminar Report Form with a summary of the seminar topic, three things they learned from the seminar, a comment on the quantitative methods used, references (one scientific review article and two primary research papers) for someone who wished to research the topic, and their justification for these sources. This ensures not only that students attend the research seminars, but also actively engage in note-taking during the seminar. Commenting on the quantitative methods used by the seminar speaker encourages students to reflect upon their own use of quantitative methods. By providing references for someone else to research the topic, students develop their skills in referencing and literature searching. The reports are marked on a pass/fail basis, and students must have achieved passes on at least 10 reports. This forms 20% of the module grade.

At the beginning of the module, students take an online test on statistics and experimental design, in order to develop their understanding of these subjects, as well as to highlight common mistakes. The test constitutes 10% of the module grade.

The first written assignment is to write a summary paragraph of between 200 and 300 words on a seminar, suitable for publication in the scientific journal Nature. The marking criteria for this are based upon the publication guidelines of Nature, as well as the usual University marking criteria. This develops the ability to convey the importance and context of research findings. This assignment constitutes 15% of the module grade.

The second written assignment is a 1500 word critical analysis of research presented in a seminar. This assignment encourages students to engage with the ideas, evidence and techniques presented in a chosen seminar. Students consider the strengths and weaknesses of the research, and suggest ways in which the research might be improved. This assignment constitutes 40% of the module grade. Students are not permitted to write their critical analysis on the research seminar on which they wrote their summary paragraph.

The final assignment is to write a 500 word news article suitable for inclusion in a popular science publication, for an audience of non-specialists, on one of the seminars. As with the critical analysis, students are not permitted to write their article on either research seminar on which they completed their summary paragraph or critical analysis. This assignment provides students with experience of writing for a non-specialist audience, promoting clarity of expression and an ability to select what areas of research will be of appeal to a broad audience.

Impact

Student feedback, both formal and informal, has demonstrated that the module is very popular. Students have reported that the assignments helped them develop skills that they were able to use in other areas of their study, and students have referenced the seminars in their examinations, suggesting that they engage well with the module and the seminar topics. Students make special reference to how attending the seminar series have helped them refine their own interests within life sciences, and some students have actually found PhD places as a result of their attendance of research seminars.

Reflections

Students find the module challenging, because it draws upon different skills to other modules within the School. Having students operate outside their academic comfort zone, however, is a valuable learning exercise, and there has been no desire to alter the course to any great extent, as student feedback does not justify this.

The greatest challenge involved in running this module is the varied topics upon which seminars may be held, as this requires markers of the reports to be specialists within the area. With the popularity of the module resulting in large student numbers, this can create a large workload for markers.

There is great value in running this module, as it develops a number of skills in students, including report writing, statistics, referencing, literature searching, writing for different audiences, and experimental design.

‘What did I do wrong?’ Supporting independent learning practices to avoid plagiarism

By edwardwhite Comment Closed

Helen Hathaway, Library; Clare Nukui, International Foundation Programme; Dr Kim Shahabudin, Study Advice; Dr Elisabeth Wilding, International Study and Language Institute
h.m.hathaway@reading.ac.uk
Year of activity: 2012-13

Overview

8905The development of an Academic Integrity Toolkit for academic tutors to draw on, which collated evaluated teaching and support resources for supporting the development of independent learning practices necessary to avoid plagiarism, and offered guidance for adapting and using them in subject teaching.

Objectives

  • To conduct research into current practices and needs for supporting the development of independent learning practices.
  • To develop a toolkit to provide academic tutors with resources for developing independent learning practices necessary to avoid plagiarism.

Context

The fundamental academic principles of independent critical thinking, supported by appropriate and properly cited evidence from evaluated sources, lie at the heart of Higher Education in the UK. A proper understanding of these principles and the independent learning practices needed to achieve them is especially crucial in avoiding unintentional plagiarism. Despite the availability of a range of advice, both internal and external to the University of Reading, students continually stated that they did not know when and how to use citations, or how to avoid unintentional plagiarism. Beyond simply learning the mechanisms of setting out a bibliography or when to include a citation, students need to understand associated practices, such as where to find appropriate sources of information in their subject, how to keep proper records, and how, when, and why to use references in their academic work.

Implementation

Data was collected from a variety of sources on current practices and perceived needs to inform the production of the toolkit. Team members were able to draw upon their professional communities for information about practices at other institutions, and on contacts at the University of Reading for practices and perceived needs. A research officer was appointed, and was tasked with collecting further data from academic tutors and students in a number of selected departments at the University, using semi-structured interviews and focus groups. These were set against the wider context of general observations gathered through separate online surveys offered to all staff and students. Existing pedagogical research into student referencing practices was also considered.

The research questions during this stage of inquiry were:

  • What are the main (perceived and actual) difficulties that students have with understanding referencing and avoiding plagiarism?
  • How do associated independent learning practices impact on this?
  • Why do students fail to engage with current teaching and guidance on referencing?
  • What teaching resources are currently available (at the University of Reading and elsewhere), and how might they be made more effective for teaching staff and students across the University?

The research was used to inform the content and production of the Academic Integrity Toolkit materials. These were generated by team members using a template, before going through an iterative process of revision and evaluation by other team members.  They were then edited by a single team member to ensure consistency.

Impact

The Academic Integrity Toolkit was successfully launched in June 2013 at an event attended by over 50 members of staff, with a visiting speaker presenting on the topic of student referencing practices. The Toolkit comprises:

    • 17 handouts giving guidance on key learning practices;
    • 8 exercise sheets with answers;
    • 13 sets of PowerPoint slides for use in teaching;
    • Links to screencasts produced by members of the Study Advice team;
    • An annotated list of useful websites.

The Academic Integrity Toolkit has been made available through the Blackboard Virtual Learning Environment, onto which staff can self-enrol. A paper version contained in a card folder was created for attendees at the launch event and to disseminate to key members of the teaching and learning community at the University of Reading.

The Toolkit has been a successful and well-used teaching resource. Departments and Schools have requested that their entire teaching staff get enrolled to the Toolkit through Blackboard. It was favourably received by the University Board of Teaching and Learning and the Sub-Committee for the Development and Enhancement of Teaching and Learning, with suggestions being made for its further development through a student-facing version in digital format.

There has been interest, both at the University of Reading and beyond, in the results of the project. Presentations were given at the Librarians’ Information Literacy Annual Conference, the Association for Learning Development in Higher Education conference, and the Association of Librarians and Information Professionals in the Social Sciences summer conference.

Reflections

While the project was successful, it was not without its difficulties. Difficulty was experienced with data collection at the University, particularly in recruiting students for focus groups, which may have been an unavoidable consequence of the necessary timing. Despite this difficulty, however, the data obtained by the focus groups that did run was supplemented by a good response to the wider University-wide survey, and by reported data from academic and support staff through their direct contact with students.

Another difficulty faced was the existing busy workloads of the team members. This was overcome by scheduling brief face-to-face lunchtime meetings once a month, and by setting up a wiki (using PBworks) to allow collation of data and joint working on documents, in addition to regular email communications. Despite the potential for difficulties caused by the project being a collaboration between the Library, International Study and Language Institute and Study Advice, the combined expertise and experience of team members proved particularly valuable, especially as it allowed the project to make use of team members’ involvement with various professional networks, and it was found to be very advantageous to have the different perspectives that were able to be provided by having a diverse team.

Follow up

It is planned that the resources developed through the project be adapted to be an Open Educational Resource, to allow them to be more widely shared for use in UK and global Higher Education teaching.

Guides to citing and avoiding plagiarism available on the Library website have been informed by the results of the project and updated appropriately.

It is hoped that more extensive resources will be developed, and that these will be mediated by members of staff.

As a result of the experience of collaborative working between different areas of the University, Helen Hathaway and Kim Shahabudin have had a chapter entitled ‘Terms of reference: working together to develop student citation practices’ accepted for publication within a forthcoming edited volume.

Links

Whiteknights biodiversity monitoring: building an app to collate long-term monitoring data of campus wildlife

By edwardwhite Comment Closed

Dr. Alice Mauchline, School of Agriculture, Policy and Development; Dr Alastair Culham, School of Biological Sciences; Dr Karsten Lundqvist, School of Systems Engineering; Professor Alison Black, School of Arts and Communication Design; Dr Hazel McGoff, School of Archaeology, Geography and Environmental Science
a.l.mauchline@reading.ac.uk

Year of activity: 2013-14

Overview
KiteSite
A mobile app was developed for the collection of field data, supporting the activities of the Whiteknights Biodiversity Blog, and providing a central database for students and staff to monitor long-term changes in the local environment on the University of Reading’s Whiteknights campus.

Objectives

  • To develop an app, suitable for use with Android and iOS devices, that was user friendly and had strong branding and identity.
  • To build a community of users for the app that would utilise and enjoy the app for biodiversity monitoring objectives.
  • To create the app as a tool that would support the teaching of biodiversity in a range of modules across several schools.
  • To create an app that could support the work of the Whiteknights Biodiversity Blog in monitoring long-term changes in the local environment of Whiteknights campus, including the University of Reading Phenological Monitoring Network (UoRPMN).

Context

The project to develop the app, which was named KiteSite, grew from Dr Mauchline’s involvement in Enhancing Fieldwork Learning, a Higher Education Academy funded project that sought to promote the use of technology in order to improve student learning in the conduct of fieldwork.

The need for the app grew out of the success of the Whiteknights Biodiversity blog. Since being established in June 2011, the blog generated increasing interest, and coordinated multiple records on biodiversity, including a growing phonological dataset, the UoRPMN. The app was conceived of as a field recording tool that would support the work of the blog in monitoring long-term changes in the local environment of Whiteknights campus. Crowd-sourcing data in the manner that such an app would allow will provide researchers with access to data on more species, over a greater area and period of time, than they may be able to collect themselves.

Implementation

First, a scoping study and literature review were conducted in order to identify existing apps, software and online resources that could be utilised.  Concurrently, six student champions, drawn from five schools across the University, interviewed staff members within their schools in order to establish the teaching needs that could be met by the development of the app.

As a result of these findings, a ‘HackDay’ event was held in December 2013 in order to decide upon the requirements for the basic functions of the app.  EpiCollect was chosen as an open source, generic, data collection tool that could be modified but already provided the functionality of sending geotagged data forms and photos to a central project website from mobile devices. The student champions modified EpiCollect to produce a prototype app, which was then tested by user-groups and refined by agile development.

In order to test the app, a mock species identification session was run, followed by field data collection using the app.  This and further data collection and feedback allowed the app to be refined and the database to be developed and enhanced.

In anticipation of the launch of the app, which was named KiteSite, a website and social media profile were set up, while promotional materials were printed and disseminated.

Ultimately the app was launched in June 2014, and a launch event was held, attracting a number of teaching and learning staff who expressed interest in using the app in their teaching and learning.

KS thumbnail

Impact

The project successfully created the KiteSite app that is currently being used by a small community for the monitoring of biodiversity on the University of Reading’s Whiteknights campus, and supporting the University of Reading Phenological Monitoring Network dataset.

Reflection

Those involved in the project felt that they benefited from working as part of a multi-disciplinary team, as they developed their skills in effective communication and learnt to avoid the use of subject specific jargon.  Given that team members also had other commitments besides the project, it was sometimes difficult for them to balance their workload.

While it was not possible to create a dedicated iOS app, as had originally been planned, a functioning equivalent within the existing EpiCollect app that operates on iOS was created.

The appointment of student champions was valuable, as by having the project led by the principle end-users, they were provided with the opportunity to shape how the final project could be used and developed most effectively for their needs. The student champions took the lead on developing the website for the app, and one of the student champions drafted the reflective paper that was then published in the Journal of Educational Innovation, Partnership and Change.

Follow up

The project team continue to seek further uses for the KiteSite app. While it is used in teaching, the current objective is to engage with student societies that might make use of the app, such as BirdSoc, an ornithology student society.

Other universities have expressed interest in the project, and are looking to set up similar resources mirroring KiteSite.

Links

From a traditional classroom to a flipped classroom

By edwardwhite Comment Closed

Dr Karsten O. Lundqvist, School of Systems Engineering
k.o.lundqvist@reading.ac.uk
Year(s) of activity: 2013-14

Overview

6477A flipped classroom approach was trialed for the Part Two Java module (SE2JA11) taught in the School of Systems Engineering. 

Objectives

  • Encourage students on the module to become deep-level learners, as they analyse, evaluate and create, rather than simply remembering and understanding.
  • Introduce a flexible teaching and learning style that students will find enjoyable.
  • Introduce flexibility that allows students to manage their time in a better way, giving them more opportunities to study the materials in a deeper manner.
  • Improve attendance and engagement with practicals.

Implementation

In the summer of 2013 videos were created for the module.  New slides to present the content were designed, with the fonts improved to make them easier to read on a computer screen.  While the content was based on that of the old slides that were available to students, practical screencasts were introduced in the video, whereby the students can see how the code behaves and how they are supposed to develop it practically.  Some slides were altered so that they presented difficult concepts in more easily understood ways, such as through use of analogies to the restaurant business and the automobile industry.

Feedback and feedforward videos were introduced to explain the progress through the course.  One of the feedforward videos was used to make the students aware of the object-orient programming (OOP) nature of the code, and that the weekly practicals would be building upon previous material.  Students were told that they could use the weekly practicals as a gauge to measure if they had problems with OOP, and should ask the teaching staff for help.

The videos were created using Camtasia, an tool for creating videos and screencasts from webcams and computer screens.  The software suite also has simple post-production tools, which allowed zooming to ensure that the small text of development environments could be viewed easily.  These videos were then embedded as items on the Blackboard Virtual Learning Environment.  Uploading the videos to a streaming service external to the University was considered, but was decided against in order to create a classroom feeling to the videos.

The flipped classroom method generally recommends that videos be simply bite-sized chunks of around 4 to 6 minutes long.  Several of the videos created for the module, however, were over 1 hour long, as a result of the amount of material that needed too be covered, the adherence to the lecturing paradigm, and the lack of time available to transform the material as much as would have been necessary in order to make 6 to 20 minute videos.

Impact

To obtain feedback from the students, two voluntary bespoke surveys were shared with the students, one available in weeks 2-3 of the Autumn Term, and one available in week 1 of the Spring Term. The first survey showed that 84% of students preferred videos over lectures, and that only 4% of students did not expect to watch the videos more than once. In the second survey, 100% of students now preferred videos to lectures, and 100% expected to watch the videos more than once.

Reflections

Flipping the classroom has been of great benefit. As the act of flipping cannot just be a case of replicating old teaching methods digitally, it promotes reflection on course content and teaching methods, and requires thorough planning. The initial investment pays off in the long term as the teaching materials produced can be reused, not only from year to year, but between different modules that have some overlapping content. While the creation of teaching materials may consume more time than the traditional delivery of content, it is flexible as it can be done when time allows, and does not require being present at an appointed time and location.

Despite concerns about the length of the videos, on the whole students expressed satisfaction about this.  The general response was that students expected the videos to be long, as they were replacing 2 hour lectures, and therefore students would feel cheated if the videos were not long and with a lot of content.  While it was agreed that students might benefit from having chapters within the videos to make them easier to search, none wanted the videos to be shorter.

In order to improve how the module is taught using the flipped classroom model in the future, the following recommendations were made:

  • Include a more self-regulated learning approach to the coursework, allowing students more flexibility over the weeks, and removing some of the summative pressures that might induce surface-level learning.
  • Change the module so that 100% of assessment is carried out through coursework. This should make students focus more on the practical work throughout the year, and help them focus more on the relevant material and learning it in a deeper way.
  • Introduce a level of self-regulated learning to the practicals, by introducing a logbook instead of weekly sign-off sheets. Students will need a number of signatures in their logbook to get 10% of their practical marks. The signatures will be given after a short formative discussion of progress provifnng useful feedback and suggestions of further work.

Follow up

The flipped classroom approach continues to be used for the teaching of SE2JA11, and has now been introduced for other modules within the School of Systems Engineering. In particular, videos on general coding theory are able to be utilised within many modules. Dr Lundqvist was able to draw upon the experience of flipping the classroom when creating the Open Online Course Begin Programming: Build Your First Mobile Game.

The recommendations generated by the pilot year have been carried out, with the exception of the introduction of a logbook, which proved impractical. While students still complete weekly sign-off sheets, the sheets are now 50% questions on the video, to ensure that students have viewed the videos and retained the information, and 50% questions on progress in their own learning, with the intention that students will reflect upon their own learning, and staff will be aware of students who are having difficulties.