Constructing research methods and statistics teaching

By edwardwhite Comment Closed

Dr Lotte Meteyard, School of Psychology and Clinical Language Sciences
l.meteyard@reading.ac.uk

Overview

Statistics teaching to Speech and Language Therapists within the Department of Clinical Language Sciences was redesigned in response to module evaluations. Whereas students had previously reported anxiety about statistics and struggled to appreciate the relevance of statistics to their practice, the introduction of formative learning activities which integrated statistics teaching with other module content produced a reduction in anxiety about statistics, a benefit to students’ grades, and an increase in student module satisfaction with their statistics training.

Objectives

  • Increase the opportunities for students to consolidate and revisit knowledge of key concepts.
  • Make explicit links within and across the teaching content to clinical practice.
  • Provide learning activities, outcomes and objectives that are clear to students.

Context

The Research Proposal (PL3RPR) module is compulsory for all Part Three undergraduate and taught postgraduate students within the Department of Clinical Language Sciences. The module provides research methods and statistics teaching, and during the module students plan a research module and complete an ethics application, with these being used for their dissertations. Feedback, however, revealed that students found the statistics lectures confusing and poorly related to other module content. Having teaching provided by a number of staff members contributed to the module having a fragmentary nature.

Implementation

In order to increase the opportunities for students to consolidate and revisit knowledge of key concepts, technology, multiple practice and collaboration were focused on in order to create frequent, meaningful activities for students to complete. Lecture handouts were provided separate from the lecture slides in order to encourage engagement during lectures, and practical activities were used to teach basic quantitative concepts and research design. During activities, analyses of data was completed as a class, and formative exercises were set each week, involving a short reading and answering focused questions on that reading. These assessments were revisited at the start of each lecture in order to feedback and discuss answers to questions. In labs, written instructions were replaced with short videos demonstrating how to complete particular procedures. Worksheets required students to write out results and answer questions about the interpretation of data. The answers to these worksheets were made available on Blackboard Learn after the end of each lab class. For each week of statistics teaching an online multiple choice questionnaire was provided, offering students optional online practice in preparation for the statistics class test. Students were encouraged to have the statistical analysis software PASW or SPSS installed on their home devices to allow them to practice away from lectures.

To make explicit links within and across the teaching content and to clinical practice, the content of the module was restructured so that students were introduced to a particular concept, with this concept then being revisited in later activities. In order to build explicit links with clinical practice students were asked to identify why research skills are important for clinical work, to complete formative assessments that involved reading chapters on healthcare research or journal articles from speech therapy research. Key readings were taken from ‘real world’ sources, such as the magazine of the Royal College of Speech and Language Therapy or the NHS. Reflection was encouraged through formative assignments which were discussed in the following week’s lecture. These required student to identify why healthcare research is critical to practice, critique a randomised controlled trial, and identify research designs and statistical tests in clinically relevant journal articles.

To provide learning activities, outcomes and assessment tasks that are aligned and clear to students, the learning outcomes of the module were rewritten and linked directly to the summative assessments. Three summative assessments were themselves changed so that students prepared a research proposal poster, an ethics application and a statistics class test. The research proposal poster was introduced to give practice at a professional skill and reduce the duplication of content between making the proposal and the ethics application. By making the ethics application a summative assessment, students would be assessed on something directly relevant to the completion of their project, while only minimal staff input would be required for the document to be submitted to the School ethics committee. The weighting of each piece of assessment was changed so that they contributed more evenly to the overall module mark. Learning activities were designed to support students in accessing and evaluating literature, generating research designs and statistical analyses. By providing research proposal and ethics application examples, and templates for their own on Blackboard Learn alongside detailed guidelines for completing coursework, student were encouraged to seek out supporting material independently.

Impact

Students on the module completed a statistical knowledge multiple choice questionnaire during the first week of the module and again after completing their statistics class test. They also completed the Statistical Anxiety Scale before beginning the module, and again at the end of the module. Results demonstrated that statistical knowledge increased, with students’ median score going from 11/20 before the course (with a range between 5-14) to 15/20 after the course (with a range between 8 and 19). There was also a reduction in anxiety about statistics. Results also demonstrated that there was a significant positive correlation between the number of formative multiple choice questionnaires a student completed and their final score on the statistics class test. Median marks in the class test and research proposal both improved from the previous year, with no students failing the statistics class test. Student module satisfaction also increased.

Reflections

Situating the statistics and research methods teaching in practical activities and in the context of students’ professional learning was one of the most powerful changes made to the module: students responded positively to practical activities used to demonstrate statistical concepts. While full participation could not be guaranteed, enough students completed tasks to allow discussion and review of these at the beginning of each lecture.

By using technology for students to practice skills away from the classroom, students were able to increase their knowledge of statistics after the course. It was particularly gratifying to see the correlation between the number of multiple choice questionnaires completed on Blackboard Learn and the attainment of students during the statistics class test.

Having resources external to the classes available, the module convenor could be assured that students could have sufficient time and experience with concepts and software.

Take-home exam

By edwardwhite Comment Closed

Stuart Lakin, Law
s.j.lakin@reading.ac.uk

Overview

In a Part Two Law module, Public Law (LW2PL2), we have moved away from the conventional exam to a take-home exam. We publish the exam paper on Blackboard at an arranged date and time. We give the students approximately 48 hours to complete and submit their answers electronically.

The impact has been entirely positive as compared to the old exam approach. Students prefer this format. The quality of their answers is markedly better. The results are better, and are consistently among the highest of all Part Two modules.

Objectives

  • To ensure that work produced in the exams is presented to a professional standard.
  • To allow students the opportunity to provide greater intellectual depth in their answers, and allowing the ability for independent research to form part of the assessment.
  • To have students demonstrate time management, in order to allow them to effectively complete their take-home exam while revising for their other examinations.

Context

We had three reasons for undertaking the activity:

First, we reasoned that LW2PL2 was better suited, pedagogically speaking, to the new format. The subject-matter is theoretical, and we assess by essay only (as opposed to by problem questions). We look for deep understanding of the issues rather than an ability mechanically to apply memorised rules. The take-home format encourages an independent research mindset.

Secondly, we thought it valuable to provide some variety in the way that Part Two students are assessed. The assessment across the Part Two modules had hitherto been by conventional exam only. Whatever the merits and demerits of the traditional exam, it can be refreshing for students to experience some other form of assessment.

Thirdly, we responded to the University call for alternative assessment. On pragmatic grounds, the take-home exam frees up room space and reduces complex timetabling requirements.

Implementation

We prepared the first cohort of students by giving them a mock take-home exam in lieu of their usual non-assessed essay. We asked them to prepare an answer to a question as if they were preparing for the exam itself. We have continued this practice ever since.

In addition, I prepared a detailed explanation of our rationales and expectations for the take-home exam, and provided this to the students. This document exists to inform students of the benefits and the opportunities provided by the format, and also ensures that they fully appreciate the assessment criteria of the format. I talk through this document with the students throughout the year.

Impact

In short, the activity has been highly successful. I believe that colleagues are considering this format for their own modules. By having students word process their exam answers, a lot of the recognised disadvantages of handwritten answers (handwriting often being slow and uncomfortable, and producing results that are messy and poorly legible, as well as the anxiety caused by these disadvantages) can be avoided. It is also easier for students to structure their essays.

By having the take-home exam scheduled during the University exam period, it is important that students manage their time effectively in completing the exam. Students are made aware that the assumption when marking is that they will have spent approximately two hours answering each question: this allows them more time than a conventional exam, but also allows time for students to make space for other commitments they might have, such as revision for other exams.

Above all, we have found that the format is a better way of encouraging scholarly engagement with the module content. We emphasise in our rationales/expectations document that the format has an element of independent research.

The level of success of the activity was unexpected. The first cohort of students to do the take-home exam were nervous and rather distrustful of the activity. Happily, they passed their positive experience down to the next year’s cohort, and that pattern has continued ever since.

Reflections

In my view, the take-home exam format treats students as independent thinkers in a way that the conventional exam does not. The emphasis is on the quality of argument and research rather than on memory skills and the ability to perform under pressure. Having said that, the new format does not entirely dispense with the latter types of skills – there is still a deadline, and students will still need to revise in advance.

There were admittedly risks involved in introducing this new format. LW2PL2 is an extremely important, compulsory module which counts towards the final degree. With hindsight, it may have been more prudent to experiment with this format in a Part One module. On the other hand, we put a great deal of thought into the format, and communicated well with the students. In these respects, we minimised the risks.

Follow up

The activity has remained largely the same as it began. We have experimented with changing the publication and submission times for the exam. We originally published the exam at midnight. This led to many students staying up all night to work on the paper. We now publish the exam at 9 am.

Final Year Group Based Research Projects

By edwardwhite Comment Closed

Professor Elizabeth Page and Dr Philippa Cranwell, Chemistry, Food and Pharmacy
e.m.page@reading.ac.uk
Year of activity: 2015-16

Overview

Group-based research projects have been introduced into the BSc Chemistry programme for final year students. Small teams of students investigate different aspects of a research problem, each working on a separate strand. The results are combined and overall conclusions drawn. The team-based approach more closely resembles the nature of research in the chemical industry. The approach can be translated to many other disciplines.

Objectives

  • To provide final year students with the opportunity for open-ended investigative laboratory research.
  • To work as a team to plan and design a suitable approach and experiments to explore the problem.
  • To carry out original research and collate and analyse results.
  • To draw conclusions and present the results both orally and as a dissertation.
  • To develop a variety of key transferable skills required for the workplace.

Context

All accredited Chemistry programmes must contain individual independent investigative work, historically in the form of a final-year research project. Since the rapid expansion of chemistry undergraduate numbers, many departments have moved from laboratory-based projects to literature reviews or short, open-ended practical work. Group projects provide an alternative approach where undergraduates carry out a worthwhile chemical investigation, with the potential of yielding useful results within the restricted time, and with the limited resources available.

Implementation

A Teaching and Learning Development Fund (TLDF) Grant in 2015 allowed us to appoint two undergraduate students to investigate some potential ideas for research projects over the summer of 2015. The students carried out initial trials into a series of research topics in the broad areas of inorganic, organic, physical and analytical chemistry. On the basis of these preliminary investigations a short briefing sheet was drawn up for each research question, to be used as a starting point for the teams.

Final year students on the BSc Chemistry and BSc Applied Chemistry (NUIST) programmes were invited to select areas of preference in chemistry for their final year project. Students were organised into teams of 3-5 students on the basis of project preferences and undertook two short (five week) projects, the first of which acted as a trial run to allow students to become familiar with an independent research environment. Each team was allocated an academic supervisor to whom they reported their results weekly. During the final week of each project team members discussed their results and prepared a presentation. Students were given feedback on the first presentation to help inform the second. The second project was written as a formal report, with each student writing up their individual investigations and the whole team contributing to the introduction and final discussions and conclusion.

Students were assessed on the basis of their individual laboratory notebook, their oral presentation and project report. They were asked to evaluate their peers’ contributions under a variety of categories to produce a factor which could be used to scale any group component marks.

Impact

In 2015-2016 a total of 12 team-based projects were carried out in 4 different research areas. As the topics were re-visited (i.e. the same topic used more than once), the second group of students were able to carry on the investigation from where the first group finished.

All projects were successful in producing results that the students were able to analyse and discuss. The value of the results to the research question varied significantly with the team and the nature of the project. Students were not penalised if they worked in a project area that did not easily yield positive results: they were advised that their grades depended upon their input into the project and their oral and written communication skills in presenting the project. In the majority of cases the teams worked well to plan and execute experiments that led to conclusive results.

Although the numbers were relatively small in 2015-2016, the team-based approach reduced academic supervision and training time, as one staff member could supervise a team of students. More results were obtained from the team-based approach than when students worked independently. The research questions had to be selected carefully and some preliminary work done, but despite this some of the projects yielded new results that are publishable. Students improved their team working skills significantly and have ample experiences to discuss at interviews.

Reflections

The success of each group project depended to a large extent on the individual supervisor and the group dynamics. Ownership of the project by the supervisor led to more successful outcomes and better group dynamics. It was observed that groups of 4 students seemed to work better than 3 or 5, as research problems often break down to comparing A against B, and therefore workload could be more easily divided. Interestingly, students requested one long project in future rather than two short ones because they felt that with a long project they could really make a meaningful impact with their work.

As the project reports were to be submitted shortly before the exam period, some students were anxious to complete their contributions in good time and found it difficult to work with their peers who had a more relaxed approach. Because of the high weighting (40 credits) on the project, we will require individual project reports in future. In addition, combined group reports were difficult to assess fairly, even with peer evaluation.

Links

The work was presented at the 2nd Enhancing Student Learning Through Innovative Scholarship Conference meeting in June 2016.

Legal Seagulls : Experience Plan for overseas students

By edwardwhite Comment Closed

Shweta Band, Law
s.band@reading.ac.uk
Year of activity: 2015-16

Overview

The name ‘Legal Seagulls’ represents all overseas students in the School of Law. I initiated the Legal Seagulls Experience Plan in 2015-16 as a three-step support initiative to enhance the academic and university-life experience for our overseas students.

This includes the Pre-arrival Academic Welcome Kit (PAWK), on-arrival Academic Bridging Course Induction Programme and weekly in-sessional support sessions in the form of GOALLS (Global Outlook Activities and Learning for Legal Seagulls)

Objectives

  • To model an experience initiative for overseas students as a symbol of real academic and social integration.
  • To develop, deliver and evaluate a structured and continual pre-arrival and in-sessional mechanism.
  • To provide a comprehensive academic transition information at the pre-arrival stage in an endeavour to bridge the gap between the home and overseas legal academic environments.
  • To foster a global outlook towards social integration and employability skills.

Context

The School of Law has a significant number of international students – close to 47% of current students. To establish a single point of contact for them, a new office was established and I was appointed as the first International Support Tutor in the School of Law in February 2015.

I was assigned the task of providing academic and pastoral care to international students. In order to understand the experience of international students in the UK, I began by studying some of the recent research on the topic published by the Higher Education Statistics Agency (HESA), UK Council for International Student Affairs (UKCISA), and Quality Assurance Agency for Higher Education (QAA) Guidance.

This research revealed that there is consistent feedback from international students for the need of a structured approach to respond to two of the biggest concerns that they have: difficulties in transition (socio-cultural-academic), and employability attributes. This corroborated with the feedback I had received in a number of meetings with members of the academic staff, support services and overseas students in the School of Law.

This inspired me to develop the Legal Seagulls Experience Plan with the objective being that it will positively change the quality of overall experience for the students during the period of study with us, and also allow them to attain their academic potential and maximize their grades.

Implementation

For an international student, the journey of studying in a foreign country doesn’t begin in the Welcome Week; it actually begins on the day the offer is accepted. To bridge the gap between this period, I send a series of pre-arrival weekly emails in the form of academic bridging e-course to all confirmed offer holders. The PAWK includes guidance and online resources for a smoother academic transition.

During Welcome Week, the School of Law organizes three different Academic Bridging Course Induction Programmes for Postgraduate students, Part One students and Credit-transfer students.

This includes a session each on Academic Calendar, Teaching and Learning Methodology, Course Objectives, Good Academic Practice, Managing Academic Transition, Learning Technology, etc.

Our in-sessional support project, begun in 2015-16, is titled GOALLS : Global Outlook Activities and Learning for Legal Seagulls: free and open weekly sessions delivered by subject experts and based largely on games and group activities. A Certificate of Participation is awarded for attending five or more sessions and this counts toward the Research Experience and Development (RED) Award.

The Autumn term GOALLS focussed on cultural and academic integration and included sessions on topics such as Know Your Host (British Ways of Life), Know the British Legal Academia, and Cross-cultural Communication Training. The Spring GOALLS series was focused entirely on support for careers and examinations.

The students can register for the Academic Induction Programme and for GOALLS via an online registration form on the Legal Seagulls website which is made available from early August.

Impact

In 2015-16, 192 students received the PAWK. I could measure the successful response to this by the number of pre-arrival online registrations received for the Induction Programme (101), GOALLS (55) and Academic English Programme for Law Classes (70)

A total of 131 students attended the Induction sessions in the Welcome Week. This was a positive increase from the previous years. Of the students surveyed, 79% rated the Undergraduate Induction Programme as 4* or 5* and 92% rated the Postgraduate Induction Programme as 4* or 5*.

Close to 300 students benefited from the fourteen GOALLS sessions spread across the Autumn and Spring Terms. Of the 1505 total number of responses received for seven sections, 78% students marked the sessions as Outstanding (5*) or Very Good (4*).

This three-point Legal Seagulls Experience Plan has been able to lay the foundation to:

  • Respond to the early stages of culture shock and novelty for overseas students.
  • Introduce the overseas students thoroughly to UK as a host and to Reading as the host University.
  • Strengthen global graduate attributes and skills for overseas students.
  • Foster intercultural understanding and communication.

A few encouraging responses quoted from the student feedback are indicative of the positive impact: “Interaction with people of a different ethnicity other than mine rebuts my initial mindset about them”; “It was brilliant learning the debate mechanism and how to structure an oral argument properly”; “Today’s session has been tremendously useful for law students who are preparing for the upcoming exam. I have learnt a number of ways to study effectively.”

Reflections

The Pre-arrival Academic Welcome Kit (PAWK) and the Academic Bridging Course Induction Programme have been continued almost in the same format for 2016-17.

I have added a team-building activity session for the credit-transfer students’ Induction Programme. The PG Induction will now be live-streamed for the students arriving late and for students on the distance learning programme.

The GOALLS sessions have been reorganized in response to the feedback from the students that most of them were busy with exams and submissions in the Spring term and therefore could not attend the sessions in spite of being interested. This was reflected in the dwindling attendance. In view of this, for 2016-17, I have re-structured GOALLS.

The sessions on academic and cultural integration, career advice and exam support have now been scheduled during the Autumn Term. Electronic feedback has been added to the paper version. As an academic value addition to GOALLS, Professor Susan Breau, Head of School, has very kindly accepted my proposal to start an academic competition, the World Constitutions Showcase, to be delivered by Legal Seagulls under the Public Law Lecture series.

My efforts will also be see a renewed focus on activities reflecting on integration of home and overseas students.

Follow up

I honestly hope to create a well-founded sense of trust amongst our international students that we are absolutely keen on giving them the best possible support and services that any foreign academic institution can think of. We have a vibrant body of overseas students and we benefit in more ways than one from their presence and participation on campus.

The Legal Seagulls Experience Plan will strive to create, nurture and award an environment of mutual learning among the home students, overseas students and staff in the School of Law.

Our long-term aim is to create an ethos of a real and open acceptance of, and support to, the academic and cultural diversity brought to us by our international students.

Links

Filling the skills gap: information literacy skills throughout the degree programme

By edwardwhite Comment Closed

Jackie Skinner, Library
jackie.skinner@reading.ac.uk
Year of activity: 2015-16

Overview

16374This is an ongoing project to devise and implement a framework of skills to be developed by undergraduate students in Food and Nutritional Sciences throughout their degree programme. I have worked closely with staff in the Department on this project and so far it has resulted in changes to module content and a redevelopment of the departmental personal tutorials system.

Objectives

  • To audit existing skills development across the Food programmes.
  • To devise a framework of skills competencies to be developed throughout the programme.
  • To embed skills in suitable modules, or explore additional ways to enable students to acquire those skills.
  • Explore ways to allow students to assess their own skills competency: how confident do they feel with their skills proficiency and how have these skills been developed?
  • To ensure international students entering at Part Two are given the same opportunities to develop skills they might have missed by not taking Part One modules at the University of Reading.

Context

Through teaching and supporting Food students as their liaison librarian it had become clear to me that there were inconsistencies in skills expectations, which caused problems for students. It appeared that some academics expected advanced skills competencies which the students had not had the chance to develop, especially in Part One. There was also a feeling among staff that the students lacked skills they should have acquired by Part Three. In addition the Department’s Industrial Advisory Board had highlighted skills weaknesses in University of Reading graduates which needed to be assessed and addressed.

Implementation

Inspired by a Library staff training workshop on the ANCIL (A New Curriculum for Information Literacy) skills framework, I decided to try to assess the scale of the problem and devise a plan to address it. This framework aims to help undergraduates develop an advanced, reflective level of information literacy which will enable them not just to find information, but to evaluate, analyse and use academic material independently and judiciously.

The first step was to undertake a survey of module convenors to map the skills required for each module and those the students would develop in each module. Submissions were received for 41 out of 51 modules and showed evidence of a disparity in skills expectations and development.

After discussion at the Department T&L Committee I met with Programme Directors and used a card sorting exercise to map out skills required by the end of each Part. Once the skills framework was ratified, these were mapped onto suitable modules. This task was made more difficult because there are very few modules taken in common by all students in the Department. In addition to mapping most skills to modules, others were identified by academics as suitable for development through the personal tutorials system, e.g. reflective learning.

Impact

Although this is still a work in progress, it is has resulted in a greater awareness of skills development within the Department.

The framework and module mapping discussions have already resulted in some changes to module content, such as integrating a session on online identity management in a Part One module. This project has also instigated a change in approach to the personal tutorials system, moving towards a more structured approach, with group tutorials fostering more peer support and learning. I am currently working with academics and one of our Study Advisers to put together an online resource to support tutors in running their tutorials.

Although I have worked with the Food and Nutritional Sciences Department for many years, the whole process of conducting this project has enhanced my understanding of the work of the Department, and enabled me to become an embedded member of the academic team.

Reflections

This project coincided with a restructuring of the Department’s degree programmes and a desire for a more co-ordinated approach to module provision. The enthusiastic support of the Head of Department was a key factor in its success, as well as the openness of all academics to discuss ways to embed skills development in their modules.

Although the initial survey was time consuming, and could be skipped by anyone seeking to develop a similar skills framework in less time, it provided firm evidence to take to the T&L Committee.

The final two objectives have still to be achieved. Developing a skills self-assessment tool will require assistance from the TEL Team, if it is to be embedded in the student record and available to tutors too. Ideally this would provide evidence of the effectiveness of skills teaching which could be reviewed annually to influence development of module materials. Reworking the language module taken by students entering Part Two from overseas universities to ensure it includes the Part One skills also needs further work with the International Study and Language Institute and the International Student Tutor. The project may be of interest to those developing Curriculum Framework resources and toolkits.

Follow up

The skills framework has been tweaked a few times as a result of discussions with module convenors and at the T&L Committee. Recent feedback from students on their research project training may also result in further changes. Iterative changes will take place as a result of analysis of information from the skills self-assessment tool.

Links

Developing independent learners – a first year skills module

By edwardwhite Comment Closed

Professor Elizabeth Page, Chemistry, Food and Pharmacy
e.m.page@reading.ac.uk

Overview

A series of skills based modules running through the three years of the BSc and MChem Chemistry programmes has been developed. The aim is to promote independent learning and the development of academic and employability skills through subject specific material and activities. This entry describes the Part One module which would be readily transferable to many cognate disciplines.

Objectives

  • To support students in developing independent learning skills as they make the transition from school to university.
  • To introduce students to open and closed types of problems and help them develop strategies for tackling them.
  • To support students in developing time management, organisation, communication, team working and other transferable academic and professional skills.
  • To encourage students to self-assess their personal transferable skills and articulate them.

Context

The main drivers for the development of the series of skills-focussed modules were:

  • To break the cycle of ‘learning for the examination’ that is practised widely in schools and colleges to enhance exam results and league table position.
  • To provide “greater and more sustainable variety in modes of study to meet the changing demands of industry and students”, as recommended in the South East Universities Biopharma Skills Consortium Project.

Implementation

An initial survey was carried out of Part One students across the Faculty of Life Sciences to determine their biggest perceived differences between study at school or college and university. The greatest changes reported were the increased requirement for self-motivation and independent study required at higher education, coupled with a decrease in clarity of course and assessment requirements.

A small group of staff from different branches of the subject (Chemistry) discussed the desirable learning outcomes of the module and planned activities through which to achieve these outcomes.

One key aim of the module was to introduce students to the idea that there is sometimes no right or wrong answer but it is the route to solving a problem that is important. We were keen to ensure that the module addressed areas of the Chemistry curriculum that were both unfamiliar and challenging so that students were forced to read around the subject in order to understand the key concepts. In this way we believed that they would be better prepared to master the material when they subsequently met it in later modules. We therefore adopted a problem-based learning approach in which a series of chemical challenges were designed.

The module starts with an open-ended problem requiring little subject knowledge apart from basic scientific ideas. In groups students are required to find reasonable answers to problems such as ‘how much radioactivity is there in a banana?’ or ‘how much hydrogen would it take to supply the nation with cups of tea for a day?’. Students can use any assumptions or sources to solve the problem and have to justify their answers in a group presentation the following week. Subsequent problems were designed in the three main branches of chemistry and each challenge was designed to encourage students to develop different skills. For example, to develop numeracy skills students are required to justify the use of a major research platform to a government minister and calculate the number of molecules that can fit into a matchbox to give an idea of the size of a molecule to a non-scientist. Three of the challenges are carried out in groups and the same group members are retained through the year. We have been fortunate to welcome colleagues from Study Support to help our students with team working skills and our link librarian to explain the use of library resources and reliable sources from data base searching.

Impact

The module was first delivered in 2011 and feedback was very positive. A key feature of the module is that it helps students recognise their strengths and reflect on transferable skills to better articulate them in interviews and on application forms. Students reported that the module has helped them answer interview questions such as ‘How have you overcome problems in a group where one member has not contributed as expected?’ and ‘Give examples of a problem you have struggled to solve and how you succeeded’. The team based approach provides new students with a small group who they quickly get to know and so establishes friendships. Following the success of the Part One module we decided to design the Part Two module to align with our career management course and again use team working as the vehicle for achieving the learning outcomes.

Reflections

The success of the module rests upon a number of factors. Engagement of staff from across the department ensures ‘buy-in’. Six academic staff were initially involved with designing and delivering the module. In addition we were fortunate to have a project officer who did much of the preparation for the module and set up groups and Wikis on the Blackboard site.

Teams are composed of students of mixed gender, ethnicity and ability, based on information on RISIS available from their UCAS applications. Most teams work well with the usual problems encountered in team working. Peer evaluation is used to secure student feedback, and a scaling factor for each team member derived which is applied to the group mark for each activity.

The first challenge is formatively assessed and students given feedback within one week. Students receive detailed feedback on subsequent summative assessments.

Follow up

In 2014 we expanded the module to 20 credits and simultaneously increased the contact time and introduced IT skills. The original challenges are still used although there is plenty of scope for developing new problems. In order to support our students applying for placements in industry we conclude the module in the spring term with a personal analysis of skills developed, which can be integrated into applications and CVs for placements. The module structure would be easily transferable to other disciplines. The team responsible for the module were awarded a University Collaborative Award in 2012. Staff involved with the module are: Dr John McKendrick, Dr Andy Russell, Dr David Nutt, Professor Matthew Almond, Dr Joanne Elliott, and Mrs Sally Wade.

Links

Fostering effective transition to university learning

By edwardwhite Comment Closed

Dr Ciara Healy, Arts and Communication Design
c.healy@reading.ac.uk

Overview

This case study presents some approaches taken in the Department of Art to encourage relationship building between different cohorts of students and all members of staff. The majority of activities took place in the first 6 weeks of the Autumn term and focused especially on Welcome Week.

Objectives

  • Encourage relationship building across the Department and the University.
  • Support the development of a sense of community for all students.
  • Facilitate opportunities for students to share their own experiences of starting University with a new cohort.
  • Involve Peer-Assisted Learning (PAL) Leaders and STaR mentors in as many of these activities as possible.

Context

As module convenor for Part One Art students, I want to ensure that new cohorts are equipped with a deep sense of belonging to a wider creative community. I am aware of how beneficial a sense of belonging is to student wellbeing, engagement and resilience over the course of their degree.

Implementation

  1. Liaise with STaR Mentors and PAL Leaders during Welcome Week.
  2. Invite all members of staff in the Department to introduce themselves to new cohorts during Welcome Week.
  3. Invite staff to present a series of 5-minute dynamic ‘trailers’ on modules to new cohorts.
  4. Facilitate STaR mentor tours of the Department and available resources.
  5. Facilitate weekly discussions throughout the first term on independent learning skills.
  6. Launch an exhibition of finalist artwork on the Friday of Welcome Week. Invite the new cohort to the private view and exhibition party.
  7. Host an exhibition of first year student work in Week 3. Equip students with an awareness of exhibition etiquette in order to help them curate and present their first body of work to all staff and students from the Department. This further emphasizes the importance of belonging to a wider creative community.

Impact

Relationship building across the Department is really important in Art as students thrive when they share resources, ideas, critical judgements, experiences and exhibition opportunities. These activities in the first few weeks of term had a significant impact on how Part One students put together their first exhibition for their assessments at the end of the Autumn term. Students from other cohorts who helped them to install their work commented on how professional and successful it was. These more experienced students were also available to support students who found independent learning a challenge.

Reflections

The existing sense of community in the Department of Art helped to make the implementation of these activities successful. It was difficult at first to recruit students to become STaR mentors, however this has been resolved this year by inviting the Co-ordinators of PAL and STaR mentors to give presentations to the students throughout Spring term. Part One students who attended PAL sessions this year have signed up to become STaR Mentors. Many of them have also signed up to be PAL leaders.

Follow up

There is now an emerging culture of support in the Department of Art through existing creative communities and now increasingly through an engagement with PAL and STAR mentoring. This culture is growing every year and has made a huge contribution to embedding a sense of belonging, resilience and wellbeing amongst Art students at the University.

International Law Mooting

By edwardwhite Comment Closed

Professor James Green, Law
j.a.green@reading.ac.uk
Year of activity: 2007-08

Overview

Since 2007, the Law School has run a Part Three module entitled ‘International Law Mooting’. This is a highly innovative module, where a team of four students participate in the prestigious Telders International Law Moot Court Competition. The competition involves the team presenting written – and then, crucially, oral – arguments on a fictional dispute in international law.

Objectives

  • Memorials are jointly written and a single mark is given to all students: this builds teamwork, and prepares students for the submission of written memorials in real cases.
  • The oral performance is assessed, meaning that advocacy and presentation skills are developed.
  • Students are also assessed on individual reflective portfolios, which reward reflective learning and emphasize skill development.

Context

The team competes externally, for the University of Reading, against other universities. This gives the University of Reading a profile nationally and internationally, and provides students with a wonderful experience. The work required to compete in the competition is significant, and so – after entering for the first time in 2006 as an extra-curricular activity – it was decided that student effort here had to be rewarded with appropriate degree credit, hence the creation of the module. It develops a wide range of practical legal skills that are simply not part of other, traditional, law modules.

Implementation

Of the various issues that arose with regard to implementing the mooting module, the most pertinent for possible implementation elsewhere is the manner in which this module was to be assessed to give best effect to its learning objectives. A key learning objective was to develop communication and advocacy skills – but there is a danger of placing emphasis entirely on the student’s performance in the single external moot. Pressure is high, and ‘stage fright’ very possible. It is also difficult to ensure quality review of the marking of oral presentations/mooting. It was therefore decided that this issue could be addressed by complementing the marks awarded for the oral performance by also awarding a percentage of the marks for a reflective assessment. This ensured that students gained the credit that they were due for their skill development across the module as a whole, and not just based on the moot final alone.

Impact

The module has been hugely successful over the years. Students consistently give extremely positive feedback on the unique module design, and team-orientated nature of the module. It is also almost always the case that students gain extremely high marks in the module, with a significant number of firsts having been awarded. Indeed, no student has achieved an overall module mark below the 2:1 classification in 9 years of running the module.

Reflections

We have, of course, reflected on the module over the years. One change we made was to increase the percentage of the overall grade for the oral performance, and to slightly reduce the amount for the portfolio. This was in response to student feedback – we had the balance a little too heavily on rewarding the reflection, and students felt they should get rather more credit for the moot itself. We feel, after reflection and a few tweaks to the module design, that the assessment methods now best suit the learning outcomes. By and large, though, the module is a resounding success and continues to run in a form that is not too dissimilar from what was originally envisaged in 2007.

Follow up

Nothing beyond what is stated in the ‘Reflections’ box, above.

Links

The Module Description Form for International Law Mooting: http://www.reading.ac.uk/modules/document.aspx?modP=LW3ILM&modYR=1617

The website for the external Telders competition: http://teldersmoot.com/

Take Home Exam by Dr Stuart Lakin, School of Law

By edwardwhite Comment Closed

This post has been uploaded to the T&L Exchange, and can now be found at:

http://blogs.reading.ac.uk/t-and-l-exchange/take-home-exam/

Exploring value co-creation (CCV) in the Law Feedback Project at ESLTIS 2016 by Imogen Moore and Laura Bennett, School of Law

By edwardwhite Comment Closed

Introduction

As joint staff leaders (together with Dr Nora Honkala) on the current Law Feedback Project, we recently presented a paper exploring aspects of the project to the second annual Enhancing Student Learning Through Innovative Scholarship Conference, held at University College London on 28-29 June 2016.  This blog post explains a little about the Law Feedback Project, how (and why) value co-creation principles were incorporated within it, and what we found useful at the 2016 ESLTIS conference.

The Law Feedback Project and Value Co-Creation

The Law Feedback Project was set up in September 2015, in response to Periodic Review recommendations and student feedback in the NSS and elsewhere, which while generally positive, indicated some room for improvement. Periodic Review had recommended involving students in development of feedback (and other) strategies, and this provided us with the impetus to put students at the heart of the project, supported by our Head of School, Professor Susan Breau. Rather than simply seeking student views on assessment and feedback in a way potentially driven and limited by staff preconceptions and preferences, we set up the project drawing on principles of value co-creation, as espoused by writers such as Catherine Bovill and Alison Cook-Sather (Bovill et al, 2012 & 2014; see also McWilliam, 2008; Mihans et al, 2008;  Tabrizi & Ackfeldt, 2013) .

CCV envisages students acting as partners in learning, moving beyond a consumer-oriented role, and has been successfully used with a wide range of teaching and learning projects. For the Law Feedback Project this would mean involving students from the start and throughout the project – in scoping, designing and running the project, and ultimately creating and implementing changes to policies and practice. Students were recruited on a voluntary basis, via the SSLC, to co-lead the project working group (alongside the three staff members). Additional students participated in focus groups which explored more widely and deeply the issues identified within the working group.

Our primary aim in using CCV was to lead to more meaningful assessment and feedback practice that better met student needs, while still recognising system and staffing constraints. The project showed that students had quite clear views on what they needed and what they liked and disliked. While often their views matched staff expectations, this was not always the case. Fears of some staff that students will always demand more feedback were somewhat unfounded – quality and specificity were favoured over quantity (although quantity mattered too). Importantly the project indicated that students did not always understand and share the language of assessment and feedback, suggesting student dissatisfaction with feedback is sometimes due to miscommunication rather than deeper failings. Involving students through CCV will assist in finding a common language for our discourse with students and allow us to identify ways to improve their assessment literacy.

ESLTIS Conference 2016

The paper was well received at the ESLTIS conference, and was followed by some interesting discussion relating to our experiences and the challenges and benefits presented by CCV. It was valuable to have the input of fellow teaching-intensive colleagues from a wide variety of institutions and disciplines, in such a supportive and thoughtful atmosphere. In total the conference was attended by well over 100 teaching focused staff from institutions across the UK and further afield, with representation from all career levels.

There were two excellent keynote speeches. The first was given by from Dr Dilly Fung of UCL, who spoke around her recent HEA publication ‘Rewarding educators and education leaders in research-intensive universities’. Her vision of what education means – and its depth and breadth beyond ‘just’ teaching – was particularly interesting. Professor Carol Evans of the University of Southampton gave the keynote address on the second day: ‘Developing and implementing holistic assessment practice’. Professor Evans looked at bringing together different aspects of good assessment practice, including the importance of students understanding the assessment and feedback – something with obvious links to our own project. The rest of the two days offered a multitude of papers under themes of assessment and feedback, scholarship of teaching and learning, supporting students, and the role of teaching-focused academics – so many stimulating ideas and new approaches to old (and new) problems. We were also treated to an entertaining panel discussion which gave insights into different institutions’ attitudes to teaching-focused staff.

Conclusion

The experience of running the project, and presenting at the conference, has been very rewarding. Following a CCV approach has taken us out of our comfort zone and added another dimension to our teaching and learning, and it was interesting to explore with others how to successfully involve students further in teaching design. As far as the project is concerned, it is hoped this will continue into 2016-7 (with some change of membership due to staff changes and student graduations), to develop and implement policies and assessment criteria in partnership with students. As for ESLTIS – well, the next conference, which is organised through the Teaching Focussed Academic Network, will be held in Newcastle in the summer of 2017; hope to see you there!