Improving assessment writing and grading skills through the use of a rubric – Dr Bolanle Adebola

By laurenmccann Comment Closed

Dr Bolanle Adebola is the Module Convenor and lecturer for the following modules on the LLM Programme (On campus and distance learning):

International Commercial Arbitration, Corporate Governance, and Corporate Finance. She is also a Lecturer for the LLB Research Placement Project.

Bolanle is also the Legal Practice Liaison Officer for the CCLFR.

A profile photo of Dr Adebola

OBJECTIVES

For students:

• To make the assessment criteria more transparent and understandable.
• To improve assessment output and essay writing skills generally.

For the teacher:

• To facilitate assessment grading by setting clearly defined criteria.
• To facilitate the feedback process by creating a framework for dialogue which is understood both by the teacher and the student.

CONTEXT

I faced a number of challenges in relation to the assessment process in my first year as a lecturer:

• My students had not performed as well as I would have liked them to in their assessments.

• It was my first time of having to justify the grades I had awarded and I found that I struggled to articulate clearly and consistently the reasons for some of the grades I had awarded.

• I had been newly introduced to the step-marking framework for distinction grades as well as the requirement to make full use of the grading scale which I found challenging in view of the quality of some of the essays I had graded.

I spoke to several colleagues but came to understand that there were as many approaches as there were people. I also discussed the assessment process with several of my students and came to understand that many were both unsure and unclear about the criteria by which their assessments were graded across their modules.
I concluded that I needed to build a bridge between my approach to assessment grading and my students’ understanding of the assessment criteria. Ideally, the chosen method would facilitate consistency and the provision of feedback on my part, and improve the quality of essays on my students’ part.

IMPLEMENTATION

I tend towards the constructivist approach to learning which means that I structure my activities towards promoting student-led learning. For summative assessments, my students are required to demonstrate their understanding and ability to critically appraise legal concepts that I have chosen from our sessions in class. Hence, the main output for all summative assessments on my modules is an essay. Wolf and Stevens (2007) assert that learning is best achieved where all the participants in the process are clear about the criteria for the performance and the levels at which it will be assessed. My goal therefore became to ensure that my students understood the elements I looked for in their essays; these being the criteria against which I graded the essays. They also had to understand how I decided the standards that their essays reflected. While the student handbook sets out the various standards that we apply in the University, I wanted to provide clearer direction on how they could meet or how I determine that an essay meets any of those standards.

If the students were to understand the criteria I apply when grading their essays, then I would have to articulate them. Articulating the criteria for a well-written essay would benefit both myself and my students. For my students, in addition to a clearer understanding of the assessment criteria, it would enable them to self-evaluate which would improve the quality of their output. Improved quality would lead to improved grades and I could give effect to university policy. Articulating the criteria would benefit me because it would facilitate consistency. It would also enable me to give detailed and helpful feedback to students on the strengths and weaknesses of the essays being graded, as well as on their essay writing skills in general; with advice on how to improve different facets of their outputs going forward. Ultimately, my students would learn valuable skills which they could apply across board and after they graduate.
For assessments which require some form of performance, essays being an example, a rubric is an excellent evaluation tool because it fulfils all the requirements I have expressed above. (Brookhart, 2013). Hence, I decided to present my grading criteria and standards in the form of a rubric.

The rubric is divided into 5 criteria which are set out in 5 rows:

  • Structure
  • Clarity
  • Research
  • Argument
  • Scholarship.

For each criterion, there are 4 performance levels which are set out in columns: Poor, Good, Merit and Excellent. An essay will be mapped along each row and column. The final marks will depend on how the student has performed on each criterion, as well as my perception of the output as a whole.

Studies suggest that a rubric is most effective when produced in collaboration with the students. (Andrade, Du and Mycek, 2010). When I created my rubric, I did not involve my students, however. I thought that would not be necessary given that my rubric was to be applied generally and with changing cohorts of students. Notwithstanding, I wanted students to engage with it. So, the document containing the rubric has an introduction addressed to the students, which explains the context in which the rubric has beencreated. It also explains how the rubric is applied and the relationship between the criteria. It states for example, that ‘even where the essay has good arguments, poor structure may undermine its score’. It explains that the final grade combines but objective assessment and a subjective evaluation of the output as a whole which is based on the marker’s discretion.

To ensure that students are not confused about the standards set out in the rubric and the assessment standards set out in the students’ handbook, the performance levels set out in the rubric are mapped against the assessment standards set out in the student handbook. The document containing the rubric also contains links to the relevant handbook. Finally, the rubric gives the students an example of how it would be applied to an assessment. Thereafter, it sets out the manner in which feedback would be presented to the students. That helps me create a structure in which feedback would be provided and which both the students and I would understand clearly.

IMPACT

My students’ assessment outputs have been of much better quality and so have achieved better grades since I introduced the rubric. In one of my modules, the average grade, as recorded in the module convenor’s report to the external examiner (MC’s Report), 2015/16, was 64.3%. 20% of the class attained distinctions, all in the 70-79 range. That year, I struggled to give feedback and was asked to provide additional feedback comments to a few students. In 2016/17, after I introduced the rubric, there was a slight dip in the average mark to 63.7%. The dip was because of a fail mark amongst the cohort. If that fail mark is controlled for, then the average percentage had crept up from 2015/16. There was a clear increase in the percentage of distinctions, which had gone up to
25.8% from 20% in the previous year. The cross-over had been

from the students who had been in the merit range. Clearly, some students had been able to use the rubric to improve the standards of their essays. I found the provision of feedback much easier in 2016/17 because I had clear direction from the rubric. When giving feedback I explained both the strengths and weaknesses of the essay in relation to each criterion. My hope was that they would apply the advice more generally across other modules as the method of assessment is the same across board. In 2017/18, the average mark for the same module went up to 68.84%. 38% of the class attained distinctions; with 3% attaining more than 80%. Hence, in my third year, I have also been able to utilise step-marking in the distinction grade which has enabled me to meet the university’s policy.

When I introduced the rubric in 2016/17, I had a control module, by which I mean a module in which I neither provided the rubric nor spoke to the students about their assessments in detail. The quality of assessments from that module was much lower than the others where the students had been introduced to the rubric. In that year, the average grade for the control module was 60%; with 20% attaining a distinction and 20% failing. In 2017/18, while I did not provide the students with the rubric, I spoke to them about the assessments. The average grade for the control module was 61.2%; with 23% attaining a distinction. There was a reduction in the failure rate to 7.6%. The distinction grade also expanded, with 7.6% attaining a higher distinction grade. There was movement both from the failure grade and the pass grade to the next standard/performance level. Though I did not provide the students with the rubric, I still provided feedback to the students using the rubric as a guide. I have found that it has become ingrained in me and is a very useful tool for explaining the reasons for my grades to my students.

From my experience, I can assert, justifiably, that the rubric has played a very important role in improving the students’ essay outputs. It has also enabled me to improve my feedback skills immensely.

REFLECTIONS

I have observed that as the studies in the field argue, it is insufficient merely to have a rubric. For the rubric to achieve the desired objectives, it is important that students actively engage with it. I must admit, that I did not take a genuinely constructivist approach to the rubric. I wanted to explain myself to the students. I did not really encourage a 2-way conversation as the studies encourage and I think this affected the effectiveness of the rubric.

In 2017/18, I decided to talk the students through the rubric, explaining how they can use it to improve performance. I led them through the rubric in the final or penultimate class. During the session, I explained how they might align their essays with the various performance levels/standards. I gave them insights into some of the essays I had assessed in the previous two years; highlighting which practices were poor and which were best. By the end of the autumn term, the first module in which I had both the rubric and an explanation of its application in class saw a huge improvement in student output as set out in the section above. The results have been the best I have ever had. As the standards have improved, so have the grades. As stated above, I have been able to achieve step-marking in the distinction grade while improving standards generally.

I have also noticed that even where a rubric is not used but the teacher talks to the students about the assessments and their expectations of them, students perform better than where there is no conversation at all. In 2017/18, while I did not provide the rubric to the control-module, I discussed the assessment with the students, explaining practices which they might find helpful. As demonstrated above, there was lower failure rate and improvement generally across board. I can conclude therefore that assessment criteria ought to be explained much better to students if their performance is to improve. However, I think that having a rubric and student engagement with it is the best option.

I have also noticed that many students tend to perform well; in the merit bracket. These students would like to improve but are unable to decipher how to do so. These students, in particular, find the rubric very helpful.

In addition, Wolf and Stevens (2007) observe that rubrics are particularly helpful for international students whose assessment systems may have been different, though no less valid, from that of the system in which they have presently chosen to study. Such students struggle to understand what is expected of them and so, may fail to attain the best standards/performance levels that they could for lack of understanding of the assessment practices. A large proportion of my students are international, and I think that they have benefitted from having the rubric; particularly when they are invited to engage with it actively.

Finally, the rubric has improved my feedback skills tremendously. I am able to express my observations and grades in terms well understood both by myself and my students. The provision of feedback is no longer a chore or a bore. It has actually become quite enjoyable for me.

FOLLOW UP

On publishing the rubric to students:

I know that blackboard gives the opportunity to embed a rubric within each module. I have only so far uploaded copies of my rubric onto blackboard for the students on each of my modules. I have decided to explore the blackboard option to make the annual upload of the rubric more efficient. I will also see if the blackboard offers opportunities to improve on the rubric which will be a couple of years old by the end of this academic year.

On the Implementation of the rubric:

I have noted, however, that it takes about half an hour to explain the rubric to students for each module which eats into valuable teaching time. A more efficient method is required to provide good assessment insight to students. This Summer, I will liaise with my colleagues, as the examination officer, to discuss the provision of a best practice session for our students in relation to their assessments. At the session, students will also be introduced to the rubric. The rubric can then be paired with actual illustrations which the students can be encouraged to grade using its content. Such sessions will improve their ability to self-evaluate which is crucial both to their learning and the improvement of their outputs.

LINKS

• K. Wolf and E. Stevens (2007) 7(1) Journal of Effective Teaching, 3. https://www.uncw.edu/jet/articles/vol7_1/Wolf.pdf
• H Andrade, Y Du and K Mycek, ‘Rubric-Referenced Self- Assessment and Middle School Students’ Writing’ (2010) 17(2) Assessment in Education: Principles, Policy &Practice, 199 https://www.tandfonline.com/doi/pdf/10.1080/09695941003 696172?needAccess=true
• S Brookhart, How to Create and Use Rubrics for Formative Assessment and Grading (Association for Supervision & Curriculum Development, ASCD, VA, 2013).
• Turnitin, ‘Rubrics and Grading Forms’ https://guides.turnitin.com/01_Manuals_and_Guides/Instru ctor_Guides/Turnitin_Classic_(Deprecated)/25_GradeMark
/Rubrics_and_Grading_Forms
• Blackboard, ‘Grade with Rubrics’ https://help.blackboard.com/Learn/Instructor/Grade/Rubrics
/Grade_with_Rubrics
• Blackboard, ‘Import and Export Rubrics’ https://help.blackboard.com/Learn/Instructor/Grade/Rubrics
/Import_and_Export_Rubrics

Using Blackboard Collaborate for small group tutorials with distance learning students

By peteandrews Comment Closed

Adrian Aronsson-Storrier, School of Law                                                                                                                             a.m.storrier@reading.ac.uk

Context

LLM International Commercial Law (Distance)

Description

 Adrian held small group seminars with groups of around 5 students per online workshop.
Workshops were scheduled in all of the distance LLM modules, and ran weekly through the
Spring and Autumn terms. Collaborate was also used for individual dissertation supervision
sessions.
 These were Postgraduate Masters level distance learning students enrolled in a range of
optional LLM modules. Students attended from across the UK and the world.
 The Law School already offered online workshop sessions using a competing webinar product
(Adobe Connect). This software was complex for students to use, not supported centrally by
the University and was paid for from the School’s budget. We sought to investigate alternative
web conferencing solutions that would be simpler for our students whilst maintaining
equivalent functionality (slide sharing, chat, whiteboard etc).
 Blackboard Collaborate was chosen to replace Adobe Connect as it was simpler for students to
use (a more straightforward interface reduced initial student training time, the integration into
Blackboard made it simpler for students to log in and participate).
 Preparation was similar to distance workshops previously delivered with the earlier Adobe
Connect web conferencing tool. For some workshops slides were prepared, in others a series
of tutorial style questions were circulated to students in advance for discussion.
 After giving students an initial training session, delivering a class on Collaborate took no more
effort than delivering an equivalent session in an on campus module.

Impact

 Students quickly adapted to Collaborate. They made frequent use of the chat function and the
‘raise hand’ function, particularly in larger groups where many students wished to contribute to
a discussion.
 Student’s enrolling in the distance LLM are required to have access to their own computer,
headphones and internet connection.
 From a support perspective, the move to Collaborate required less ongoing staff and student
training than our previous web conferencing software – once set up on Blackboard it was simple
for students and staff to access Collaborate sessions for their weekly workshops.
 Blackboard Collaborate achieved everything we had previously delivered to students using
Adobe Connect. It had the advantage of being simpler for students to use, and the blackboard
integration made connecting to the sessions simpler.

Thoughts and Reflections

 Lecturers in the school of law tended to use Collaborate from their homes (distance workshops
are often scheduled outside core hours, to accommodate students in diverse time zones). This
required staff to have sufficient equipment (laptop, headphones or a headset).
 One challenge – which often impacts distance learning when working with students in less
economically developed nations – was issue of the student’s poor internet connection
impacting sessions. At times students (particularly in Africa and the Middle East) had poor
internet connections which prevented full video streaming. While the software does allow
students to participate by providing streaming audio only, this is less immersive for the student.
 Ensure that all participants are making use of headphones or a microphone headset. If students
rely on computer speakers there will often be some level of echo introduced into the web
conference, which can be distracting. Students without headphone should be encouraged to
mute their microphones when not speaking.
 Provide students with an introductory session on the software before beginning online
instruction. We used a general online induction day for students as a trial, allowing them to test
that the software worked and giving them time to learn the functionality before being required
to use it in class.

 

Adopting a flipped classroom approach to meet the challenges of large group lectures

By peteandrews Comment Closed

Amanda Millmore, School of Law,  a.millmore@reading.ac.uk

Overview

Faced with double-teaching a cohort of 480 students (plus an additional 30 in University of Reading Malaysia), I was concerned to ensure that students in each lecture group had a similar teaching experience. My solution was to “flip” some of the learning, by recording short video lectures covering content that I would otherwise have lectured live and to use the time freed up to slow the pace and instigate active learning within the lectures.

Objectives

  • Record short video lectures to supplement live lectures.
  • Use the time freed up by the removal of content no longer delivered live to introduce active learning techniques within the lectures.
  • Support the students in their problem-solving skills (tested in the end of year examination).

Context

The module “General Introduction to Law” is a “lecture only” first year undergraduate module, which is mandatory for many non-law students, covering unfamiliar legal concepts. Whilst I have previously tried to introduce some active learning into these lectures, I have struggled with time constraints due to the sheer volume of compulsory material to be covered.

Student feedback requested more support in tackling legal problem questions, I wanted to assist students and needed to free up some space within the lectures to do this and “flipping” some of the content by creating videos seemed to offer a solution.

As many academics (Berrett, 2012; Schaffzin, 2016) have noted, there is more to flipping than merely moving lectures online, it is about a change of pedagogical approach.

Implementation

I sought initial support from the TEL (Technology Enhanced Learning) team, who were very happy to give advice about technology options. I selected the free Screencastomatic software, which was simple to use with minimal equipment (a headset with microphone plugged into my computer).

I recorded 8 short videos, which were screencasts of some of my lecture slides with my narration; 6 were traditional lecture content and 2 were problem solving advice and modelling an exemplar problem question and answer (which I’d previously offered as straightforward read-only documents on Blackboard).

The software that I used restricted me to 15 minute videos, which worked well for maintaining student attention. My screencast videos were embedded within the Blackboard module and could also be viewed directly on the internet https://screencast-o-matic.com/u/iIMC/AmandaMillmoreGeneralIntroductiontoLaw.

I reminded students to watch the videos via email and during the lectures, and I was able to track the number of views of each video, which enabled me to prompt students if levels of viewing were lower than I expected.

By moving some of the content delivery online I was also able to incorporate more problem- solving tasks into the live lectures. I was able to slow the pace and to invite dialogue, often by using technology enhanced learning. For example, I devoted an hour to tackling an exam-style problem, with students actively working to solve the problem using the knowledge gained via the flipped learning videos and previous live lectures. I used the applications Mentimeter, Socrative and Kahoot to interact with the students, asking them multiple-choice questions, encouraging them to vote on questions and to create word clouds of their initial thoughts on tackling problem questions as we progressed.

Impact

Student feedback, about the videos and problem solving, was overwhelmingly positive in both formal and informal module evaluations.

Videos can be of assistance if a student is absent, has a disability or wishes to revisit the material. Sankoff (2014) and Billings-Gagliardi and Mazor (2007) dismiss concerns about reduced student attendance due to online material, and this was borne out by my experience, with no noticeable drop-off in numbers attending lectures; I interpret this as a positive sign of student satisfaction. The videos worked to supplement the live lectures rather than replace them.

There is a clear, positive impact on my own workload and that of my colleagues. Whilst I am no longer teaching on this module in the current academic year, my successor has been able to use my videos again in her teaching, thereby reducing her own workload. I have also been able to re-use some of the videos in other modules.

Reflections

Whilst flipped learning is intensive to plan, create and execute, the ability to re-use the videos in multiple modules is a huge advantage; short videos are simple to re-record if, and when, updating is required.

My initial concern that students would not watch the videos was utterly misplaced. Each video has had in excess of 1000 views (and one video has exceeded 2000), which accounts for less than 2 academic years’ worth of student usage.

I was conscious that there may be some students who would just ignore the videos, thereby missing out on chunks of the syllabus, I tried to mitigate this by running quizzes during lectures on the recorded material, and offering banks of multiple choice questions (MCQs) on Blackboard for students to test their knowledge (aligned to the formative examination which included a multiple choice section). In addition, I clearly signposted the importance of the video recorded material by email, on the Blackboard page and orally and emphasised that it would form part of the final examination and could not be ignored.

My experience echoes that of Schaffzin’s study (2016) monitoring impact, which showed no statistical significance in law results having instituted flipped learning, although she felt that it was a more positive teaching method. Examination results for the module in the end of year formative assessment (100% examination) were broadly consistent with the results in previous academic years, but student satisfaction was higher, with positive feedback about the use of videos and active learning activities.

Links

University of Reading TEL advice about personal capture – https://sites.reading.ac.uk/tel-support/category/learning-capture/personal-capture

Berrett, D. (2012). How “Flipping” the Classroom Can Improve the Traditional Lecture. https://www.chronicle.com/article/how-flipping-the-classroom/130857. Chronicle of Higher Education..

Billings-Gagliardi, S and Mazor, K. (2007) Student decisions about lecture attendance: do electronic course materials matter?. Academic Medicine: Journal of the Association of American Medical Colleges, 82(10), S73-S76.

Sankoff, P. (2014) Taking the Instruction of Law outside the Lecture Hall: How the Flipped Classroom Can Make Learning More Productive and Enjoyable (for Professors and Students), 51, Alberta Law Review, pp.891-906.

Schaffzin, K. (2016) Learning Outcomes in a Flipped Classroom: A comparison of Civil Procedure II Test Scores between Students in a Traditional Class and a Flipped Class, University of Memphis Law Review, 46, pp. 661.

Redesigning postgraduate curricula on commercial law through student engaging, research-informed and multidisciplinary pathway programmes

By edwardwhite Comment Closed

Professor Stavroula Karapapa, School of Law                          s.karapapa@reading.ac.uk

Overview

In 2015/2016, we substantially redeveloped our postgraduate provision in commercial law through the introduction of a pioneering, student-engaging, research-informed and multidisciplinary set of postgraduate pathway programmes. Contrary to the programmes previously in place, the new curriculum is unique in its pathway design allowing students to develop a breadth of commercial law expertise whilst also specialising in their area of interest (for a full list of programmes see here). The project on which this entry reflects has resulted in an innovative curriculum that shaped the identity of Centre for Commercial Law and Financial Regulation (CCLFR) as a centre of excellence on cutting-edge themes of commercial law.

Objectives

  • To redevelop our postgraduate curriculum in commercial law through the introduction of cutting-edge themes of study based on the principles of research-informed and multidisciplinary teaching.
  • To empower student learning, improve student experience, and foster the development of a learning community.
  • To hear the student voice towards the design of the curriculum and to proactively and directly engage ‘students as partners’ in the development and evaluation of the core module for the new programmes.

Context

As often happens in Higher Education, the postgraduate programmes in Commercial Law previously in place were the result of the work of independent colleagues at various points in time, starting in 2011. Modular options reflected this dynamic, and they were also impacted by continuous staffing changes over the years. The pathway programmes are the result of collective effort within the School of Law, effective consultation with students and evaluation of their feedback, and constructive collaboration with colleagues from various Schools and services across the University (including marketing, careers, conversions etc.).

Implementation

Following a review of our PGT provision, we redeveloped our commercial law curriculum on the basis of three pillars:

  1. student feedback (module evaluation forms and ‘graduation’ forms collected since 2011) concerning suggestions for improvement, informal comments from students enrolled in 2015/2016 on ideas for new modules/programmes and engagement of ‘students as partners’ in the development of the core module for the new pathway programmes;
  2. extensive market study carried out by marketing and the (then) PGT Director regarding areas worth expanding on;
  3. expansion of our module offerings through the valuable contribution of numerous colleagues in the School of Law and consultation with various Schools across the University that agreed to open up relevant modules, effectively enhancing multidisciplinarity in our programmes.

Instead of offering numerous programmes with no clear link to each other, we introduced a set of pathway programmes (including 5 new PGT programmes and a redesign of the existing ones) whereby all programmes are centred around one core legal field, International Commercial Law, and students have the option to follow a pathway on a specialist area designed around our research strengths as a School and as a University, essentially building on research-informed teaching. Part of this redesigning process was the revision of the compulsory module for all pathways, LWMTAI-Advanced Issues in Commercial Law, which was based on the engagement of students as partners, drawing on a UoR small-scale research project that was initiated in June 2016, an entry of which is available here and here.

Impact

The collective effort of numerous colleagues in the School of Law and the support from various Schools and services across the University resulted in the development of a pioneering set of pathway programmes, centred around the values of research-informed teaching and multidisciplinarity and developed on the basis of student feedback. The project enhanced student engagement, taking on board student views on the learning design. The redrafting of a core module (LWMTAI) had direct impact on student learning, enabling students to proactively review their own learning process and to develop an increased sense of leadership and motivation. There was also positive correlation between the introduction of new pathways (especially Information Technology and Commerce; Energy Law and Natural Resources) and PGT recruitment. Anecdotal evidence indicates that the conversion rate of existing PGT students to our PGR programme has also increased. Importantly, the redevelopment of our programmes created a distinctive identity for CCLFR as a centre of excellence on cutting-edge themes of commercial law.

Reflections

The success of the redevelopment of our PGT curriculum was based on three pillars:

  1. Collective effort: The redevelopment of the programmes required the engagement of various colleagues from the School of Law who met on numerous occasions to reflect on the programmes and introduced new modules on cutting-edge themes to meet the needs of the new pathway design. This effort exceeded business as usual. An example of such collective effort is the redesign of the core module of the pathway programmes which followed the ‘student as partners’ approach and was implemented with the collaboration of various members of staff from the School of Law.
  2. Student engagement: Unlike what usually happens in higher education with ex post student feedback, the pathway design used that feedback constructively towards designing new programmes, taking into consideration student comments in evaluation forms and also engaging students in the programme design process. Importantly, it was students themselves that proactively informed the curriculum of the core module for all pathway programmes, with their voice having being heard even before the completion of the taught component.
  3. Cutting-edge themes and research-informed teaching: At the heart of student feedback was the desire to increase the number of modular offerings from other Schools and Departments, effectively to enhance the multidisciplinary approach that was already in place. Introducing more modules from other Schools to our curriculum on the basis of their relevance and appropriateness to our pathways has become a learning process to us as educators in that it has resulted in dynamic synergies and an innovative curriculum as end-result of the exercise.

Links

Details on our new pathway programmes are available here: http://www.reading.ac.uk/law/pg-taught/law-pgt-courses.aspx

Engaging students as partners in the redesign of an existing course curriculum

By edwardwhite Comment Closed

Dr Despoina Mantzari, School of Law
d.mantzari@reading.ac.uk

Overview

In June 2016 I was awarded a small University of Reading Teaching and Learning grant with the objective to involve a group of ten postgraduate taught students from the School of Law as partners in the process of redesigning the curriculum of a core postgraduate taught module. This entry reflects on the process of engaging students as partners in the redesign of an existing course curriculum. It discusses how insights from the burgeoning literature on students as partners in higher education informed the process and assesses the outcomes of the latter for improving and supporting teaching and learning.

Objectives

  • To listen to the ‘student voice’ before course delivery, by proactively engaging students as partners in the redesign of the module.
  • To co-create learning experiences in collaboration with students that goes beyond the student satisfaction surveys and other ex-post forms of evaluation.
  • To redesign a module so that it is both engaging and empowering.

Context

The module Advanced International Commercial Law Issues (LWMTAI), being a core compulsory module of the new LLM, had to be redesigned so as to fit into the new programme requirements. In doing so, I wanted to listen to the ‘student voice’ before course delivery, by proactively engaging students as partners in the redesign of the module. This exercise departs from current practice in higher education, where ‘student voice’ is largely heard following the completion of the taught component of the module on a Module Evaluation Form.

Implementation

Guided by the values of inclusion and partnership, I first emailed all students enrolled on the module in its pre-revised form (2015-16) and introduced the project and its aims, and invited expressions of interest. In order to further test the modules’ renewed approach to the theoretical framework and other relevant components, I also invited a group of five students who had never been enrolled on the module to participate in the project. In selecting this latter group of five students, I was guided by considerations of diversity, both in terms of ethnic and cultural background as well as prior exposure to commercial law. Inviting all LLM students who had never enrolled on the project would have been inappropriate for the aims of the project and would render it difficult to manage. Both previously used (prior to 2015-16) and revised module description forms (to be introduced in 2016-17) of the module were circulated to both groups along with a questionnaire. All students involved were asked to reflect on the strengths and weaknesses of the module, as reflected in the module description forms, along with other concerns or recommendations they wished to share. These were discussed during a two-hour event, open to all students participating in the project and School of Law staff involved in postgraduate taught and undergraduate Law teaching.

Impact

The project enhanced student motivation and engagement, and fostered the development of a learning community within the School of Law. Students enjoyed their participation in the project and in particular their contribution to the event that followed. They were fascinated by their collaboration with staff and by their active role in critically reviewing the course curriculum.

The project also helped students to review their own learning process and allowed them to develop an increased sense of leadership and motivation. It also increased their confidence to express their views in academic settings. Student involvement facilitated the design of the module in ways that significantly improved it.

The project had a transformative effect on the way I perceive my role as an educator and the boundaries thereof.

Reflections

Three key factors contributed to the project’s success:

First, the fact that I ‘institutionalised’ the project by applying for a University of Reading Teaching and Learning Small Research Grant not only allowed me to fund the activities, but also raised the profile of the project in the eyes of both students and staff.

Second, the careful selection of those elements of the curriculum redesign that would be part of the student-staff partnership. I opted for a model of interaction where students are given limited choice and influence. The reason for this related to the nature of the project, which concerned the redesign of an existing module in its entirety. When engaging students as partners, reciprocity cannot always be fulfilled, as high-stake issues of module redesigns, such as the theoretical framework or methods of assessment cannot be entirely handed over to students. Students may find themselves confused if a tutor hands over total control of such an important element without preparation or guidance. Such practice may jeopardise the gatekeeper function of the educator.

The third element went to the heart of student as partner practice: how many students to involve in the project, and by which means. The literature suggests that students as partners can involve work with individuals, small groups, and situations where students are invited to become partners, or even elected or selected. While the literature has drawn attention to the potential benefits of whole cohort approaches, it may be difficult, impossible, or even undesirable in some contexts to involve all students at all times. In this case, a whole-cohort approach could not be adopted, as some students enrolled in the module in its pre-revised form had already left the University. Furthermore, selecting students could potentially undermine the values of inclusion, respect and responsibility that underpin the students as partners approach. Meaningful partnership requires a high level of equality and contribution from partners, and that would be jeopardised by implementing an approach that would invite to the project only student that the module convenor deemed suitable to participate.

Integrating Research-Led Teaching into Law: From Visit Days to Finals – Dr Beatrice Krebs and Dr Lawrence Hill-Cawthorne, School of Law

By edwardwhite Comment Closed

The benefits of research-led teaching for both staff and students are well known. From the perspective of students, it encourages and facilitates deeper learning and engagement with complex intellectual issues in the course materials. In so doing, it gives the students the opportunity to develop critical and creative thinking. For staff, it offers the opportunity to use the classroom as a laboratory for testing out ideas in their research area, and discussing them with a student audience often helps to clarify our own thinking.

In Law, we have successfully integrated research-led teaching not only throughout the undergraduate degree but also from the outset when students visit the University on open and visit days. In this blog post, we want to share some of our practices with integrating research into teaching through the undergraduate degree course.

Open and visit days

Part of research-led teaching requires making students aware from the outset of their degree of the research we do. Open and visit days offers a perfect opportunity for this and indeed allows us to advertise our expertise in cutting-edge research. To this end, we have made showcasing our research expertise and research-led teaching a key part of our open and visit day experience. Thus, we begin with a talk by the admissions tutor (one of the present authors) that, in part, offers an overview of the different research strengths of the Law School and emphasises the value in being taught by leading researchers in the field. As part of this, he also presents examples of staff that not only teach and research in their specialist fields but are involved in the practice of law (for example, many of our staff act as academic advisors to counsel in court cases and participants in key policy initiatives around the world – see our research impact pages). We then move on to a taster lecture from a member of staff on a topical subject that is accessible and interesting to school pupils and is representative of what they will study during their degree. Crucially, this lecture is given by a member of staff on their specialist research area and incorporates aspects of their research. For example, one of the present authors gave a taster lecture at the most recent visit days in February 2017 on the Jogee case of the UK Supreme Court that changed the law on accessorial liability in criminal law, drawing on her research in this area and first-hand knowledge of the case.

Overall, this approach to open and visit days has been very successful. Feedback has consistently been very good, with notable mention of the interesting and engaging topics of the taster lectures. We have noticed especially in the taster lectures that visiting students are generally keen to get involved by asking questions, offering answers and debating topics. For this reason, we have made the taster lectures more interactive, for example, by asking visitors to give their views on a particular issue by a show of hands and then asking one or two people to explain the reasons for their views.

First year

Throughout the degree, students are taught by members of staff in their specialist research areas, which exposes students to the latest scholarship and key debates in the field that they are studying. However, research-led teaching in Law is not limited to substantive research topics but also underlying research methodologies. For example, in tutorials in Criminal Law, when explaining how the law works in particular areas, comparisons are often drawn to other jurisdictions so as both to highlight the particularities of the English and Welsh approach and to expose students to alternative ways of addressing the same social problems. This direct comparison pushes students to think critically about the legal rules that they learn and to ask themselves what are the advantages and disadvantages of how our jurisdiction deals with certain issues in the Law. Exposing students in their first year to this also prepares them well for the various research-based modules (e.g. Research Placement Project and Dissertation) in their second and third years.

Second Year

In the second year, we have a bespoke research-informed module, Research Placement Project (RPP). RPP offers students the opportunity to work directly with a member of staff on a particular research project. The student develops their own research question with the guidance and supervision of one of the academics that has signed up to the module. The students are given lectures on the nature of scholarly research and research skills, as well as seminars that function as workshops with students discussing the progress they have made on their research. This module offers students an early opportunity at developing their own, discrete research project with guidance from the academic and to engage in a deeper form of learning and critical analysis. Moreover, as the topics of the research projects are not restricted to what they have studied thus far, they are able to extend their existing knowledge into topical and exciting cutting-edge areas of research.

Final Year

The final year offers a range of opportunities to further students’ engagement with research. One example is the Dissertation module, for which students develop independently a research question and then find a supervisor that works in that field to support them as they write a 12,500 word dissertation. In addition, in specific taught modules, we also integrate research into seminars and tutorials. For example, in International Law tutorials, two students are sent a scholarly article in advance to read and to summarise to the other students in the tutorial. The articles tend to be of a general nature, exploring different understandings and ways of thinking about international law. Other students then have an opportunity to ask questions about the article and engage with it themselves. This has generally been very successful and has made students engage with very complex intellectual controversies that they otherwise would not have encountered.

Concluding remarks

In this blog post we have sought to outline a few ways in which we incorporate our research interests as academics into the teaching of Law throughout the undergraduate degree. Feedback from students has been positive about these different approaches. Importantly, research-led teaching not only benefits students, by encouraging deeper and more critical approaches to reading and writing, but also benefits academics, as we are able to discuss our research interests with students who may be able to offer a fresh perspective.

As noted, we have sought to incorporate research engagement at the earliest stage, making it a crucial part of the open and visit days to give potential students a clearer idea of academia and university life. As the degree progresses, we can often see a clear improvement in how students express themselves and handle different ideas and arguments with nuance and maturity. Research-led teaching thus benefits the quality of their written work and is key to establishing students as independent thinkers both within and outside the classroom.

LW2RPP – Research Placement Project

By edwardwhite Comment Closed

Dr. Stavroula Karapapa, Law
s.karapapa@reading.ac.uk

Overview

Research Placement Project (LW2RPP) is a module developed within the School of Law that aims to provide Part Two students with a hands-on experience of the academic research process, from the design of a project and research question through to the production of a research output. It is an optional module that combines individual student research, lectures and seminars.

Objectives

  • To provide students with a hands-on experience of the academic research process, from the design of a project and research question through to the production of a research output.
  • To provide a forum for the development of key research skills relating to the capacity to generate original knowledge.
  • To provide a forum for the development of key skills relating to the presentation of ideas in written form.
  • To give the opportunity to obtain an in-depth understanding of a specific applied topic of legal study.

Context

The module was initially developed as an alternative to Legal Writing Credit (LW2LWC) with a view to offer more optional modules to Law students at Part Two.

Implementation

The module has a unique learning design in that it introduces law students to semi-guided legal research through lectures, seminars and independent student learning. The lectures introduce students to research methods. Seminars are lead by experts in a particular area that have a strong interest in a specific topic because they currently carry out research on it. We have had a variety of topics offered throughout the four years that the module runs, spanning international law, criminal law, company law, media law, family law etc. Students are given the option to choose their group at the beginning of the academic year and to work on topics related to a specific research area.

During the module, students receive formative feedback on two occasions, as they are required to present a piece of preparatory work, such as a literature review or draft bibliography, in their second and third project supervision sessions, with these pieces forming the basis for discussion with their supervisor and with peers. Students are therefore able to use this formative feedback to direct their final output, an assessed essay of 10 pages.

Impact

The objectives of the activity have been met. Students have been acquainted with a particular research area and they have developed skills and some experience on legal research writing. Having colleagues deliver seminars on their current areas of research is valuable, as it showcases the wide variety of research in Law that takes place within the School and the subject more generally, and students respond well to this element of the module. The outputs that students produce have generally been of a good quality, and have demonstrated an ability to use appropriate methodologies to conduct and utilise independent research. Involvement in a research project of this nature at Part Two has been valuable for students to develop skills which they then continue to utilise at Part Three, particularly in their dissertation.

Reflections

The main force behind the success of the module is the contribution of the various colleagues that volunteer every year to offer some classes and group supervision to Part Two students.

Take-home exam

By edwardwhite Comment Closed

Stuart Lakin, Law
s.j.lakin@reading.ac.uk

Overview

In a Part Two Law module, Public Law (LW2PL2), we have moved away from the conventional exam to a take-home exam. We publish the exam paper on Blackboard at an arranged date and time. We give the students approximately 48 hours to complete and submit their answers electronically.

The impact has been entirely positive as compared to the old exam approach. Students prefer this format. The quality of their answers is markedly better. The results are better, and are consistently among the highest of all Part Two modules.

Objectives

  • To ensure that work produced in the exams is presented to a professional standard.
  • To allow students the opportunity to provide greater intellectual depth in their answers, and allowing the ability for independent research to form part of the assessment.
  • To have students demonstrate time management, in order to allow them to effectively complete their take-home exam while revising for their other examinations.

Context

We had three reasons for undertaking the activity:

First, we reasoned that LW2PL2 was better suited, pedagogically speaking, to the new format. The subject-matter is theoretical, and we assess by essay only (as opposed to by problem questions). We look for deep understanding of the issues rather than an ability mechanically to apply memorised rules. The take-home format encourages an independent research mindset.

Secondly, we thought it valuable to provide some variety in the way that Part Two students are assessed. The assessment across the Part Two modules had hitherto been by conventional exam only. Whatever the merits and demerits of the traditional exam, it can be refreshing for students to experience some other form of assessment.

Thirdly, we responded to the University call for alternative assessment. On pragmatic grounds, the take-home exam frees up room space and reduces complex timetabling requirements.

Implementation

We prepared the first cohort of students by giving them a mock take-home exam in lieu of their usual non-assessed essay. We asked them to prepare an answer to a question as if they were preparing for the exam itself. We have continued this practice ever since.

In addition, I prepared a detailed explanation of our rationales and expectations for the take-home exam, and provided this to the students. This document exists to inform students of the benefits and the opportunities provided by the format, and also ensures that they fully appreciate the assessment criteria of the format. I talk through this document with the students throughout the year.

Impact

In short, the activity has been highly successful. I believe that colleagues are considering this format for their own modules. By having students word process their exam answers, a lot of the recognised disadvantages of handwritten answers (handwriting often being slow and uncomfortable, and producing results that are messy and poorly legible, as well as the anxiety caused by these disadvantages) can be avoided. It is also easier for students to structure their essays.

By having the take-home exam scheduled during the University exam period, it is important that students manage their time effectively in completing the exam. Students are made aware that the assumption when marking is that they will have spent approximately two hours answering each question: this allows them more time than a conventional exam, but also allows time for students to make space for other commitments they might have, such as revision for other exams.

Above all, we have found that the format is a better way of encouraging scholarly engagement with the module content. We emphasise in our rationales/expectations document that the format has an element of independent research.

The level of success of the activity was unexpected. The first cohort of students to do the take-home exam were nervous and rather distrustful of the activity. Happily, they passed their positive experience down to the next year’s cohort, and that pattern has continued ever since.

Reflections

In my view, the take-home exam format treats students as independent thinkers in a way that the conventional exam does not. The emphasis is on the quality of argument and research rather than on memory skills and the ability to perform under pressure. Having said that, the new format does not entirely dispense with the latter types of skills – there is still a deadline, and students will still need to revise in advance.

There were admittedly risks involved in introducing this new format. LW2PL2 is an extremely important, compulsory module which counts towards the final degree. With hindsight, it may have been more prudent to experiment with this format in a Part One module. On the other hand, we put a great deal of thought into the format, and communicated well with the students. In these respects, we minimised the risks.

Follow up

The activity has remained largely the same as it began. We have experimented with changing the publication and submission times for the exam. We originally published the exam at midnight. This led to many students staying up all night to work on the paper. We now publish the exam at 9 am.

Legal Seagulls : Experience Plan for overseas students

By edwardwhite Comment Closed

Shweta Band, Law
s.band@reading.ac.uk
Year of activity: 2015-16

Overview

The name ‘Legal Seagulls’ represents all overseas students in the School of Law. I initiated the Legal Seagulls Experience Plan in 2015-16 as a three-step support initiative to enhance the academic and university-life experience for our overseas students.

This includes the Pre-arrival Academic Welcome Kit (PAWK), on-arrival Academic Bridging Course Induction Programme and weekly in-sessional support sessions in the form of GOALLS (Global Outlook Activities and Learning for Legal Seagulls)

Objectives

  • To model an experience initiative for overseas students as a symbol of real academic and social integration.
  • To develop, deliver and evaluate a structured and continual pre-arrival and in-sessional mechanism.
  • To provide a comprehensive academic transition information at the pre-arrival stage in an endeavour to bridge the gap between the home and overseas legal academic environments.
  • To foster a global outlook towards social integration and employability skills.

Context

The School of Law has a significant number of international students – close to 47% of current students. To establish a single point of contact for them, a new office was established and I was appointed as the first International Support Tutor in the School of Law in February 2015.

I was assigned the task of providing academic and pastoral care to international students. In order to understand the experience of international students in the UK, I began by studying some of the recent research on the topic published by the Higher Education Statistics Agency (HESA), UK Council for International Student Affairs (UKCISA), and Quality Assurance Agency for Higher Education (QAA) Guidance.

This research revealed that there is consistent feedback from international students for the need of a structured approach to respond to two of the biggest concerns that they have: difficulties in transition (socio-cultural-academic), and employability attributes. This corroborated with the feedback I had received in a number of meetings with members of the academic staff, support services and overseas students in the School of Law.

This inspired me to develop the Legal Seagulls Experience Plan with the objective being that it will positively change the quality of overall experience for the students during the period of study with us, and also allow them to attain their academic potential and maximize their grades.

Implementation

For an international student, the journey of studying in a foreign country doesn’t begin in the Welcome Week; it actually begins on the day the offer is accepted. To bridge the gap between this period, I send a series of pre-arrival weekly emails in the form of academic bridging e-course to all confirmed offer holders. The PAWK includes guidance and online resources for a smoother academic transition.

During Welcome Week, the School of Law organizes three different Academic Bridging Course Induction Programmes for Postgraduate students, Part One students and Credit-transfer students.

This includes a session each on Academic Calendar, Teaching and Learning Methodology, Course Objectives, Good Academic Practice, Managing Academic Transition, Learning Technology, etc.

Our in-sessional support project, begun in 2015-16, is titled GOALLS : Global Outlook Activities and Learning for Legal Seagulls: free and open weekly sessions delivered by subject experts and based largely on games and group activities. A Certificate of Participation is awarded for attending five or more sessions and this counts toward the Research Experience and Development (RED) Award.

The Autumn term GOALLS focussed on cultural and academic integration and included sessions on topics such as Know Your Host (British Ways of Life), Know the British Legal Academia, and Cross-cultural Communication Training. The Spring GOALLS series was focused entirely on support for careers and examinations.

The students can register for the Academic Induction Programme and for GOALLS via an online registration form on the Legal Seagulls website which is made available from early August.

Impact

In 2015-16, 192 students received the PAWK. I could measure the successful response to this by the number of pre-arrival online registrations received for the Induction Programme (101), GOALLS (55) and Academic English Programme for Law Classes (70)

A total of 131 students attended the Induction sessions in the Welcome Week. This was a positive increase from the previous years. Of the students surveyed, 79% rated the Undergraduate Induction Programme as 4* or 5* and 92% rated the Postgraduate Induction Programme as 4* or 5*.

Close to 300 students benefited from the fourteen GOALLS sessions spread across the Autumn and Spring Terms. Of the 1505 total number of responses received for seven sections, 78% students marked the sessions as Outstanding (5*) or Very Good (4*).

This three-point Legal Seagulls Experience Plan has been able to lay the foundation to:

  • Respond to the early stages of culture shock and novelty for overseas students.
  • Introduce the overseas students thoroughly to UK as a host and to Reading as the host University.
  • Strengthen global graduate attributes and skills for overseas students.
  • Foster intercultural understanding and communication.

A few encouraging responses quoted from the student feedback are indicative of the positive impact: “Interaction with people of a different ethnicity other than mine rebuts my initial mindset about them”; “It was brilliant learning the debate mechanism and how to structure an oral argument properly”; “Today’s session has been tremendously useful for law students who are preparing for the upcoming exam. I have learnt a number of ways to study effectively.”

Reflections

The Pre-arrival Academic Welcome Kit (PAWK) and the Academic Bridging Course Induction Programme have been continued almost in the same format for 2016-17.

I have added a team-building activity session for the credit-transfer students’ Induction Programme. The PG Induction will now be live-streamed for the students arriving late and for students on the distance learning programme.

The GOALLS sessions have been reorganized in response to the feedback from the students that most of them were busy with exams and submissions in the Spring term and therefore could not attend the sessions in spite of being interested. This was reflected in the dwindling attendance. In view of this, for 2016-17, I have re-structured GOALLS.

The sessions on academic and cultural integration, career advice and exam support have now been scheduled during the Autumn Term. Electronic feedback has been added to the paper version. As an academic value addition to GOALLS, Professor Susan Breau, Head of School, has very kindly accepted my proposal to start an academic competition, the World Constitutions Showcase, to be delivered by Legal Seagulls under the Public Law Lecture series.

My efforts will also be see a renewed focus on activities reflecting on integration of home and overseas students.

Follow up

I honestly hope to create a well-founded sense of trust amongst our international students that we are absolutely keen on giving them the best possible support and services that any foreign academic institution can think of. We have a vibrant body of overseas students and we benefit in more ways than one from their presence and participation on campus.

The Legal Seagulls Experience Plan will strive to create, nurture and award an environment of mutual learning among the home students, overseas students and staff in the School of Law.

Our long-term aim is to create an ethos of a real and open acceptance of, and support to, the academic and cultural diversity brought to us by our international students.

Links

International Law Mooting

By edwardwhite Comment Closed

Professor James Green, Law
j.a.green@reading.ac.uk
Year of activity: 2007-08

Overview

Since 2007, the Law School has run a Part Three module entitled ‘International Law Mooting’. This is a highly innovative module, where a team of four students participate in the prestigious Telders International Law Moot Court Competition. The competition involves the team presenting written – and then, crucially, oral – arguments on a fictional dispute in international law.

Objectives

  • Memorials are jointly written and a single mark is given to all students: this builds teamwork, and prepares students for the submission of written memorials in real cases.
  • The oral performance is assessed, meaning that advocacy and presentation skills are developed.
  • Students are also assessed on individual reflective portfolios, which reward reflective learning and emphasize skill development.

Context

The team competes externally, for the University of Reading, against other universities. This gives the University of Reading a profile nationally and internationally, and provides students with a wonderful experience. The work required to compete in the competition is significant, and so – after entering for the first time in 2006 as an extra-curricular activity – it was decided that student effort here had to be rewarded with appropriate degree credit, hence the creation of the module. It develops a wide range of practical legal skills that are simply not part of other, traditional, law modules.

Implementation

Of the various issues that arose with regard to implementing the mooting module, the most pertinent for possible implementation elsewhere is the manner in which this module was to be assessed to give best effect to its learning objectives. A key learning objective was to develop communication and advocacy skills – but there is a danger of placing emphasis entirely on the student’s performance in the single external moot. Pressure is high, and ‘stage fright’ very possible. It is also difficult to ensure quality review of the marking of oral presentations/mooting. It was therefore decided that this issue could be addressed by complementing the marks awarded for the oral performance by also awarding a percentage of the marks for a reflective assessment. This ensured that students gained the credit that they were due for their skill development across the module as a whole, and not just based on the moot final alone.

Impact

The module has been hugely successful over the years. Students consistently give extremely positive feedback on the unique module design, and team-orientated nature of the module. It is also almost always the case that students gain extremely high marks in the module, with a significant number of firsts having been awarded. Indeed, no student has achieved an overall module mark below the 2:1 classification in 9 years of running the module.

Reflections

We have, of course, reflected on the module over the years. One change we made was to increase the percentage of the overall grade for the oral performance, and to slightly reduce the amount for the portfolio. This was in response to student feedback – we had the balance a little too heavily on rewarding the reflection, and students felt they should get rather more credit for the moot itself. We feel, after reflection and a few tweaks to the module design, that the assessment methods now best suit the learning outcomes. By and large, though, the module is a resounding success and continues to run in a form that is not too dissimilar from what was originally envisaged in 2007.

Follow up

Nothing beyond what is stated in the ‘Reflections’ box, above.

Links

The Module Description Form for International Law Mooting: http://www.reading.ac.uk/modules/document.aspx?modP=LW3ILM&modYR=1617

The website for the external Telders competition: http://teldersmoot.com/