Promoting Research in Teacher Education

Nasreen Majid, Institute of Education                                                                                            n.majid@reading.ac.uk

Overview

All students on the BA Primary Education (QTS) programme develop a piece of research, entitled, Advanced Teaching Project (ATP). This blog summarises how the ATP conference is used to develop peer learning in order for part 2 students to learn from the research experiences of part 3 students. 

Objectives

  • Develop sustained and structured scaffolds to undertake effective undergraduate research
  • Develop high quality peer learning opportunities
  • Develop a culture of educational research
  • Enable an understanding that teaching is a research informed profession.

Context

Module ED3PI1 is a 40 credit module, assessed through an 8000 word ATP dissertation. The ATP develops our trainee teaches’ educational research skills. The preparation for this project starts at the end of part 2, with an introductory lecture and a conference in the summer term, showcasing the research undertaken by the part 3 students. 

The conference aims are firstly to celebrate the outstanding work undertaken by our students and the teaching aim is for peer learning, where the part 3 presentations and posters inform part 2s on the best approaches to write a strong piece of undergraduate research. This approach amplifies the impact of learning as it is an exchange between peers and based on the part 3 students’ experiences of writing their ATP over an academic year.

The student presentations highlight the research undertaken, how they conducted their literature review, their methodological approach and the effectiveness of this. The students share ‘top tips’ throughout the presentation to enable collaborative learning. The presenters use mentimeter to generate questions, thus providing an anonymous platform for part 2 students to ask questions freely.

Impact

The ATP conference sets a foundation for the students to develop a sustained and structured approach to undergraduate research. This is measured by the way students engage with their ATPs and the quality of research output. Furthermore, the ATP work serves as a springboard for some part 3 students to undertake Masters level work as well as being encouraged to publish their research. A major impact of the conference is the high quality peer learning opportunities that take place. This culminates to our students building a strong identity as educational researchers.

The materials shared at the conference, including the presentations and posters are drawn upon across part 3, during the teaching input for the module to further consolidate the learning experienced during the ATP conference. The videos developed during the conference are shared across the academic year to facilitate further learning.

Reflections

The process of developing high quality projects for the ATP using a peer learning model provides a strong opportunity for students to collaborate and learn from the previous cohort’s experiences. It is clear from the observations that the part 2 students gain a great deal from listening to and being assured by the part 3 students about the ATP writing and learning process. Evidently, learning from peers and understanding that the part 3 students were in the same situation one year ago, provides food for thought for the part 2 students and enables then to recognise that although the work is very challenging, it is ‘doable’ to a high standard because they have seen outstanding examples of work from their peers. Overall, I am always impressed by the work that goes into the presentations and the professional way the part 3 students deliver their research to their peers.

Links

Link to the IOE news feed featuring the ATP conference:

http://blogs.reading.ac.uk/ioe-news-and-events/2018/06/06/at-the-annual-student-teacher-research-conference-there-was-an-astonishing-range-of-talent-and-also-a-fair-hint-of-nostalgia/

Study Even Smarter

Michelle Reid, Kim Shahabudin, and Sonia Hood, Study Advice

The successful Study Smart online course will be running again for new Part 1 undergraduates, and will be launched to the new cohort on 28th August. Study Smart helps students make a smooth transition to university study by giving them a shared start point and by welcoming them into the University of Reading learning community. We aim to build on the success of last year, which saw 94% of students who completed the course saying their understanding of what was expected at university-level study was either fairly good, or very good.

National Interest

It is pleasing to see Study Smart becoming nationally recognised as a good model for student transitions. We have received inquiries from other leading Higher Education Institutions about using our model, and we have been showcased in a recent visit from Chris Millward, Director for Fair Access and Participation.

New and Improved

The Study Advice team are currently working on a number of improvements to Study Smart based on student and staff feedback. We are streamlining some of the steps in the course in order to make Study Smart more manageable and appealing, particularly to international students who may be pressed for time. We are liaising with ISLI in order to make sure our communications to pre-sessional students are as effective as possible. We are highlighting the benefits of doing Study Smart for students in STEM subjects. One of the most successful elements of the course last year was the student mentors, and we have recruited an excellent team of mentors for this year who have an even wider range of backgrounds and transition experiences to share with the incoming students. We are also investigating whether the main invitation to the course can come from Schools to give additional weight to the message.

Hands-On Session for staff

Feedback also emphasised the value of staff endorsements in helping students to engage with the course, so we would really value your promotion of Study Smart to your tutees and classes. To help academic staff get a feel for the course, we ran a successful Study Smart ‘Hands-On’ session on 4th June with an opportunity to explore the student-view of the course and sample the famous Study Advice cake! We will be running another ‘Hands-on’ session in early September so look out for details of this coming soon via the CQSD T&L programme.

For more information about Study Smart, see our Tutor’s Guide: http://libguides.reading.ac.uk/studysmart or email studyadvice@reading.ac.uk

Engaging students in the design of assessment criteria

Dr Maria Kambouri-Danos, Institute of Education                                                                                                                m.kambouridanos@reading.ac.uk                                                                                                                                                                                            Year of activity 2017/18

Overview

I recently led a group of colleagues while working in partnership with students to develop a new module in BA in Children’s Development and Learning (BACDL) delivered at the Institute of Education (IoE). This approach to working in partnership with students is a core part of the project’s aim and the work described here has been part of a Partnerships in Learning & Teaching (PLanT) project.

Objective

The team’s aim was to develop and finalise a new module for BACDL in close partnership with the students. The new module will replace two existing modules (starting from 2018-19), aiming to reduce overall assessment (programme level), a need identified during a Curriculum Review Exercise. The objective was to adopt an inclusive approach to student engagement when finalising the new module, aiming to:

  • Go beyond feedback and engage students by listening to the ‘student voice’
  • Co-develop effective and student-friendly assessable outcomes
  • Identify opportunities for ‘assessment for learning’
  • Think about constructive alignment within the module
  • Encourage the development of student-staff partnerships

Context

To accomplish the above, I brought together five academics and six students (BACDL as well as Foundation Degree (FDCDL) students). Most of the students on this programme are mature students (i.e. with dependants) who are working full time while attending University (1 day/week). To encourage students from this ‘hard to reach group’ to engage with the activity, we secured funding through the Partnerships in Learning & Teaching scheme, which enabled the engagement of a more diverse group (Trowler, 2010).

Implementation

The team participated in four partnership workshops, during which staff and students engaged in activities and discussions that helped to develop and finalise the new module. During the first workshop, we discussed the aims of the collaborative work and went through the module’s summary, aims and assessable outcomes. We looked at the two pre-existing modules and explored merging them into a new module, maintaining key content and elements of quality. During the second workshop, we explored chapter two from the book ‘Developing Effective Assessment in Higher Education: a practical guide’ (Bloxham & Boyd, 2007), which guided the discussions around developing the assessment design for the new module.

During the third workshop, we discussed aspects of summative and formative tasks and finalised the assessment design (Knight, 2012). We then shared the new module description with the whole BACDL cohort and requested feedback, which enabled us to get other students’ views, ensuring a diverse contribution of views and ideas (Kuh, 2007). During the last workshop, with support from the Centre of Quality Support and Development (CQSD) team, we implemented a game format workshop and created a visual ‘storyboard’, outlining the type and sequence of learning activities required to meet the module’s learning outcomes (ABC-workshop http://blogs.ucl.ac.uk/abc-ld/home/abc-workshop-resources/). This helped to identify and evaluate how the new module links with the rest of the modules, while it also helped to think about practical aspects of delivering the module and ways to better support the students (e.g. through a virtual learning environment).

Photos from staff-student partnership workshops

Impact

The close collaboration within the team ensured that the student voice was heard and taken into account while developing the new module. The partnership workshops provided the time to think collaboratively about constructive alignment and ensure that the new module’s assessment enables students to learn. It also ensured that the module’s assessable outcomes are clearly defined using student-friendly language.

A pre- and post-workshop survey was used to evaluate the impact of this work. The survey measured the degree to which students appreciate the importance of providing feedback, participate in activities related to curriculum review/design, feel part of a staff-student community and feel included in developing their programme. The survey results indicate an increase in relation to all of the above, demonstrating the positive impact of activities like this on student experience. All students agreed that it has been beneficial to take part in this collaborative work, mentioning that being engaged in the process, either directly (attending the workshops) or indirectly (providing feedback) helped them to develop a sense of belonging and feel part of the community of staff and students working together (Trowle, 2010; Kuh, 2005;2007).

Reflections

This project supported the successful development of the new module, from which future students will benefit (Kuh, 2005). The work that the team produced has also informed the work of other groups within the IoE. At the institutional level, this work has supported the development of the CQSD ‘Student Engagement’ projects. All the above were achieved because of close collaboration, and could not have been done by a group of individuals working on their own (Wheatley, 2010). Because of that, our team was awarded the University Collaborative Awards for Outstanding Contributions to Teaching and Learning.

References

Bloxham, S. & Boyd, P. (2007). Developing effective assessment in higher education: a practical guide. Maidenhead: Open University Press.

Knight, P. (Ed.). (2012). Assessment for learning in higher education. Routledge.

Kuh, G.D. (2005). Putting Student Engagement Results to Use: Lessons from the Field, Assessment Update. 17(1), 12–1.

Kuh, G.D. (2007). How to Help Students Achieve, Chronicle of Higher Education. 53(41), 12–13.

Trowler, V. (2010). Student engagement literature review. The Higher Education Academy.

Wheatley, M. (2010). Finding our Way: Leadership for an Uncertain Time. San Francisco: Berrett-Koehler

Curriculum Framework Conference 2018

On 31 January the Meadow Suite in Park House was a-buzz with an air of anticipation as attendees at the Curriculum Framework Conference munched on Breakfast Baguettes and gulped down copious quantities of fresh coffee and tea.

Following a generous welcome and the obligatory identification of emergency exits, the morning’s session commenced with a thoroughly engaging and thought-provoking key-note address from Professor Tansy Jessop from Southampton Solent University. Delegates were immersed into a lively discussion of the changing university environment and the impact this has on all aspects of teaching and learning. The key take-away seemed to be that transforming the assessment experience for students requires a programme level approach, and is a critical component in the move from a knowledge-transmission model of higher education, to one of social constructivism. Following an opportunity for collegial networking over a further cuppa,

a choice of parallel sessions offered conference attendees a range of interactive workshops pertinent to the Curriculum Framework ; this blog post will focus on the TESTA Masterclass workshop delivered by Tansy.

The Masterclass introduced participants to the three components of TESTA methodology: 1) Assessment Mapping, 2) a Student Assessment Experience Questionnaire, 3) Student Focus Groups.

The Psychology Department volunteered their level-one compulsory modules as an impromptu case-study to illustrate the process of assessment mapping. This was seen as a brave move by at least one of the participants!

The resulting quantification of both the total number and the spread of assessment types demonstrated the value in undertaking this type of analysis. Participants also had a chance to review the current version of the Assessment Experience Questionnaire, and to review a transcript taken from a student focus group. Tansy skilfully showed the importance of using all three tools to gain a holistic understanding of the assessment environment as a precursor to full-scale review.

TESTA was born out of an HEA funded project; resources, tools and case studies are available online here.

Parallel sessions in both the morning and afternoon also engaged participants in: rapid Curriculum Design, Fostering Belonging in Culturally Diverse Cohorts, Inclusive Practice, Engaging students in curriculum review, and embedding Research & Enquiry, Assessment Literacy, and Employability into the curriculum

From the conference it was evident that curriculum review in light of the Curriculum Framework is gathering momentum. In response to participant feedback, the Curriculum Framework team is planning a follow-up session focussing on what curriculum review looks like in practice. This session will be designed to answer the more practical questions of what, how, and where do I start.

Watch this space!

 

 

Redesigning postgraduate curricula on commercial law through student engaging, research-informed and multidisciplinary pathway programmes

Professor Stavroula Karapapa, School of Law                          s.karapapa@reading.ac.uk

Overview

In 2015/2016, we substantially redeveloped our postgraduate provision in commercial law through the introduction of a pioneering, student-engaging, research-informed and multidisciplinary set of postgraduate pathway programmes. Contrary to the programmes previously in place, the new curriculum is unique in its pathway design allowing students to develop a breadth of commercial law expertise whilst also specialising in their area of interest (for a full list of programmes see here). The project on which this entry reflects has resulted in an innovative curriculum that shaped the identity of Centre for Commercial Law and Financial Regulation (CCLFR) as a centre of excellence on cutting-edge themes of commercial law.

Objectives

  • To redevelop our postgraduate curriculum in commercial law through the introduction of cutting-edge themes of study based on the principles of research-informed and multidisciplinary teaching.
  • To empower student learning, improve student experience, and foster the development of a learning community.
  • To hear the student voice towards the design of the curriculum and to proactively and directly engage ‘students as partners’ in the development and evaluation of the core module for the new programmes.

Context

As often happens in Higher Education, the postgraduate programmes in Commercial Law previously in place were the result of the work of independent colleagues at various points in time, starting in 2011. Modular options reflected this dynamic, and they were also impacted by continuous staffing changes over the years. The pathway programmes are the result of collective effort within the School of Law, effective consultation with students and evaluation of their feedback, and constructive collaboration with colleagues from various Schools and services across the University (including marketing, careers, conversions etc.).

Implementation

Following a review of our PGT provision, we redeveloped our commercial law curriculum on the basis of three pillars:

  1. student feedback (module evaluation forms and ‘graduation’ forms collected since 2011) concerning suggestions for improvement, informal comments from students enrolled in 2015/2016 on ideas for new modules/programmes and engagement of ‘students as partners’ in the development of the core module for the new pathway programmes;
  2. extensive market study carried out by marketing and the (then) PGT Director regarding areas worth expanding on;
  3. expansion of our module offerings through the valuable contribution of numerous colleagues in the School of Law and consultation with various Schools across the University that agreed to open up relevant modules, effectively enhancing multidisciplinarity in our programmes.

Instead of offering numerous programmes with no clear link to each other, we introduced a set of pathway programmes (including 5 new PGT programmes and a redesign of the existing ones) whereby all programmes are centred around one core legal field, International Commercial Law, and students have the option to follow a pathway on a specialist area designed around our research strengths as a School and as a University, essentially building on research-informed teaching. Part of this redesigning process was the revision of the compulsory module for all pathways, LWMTAI-Advanced Issues in Commercial Law, which was based on the engagement of students as partners, drawing on a UoR small-scale research project that was initiated in June 2016, an entry of which is available here and here.

Impact

The collective effort of numerous colleagues in the School of Law and the support from various Schools and services across the University resulted in the development of a pioneering set of pathway programmes, centred around the values of research-informed teaching and multidisciplinarity and developed on the basis of student feedback. The project enhanced student engagement, taking on board student views on the learning design. The redrafting of a core module (LWMTAI) had direct impact on student learning, enabling students to proactively review their own learning process and to develop an increased sense of leadership and motivation. There was also positive correlation between the introduction of new pathways (especially Information Technology and Commerce; Energy Law and Natural Resources) and PGT recruitment. Anecdotal evidence indicates that the conversion rate of existing PGT students to our PGR programme has also increased. Importantly, the redevelopment of our programmes created a distinctive identity for CCLFR as a centre of excellence on cutting-edge themes of commercial law.

Reflections

The success of the redevelopment of our PGT curriculum was based on three pillars:

  1. Collective effort: The redevelopment of the programmes required the engagement of various colleagues from the School of Law who met on numerous occasions to reflect on the programmes and introduced new modules on cutting-edge themes to meet the needs of the new pathway design. This effort exceeded business as usual. An example of such collective effort is the redesign of the core module of the pathway programmes which followed the ‘student as partners’ approach and was implemented with the collaboration of various members of staff from the School of Law.
  2. Student engagement: Unlike what usually happens in higher education with ex post student feedback, the pathway design used that feedback constructively towards designing new programmes, taking into consideration student comments in evaluation forms and also engaging students in the programme design process. Importantly, it was students themselves that proactively informed the curriculum of the core module for all pathway programmes, with their voice having being heard even before the completion of the taught component.
  3. Cutting-edge themes and research-informed teaching: At the heart of student feedback was the desire to increase the number of modular offerings from other Schools and Departments, effectively to enhance the multidisciplinary approach that was already in place. Introducing more modules from other Schools to our curriculum on the basis of their relevance and appropriateness to our pathways has become a learning process to us as educators in that it has resulted in dynamic synergies and an innovative curriculum as end-result of the exercise.

Links

Details on our new pathway programmes are available here: http://www.reading.ac.uk/law/pg-taught/law-pgt-courses.aspx

Forecasting, Feedback and Self-reflection by Dr Peter Inness

Overview:

Each year a group of part 2 students from Meteorology make their way across campus to the Minghella Building to film weather forecasts in the professional “green screen” studio. As well as improving their forecasting ability this module also helps students to improve their presentation skills – a key employability attribute in many careers.

Objectives:

During the module students will;

  • make short video weather forecasts in a professional studio
  • receive feedback on performance in order to improve on the quality of the work
  • give peer feedback to fellow students in order to develop this useful life skill
  • reflect on their performance and consider how they can use the feedback to improve future performances.

Context:

Presentation skills are a crucial aspect of many jobs, whether it be in front of a camera or face to face with an audience. Lecturers in Meteorology may not always be the best people to coach these skills so we draw on experience in a School where performance and presentation is at the heart of everything they do.
Students spend 4 sessions in the TV studio, working up to the filming of a “live” TV weather forecast. After each rehearsal, students receive detailed feedback on their performance from staff and also from their fellow students. Crucially they are also asked to reflect on their own performance and how they might improve it. This self- reflection aspect is something we would like to encourage across the Meteorology department as it is a skill which perhaps doesn’t come naturally to a scientific discipline in the same way as it does in a performance related discipline such as film and theatre.

Impact:

Students are very appreciative of the high level of feedback on performance in this module, as evidenced in module evaluation questionnaires. The feedback also has a massive impact on improving the students’ performances across the module, resulting in some near professional standard performances by the end.

It is obvious that the encouragement to reflect and take on board feedback is a major driver of improved student performance in this module.

Reflections:

Working in an environment in which feedback and self-reflection are built into the activities has made me as a module convenor in a science department realise that this is something we can use more effectively across many of our other modules, not just those which involve presentation.

Self-reflection and peer feedback have a clear impact on performance in this module and we need to find ways to incorporate more of these activities into the rest of our taught modules.

I am now actively looking at ways that we can make reflection an integral part of how our students approach their learning.

 

Involving students in the appraisal of rubrics for performance-based assessment in Foreign Languages By Dott. Rita Balestrini

Context

In 2016, in the Department of Modern Languages and European Studies (DMLES), it was decided that the marking schemes used to assess writing and speaking skills needed to be revised and standardised in order to ensure transparency and consistency of evaluation across different languages and levels. A number of colleagues teaching language modules had a preliminary meeting to discuss what changes had to be made, what criteria to include in the new rubrics and whether the new marking schemes would apply to all levels. While addressing these questions, I developed a project with the support of the Teaching and Learning Development Fund. The project, now in its final stage, aims to enhance the process of assessing writing and speaking skills across the languages taught in the department. It intends to make assessment more transparent, understandable and useful for students; foster their active participation in the process; and increase their uptake of feedback.

The first stage of the project involved:

  • a literature review on the use of standard-based assessment, assessment rubrics and exemplars in higher education;
  • the organization of three focus groups, one for each year of study;
  • the development of a questionnaire, in collaboration with three students, based on the initial findings from the focus groups;
  • the collection of exemplars of written and oral work to be piloted for one Beginners language module.

I had a few opportunities to disseminate some key ideas emerged from the literature review – School of Literature and Languages’ assessment and feedback away day, CQSD showcase and autumn meeting of the Language Teaching Community of Practice. Having only touched upon the focus groups at the CQSD showcase, I will describe here how they were organised, run and analysed and will summarise some of the insights gained.

Organising and running the focus groups

Focus groups are a method of qualitative research that has become increasingly popular and is often used to inform policies and improve the provision of services. However, the data generated by a focus group are not generalisable to a population group as a whole (Barbour, 2007; Howitt, 2016).

After attending the People Development session on ‘Conducting Focus groups’, I realised that the logistics of their organization, the transcription of the discussion and the analysis of the data they generate require a considerable amount of time and detailed planning . Nonetheless, I decided to use them to gain insights into students’ perspectives on the assessment process and into their understanding of marking criteria.

The recruitment of participants was not a quick task. It involved sending several emails to students studying at least one language in the department and visiting classrooms to advertise the project. In the end, I managed to recruit twenty-two volunteers: eight for Part I, six for Part II and eight for Part III. I obtained their consent to record the discussions and use the data generated by the analysis. As a ‘thank you’ for participating, students received a £10 Amazon voucher.

Each focus group lasted one hour, the discussions were entirely recorded and were based on the same topic guide and stimulus material. To open discussion, I used visual stimuli and asked the following question:

  • In your opinion, what is the aim of assessment?

In all three groups, this triggered some initial interaction directly with me. I then started picking up on differences between participants’ perspectives, asking for clarification and using their insights. Slowly, a relaxed and non-threatening atmosphere developed and led to more spontaneous and natural group conversation, which followed different dynamics in each group. I then began to draw on some core questions I had prepared to elicit students’ perspectives. During each session, I took notes on turn-taking and some relevant contextual clues.

I ended all the three focus group sessions by asking participants to carry out a task in groups of 3 or 4. I gave each group a copy of the marking criteria currently used in the department and one empty grid reproducing the structure of the marking schemes. I asked them the following question:

  • If you were given the chance to generate your own marking criteria, what aspects of writing/speaking /translating would you add or eliminate?

I then invited them to discuss their views and use the empty grid to write down the main ideas shared by the members of their group. The most desired criteria were effort, commitment, and participation.

Transcribing and analysing the focus groups’ discussions

Focus groups, as a qualitative method, are not tied to any specific analytical framework, but qualitative researchers warn us not to take the discourse data at face value (Barbour, 2007:21). Bearing this in mind, I transcribed the recorded discussions and chose discourse analysis as an analytical framework to identify the discursive patterns emerging from students’ spoken interactions.

The focus of the analysis was more on ‘words’ and ‘ideas’ rather than on the process of interaction. I read and listened to the discussions many times and, as I identified recurrent themes, I started coding some excerpts. I then moved back and forth between the coding frame and the transcripts, adding or removing themes, renaming them, reallocating excerpts to different ‘themes’.

Spoken discourse lends itself to multiple levels of analysis, but since my focus was on students’ perspectives on the assessment process and their understanding of marking criteria, I concentrated on those themes that seemed to offer more insights into these specific aspects. Relating one theme to the other helped me to shed new light on some familiar issues and to reflect on them in a new way.

Some insights into students’ perspectives

As language learners, students gain personal experience of the complexity of language and language learning, but the analysis suggests that they draw on the theme of complexity to articulate their unease with the atomistic approach to evaluation of rubrics and, at times, also to contest the descriptors of the standard for a first level class. This made me reflect about whether the achievement of almost native-like abilities is actually the standard against which we want to base our evaluation. Larsen-Freeman’s (2015) and Kramsch’s (2008) approach to language development as a ‘complex system’ helped me to shed light on the idea of ‘complexity’ and ‘non-linear relations’ in the context of language learning which emerged from the analysis.

The second theme I identified is the ambiguity and vagueness of the standards for each criterion. Students draw on this theme not so much to communicate their lack of understanding of the marking scheme, but to question the reliability of a process of evaluation that matches performances to numerical values by using opaque descriptors.

The third theme that runs through the discussions is the tension between the promise of objectivity of the marking schemes and the fact that their use inevitably implies an element of subjectivity. There is also a tension between the desire for an objective counting of errors and the feeling that ‘errors’ need to be ‘weighted’ in relation to a specific learning context and an individual learning path. On one hand, there is the unpredictable and infinite variety of complex performances that cannot easily be broken down into parts in order to be evaluated objectively, on the other hand, there is the expectation that the sum of the parts, when adequately mapped to clear marking schemes, results in an objective mark.

Rubrics in general seem to be part of a double discourse. They are described as unreliable, discouraging and disheartening as an instructional tool. The feedback they provide is seen as having no effect on language development as does the complex and personalised feedback that teachers provide. Effective and engaging feedback is always associated with the expert knowledge of a teacher, not with rubrics. However, the need for rubrics as a tool of evaluation is not questioned in itself.

The idea of using exemplars to pin down standards and make the process of evaluation more objective emerges from the Part III focus group discussion. Students considered pros and cons of using exemplars drawing on the same rationales that can be found debated in scholarly articles. Listening to, and reading systematically through, students’ discourses was quite revealing and brought to light some questionable views on language and language assessment that most marking schemes measuring achievement in foreign languages contribute to promote.

Conclusion

The insights into students’ perspectives gained from the analysis of the focus groups suggest that rubrics can easily create false expectations in students and foster an assessment ‘culture’ based on an idea of learning as steady increase in skills. We need to ask ourselves how we could design marking schemes that communicate a more realistic view of language development. Could we create marking schemes that students do not find disheartening or ineffective in understanding how to progress? Rather than just evaluation tools, rubrics should be learning tools that describe different levels of performance and avoid evaluative language.

However, the issues of ‘transparency’ and ‘reliability’ cannot be solved by designing clearer, more detailed or student-friendly rubrics. These issues can only be addressed by sharing our expert knowledge of ‘criteria’ and ‘standards’ with students, which can be achieved through dialogue, practice, observation and imitation. Engaging students in marking exercises and involving them in the construction of marking schemes – for example by asking them how they would measure commonly desired criteria like effort and commitment – offers us a way forward.

References:

Barbour, R. 2007. Doing focus groups. London: Sage.

Howitt, D. 2016. Qualitative Research Methods in Psychology. Harlow: Pearson.

Kramsch, C. 2008. Ecological perspectives on foreign language education. Language Teaching 41 (3): 389-408.

Larsen-Freeman, D. 2015. Saying what we mean: Making a case for ‘language acquisition’ to become ‘language development’. Language Teaching 48 (4): 491-505.

Potter, M. and M. Wetherell. 1987. Discourse and social psychology. Beyond attitudes and behaviours. London: Sage.

 

Links to related posts

‘How did I do?’ Finding new ways to describe the standards of foreign language performance. A follow-up project on the redesign of two marking schemes (DLC)

Working in partnership with our lecturers to redesign language marking schemes 

Sharing the ‘secrets’: Involving students in the use (and design?) of marking schemes

Reflections on university transition from a new staff member By Dr Alana James

I started university this year, or at least it feels like I have upon starting my new job as a Lecturer in the School of Psychology and Clinical Language Sciences (PCLS). Every face around me is unfamiliar, the campus seems an unnerving maze, and simple processes have become logic puzzles. Oh the joy I felt at using a printer successfully (let’s not mention the attempts at scanning a document). There are many enjoyable aspects – meeting lovely new colleagues and joining in the School’s coffee mornings for example – but the transition is more disorientating than I expected. At the end of my first week I was grateful for some downtime at home, and found myself reflecting upon how my experience compares with the transition to university for new students.

New students face the same challenges I am but may also be living independently, away from their support network, for the first time. Many go home each day to a new place and have to figure out new washing machines and cookers never mind printers, as well as try to get along with housemates. For those commuting there are other challenges, including being at the mercy of traffic or public transport, and trying to forge friendships between classes. I have worked in universities before, and am able to draw upon previous experience; many new students arrive without having spent much, if any, time in a higher education environment. We know that factors such as being the first in your family to go to university or having a disability can make the transition even harder.

My own disorientation in these first days at the University of Reading has reminded me how all-encompassing the transition to university can be. As an academic my focus is often upon ensuring my new students have the academic skills needed to be an independent learner, but it’s important to be mindful that this is just one aspect of the overall transition experience. It’s easy to forget that the initial onset of new faces, places, and challenges can be mentally and physically wearing as well as exciting. When I meet my new students at the start of the next academic year I will try to recall how I felt when I joined the UoR.

One of the influencing factors in my decision to join the UoR was its commitment to student support, particularly mentoring. Harnessing our students’ potential to support each other through mentoring can ease mentees’ transition into university, whilst developing the mentors’ own skills and experience. I have previously run a scheme where psychology students mentored A-level pupils, giving them an insight into what university life is really like, and found that the mentors also benefited in terms of developing transferable skills and ideas about careers. Some recent research with my collaborator found that specialist mentoring, between qualified staff and mentees, is an effective form of support for students with mental health conditions and autism. I will certainly be encouraging my future students at the UoR to make the most of the STaR mentoring scheme and the mentoring connected to the Study Smart online course, first as mentees and later as mentors.

As for me, I am very much looking forward to the meetings with my staff mentor.

A letter to my pre-UoRM self about teaching international students By Dr Dan Jones

Dear pre-UoRM Dan (circa 2015),

So, you’re looking forward to going to the University of Reading Malaysia (UoRM) soon, right? Slightly daunting I’m sure, but you’ll be telling yourself that the UK campus already has a large international cohort and that teaching in Malaysia won’t be that different to what you have already been doing, right? Well, not quite. Therefore, I thought I’d take a moment to write you this letter to give you a few snippets of advice…

It wasn’t until I started at UoRM that I came to realise what diverse teaching needs were; a classroom on the other side of the world, a different continent, with a highly international cohort, a diverse educational background, and almost all with English as a second language. Immersed in this setting I was suddenly rather outnumbered by the local knowledge and experience of the classroom. I learned quickly that to engage these students I had to reflect on my current teaching practices. To quote from the curriculum framework, I had to “adapt to students’ needs rather than expecting students to adapt to me.”; some of my rigid expectations did not fit with this context, some assumptions were unfair. Over two years I picked up many tips for teaching international students, however, for ease of digestion, I thought I’d focus on five key points. I think an awareness will help with your transition, and could even be used at UoR before you go!

  1. Assumptions and expectations of roles: the role of a student and a staff member at university needs to be set out and understood, by both parties, early in the course. I found that international students start university with a range of educational, and cultural, backgrounds. If students and staff are not on the same page when it comes to what is expected from them in their degree, confusion and uncertainty arises. Acknowledging this difference, and laying out expectations clearly, was the most important lesson I took from UoRM, enabling me to maximise the effectiveness of my teaching.
  2. Adapting to students’ requirements: new skills may need breaking down, defined, and the basics taught before building upon foundations. The student must play their part by working hard to learn a new skill, we do not want to end up spoon-feeding students. However, an educator can also facilitate such a transition, learn to acknowledge differences in backgrounds, and help students adapt to different environments.
  3. Instilling confidence: many challenges I first had were related to confidence in the classroom: the culture I was in implicitly discouraged students to answer, or ask, questions. Schools often utilised embarrassment or peer pressure in the classroom, leading to an underconfident and passive cohort. I introduced ways to make the environment more accepting and friendly: electronically answering questions, using post-it notes to discuss, encouragement, light-heartedness – small things that added up to make a difference; by second year the difference in confidence was discernible.
  4. Providing a new/different context: particularly in psychology, many examples and theories are Western-centric, something I did not acknowledge before. It was a case of contextualising, to make the content more accessible for students, which led to a greater inclusiveness, and subsequently better engagement.
  5. Using simpler language: a practical issue that one must be aware of. The language I used was occasionally too advanced for the audience, and could benefit from additional explanation or simpler language. I was aware not to ‘dumb-down’ lectures (this is higher education after all), however, it is likely to be beneficial for all (including those with English as a first language) for the teacher to acknowledge the type, and level, of language that they are using.

Of course, a stipulation to this is that these points have arisen from my own experiences, and I can hear you now, “…well Dan, this is all very well, but where is the evidence? You are just relying on anecdote, can we really generalise from this?”. Yes, you’re right in your thinking, but, the changes in students’ approach to my classes was striking; confidence grew, participation improved and students were engaged. Nevertheless, as the scientist is exclaiming in you, that same scientist is exclaiming in me. Consequently, I, in collaboration with colleagues in the UK, Japan and Malaysia, am currently investigating whether cultural factors could explain the use of critical thinking in higher education. Data has been collected and analysis is underway…

Although realised and formed at UoRM, they are as applicable to the UK. UoR has almost 4,000 international students across all programmes and although we want to give international students the British education experience, I think it’s important to acknowledge differences and be aware of cultural challenges. Feel free to share this letter with colleagues at UoR and UoRM; these may not be the ‘best’ techniques, but, at the very least, may increase the discussion around multicultural learning, which can only benefit staff and students alike.

Finally, do make the most of your Malaysian adventure, it’ll be great. You’ll learn lots and be regularly challenged, but come back more culturally aware and open-minded than ever! Oh, and don’t forget to send a postcard…

Facilitating student reflection on learning in the Great Hall by Rev Dr Geoff Taggart

The Great Hall is the jewel in the crown of the London Rd campus and its cavernous interior gives it a unique atmosphere, ideal for reflective kinds of learning. I was fortunate enough to teach a session there in October and its dramatic, imposing space was a key pedagogical tool. The session lasted two hours and involved 50 2nd year students training to become primary teachers through the BA Primary Education (QTS) programme. Although the focus of the session was the teaching of religious education in school, it did not involve any teaching about specific religions at all. This is because a key aspect of RE in school is ‘learning from religions’, not about them. In other words, the focus is upon the pupils’ own developing sense of purpose, sense of identity, meaning and belonging.

I am writing this since such a session would seem useful to undergraduates on all programmes since the development of self-awareness, goal-setting and clarification of values are skills needed by all students. There is also a growing need to find new ways to sustain student wellbeing.

Once the students were seated, I told them a little about the space they were seated in, about when the hall was built and what it is used for. Talking about all the graduation ceremonies which are held here, I expressed the view that, for about 100 years, the hall has been the ‘symbolic heart’ of the university since it is probably the one room in the whole institution which most students, on all UK campuses, have passed through at least once. I told them what happens at graduation and role-played walking in at the back and up to the stage to shake the VC’s hand. I asked them to do a piece of writing for themselves, in silence, stressing the fact that this was not an assessment and would not be handed in. On a handout, the prompts for writing were:

  • List all the important events which will happen for you between now and graduation day (e.g. birthdays, holidays etc).
  • What are the important things you will need to do between now and graduation day?
  • Are there things which have happened which you already know will become permanent memories of your time at university?
  • Which aspects of yourself need to be nurtured and cultivated before graduation?
  • Are there any aspects of yourself to which you need to say goodbye before graduation?
  • Who will you invite to your graduation?
  • What is the link (if any) between these people and the memory you wrote about at the start of the day?
  • What would you like to say to these people/person?
  • Is there anything particular you want to do today as a result of this writing?

I stressed the fact that students could spend as long or as short a time on the activity as they liked but, if they wished to stop, they should leave the hall and meet up with friends later, rather than disturbing them. There were other activities they could go onto. Over the previous few weeks, Mark Laynesmith and I had been fortunate enough to borrow a canvas labyrinth to use with students. This was set out in the hall. I explained that the centre represented graduation day and they could ‘take a stone for a walk’, reflecting on the actions and changes that need to happen as they get closer and closer to it. I also had large carpet tiles and baskets of different shaped stones. I explained that, if they wanted, they could extend their reflection by creating a picture out of stones which represented their life at the current time.

I asked students to complete an evaluation form before they left. One of the things I wanted to know was whether students felt that this kind of exercise was legitimate and worthwhile on a degree-level programme. All fifty students agreed unanimously that it is ‘a good thing for universities to have space on their courses for students to reflect on their aims and values in life’. One student acknowledged that ‘there are courses/societies where you can reflect but it is hard to allow/give yourself time to go to them. This is why it is very good to incorporate it into lectures.’ One student commented that ‘we need this time to just be calm and think without things like technology getting in the way.’ Another said that ‘being a student is daunting because you are working for your future while trying to fit in. Reflection helps with mental state [sic] and could prevent students from getting bogged down.’

I was also curious whether students would have preferred to clarify values and shares their goals in group discussion, rather than in solitary writing. Although seven students would have preferred this, the vast majority agreed that the silent reflection exercise was better in this regard. One student commented:

 ‘I think the quality/depth of my reflection has been much better by writing it as (1) it is harder to come up with words on the spot in conversation to describe things and (2) I feel I can express more when I know only I am going to be reading it.’

Six students felt that both solitary and group work could complement each other and this remark was typical:

 ‘I feel if reflecting with others they may help to remind you of events you may have put to the back of your mind but on the other hand silence was very nice to just sit and reflect.’

Overall, the comments from the students were overwhelmingly positive. These are some examples:

  • ‘It has allowed me to stop and think about where I am in my life and where I want to go.’
  • ‘I very much enjoyed the reflective session. It has benefitted me in many ways by putting my personal and university practices into perspective.’
  • ‘It made it clear to me how important family are in your life.’
  • ‘I was able to let all my feelings out on paper that I wouldn’t normally feel comfortable doing’.
  • ‘I have become more aware of my personal goals and who/where I want to be at the time of my graduation.’
  • ‘I found it really useful to think about what aspects of myself I want to change/develop before graduation day.’
  • ‘The Great Hall reflective writing experience was one of the most beneficial activities I’ve ever done in a lecture.’
  • ‘Today has made me think about my life in lots of ways – emotional but helpful.’
  • ‘I almost feel uplifted after reflecting upon myself and others.’
  • ‘I hadn’t realised how many good memories I had from only one year of uni.’
  • ‘Slowing down today has had a huge positive affect’
  • ‘The first thing I’m going to do when I leave is call my family and thank them for supporting me on my journey through university.’
  • ‘Very helpful in understanding where my head is at mentally and grounding as I was able to list the most important things that matter to me.’

 

This exercise brought home to me how valuable the scale and atmosphere of the Great Hall can be as a resource in promoting a deep level of reflection and how it could contribute to all kinds of ‘contemplative pedagogy’.