Update on making Word and PowerPoint accessible: By Professor Richard Mitchell

Preamble

Earlier in the year, Laura Bennett and I wrote a blog on making Word and PowerPoint accessible, which reflected our experience of implementing the University’s policy on Inclusive Practice in T&L, which is available here.

Since that blog was written, the University has included Ally into Blackboard, which provides academics with a view on how accessible our documents are and step-by-step guidance on how to make them accessible. In this blog I reflect on Ally and other developments, including the part of the recent Accessibility Audit Report from JISC which covered one of my courses.

Ally in Blackboard

As is explained on the TEL Support Site, Ally is an add on to Blackboard which allows students to download your teaching material in alternative formats (such as in HTML for view on mobile phone, electronic braille, etc) and it provides an accessibility score on your material  as well as feedback and guidance to enable you to make the material more accessible. Instructors can see a colour coded dial with a percentage

 

 

 

 

If low, the file is deemed not accessible and needs immediate attention; if medium it is somewhat accessible and could use improvement; if high it is accessible but could be improved; and occasionally the file is judged perfect.

If you click on the icon, you are presented with a screen with the score, and an option to see all the issues. You can then see what you need to do, and how the score can be increased – though so far there is guidance on only some of the issues.

I then go back to the original Word or PowerPoint file, make the appropriate changes, and re upload them to Blackboard. I can then get a new assessment by Ally, though I tend to have to wait for it.

The percentages given can seem harshly low – I had a document with two images which I had not added Alt Text to (one being the University crest), and the score was about 50%. The file became perfect when I added suitable text to those images. I gather that Ally considers the lack of Alt Text as a more pressing issue, which accounts for the scoring.

It should be noted that Word and PowerPoint’s built in checker is satisfied if you enter a Title or Description to any Alt Text, but Ally is happy only if there is a description – so is there any point in adding a title?

I am told that Alt-Text is read by screen readers, which explains why Ally considers it important – whereas a Title can be what is shown when a mouse hovers over the figure.

Ally can’t assess how useful your Alt Text is, just that it is there – so you should use your judgement.

As we noted in the original blog, you don’t have to be perfect – most of my PowerPoint documents are rated as High, with a score of 99% – the concern being about contrast issues, but as of writing there is no guidance on where the issue occurs. I am occasionally judged as Perfect which is nice! However, this may be more of a judgement call, as it is usually obvious when viewed on the screen. Blackboard suggests downloading this tool to fix contrast issues.

One issue Ally flags is untagged PDF files. If, say, your source document is a Word file, and you correctly use styles such as Title, Heading 1, Heading 2, Normal, etc. and then decide to produce a PDF, I recommend that you do so by saving the document as PDF, but just before saving, press the Options button in the dialog box, and ensure the Document Tags for Accessibility option is ticked.

I have come to the conclusion, however, that it is better to upload Word or PowerPoint documents, rather than PDFs to Blackboard. Students can readily download such documents (in whatever format) and can change them as they require – such as adding notes to PowerPoint slides, for instance.

Using notes in PowerPoint

In 2017, I attended one of the public lectures I help to organise for the local IET on the Internet of Insecure Things. It was a very engaging lecture, comprising slides mainly composed of pictures, which the speaker in effect used as prompts. In contrast, if a slide comprises text which the speaker reads, albeit with some embellishments, a lecture can be dull.

However, from an accessibility point of view, such an approach does not provide much support. A solution to this is to use the notes section in PowerPoint. In fact, there is brief guidance in a few web sites which recommend that it is good practice if slides are decluttered and detail put in the notes section, though not specifically from an accessibility point of view.

I therefore experimented with one of my modules in the Spring term, where I simplified the text on slides, moving and embellishing some of the text into the notes section. The slides are less cluttered, and the students have access to the notes as they can download the PowerPoint from Blackboard, and they can add more detail if they want. That module went much better.

In 2018, JISC did an accessibility audit of some of the university pages and systems, and two courses in Blackboard, one of which being my second year Neural Networks module. It was noted that my lecture notes did not utilise the notes section, but that did not matter as sufficient information was there, and there were other resources on the module. However, I took it as affirmation that decluttering slides and using the notes section were good from an accessibility point of view.

Therefore, as I had planned, for this year I have reduced the amount of material on the slides for all my courses, and utilised the notes section. For this to be effective in the lecture room, the lecturer needs to use Presenter mode, where the students see the full slide, but the presenter on their screen sees, the slide, the next slide, and the notes section.

I asked IT for guidance on how this is achieved, as searches I did online did not help, and was told the following:

The reason presenter mode doesn’t work in the lecture theatres is that, although there are 2 physical screens, the system behaves as if there is only 1, it duplicates the first across all others.

This can be changed by holding the windows button + P. Then you can switch from ‘duplicate’ to ‘extend’ screens with the keyboard directional arrows + enter.

Once you have set the screen to extend, the PC will recognise 2 separate windows to operate with, and so presenter mode will work.

Please reset the room to the way you found it whenever you use this function, by pressing windows button + P and reselecting ‘duplicate’.

I have found that this works in some rooms – but not all, though I am lobbying.

What I can say is that I feel the lectures are going better, are more engaging, but it works best when the notes are visible (and hence provide some prompts) to the presenter.

Summary

From my experience, Ally is a useful tool for accessibility, though I do not have experience of students downloading material in alternative formats. There are some discrepancies between the assessment of accessibility between Ally and Word and PowerPoint, such as in the use of Alt Text. The score given by Ally seems disproportionate and it is a shame that you don’t get an immediate reassessment when you upload a changed version. It will be better when there is more guidance on addressing issues.

I also recommend the use of the notes section in PowerPoint, and believe it to be good practice in general and for accessibility. I hope that Presenter view will be working in all lecture theatres.

Attention Workshop

Florian Roithmayr, School of Art and Communication Design                f.roithmayr@reading.ac.uk

Overview

The two-day workshop “Attention Please” engaged students across the School of Art and Communication Design and the School of Architecture in a series of exercises to re-focus and sharpen their attention onto different materials, in different settings, under different circumstances, and in different speeds, challenging established routines and habits.

Objectives

  • experience and develop skills to collaborate across disciplines and year groups
  • develop team building skills
  • develop skills in mindfulness and sustained attention
  • challenge usual routines and habits of engaging with materials and objects
  • challenge discipline specific practices, narratives and vocabulary of engaging with materials and objects

Context

The workshop was conceived as an extra curriculum activity independent of regular departmental teaching and learning to address attitudes and practices that affect students and researchers across disciplines and year groups. Funding allowed and facilitated a whole program of exercises and in-depth engagement over two full-days of activities across Schools.

Implementation

A number of specialist coaches and mentors were invited to facilitate different exercises and workshops as individual or group activities to build a program that develops and unfolds over the course of the two days: a percussion workshop to develop skills in listening and responding within groups, to work with and against rhythms and melodies, volume levels and intensities. A voice coach gave a workshop in speaking and shouting, assertiveness in discussions and silence. A body coach gave a workshop in posture, attention to body language and reading behaviour. A flower-arranging specialist offered a workshop in composition and attention to details. Workshops also engaged participants in sustained periods of mindfulness, concentration and awareness, to each other, themselves, or their surrounding environment and context.

Impact

Student feedback on the days and reflective feedback at the end suggests a real need for more cross-school activities and engagements, and peer learning. Especially postgraduate researchers expressed the positive impact engaging with other student years had on their work/research habits.

Reflections

The timing of the workshop proved to be a major contributing factor to the success of the activities: although not pre-planned and designed as such, the end of the summer term offered the chance for a large uptake by participants as students had finished their exams and were keen and open and very interested to participate in extra curriculum activities across the school without the restraint of clashes with teaching and other commitments.

Follow up

There has not been any further development, but there is always the possibility to repeat the activity again in the future and build on the workshop as a whole.

Links

https://www.flickr.com/gp/readingfineart/5QB6XW 

 

What a Cultural Adventure: Moving from a Career in Industry to Academia!

Shelen W H Ho, Henley Business School, University of Reading Malaysia                            shelen.ho@henley.edu.my

“Academia isn’t for everyone!”  I was warned by my business associates when I decided to become a full-time academic in 2016, after spending decades working outside of the enclaves of universities and research facilities.  In the past, industry professionals had little to offer to institutions driven by grant acquisitions and research publications.  However, in recent years, there has been an increasing emphasis being placed on producing graduates with relevant work skills. Academic institutions have become more open to receiving these professionals with years of real-world experience to bring practical innovation into university courses.

In my practice as a business consultant, I was often chosen to be a member of clients’ recruitment panels to provide an outsider’s perspective to the assessment of candidates. There were common grievances voiced by clients that new graduates today lacked critical thinking skills, attention to details, interpersonal competencies and ownership attitude.  The Malaysian Higher Education Ministry has also urged higher education institutions to change the process of teaching and learning to produce holistic, balanced and entrepreneurial graduates with life and career skills, who could adapt and fill in jobs ‘that are yet to exist’ in the 4th industrial revolution (4IR).  With opportunities on the rise and my passion to contribute back to the community, I took a leap of faith from client meetings and corporate environment to meeting students and adapting to a university’s rhythm.

I have to admit it was a culture shock when I started my job as an associate professor at the Henley Business School in the Malaysian campus.  I knew the working culture and work values would be different but experiencing them required me to make connections between what I knew.  I was so used to rushing around everywhere as a consultant and the rhythm in the university was a major source of frustration for me right from the start.  I have since accepted the slower rhythm but not a convert, as yet.  Another peculiar difference is demand expectations.  In business, I needed to have the answers all the time and be answerable every minute, meeting the briefs on time and on budget.  My time belonged to somebody else and I was never really left alone. The demand is different in academia; at least that was what I was told and had observed.  I am allowed to not have the definite answer.  I get time to reflect.  I can explore and think about it first.  However, I also get to be on-call for students, which I find quite enjoyable as students are why I am here after all. A further intriguing experience is with project demands.  The fast-paced, productivity-driven corporate environment leaves little time for eureka moments that come from repeated failure with commercial projects.  In the business world, an approach that does not work or that produces sub-par results is quickly discarded.  That is often frustrating.  On the other hand, in academia, there is time, freedom and support to ask the hard questions, make mistakes and come to inconclusive results.  A failed experiment or a faulty hypothesis does not mean the end of a research project; it could still contribute to statistically significant findings. That is elation to intellectual curious researchers.

As a business consultant, one activity that I looked forward to was invitations to provide training in corporates.  Many of my consultancy associates shared the same desire.  I have the opportunity to train managers and executives in many multinational corporations and public organizations over the years.  When I became an academic, I thought I was well-equipped for teaching with my training experiences.  However, I soon realized that training is not quite the same as teaching. Teaching seeks to impart knowledge and provide information.  Teachers are expected to have the latest subject-matter knowledge and an understanding of pedagogical processes to fill the knowledge gap in students and enable them to achieve the intended learning outcomes. A trainer, on the other hand, has narrow set of items to cover during training sessions.  The focus is less on having a broad knowledge base for the subjects, and more on the behavioral aspects of the trainees.  The aim is to develop certain competencies. For instance, with applied management subjects, it is possible to teach someone about the theory of conflicts management, but that knowledge will not make them a good conflict manager. Specific, practical and applied training is necessary to use abstract knowledge to learn or master a skill. A common feedback from employers about university graduates is that they do not have the practical skills that are necessary to thrive in the workplace. Although many universities and institutions are excellent at teaching, the training component is found in practice to either fall short or is non-existent.

It became clear to me that both teaching and training should be complementary to meet the challenges of educational transformation for the 4IR.  I am a certified professional trainer. However, I needed to learn how to be a professional teacher. Working in partnership with the Centre for Quality and Support Development (CQSD) and the dedicated mentoring by my colleagues at the centre was invaluable to my achievement so far with teaching and learning.  The acknowledgement of my effort with the HEA Senior Fellowship award recently was totally unexpected when I started teaching in 2016.  However, it was the journey to certification that was most rewarding as it has engendered enthusiasm in me and provided me with new insights and new meaning to my past and current work as a facilitator of learning for the future generation of leaders.  The recognition has provided me with a conduit to move forward in the world of teaching and learning.

To conclude, as with many other universities, the University of Reading has adopted the strategy of curriculum internationalisation to prepare our graduates for employment in the global economy.  Internationalisation of the curriculum is the incorporation of an international and intercultural dimension into the preparation, delivery and outcomes of a program of study (Leask, 2009). However, as advocated by Zimitat (2008), ‘internationalizing curricula is not just about content, it also requires changes in pedagogy to encourage students to develop critical skills to understand forces shaping their discipline and challenge accepted viewpoints’.  Here, teachers play the key leading role. As reported in the 3rd global survey report by the International Association of Universities (IAU), ‘the interest, capacity and involvement of faculty members appears to act as a major barrier to moving forward’ (Egron-Polak et al, 2010).  This sharing of my personal adventure could perhaps provide some insights and add to the rich picture for colleagues and peers to have a better understanding of the motivations and challenges experienced by faculty moving between industry and academia. The support for these faculty members could then be more targeted, their competencies and energy better harnessed to build internationalization knowledge and readiness for the institution to reach the internationalization goals.  In line with the UKPSF professional values of inclusiveness and respect for diverse community (V1, V2), I wish to end with a popular quote by a bestselling author, the late Steven R. Covey, ‘strength lies in differences, not in similarities’.

References

Egron-Polak, E., Hudson, R., Gacel-Avila, J., & International Association of Universities. (2010). Internationalization of higher education: Global trends, regional perspectives: IAU 3rd global survey report. Paris: International Association of Universities, IAU (pp. 77-78).

Leask, B. (2009) Using formal and informal curricula to improve interactions between home and international students. Journal of Studies in International Education, Vol. 13, No. 2, 205-221.

Zimitat, C. (2008). Student Perceptions of the Internationalisation of the Curriculum. Chapter 13. In L. Dunn and M. Wallace (Eds), Teaching in Transnational Higher Education (pp. 135-147), London: Routledge.

Group work in Computer Science

Richard Mitchell and Pat Parslow, Department of Computer Science                                r.j.mitchell@reading.ac.uk     p.parslow@reading.ac.uk

The Department of Computer Science held a workshop recently to consider our use of Group Work. This was facilitated by Pete Inness, School Deputy DTL, and Pete Andrews (CQSD), who gave a useful overview of some of the challenges and potential benefits of group work, and included a talk from Annabel Avery (DAS) on issues associated with students with Special Needs.

Group work is an important aspect of the Computer Science degree, as generally in industry graduates work with others on various projects, and so it is important to be part of a team.

The aim of the workshop was to discuss issues and to highlight some areas of good practice which could be used elsewhere in the Department, School and further afield. This blog discusses our experiences in the Group work we set, in the Part 1 Software Engineering module, the Part 3 social, legal and ethical aspects of computer science module and the Part 3 Virtual Reality module.

Richard’s Virtual Reality Groupwork

The coursework for the Virtual Reality module is to produce a virtual world. Initially all students produce a simple world, using the Unity game engine, and this is worth a quarter of the coursework mark. The rest of the coursework is to produce a more complicated world, in a particular theme. As this generally requires the use of various software packages, and I feel it unreasonable for every student to learn each package, this is done in groups of typically around six people. This allows a specialist in say SketchUp to use it, a specialist in Blender to use it, someone good at scripts in Unity to do that, etc. Each group submits their finished product and each member submits a report on their individual contribution.

As it is a final year assignment, I am not interested in team dynamics, rather (as per a project in industry), I am interested in the final product. Hence the virtual world is visited, assessed against criteria and a mark generated. Everyone gets the same mark, unless it is clear they have done nothing (including not submitting an individual report).

Again, as it is in the final year, I find it easier for students to organise their own groups. Whilst this may go against some advice re special needs students, I can comment that I was advised this year by their (ever helpful) DAS supporter that a student was anxious about the group work until they knew they could choose their own group.

I do however ask that each group notifies me early on as to the members of their group and the tasks that have been allocated to each individual. This has worked, though on the odd occasion when some students are not in a group, I help them set one up. Annabel noted that this was good practice worth disseminating.

Also we feel it is good practice to include both individual and group assessed work.

Students have produced a variety of excellent worlds, showing great creativity and have feedback that they appreciate the opportunity provided. In this year’s ‘impossible world’ theme, highlights include a surreal Dali-Escher-Caroll-esque world, some haunted houses and a virtual brain. Last year’s ‘educational’ themed projects included various museums, including one where each member built a separate room illustrating say computers, Ancient Egypt and (of course) dinosaurs. In this last example, the students could support each other in the use of the different packages.

Pat’s Experiences

The focus on product is common across most Computer Science group work, although it is coupled with assessment for learning.  It is actually important to distinguish between group, and team, assignments.  One of the goals I have is to help students learn the benefits of working as a team rather than as a group – having a common drive, working interdependently, and producing products collectively rather than a set of individual outputs “smooshed” together to produce the course work submission.  Typically, students are resistant to this process!

In Software Engineering, a first year module for which Pat has recently taken on full responsibility, there are a mix of group and individual course work assessments.  Two of them are group work, with more of a focus on “team” in the second one.  Unlike other group assessments, the members of the groups are assigned by the lecturer.  For the first iteration, they are randomly assigned, taking note of any special circumstances such as social anxiety or other mitigating factors.  This assessment has a very low overall weighting (5% of the module) and is designed so that it allows individual efforts, which can then be combined, but which benefit from group discussion to provide different viewpoints.

The second set of teams are determined based on the marks the students have gained in their first individual course work.  For the first time this year, I assigned the teams based on ability bands, rather than deliberately building in diversity to the groups.  This was felt to be something of a risk, but the expectation was that the groups who had scored lower in their individual work would start to realise that they could not just rely on other team members to do the work for them – an issue students frequently comment on whether they select their own teams or have them chosen for them.  This assessment is designed to rely more heavily on team discussion, with less leeway for dividing the tasks up in a “one per student” manner, and requiring inputs from a range of skills to complete properly.

This aspect worked well – the groups consisting of those who scored less well in individual work improved their marks, and there were very few students who failed to contribute.  Less expected, although with hindsight, possibly obvious, was that the teams of high scoring individuals did less well, and feedback from a sample suggests that this was because they tended to be quite individualistic, and not particularly well adapted to working in teams with others with similar traits.  This was felt to be a useful lesson for both the students, and the instructor.

The marking scheme for the first year work is weighted towards them demonstrating that they have taken the correct approaches, rather than having any arbitrary view of “right or wrong” – the subject area and choice of assessment facilitates this.   Part of our knowledge domain requires attention to detail and following specifications, and these pieces of work also contain assessments of the students’ ability to do this – correctly interpreting the specification, following style rules, and producing a high quality piece of proof-read work can go a long way.

In the third year social, legal and ethical aspects of computer science module, the groups are devised to maximise diversity.  The finalists tend to prefer the idea of forming their own teams, but when asked, they almost all say that even when they have free choice, they regret choosing the teams they did after an assessment.  Typically, it appears that forming teams of, say, 7 students is a challenge for them as well – frequently Pat has to point out that 8 is greater than 7.  The teams are balanced by gender (as far as is possible in our subject area), domestic or overseas, with or without industrial experience, and with students with declared disabilities distributed as evenly as possible.  The rationale is that the subject matter itself benefits greatly from having as much diversity as possible.

The task, in this instance, is to watch and critically analyse a “near future science fiction film or TV series”, drawing out similarities with the real world and looking at how the ideas in the show relate to our existing ethical, legal and social realities.  The strong advice given it to discuss the topics together as a team, and it is clear from the resulting product (a report) which teams use this approach.

In addition to the actual group/team work, in each instance the students have an assessed reflective piece of work to complete, in which they are invited to reflect not only on their own learning approaches and how they might improve them, but also on how well the team worked.  They are given a basic structure for this reflection, and encouraged to expand on it using sources from literature.  Those that make the best use of the scaffolding and of the existing literature also produce the deepest insights.

Reflecting on these assessments this year, I am pleased with the variety of experience they give the students.  The problems set are themselves close to real life scenarios, or are real life activities, and have the benefit of not being “Googleable”, but judicious design also leaves them relatively easy to mark, which is a consideration with the size of the cohorts.   One key feature introduced this year has been the use of “CSGitLab”, a version control platform and collaboration tool, which has the benefit of being the type of tool used in industry, but also allowing individual contributions to be identified even in those instances where the team has done a good job of producing a single integrated product.  Although variations on marks within the team are kept to a minimum, there are cases where one member clearly has not made any significant contribution, and it is important to recognise this in the assignment of marks.

Discussion

One of the benefits of Group Work Pete Andrews highlighted was the development of workplace skills including critical reflection, creativity, communication, problem-solving, organisation and teamwork (see the UoR Graduate Attributes). He also quoted Barrows, 2000: “An education process that requires learners to go through the same activities… that are valued in the real world”.

The examples discussed here are very much consistent with these benefits.

We also wish to highlight our experiences re group selection, the importance of identifying as soon as possible any issues with groups, the inclusion of both group and individual work, to note the distinctions between group and team, and assessing the product and team working. We will explore more the use of collaborative tools in future years. As ever, we believe it important to manage expectations, making it clear why group work is used and the benefits. We much appreciate the support from the Petes, Annabel and our colleagues for the workshop and the discussions.

References

Barrows, H. (2000). Problem-based Learning applied to medical education. Southern Illinois University, School of Medicine.

https://www.reading.ac.uk/internal/curriculum-framework/cf-graduate-attributes.aspx

Promoting Research in Teacher Education

Nasreen Majid, Institute of Education                                                                                            n.majid@reading.ac.uk

Overview

All students on the BA Primary Education (QTS) programme develop a piece of research, entitled, Advanced Teaching Project (ATP). This blog summarises how the ATP conference is used to develop peer learning in order for part 2 students to learn from the research experiences of part 3 students. 

Objectives

  • Develop sustained and structured scaffolds to undertake effective undergraduate research
  • Develop high quality peer learning opportunities
  • Develop a culture of educational research
  • Enable an understanding that teaching is a research informed profession.

Context

Module ED3PI1 is a 40 credit module, assessed through an 8000 word ATP dissertation. The ATP develops our trainee teaches’ educational research skills. The preparation for this project starts at the end of part 2, with an introductory lecture and a conference in the summer term, showcasing the research undertaken by the part 3 students. 

The conference aims are firstly to celebrate the outstanding work undertaken by our students and the teaching aim is for peer learning, where the part 3 presentations and posters inform part 2s on the best approaches to write a strong piece of undergraduate research. This approach amplifies the impact of learning as it is an exchange between peers and based on the part 3 students’ experiences of writing their ATP over an academic year.

The student presentations highlight the research undertaken, how they conducted their literature review, their methodological approach and the effectiveness of this. The students share ‘top tips’ throughout the presentation to enable collaborative learning. The presenters use mentimeter to generate questions, thus providing an anonymous platform for part 2 students to ask questions freely.

Impact

The ATP conference sets a foundation for the students to develop a sustained and structured approach to undergraduate research. This is measured by the way students engage with their ATPs and the quality of research output. Furthermore, the ATP work serves as a springboard for some part 3 students to undertake Masters level work as well as being encouraged to publish their research. A major impact of the conference is the high quality peer learning opportunities that take place. This culminates to our students building a strong identity as educational researchers.

The materials shared at the conference, including the presentations and posters are drawn upon across part 3, during the teaching input for the module to further consolidate the learning experienced during the ATP conference. The videos developed during the conference are shared across the academic year to facilitate further learning.

Reflections

The process of developing high quality projects for the ATP using a peer learning model provides a strong opportunity for students to collaborate and learn from the previous cohort’s experiences. It is clear from the observations that the part 2 students gain a great deal from listening to and being assured by the part 3 students about the ATP writing and learning process. Evidently, learning from peers and understanding that the part 3 students were in the same situation one year ago, provides food for thought for the part 2 students and enables then to recognise that although the work is very challenging, it is ‘doable’ to a high standard because they have seen outstanding examples of work from their peers. Overall, I am always impressed by the work that goes into the presentations and the professional way the part 3 students deliver their research to their peers.

Links

Link to the IOE news feed featuring the ATP conference:

http://blogs.reading.ac.uk/ioe-news-and-events/2018/06/06/at-the-annual-student-teacher-research-conference-there-was-an-astonishing-range-of-talent-and-also-a-fair-hint-of-nostalgia/

Study Even Smarter

Michelle Reid, Kim Shahabudin, and Sonia Hood, Study Advice

The successful Study Smart online course will be running again for new Part 1 undergraduates, and will be launched to the new cohort on 28th August. Study Smart helps students make a smooth transition to university study by giving them a shared start point and by welcoming them into the University of Reading learning community. We aim to build on the success of last year, which saw 94% of students who completed the course saying their understanding of what was expected at university-level study was either fairly good, or very good.

National Interest

It is pleasing to see Study Smart becoming nationally recognised as a good model for student transitions. We have received inquiries from other leading Higher Education Institutions about using our model, and we have been showcased in a recent visit from Chris Millward, Director for Fair Access and Participation.

New and Improved

The Study Advice team are currently working on a number of improvements to Study Smart based on student and staff feedback. We are streamlining some of the steps in the course in order to make Study Smart more manageable and appealing, particularly to international students who may be pressed for time. We are liaising with ISLI in order to make sure our communications to pre-sessional students are as effective as possible. We are highlighting the benefits of doing Study Smart for students in STEM subjects. One of the most successful elements of the course last year was the student mentors, and we have recruited an excellent team of mentors for this year who have an even wider range of backgrounds and transition experiences to share with the incoming students. We are also investigating whether the main invitation to the course can come from Schools to give additional weight to the message.

Hands-On Session for staff

Feedback also emphasised the value of staff endorsements in helping students to engage with the course, so we would really value your promotion of Study Smart to your tutees and classes. To help academic staff get a feel for the course, we ran a successful Study Smart ‘Hands-On’ session on 4th June with an opportunity to explore the student-view of the course and sample the famous Study Advice cake! We will be running another ‘Hands-on’ session in early September so look out for details of this coming soon via the CQSD T&L programme.

For more information about Study Smart, see our Tutor’s Guide: http://libguides.reading.ac.uk/studysmart or email studyadvice@reading.ac.uk

Promoting Research in Teacher Education

Nasreen Majid, Institute of Education, n.majid@reading.ac.uk

All students on the BA Primary Education (QTS) programme develop a piece of research, entitled, Advanced Teaching Project (ATP). This blog entry summarises how the ATP conference is used to develop peer learning in order for part 2 students to learn from the research experiences of part 3 students.

Objectives

  • Develop sustained and structured scaffolds to undertake effective undergraduate research
  • Develop high quality peer learning opportunities
  • Develop a culture of educational research
  • Enable an understanding that teaching is a research informed profession

Module ED3PI1 is a 40 credit module, assessed through an 8000 word ATP dissertation. The ATP develops our trainee teaches’ educational research skills. The preparation for this project starts at the end of part 2, with an introductory lecture and a conference in the summer term, showcasing the research undertaken by the part 3 students.

The conference aims are firstly to celebrate the outstanding work undertaken by our students and the teaching aim is for peer learning, where the part 3 presentations and posters inform part 2s on the best approaches to write a strong piece of undergraduate research. This approach amplifies the impact of learning as it is an exchange between peers and based on the part 3 students’ experiences of writing their ATP over an academic year.

The student presentations highlight the research undertaken, how they conducted their literature review, their methodological approach and the effectiveness of this. The students share ‘top tips’ throughout the presentation to enable collaborative learning. The presenters use mentimeter to generate questions, thus providing an anonymous platform for part 2 students to ask questions freely.

The ATP conference sets a foundation for the students to develop a sustained and structured approach to undergraduate research. This is measured by the way students engage with their ATPs and the quality of research output. Furthermore, the ATP work serves as a springboard for some part 3 students to undertake Masters level work as well as being encouraged to publish their research. A major impact of the conference is the high quality peer learning opportunities that take place. This culminates in our students building a strong identity as educational researchers.

The materials shared at the conference, including the presentations and posters are drawn upon across part 3, during the teaching input for the module to further consolidate the learning experienced during the ATP conference. The videos developed during the conference are shared across the academic year to facilitate further learning.

The process of developing high quality projects for the ATP using a peer learning model provides a strong opportunity for students to collaborate and learn from the previous cohort’s experiences. It is clear from the observations that the part 2 students gain a great deal from listening to and being assured by the part 3 students about the ATP writing and learning process. Evidently, learning from peers and understanding that the part 3 students were in the same situation one year ago, provides food for thought for the part 2 students and enables then to recognise that although the work is very challenging, it is ‘doable’ to a high standard because they have seen outstanding examples of work from their peers. Overall, I am always impressed by the work that goes into the presentations and the professional way the part 3 students deliver their research to their peers.

 

Link to the IOE news feed featuring the ATP conference: http://blogs.reading.ac.uk/ioe-news-and-events/2018/06/06/at-the-annual-student-teacher-research-conference-there-was-an-astonishing-range-of-talent-and-also-a-fair-hint-of-nostalgia/

The EMA Symposium: Sharing Knowledge, Good Practice, and Cake

Dr Madeleine Davies and Dr Emma Mayhew

On Tuesday 22nd May 2018, over 150 colleagues from across the university gathered in the Meadow Suite to hear a series of presentations and to engage in conversations about the work that the EMA Programme has been doing to prepare for roll-out of online assessment and feedback. Colleagues from the majority of Schools and units across the university were represented and staff from academic Schools, Support Centres, and CQSD shared experience and good practice. An active Twitter feed provided live commentary on the presentations and activities (120 tweets and re-tweets) and reflected an atmosphere that was informative and wholly positive.

The event was organised by Dr Emma Mayhew (EMA Academic Director) and Dr Madeleine Davies (EMA Academic Partner) and was introduced by Professor Gavin Brooks, the Programme’s sponsor. The Vice-Chancellor attended for the first hour of the event which was supported throughout by colleagues from TEL. As well as seven panels involving presentations given by 21 colleagues, the day of activities included a Q&A session, a roundtable, a Menti quiz, a talk about Learning Analytics, and a demonstration of online marking for beginners: the result was a permanent movement between learning and dialogue. Piles of EMA cup-cakes and biscuits retained energy levels throughout the day.

The Symposium was designed to offer events for colleagues new to online assessment as well as to those with more experience. Colleagues attending the Symposium provided information about their level of technological confidence: of 40 surveyed participants, 5% rated themselves as having low levels of confidence with technology, 45% rated themselves as having average levels of confidence, and 48% rated themselves as having advanced confidence. The Symposium offered talks and events for all levels.

Presentations from the Early Adopter Schools discussed the process of change and offered advice about successfully implementing online assessment in departments; a panel was also convened where ‘nervous adopters’ who had already transitioned to online marking spoke about the training and tactics that had worked for them. For more experienced users the Symposium offered presentations on the use of rubrics and QuickMarks, explaining the several ‘hidden’ benefits of online marking and demonstrating the potential of previously unidentified buttons.

Throughout the day, the emphasis remained on student experience and marking quality: several presentations commented on ways in which online assessment could enhance feedback and release a range of marking options that had not been available previously. At the same time, presentations emphasised that ‘good marking is still good marking’, as Rob Hosfield stated: the change to a new delivery model does not alter the fact that it is the usability of feedback that matters most in relation to teaching and learning.

Participants also heard presentations from the Support Centres and their experience of change: Luisa Ciampi’s presentation explained how online assessment benefits our colleagues in the Support Centres and Marguerite Gascoine spoke of the process of change. Advice about managing the potential impact of increased screen-time was given in a session led by Dr Eileen Hyder, and a presentation by Dr Calvin Smith demonstrated how new screens in RISIS support the move towards the Academic Tutoring System (Calvin was the winner of the ‘Best Title’ Menti Prize for ‘Spotting Crisis in RISIS’).

The feedback that was collected at the end of the afternoon was overwhelmingly positive:

39/40 colleagues rated the event as good or excellent and 38/40 said that the event would impact positively on their teaching and learning provision. Colleagues commented positively on the benefit of hearing the experience of a wide range of colleagues, the broad range of topics covered, and the advice on good practice. The feedback also noted how useful it had been to bring academic and professional staff together to discuss experiences, and several colleagues mentioned how they had enjoyed putting faces to the names of Support Centre colleagues. Also praised was the emphasis on how new data can be used, sessions on the practical use of marking tools, and hearing the experiences of Early Adopter schools. There was a great deal of positive feedback on a talk given by Dr Alex Knox on Learning Analytics.

As the organisers of the Symposium, we were delighted by colleagues’ positivity, collegiality, and eagerness to share online assessment experience. We hope that our colleagues will be able to join us again in September when the Programme is hosting a conference in association with the the Advance HE’s (formerly HEA) Assessment and Feedback Community of Practice. In the meantime, screencasts of key presentations will be posted on the EMA website together with a collection of helpful links and information.

Thank you to all our colleagues who attended the Symposium to share experience and to listen to that of others. We were overwhelmed by the generosity of staff who contributed their time and expertise to the event, and by the goodwill of our colleagues who attended.

Co-presenting with Students at Conferences and Engaging them in the Teaching and Learning Dialogue

Dr Madeleine Davies (Department of English Literature) and Bethany Barnett-Sanders (Part 3 student, Department of English Literature)

Engaging students in academic conversations outside the classroom presents challenges but recent activity in the Department of English Literature suggests that there are several ways of creating opportunities for this engagement. DEL has worked with Part 2 and Part 3 students on a range of initiatives that has involved them in conference organisation (‘Postmodern Biofictions’), event management (‘Celebrating Forgotten Women’) and editing work (The Creative Writing Anthology and Second Sight: The Margaret Atwood Learning Journals).

In April I was finalising work on the TLDF-Funded ‘Diversifying Assessment’ project in DEL which, connecting with the Curriculum Framework, had involved convening student focus groups. These groups generated productive perspectives on our assessment and feedback practices. I decided to disseminate the results of the project at the Change Agents’ Network (CAN) conference (Winchester) and I felt that it was important that one of the students involved in the focus groups should co-present in order to express the issues from a student point of view.

The CAN Conference was extremely interesting and several papers commented on a range of student engagement projects; however, students were generally absent from the sessions. Our ‘Diversifying Assessment’ presentation, however, expressed both staff and student viewpoints. Bethany Barnett-Sanders, my co-presenter, comments here about her experience of joining me at the conference:

‘Attending the CAN conference with Maddi to help deliver a presentation on diversifying assessment was a really valuable experience. The whole process, from the initial focus groups to the presentation, was so affirming. I participated initially in the focus groups run by Maddi because assessment is an issue that I feel quite strongly about: as the situation stood at the beginning of the project, the department favoured the assessed essay + exam model which, from the student perspective, is not very popular. This model seems to be the default assessment pattern and so I relished the opportunity to find out why and to share my thoughts on what assessment could look like. As a student, being asked for my thoughts on a topic that is so integral to the university experience was both pleasantly surprising and incredibly encouraging; it allowed me to feel as though I could really shape the programme for myself and others and it enabled me to engage in my degree in a way that I never had before.

When asked to present at the conference with Maddi, it was great to know that those groups had led to a place from which real change could be generated. I agreed to present not just for the valuable public speaking experience that would be useful to have on my CV but, again, to take advantage of the opportunity to share the student’s perspective on assessment, something that affects them more than anyone else. Presenting at the conference was quite a nerve-wracking experience, but one that I’m very grateful I’ve had. I think involving students in these conferences is a fantastic idea as it allows for different perspectives on issues that would otherwise be left unchallenged and encourages collaboration between students and staff.

Having a room full of people, who were all there to learn from each other, listen to our presentation, was a big boost to my own confidence. I also really enjoyed listening to Maddi’s perspective on assessment as it allowed me to consider things that I hadn’t before. It was also lovely to spend time with one of my lecturers outside of the seminar room and I think it allowed for a very natural, open dialogue to take place about a whole range of things, which is harder to come by in formal contact hours. The conference was also a great learning opportunity, as it allowed me to listen to what other universities are doing and reflect on that from the student’s perspective; judging by the majority of the attendees and by the lack of students in the rooms, this isn’t something that happens regularly at these events.

I hope that the success of our presentation encourages other universities and other members of staff within the department to invite their students to share their opinions at these events in the future.’

I was thoroughly impressed by Bethany’s professionalism in delivering her comments at the conference – she was a credit to the university. My conversations travelling to and from the event with Bethany also helped to deepen my own understanding of the assessment issue from the students’ viewpoint: for example, I had thought that risk-aversion informed our students’ antipathy towards exams – Bethany confirmed this but allowed me to see how this is a natural consequence of a fee-paying, ‘high stakes’ environment.

I will certainly involve more students in T&L conference presentations in the future: my experience of this is entirely positive and it allows our students to engage in important conversations with us about their education. Further, within a landscape where graduate employability is key, we have here an opportunity to enable our students to build their experience and to gather skills that may not be available within formal teaching environments.

Engaging students in the design of assessment criteria

Dr Maria Kambouri-Danos, Institute of Education                                                                                                                m.kambouridanos@reading.ac.uk                                                                                                                                                                                            Year of activity 2017/18

Overview

I recently led a group of colleagues while working in partnership with students to develop a new module in BA in Children’s Development and Learning (BACDL) delivered at the Institute of Education (IoE). This approach to working in partnership with students is a core part of the project’s aim and the work described here has been part of a Partnerships in Learning & Teaching (PLanT) project.

Objective

The team’s aim was to develop and finalise a new module for BACDL in close partnership with the students. The new module will replace two existing modules (starting from 2018-19), aiming to reduce overall assessment (programme level), a need identified during a Curriculum Review Exercise. The objective was to adopt an inclusive approach to student engagement when finalising the new module, aiming to:

  • Go beyond feedback and engage students by listening to the ‘student voice’
  • Co-develop effective and student-friendly assessable outcomes
  • Identify opportunities for ‘assessment for learning’
  • Think about constructive alignment within the module
  • Encourage the development of student-staff partnerships

Context

To accomplish the above, I brought together five academics and six students (BACDL as well as Foundation Degree (FDCDL) students). Most of the students on this programme are mature students (i.e. with dependants) who are working full time while attending University (1 day/week). To encourage students from this ‘hard to reach group’ to engage with the activity, we secured funding through the Partnerships in Learning & Teaching scheme, which enabled the engagement of a more diverse group (Trowler, 2010).

Implementation

The team participated in four partnership workshops, during which staff and students engaged in activities and discussions that helped to develop and finalise the new module. During the first workshop, we discussed the aims of the collaborative work and went through the module’s summary, aims and assessable outcomes. We looked at the two pre-existing modules and explored merging them into a new module, maintaining key content and elements of quality. During the second workshop, we explored chapter two from the book ‘Developing Effective Assessment in Higher Education: a practical guide’ (Bloxham & Boyd, 2007), which guided the discussions around developing the assessment design for the new module.

During the third workshop, we discussed aspects of summative and formative tasks and finalised the assessment design (Knight, 2012). We then shared the new module description with the whole BACDL cohort and requested feedback, which enabled us to get other students’ views, ensuring a diverse contribution of views and ideas (Kuh, 2007). During the last workshop, with support from the Centre of Quality Support and Development (CQSD) team, we implemented a game format workshop and created a visual ‘storyboard’, outlining the type and sequence of learning activities required to meet the module’s learning outcomes (ABC-workshop http://blogs.ucl.ac.uk/abc-ld/home/abc-workshop-resources/). This helped to identify and evaluate how the new module links with the rest of the modules, while it also helped to think about practical aspects of delivering the module and ways to better support the students (e.g. through a virtual learning environment).

Photos from staff-student partnership workshops

Impact

The close collaboration within the team ensured that the student voice was heard and taken into account while developing the new module. The partnership workshops provided the time to think collaboratively about constructive alignment and ensure that the new module’s assessment enables students to learn. It also ensured that the module’s assessable outcomes are clearly defined using student-friendly language.

A pre- and post-workshop survey was used to evaluate the impact of this work. The survey measured the degree to which students appreciate the importance of providing feedback, participate in activities related to curriculum review/design, feel part of a staff-student community and feel included in developing their programme. The survey results indicate an increase in relation to all of the above, demonstrating the positive impact of activities like this on student experience. All students agreed that it has been beneficial to take part in this collaborative work, mentioning that being engaged in the process, either directly (attending the workshops) or indirectly (providing feedback) helped them to develop a sense of belonging and feel part of the community of staff and students working together (Trowle, 2010; Kuh, 2005;2007).

Reflections

This project supported the successful development of the new module, from which future students will benefit (Kuh, 2005). The work that the team produced has also informed the work of other groups within the IoE. At the institutional level, this work has supported the development of the CQSD ‘Student Engagement’ projects. All the above were achieved because of close collaboration, and could not have been done by a group of individuals working on their own (Wheatley, 2010). Because of that, our team was awarded the University Collaborative Awards for Outstanding Contributions to Teaching and Learning.

References

Bloxham, S. & Boyd, P. (2007). Developing effective assessment in higher education: a practical guide. Maidenhead: Open University Press.

Knight, P. (Ed.). (2012). Assessment for learning in higher education. Routledge.

Kuh, G.D. (2005). Putting Student Engagement Results to Use: Lessons from the Field, Assessment Update. 17(1), 12–1.

Kuh, G.D. (2007). How to Help Students Achieve, Chronicle of Higher Education. 53(41), 12–13.

Trowler, V. (2010). Student engagement literature review. The Higher Education Academy.

Wheatley, M. (2010). Finding our Way: Leadership for an Uncertain Time. San Francisco: Berrett-Koehler