{"id":490,"date":"2019-08-20T15:18:49","date_gmt":"2019-08-20T15:18:49","guid":{"rendered":"http:\/\/sites.reading.ac.uk\/t-and-l-exchange\/?p=490"},"modified":"2019-10-04T08:06:09","modified_gmt":"2019-10-04T08:06:09","slug":"moving-towards-e-assessment-the-use-of-electronic-submission-and-grading-on-the-academic-skills-module-svetlana-mazhurnaya","status":"publish","type":"post","link":"https:\/\/sites.reading.ac.uk\/t-and-l-exchange\/2019\/08\/20\/moving-towards-e-assessment-the-use-of-electronic-submission-and-grading-on-the-academic-skills-module-svetlana-mazhurnaya\/","title":{"rendered":"MOVING TOWARDS E-ASSESSMENT: The Use of Electronic Submission and Grading on the Academic Skills Module &#8211; Svetlana Mazhurnaya"},"content":{"rendered":"<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-full wp-image-491\" src=\"\/wp-content\/uploads\/sites\/26\/2019\/08\/Svetlana_M.jpg\" alt=\"Profile picture for Svetlana Mazhurnaya\" width=\"180\" height=\"188\" \/><\/p>\n<p>I have been teaching English for over 15 years. I worked on EFL courses in Russia and the UK between 2000 \u2013 2012. I started teaching English for Academic Purposes in 2013 when I joined the International Foundation Programme at the University of Surrey. I have been working as an EAP tutor at the University of Reading since 2014, first on the International Foundation Programme and now on the Pre-sessional English Programme. I have recently become part of the assessment group within ISLI, which creates and administers tests of EAP.<\/p>\n<h3>OBJECTIVES<\/h3>\n<p>\u2022 To familiarise Foundation level students with e-assessment practices as part of their preparation for Undergraduate Courses at UoR<br \/>\n\u2022 To simplify assessment administration procedure for multiple module subgroups with varied deadlines on a 20-credit module<br \/>\n\u2022 To reduce the marking workload associated with paper submissions<br \/>\n\u2022 To deliver more timely and accessible feedback to students<\/p>\n<h3>CONTEXT<\/h3>\n<p>The International Foundation Programme has a 15-module portfolio delivered by various UoR departments. International Students joining the course have to manage multiple assessment deadlines and follow academic assessment practices used within the departments delivering their core modules. In order to support them, IFP runs a 20-credit Academic Skills module taught over 2 hours per week and assessed through a combination of formative and summative oral and written assignments marked off-line. A combination of word documents, excel spreadsheet and online RISIS reports are used for assessment data administration. When I joined the programme in 2015, the team were looking for ways of:<\/p>\n<p>\u2022 optimising the administration of a large volume of paper submissions with multiple sub-group deadlines<\/p>\n<p>\u2022 reducing the tutors\u2019 marking workload &amp; simplifying the assessment data entry process<\/p>\n<p>\u2022 gauging the level of learners\u2019 engagement with feedback<\/p>\n<h3>IMPLEMENTATION<\/h3>\n<h4>The trial<\/h4>\n<p>\u2022 Having previously used electronic marking tools, I was keen to introduce them on the IFP. With the Module Convenor\u2019s support, I started trialling the Turnitin e-submission and grading tools with my sub-group in spring 2015. It was agreed that a formative assessment piece would be suitable for the trial to allow space for an error and that learner training could be integrated into the module syllabus as part of developing the students\u2019 referencing and source integration skills. There were 3 classroom demonstrations: how to submit work, how to check originality reports and how to access electronic feedback. Learners were also signposted to the learner training resources available on Blackboard. Some students requested further guidance and were supported through a peer-led demonstrations in subsequent lessons. The fact that most students managed the e-submission with minimal training was an encouraging start.<\/p>\n<p>\u2022 For the purposes of maintaining consistency in feedback delivery with other module subgroups I created a QuickMarks set based on the existing module error correction codes that all of the tutors used and hyper-linked them to the online practice materials we normally recommend to students when suggesting areas for improvement. I also uploaded our mark scheme as a Turnitin rubric. Similarly, I provided global feedback comments on submitted work. The only difference in the feedback delivery was its online mode and the fact that QuickMarks were associated with one of the 5 assessment criteria such as \u201corganization\u201d or \u201ctask completion\u201d, hopefully making the rationale behind the grading more explicit.<\/p>\n<p>\u2022 Students reacted favourably to receiving electronic feedback, saying that they liked having instant access to their grades through \u201cMy Grades\u201d feature and that word-processed comments were easier to understand for international students than handwritten ones. They also like the fact that QuickMarks we use are hyperlinked to external practice materials. This allows them to work independently. For example, a comment on referencing issues is linked to the referencing guidelines page.<\/p>\n<p>\u2022 Interestingly, the electronic assignment inbox showed that the students\u2019 level of engagement with feedback varied: some viewed the marks but did not access the detailed feedback; others read the comments but did not explore the hyperlinks. This has prompted us to run follow-up tutorials that students have to prepare for using tutor\u2019s feedback. Overall, the trial was largely successful but highlighted the need for some more learner training in how to process e-feedback.<\/p>\n<h4>Sharing practice<\/h4>\n<p>\u2022 Because the online marking procedure used with the trial group was largely replicating our existing off-line marking procedure in a less time-consuming way, other module tutors were keen to experiment with e-assessments. The Programme Director and the Module Convenor were very supportive and allowed me to spend time on one-to-one consultations with team members in order to demonstrate the benefits of using e-assessment tools and train them if they wished to trial them.<\/p>\n<h4>Wider implementation<\/h4>\n<p>\u2022 Over the next couple of terms it was decided to introduce e- submission for all written coursework assignment in order to optimise the administration process. However, tutors were allowed the flexibility of marking online or downloading e- submissions in order to mark them in Word or print papers. This approach met our staff training needs and working styles.<br \/>\nThe challenge at this stage was that the e-feedback and grades had to be transferred into the official feedback forms and spreadsheets for consistency purposes. In order to avoid multiple data entry, we decided to start using the Turnitin rubric and the Blackboard Grade centre. Creating a Turnitin rubric was easy and eliminated the need for calculating grades in excel documents and transferring them to a master spreadsheet. We have not moved away from excel documents completely but have significantly reduced the manual data entry load.<\/p>\n<p>\u2022 By autumn 2016 all Academic Skills written assignments were submitted and graded online<\/p>\n<h3>IMPACT<\/h3>\n<h4>Effect on the students<\/h4>\n<p>\u2022 Students find the new submission procedure, with a single submission point and an electronic receipt system, easier to follow.<\/p>\n<p>\u2022 Many IFP students have used the opportunity to submit work remotely while visiting their families abroad during holidays.<\/p>\n<p>\u2022 Many students are using Turnitin Originality reports as a formative learning tool that helps them see how well they have paraphrased or referenced source material and revise their drafts independently more, which has resulted in fewer cases of unintentional plagiarism.<\/p>\n<p>\u2022 There is a greater transparency to learners as to how their mark was arrived at because they can see the number and type of QuickMarks comments that are associated with each criterion their work has been graded on.<\/p>\n<p>\u2022 Generally, they now view e-submission and feedback as part of the daily university activities, which prepares them for the reality of the academic studies on their future degree courses.<br \/>\nEffect on the Tutors<\/p>\n<p>\u2022 Using e-submission has decreased the burden of assessment administration: instead of sorting large volumes of student papers into sub-groups manually tutors use GradeCentre SmartViews to filter out their students\u2019 submissions.<\/p>\n<p>\u2022 Non-submitters are identified and sent a reminder earlier. In the past non-submitters could only be identified after the anonymous marking process has been completed, which often resulted in a hefty penalty. Now a tutor or the module convenor uses the \u201ce-mail non-submitters\u201d button right after the deadline to chase the students (even if marking is anonymous). As a result, students who failed to submit their assignment or uploaded to the wrong submission point receive an early reminder. For many IFP students, it is a learning curve and getting an early reminder helps them.<\/p>\n<p>\u2022 Marking has become easier with Turnitin: tutors can manage the 15 days turnaround time better because they can start marking straight after the deadline and not have to wait until the printed copies are distributed. Many find QuickMarks hyperlinked to external practice or reference materials helpful as a way to feed forward without giving a lengthy explanation. Some tutors reported being slowed down by internet connection issues. It also took us some time to adjust to the<br \/>\nneed Feedback Studio Interface.<\/p>\n<p>\u2022 Using electronic assessment tools has also prompted a professional dialogue about our current assessment practices and highlighted the need for protocols on e-submissions, e- moderation and external examining. So it is great news that such guidelines are being developed as part of the EMA work.<\/p>\n<p>\u2022 We have gained a better overview of IFP students\u2019 engagement levels because GradeMark allows us to identify and contact non-submitters at one click. It also shows us the number of submission attempts and whether students have accessed feedback prior to tutorials. This helps us to support at risk students better.<\/p>\n<h4>Effects on the Module Convenor<\/h4>\n<p>\u2022 The module convenor has gained a better real-time overview of the marking process: number of scripts marked so far, marking analytics (average, standard deviation, range), all displayed in the GradeCentre column statistics. This has allowed the module convenor to support the tutors by re-distributing scripts or helping to mark and moderate.<\/p>\n<p>\u2022 The module convenor can also see how much feedback is given to students across the board, which is important for quality assurance purposes.<\/p>\n<p>\u2022 Dealing with possible cases of academic misconduct and late submissions has become easier thanks to Turnitin originality reports and electronic receipt system.<\/p>\n<h3>REFLECTIONS<\/h3>\n<p>\u2022 Our team\u2019s experience has shown that it is worthwhile trying to integrate electronic assessment literacy into the course syllabus. It would also be great if there were university-wide learner-training sessions, similar to CQSD sessions offered to staff.<\/p>\n<p>\u2022 Moving our module toward e-assessment was manageable<br \/>\nbecause our approach to electronic tools has been selective: where our current assessment practices worked well, we only sought to replicate them. When a change was needed, we looked for ways technology could be used to implement it.<\/p>\n<p>\u2022 Sharing best practice and providing peer support has proven to be a good way of encouraging more colleagues to use e- assessment tools, because it was not perceived as a top-down driven change.<\/p>\n<p>\u2022 Having the programme management support has really helped our small community of e-practitioners to grow. Creating training opportunities and allowing some flexibility during the transition to e-practice have been key to its success. There was a point when our exploratory e-assessment practices needed to be more standardized and programme level decisions were key to maintaining consistency of practice.<\/p>\n<h3>FOLLOW UP<\/h3>\n<p>Following the successful trial of the e-assessment tools on the Academic Skills and International English Modules, the programme management is keen to encourage other IFP modules to trial them.<\/p>\n<p>In Spring 2017, a member of the Blackboard Team delivered a Staff Development Session on GradeMark to the IFP team.<\/p>\n<p>We are currently exploring the possibility of doing our internal and external moderation electronically.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>I have been teaching English for over 15 years. I worked on EFL courses in Russia and the UK between 2000 \u2013 2012. I started teaching English for Academic Purposes in 2013 when I joined the International Foundation Programme at the University of Surrey. I have been working as an EAP tutor at the University [&hellip;]<\/p>\n","protected":false},"author":75,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"om_disable_all_campaigns":false,"_exactmetrics_skip_tracking":false,"_exactmetrics_sitenote_active":false,"_exactmetrics_sitenote_note":"","_exactmetrics_sitenote_category":0},"categories":[10,14],"tags":[62,53],"jetpack_sharing_enabled":true,"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/sites.reading.ac.uk\/t-and-l-exchange\/wp-json\/wp\/v2\/posts\/490"}],"collection":[{"href":"https:\/\/sites.reading.ac.uk\/t-and-l-exchange\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sites.reading.ac.uk\/t-and-l-exchange\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sites.reading.ac.uk\/t-and-l-exchange\/wp-json\/wp\/v2\/users\/75"}],"replies":[{"embeddable":true,"href":"https:\/\/sites.reading.ac.uk\/t-and-l-exchange\/wp-json\/wp\/v2\/comments?post=490"}],"version-history":[{"count":0,"href":"https:\/\/sites.reading.ac.uk\/t-and-l-exchange\/wp-json\/wp\/v2\/posts\/490\/revisions"}],"wp:attachment":[{"href":"https:\/\/sites.reading.ac.uk\/t-and-l-exchange\/wp-json\/wp\/v2\/media?parent=490"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sites.reading.ac.uk\/t-and-l-exchange\/wp-json\/wp\/v2\/categories?post=490"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sites.reading.ac.uk\/t-and-l-exchange\/wp-json\/wp\/v2\/tags?post=490"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}