{"id":7323,"date":"2023-08-14T09:59:39","date_gmt":"2023-08-14T09:59:39","guid":{"rendered":"https:\/\/sites.reading.ac.uk\/t-and-l-exchange\/?p=7323"},"modified":"2023-08-14T14:41:05","modified_gmt":"2023-08-14T14:41:05","slug":"designing-an-authentic-assessment-tailored-specifically-for-part-4-students","status":"publish","type":"post","link":"https:\/\/sites.reading.ac.uk\/t-and-l-exchange\/2023\/08\/14\/designing-an-authentic-assessment-tailored-specifically-for-part-4-students\/","title":{"rendered":"Designing an authentic assessment tailored specifically for Part 4 students"},"content":{"rendered":"<h2><a href=\"https:\/\/sites.reading.ac.uk\/t-and-l-exchange\/case-studies\/\"><img decoding=\"async\" loading=\"lazy\" class=\"alignleft wp-image-6130 size-full\" src=\"\/wp-content\/uploads\/sites\/42\/2019\/08\/Back-Arrow-e1565604225291.png\" alt=\"\" width=\"45\" height=\"45\" \/><\/a><\/h2>\n<p>&nbsp;<\/p>\n<h6>By: Dr Julia Abery, Department of Mathematics and Statistics, <a href=\"mailto:j.abery@reading.ac.uk\">j.abery@reading.ac.uk<\/a><\/h6>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-full wp-image-7324\" src=\"https:\/\/sites.reading.ac.uk\/t-and-l-exchange\/wp-content\/uploads\/sites\/26\/2023\/08\/mimi-thian-vdXMSiX-n6M-unsplash-scaled.jpg\" alt=\"Four people watching a Macbook\" width=\"2560\" height=\"1920\" srcset=\"https:\/\/sites.reading.ac.uk\/t-and-l-exchange\/wp-content\/uploads\/sites\/26\/2023\/08\/mimi-thian-vdXMSiX-n6M-unsplash-scaled.jpg 2560w, https:\/\/sites.reading.ac.uk\/t-and-l-exchange\/wp-content\/uploads\/sites\/26\/2023\/08\/mimi-thian-vdXMSiX-n6M-unsplash-300x225.jpg 300w, https:\/\/sites.reading.ac.uk\/t-and-l-exchange\/wp-content\/uploads\/sites\/26\/2023\/08\/mimi-thian-vdXMSiX-n6M-unsplash-1024x768.jpg 1024w, https:\/\/sites.reading.ac.uk\/t-and-l-exchange\/wp-content\/uploads\/sites\/26\/2023\/08\/mimi-thian-vdXMSiX-n6M-unsplash-768x576.jpg 768w, https:\/\/sites.reading.ac.uk\/t-and-l-exchange\/wp-content\/uploads\/sites\/26\/2023\/08\/mimi-thian-vdXMSiX-n6M-unsplash-1536x1152.jpg 1536w, https:\/\/sites.reading.ac.uk\/t-and-l-exchange\/wp-content\/uploads\/sites\/26\/2023\/08\/mimi-thian-vdXMSiX-n6M-unsplash-2048x1536.jpg 2048w\" sizes=\"(max-width: 2560px) 100vw, 2560px\" \/><\/p>\n<p><small>Photo by <a href=\"https:\/\/unsplash.com\/photos\/vdXMSiX-n6M\">Mimi Thian<\/a> on <a href=\"https:\/\/unsplash.com\/\">Unsplash<\/a><\/small><\/p>\n<h1>Overview<\/h1>\n<p>I designed a tailored applied statistics assignment for a UoR Part 4 Department of Mathematics and Statistics module (module code ST4MVA) which successfully met two distinct objectives. Firstly, the assignment tested advanced, specific masters-level skills, as outlined in the QAA framework. Secondly, the assignment incorporated the critical elements of <em>authentic assessment<\/em> as recommended by Ashford-Rowe et al. (2014).<\/p>\n<h1>Objectives<\/h1>\n<p>In designing the assessment, the objectives were as follows:<\/p>\n<ul>\n<li>To test masters-level skills described in the QAA L7 descriptor and to conform to departmental guidelines for L7 assessment.<\/li>\n<li>To align with the ALOs (assessable learning outcomes) of the Part 4 applied statistics module ST4MVA.<\/li>\n<li>To incorporate the critical elements of an authentic assessment, aiming to improve student engagement and develop employability skills.<\/li>\n<\/ul>\n<h1>Context<\/h1>\n<p>I produced a Part 4 assessment in multivariate methods which tests specific, advanced level 7 skills including systematic subject knowledge, evaluation, analysis, creation and independent research, to align with our department\u2019s aims for assessment at this level.<\/p>\n<p>Following discussion with colleagues and students, I became persuaded that an authentic assessment could increase value and meaning to the student. This meant basing the assessment on engaging \u2018real-world\u2019 scenarios, and aiming to incorporate employability skills and to promote deeper learning approaches.<\/p>\n<h1>Implementation<\/h1>\n<p>I consulted ST4MVA ALOs and departmental guidelines for Part 4 assessment, and decided on a data analysis assignment requiring selection and implementation of a range of multivariate methods in the statistical computing package R, some of which are researched independently. I took direction from the QAA level 7 descriptor; \u2018to deal with complex issues both systematically and creatively \u2026 communicate their conclusions clearly to specialist and non-specialist audiences; demonstrate self-direction and originality in tackling and solving problems, and act autonomously in planning and implementing tasks at a professional or equivalent level.\u2019 I designed an open ended task, so students could be creative and direct their own work. I requested two written reports, for specialist and non-specialist audiences.<\/p>\n<p>Having reviewed various articles, I elected to use a simplified version of Ashford-Rowe et al.\u2019s (2014) list of critical elements of authentic assessment. The table below shows how the assignment addresses these elements.<\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone wp-image-7330\" src=\"https:\/\/sites.reading.ac.uk\/t-and-l-exchange\/wp-content\/uploads\/sites\/26\/2023\/08\/abery-table.png\" alt=\"Table with three columns - see file download for accessible version\" width=\"815\" height=\"374\" srcset=\"https:\/\/sites.reading.ac.uk\/t-and-l-exchange\/wp-content\/uploads\/sites\/26\/2023\/08\/abery-table.png 1202w, https:\/\/sites.reading.ac.uk\/t-and-l-exchange\/wp-content\/uploads\/sites\/26\/2023\/08\/abery-table-300x138.png 300w, https:\/\/sites.reading.ac.uk\/t-and-l-exchange\/wp-content\/uploads\/sites\/26\/2023\/08\/abery-table-1024x470.png 1024w, https:\/\/sites.reading.ac.uk\/t-and-l-exchange\/wp-content\/uploads\/sites\/26\/2023\/08\/abery-table-768x353.png 768w\" sizes=\"(max-width: 815px) 100vw, 815px\" \/><\/p>\n<pre><a href=\"https:\/\/sites.reading.ac.uk\/t-and-l-exchange\/wp-content\/uploads\/sites\/26\/2023\/08\/Abery-authentic-assessment-table.pdf\">Select here to download an accessible version of this table.<\/a><\/pre>\n<figure class=\"table-figure\"><\/figure>\n<h1>Impact<\/h1>\n<p>Feedback from internal and external examiners and other colleagues suggests the assignment successfully captures features of an authentic assessment and allows students to demonstrate higher level abilities and employability skills. \u00a0Some colleagues thought a similar approach might be used elsewhere in our programmes. Writing an assignment with close alignment to the principles of authentic assessment was instructive and will undoubtedly influence the way I approach assessment in other modules and at other levels.<\/p>\n<p>Students reported that the tasks were genuinely useful ones to practise and master, and tested higher level skills such as evaluation, creativity and analysis. The assignment was felt to be challenging and at least moderately engaging and interesting. One student commented \u2018being able to apply the\u00a0techniques we had learnt in lectures onto \u201creal world data\u201d made it very applicable to a real-world scenario[s].\u2019<\/p>\n<h1>Reflections<\/h1>\n<p>At least three features helped to ensure success: Firstly, obtaining data from an industry partner, and working on the project with them, helped to maintain a real-world focus and ensured employability skills were assessed. Secondly, detailed scrutiny of the assignment by experienced internal and external examiners resulted in making some changes and improvements which led to a better and more challenging assignment. This highlights the benefits of collaborating with colleagues and other academics when developing authentic assessment, and being open to constructive criticism. Thirdly, consulting the literature and identifying a checklist ensured that I had clear objectives and maintained a wide perspective on different aspects of authentic assessment.<\/p>\n<p>On reflection, a fuller understanding of authentic assessment may be achieved by consulting local employers, identifying skills they look for when they recruit and checking whether assessments align well with these. More feedback from students would be beneficial, clarifying the extent to which claims in the literature of enhanced learning, increased engagement and motivation play out in students\u2019 experience.<\/p>\n<p>The assessment has now been released, completed and marked but only for a small number of students to date, meaning that a full evaluation is yet to happen.\u00a0A possible extension of the practice would be to implement <span style=\"font-style: normal !msorm\"><em>authentic assessment<\/em><\/span> at programme level \u2013 so each student can benefit.<\/p>\n<hr \/>\n<p>&nbsp;<\/p>\n<h1>References<\/h1>\n<ul>\n<li>Ashford-Rowe, K., Herrington, J., and Brown, C. (2014). Establishing the critical elements that determine authentic assessment. <span style=\"font-style: normal !msorm\"><em>Assessment and Evaluation in Higher Education<\/em><\/span>, <span style=\"font-style: normal !msorm\"><em>39<\/em><\/span>(2), pp. 205\u2013222. <a href=\"https:\/\/www.tandfonline.com\/doi\/full\/10.1080\/02602938.2013.819566\">https:\/\/www.tandfonline.com\/doi\/full\/10.1080\/02602938.2013.819566<\/a><\/li>\n<li>QAA. (2014). UK Quality Code for Higher Education Part A: Setting and Maintaining Academic Standards. The Frameworks for Higher Education Qualifications of UK Degree-Awarding Bodies. <a href=\"https:\/\/www.qaa.ac.uk\/docs\/qaa\/quality-code\/qualifications-frameworks.pdf\">https:\/\/www.qaa.ac.uk\/docs\/qaa\/quality-code\/qualifications-frameworks.pdf<\/a><\/li>\n<\/ul>\n<hr \/>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>This case study by Julia Abery in SMPCS outlines the process of designing a tailored masters-level authentic assessment with the aim of increasing student engagement and promoting transferable skills. <\/p>\n","protected":false},"author":235,"featured_media":7324,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"om_disable_all_campaigns":false,"_exactmetrics_skip_tracking":false,"_exactmetrics_sitenote_active":false,"_exactmetrics_sitenote_note":"","_exactmetrics_sitenote_category":0},"categories":[10,24,9],"tags":[631,630,629,628],"jetpack_sharing_enabled":true,"jetpack_featured_media_url":"https:\/\/sites.reading.ac.uk\/t-and-l-exchange\/wp-content\/uploads\/sites\/26\/2023\/08\/mimi-thian-vdXMSiX-n6M-unsplash-scaled.jpg","_links":{"self":[{"href":"https:\/\/sites.reading.ac.uk\/t-and-l-exchange\/wp-json\/wp\/v2\/posts\/7323"}],"collection":[{"href":"https:\/\/sites.reading.ac.uk\/t-and-l-exchange\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sites.reading.ac.uk\/t-and-l-exchange\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sites.reading.ac.uk\/t-and-l-exchange\/wp-json\/wp\/v2\/users\/235"}],"replies":[{"embeddable":true,"href":"https:\/\/sites.reading.ac.uk\/t-and-l-exchange\/wp-json\/wp\/v2\/comments?post=7323"}],"version-history":[{"count":6,"href":"https:\/\/sites.reading.ac.uk\/t-and-l-exchange\/wp-json\/wp\/v2\/posts\/7323\/revisions"}],"predecessor-version":[{"id":7343,"href":"https:\/\/sites.reading.ac.uk\/t-and-l-exchange\/wp-json\/wp\/v2\/posts\/7323\/revisions\/7343"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/sites.reading.ac.uk\/t-and-l-exchange\/wp-json\/wp\/v2\/media\/7324"}],"wp:attachment":[{"href":"https:\/\/sites.reading.ac.uk\/t-and-l-exchange\/wp-json\/wp\/v2\/media?parent=7323"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sites.reading.ac.uk\/t-and-l-exchange\/wp-json\/wp\/v2\/categories?post=7323"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sites.reading.ac.uk\/t-and-l-exchange\/wp-json\/wp\/v2\/tags?post=7323"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}