{"id":4790,"date":"2019-01-25T10:03:53","date_gmt":"2019-01-25T10:03:53","guid":{"rendered":"http:\/\/sites.reading.ac.uk\/tel-support\/?p=4790"},"modified":"2019-01-25T10:05:31","modified_gmt":"2019-01-25T10:05:31","slug":"internal-moderation-large-cohorts-and-multiple-markers","status":"publish","type":"post","link":"https:\/\/sites.reading.ac.uk\/tel-support\/2019\/01\/25\/internal-moderation-large-cohorts-and-multiple-markers\/","title":{"rendered":"Internal moderation: Large cohorts and multiple markers"},"content":{"rendered":"<h1>Turnitin<\/h1>\n<p>For Turnitin assignments with multiple markers, the\u00a0<a href=\"https:\/\/sites.reading.ac.uk\/tel-support\/2018\/07\/27\/turnitin-marking-submissions-by-group-turnitin-by-group\/\">Turnitin Assignments by Groups<\/a>\u00a0feature can be used to distribute markers to papers. This can be used with both Named and Anonymous marking.<\/p>\n<p>The Moderator can then use <a href=\"https:\/\/sites.reading.ac.uk\/tel-support\/2019\/01\/17\/internal-moderation-using-turnitin-assignments-by-groups\/\">Turnitin Assignments by Groups<\/a>\u00a0to view all papers marked by each marker.<\/p>\n<h2>Anonymous Moderation<\/h2>\n<p>This is possible with both Named and Anonymous moderation, but when anonymity is enabled you cannot easily see the spread of marks for individual markers, or identify papers on grade boundaries.<\/p>\n<p>If Moderation is to be carried out with anonymity enabled, the Module Convenor will have to ask each marker to record on an Excel sheet the<\/p>\n<ul>\n<li>marker\u2019s name<\/li>\n<li>paper ID<\/li>\n<li>mark awarded<\/li>\n<\/ul>\n<p>for all papers marked.<\/p>\n<p>The moderator can then identify<\/p>\n<ul>\n<li>markers who may have marked too harshly or too generously<\/li>\n<li>which papers they wish to moderate.<\/li>\n<\/ul>\n<p>To access papers for moderation<\/p>\n<ol>\n<li>Make a note of which Group was allocated to the marker in question.<\/li>\n<li>Make a note of (or copy) the paper ID.<\/li>\n<li>Use Turnitin Assignments by Group to locate the relevant Group.<\/li>\n<li>Use the search function to locate the specific paper<\/li>\n<\/ol>\n<p><img data-attachment-id=\"4787\" data-permalink=\"https:\/\/sites.reading.ac.uk\/tel-support\/2019\/01\/18\/internal-moderation-turnitin-anonymous-moderation-markers-moderate-each-others-work\/turnitin-by-groups-search-by-paper-id\/\" data-orig-file=\"https:\/\/i0.wp.com\/sites.reading.ac.uk\/tel-support\/wp-content\/uploads\/sites\/30\/2019\/01\/Turnitin-by-Groups-search-by-Paper-ID.png?fit=1197%2C462&amp;ssl=1\" data-orig-size=\"1197,462\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}\" data-image-title=\"Turnitin by Groups &#8211; search by Paper ID\" data-image-description=\"\" data-image-caption=\"\" data-medium-file=\"https:\/\/i0.wp.com\/sites.reading.ac.uk\/tel-support\/wp-content\/uploads\/sites\/30\/2019\/01\/Turnitin-by-Groups-search-by-Paper-ID.png?fit=1197%2C462&amp;ssl=1\" data-large-file=\"https:\/\/i0.wp.com\/sites.reading.ac.uk\/tel-support\/wp-content\/uploads\/sites\/30\/2019\/01\/Turnitin-by-Groups-search-by-Paper-ID.png?fit=980%2C378&amp;ssl=1\" decoding=\"async\" loading=\"lazy\" class=\"alignnone size-full wp-image-4787\" src=\"\/wp-content\/uploads\/sites\/30\/2019\/01\/Turnitin-by-Groups-search-by-Paper-ID.png\" alt=\"Turnitin by Groups - search by Paper ID\" width=\"1197\" height=\"462\" srcset=\"https:\/\/i0.wp.com\/sites.reading.ac.uk\/tel-support\/wp-content\/uploads\/sites\/30\/2019\/01\/Turnitin-by-Groups-search-by-Paper-ID.png?w=1197&amp;ssl=1 1197w, https:\/\/i0.wp.com\/sites.reading.ac.uk\/tel-support\/wp-content\/uploads\/sites\/30\/2019\/01\/Turnitin-by-Groups-search-by-Paper-ID.png?resize=768%2C296&amp;ssl=1 768w, https:\/\/i0.wp.com\/sites.reading.ac.uk\/tel-support\/wp-content\/uploads\/sites\/30\/2019\/01\/Turnitin-by-Groups-search-by-Paper-ID.png?resize=150%2C58&amp;ssl=1 150w, https:\/\/i0.wp.com\/sites.reading.ac.uk\/tel-support\/wp-content\/uploads\/sites\/30\/2019\/01\/Turnitin-by-Groups-search-by-Paper-ID.png?resize=366%2C141&amp;ssl=1 366w, https:\/\/i0.wp.com\/sites.reading.ac.uk\/tel-support\/wp-content\/uploads\/sites\/30\/2019\/01\/Turnitin-by-Groups-search-by-Paper-ID.png?resize=770%2C297&amp;ssl=1 770w\" sizes=\"(max-width: 980px) 100vw, 980px\" \/><\/p>\n<p>For more information please see\u00a0<a href=\"https:\/\/sites.reading.ac.uk\/tel-support\/internal-moderation-of-a-turnitin-assignment\/\">Internal Moderation of a Turnitin Assignment<\/a>.<\/p>\n<p>See also our suggested workflow for situations where\u00a0<a href=\"https:\/\/sites.reading.ac.uk\/tel-support\/2019\/01\/18\/internal-moderation-turnitin-anonymous-moderation-markers-moderate-each-others-work\/\">multiple markers moderate each other\u2019s work<\/a>.<\/p>\n<p>&nbsp;<\/p>\n<div id=\"bb\">\n<h1>Blackboard Assignments<\/h1>\n<pre><img data-attachment-id=\"904\" data-permalink=\"https:\/\/sites.reading.ac.uk\/tel-support\/2018\/06\/28\/turnitin-create-and-import-a-qualitative-rubric-using-excel\/i-100-2\/\" data-orig-file=\"https:\/\/i0.wp.com\/sites.reading.ac.uk\/tel-support\/wp-content\/uploads\/sites\/30\/2018\/06\/i-100-2.png?fit=100%2C100&amp;ssl=1\" data-orig-size=\"100,100\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}\" data-image-title=\"i-100-2\" data-image-description=\"\" data-image-caption=\"\" data-medium-file=\"https:\/\/i0.wp.com\/sites.reading.ac.uk\/tel-support\/wp-content\/uploads\/sites\/30\/2018\/06\/i-100-2.png?fit=100%2C100&amp;ssl=1\" data-large-file=\"https:\/\/i0.wp.com\/sites.reading.ac.uk\/tel-support\/wp-content\/uploads\/sites\/30\/2018\/06\/i-100-2.png?fit=100%2C100&amp;ssl=1\" decoding=\"async\" loading=\"lazy\" class=\"size-full wp-image-904 aligncenter\" src=\"\/wp-content\/uploads\/sites\/30\/2018\/06\/i-100-2.png\" alt=\"Important information!\" width=\"100\" height=\"100\" srcset=\"https:\/\/i0.wp.com\/sites.reading.ac.uk\/tel-support\/wp-content\/uploads\/sites\/30\/2018\/06\/i-100-2.png?w=100&amp;ssl=1 100w, https:\/\/i0.wp.com\/sites.reading.ac.uk\/tel-support\/wp-content\/uploads\/sites\/30\/2018\/06\/i-100-2.png?resize=75%2C75&amp;ssl=1 75w\" sizes=\"(max-width: 100px) 100vw, 100px\" \/>\r\nThe information below relates to assignments where individual students submit work, not to <a href=\"https:\/\/sites.reading.ac.uk\/tel-support\/2018\/10\/25\/mode-of-submission-electronic-document-group-work\/\">Blackboard Group Assignments<\/a>.<\/pre>\n<h2>Named Marking<\/h2>\n<p>As with Turnitin, markers can be assigned to papers by setting up\u00a0<a href=\"https:\/\/sites.reading.ac.uk\/tel-support\/2018\/07\/23\/blackboard-creating-multiple-manual-enrol-groups-for-your-course\/\">Manual Enrol<\/a> or\u00a0<a href=\"https:\/\/sites.reading.ac.uk\/tel-support\/2018\/07\/23\/blackboard-creating-random-enrol-groups-for-your-course\/\">Random Enrol<\/a>\u00a0Groups. These Groups do not have to be made visible to the students.<\/p>\n<p>Markers can then access the relevant papers via a <a href=\"https:\/\/sites.reading.ac.uk\/tel-support\/2018\/07\/23\/smart-view-for-groups\/\">Smart View<\/a>\u00a0in\u00a0the Grade Centre.<\/p>\n<p>Moderators can use the same approach to access the papers marked by each marker.<\/p>\n<p>For further details, see our Internal Moderation guide\u00a0<a href=\"https:\/\/sites.reading.ac.uk\/tel-support\/2018\/10\/25\/internal-moderation-workflow-blackboard-named-marking-named-moderation-inside-15-days\/\">Bb 03: Blackboard Named Marking + Named Moderation within 15 days<\/a>.<\/p>\n<h2>Anonymous Marking<\/h2>\n<p>It is not possible to use Groups in this way when Anonymous marking is enabled.<\/p>\n<p>To record who has marked which papers, and to see the spread of marks awarded, each marker will need to note the Paper ID and mark on a spreadsheet\/form, and send this to the moderator when marking is complete.<\/p>\n<p>Alternatively, the moderator can access the Grade History for the Blackboard Assignment, and view the marker&#8217;s name and grade awarded.<\/p>\n<p><img data-attachment-id=\"4808\" data-permalink=\"https:\/\/sites.reading.ac.uk\/tel-support\/2019\/01\/25\/internal-moderation-large-cohorts-and-multiple-markers\/anonymous-blackboard-assignment-view-grade-history-1\/\" data-orig-file=\"https:\/\/i0.wp.com\/sites.reading.ac.uk\/tel-support\/wp-content\/uploads\/sites\/30\/2019\/01\/Anonymous-Blackboard-Assignment-View-Grade-History-1.png?fit=308%2C517&amp;ssl=1\" data-orig-size=\"308,517\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}\" data-image-title=\"Anonymous Blackboard Assignment &#8211; View Grade History 1\" data-image-description=\"\" data-image-caption=\"\" data-medium-file=\"https:\/\/i0.wp.com\/sites.reading.ac.uk\/tel-support\/wp-content\/uploads\/sites\/30\/2019\/01\/Anonymous-Blackboard-Assignment-View-Grade-History-1.png?fit=308%2C517&amp;ssl=1\" data-large-file=\"https:\/\/i0.wp.com\/sites.reading.ac.uk\/tel-support\/wp-content\/uploads\/sites\/30\/2019\/01\/Anonymous-Blackboard-Assignment-View-Grade-History-1.png?fit=308%2C517&amp;ssl=1\" decoding=\"async\" loading=\"lazy\" class=\"alignnone size-full wp-image-4808\" src=\"\/wp-content\/uploads\/sites\/30\/2019\/01\/Anonymous-Blackboard-Assignment-View-Grade-History-1.png\" alt=\"Anonymous Blackboard Assignment - View Grade History from the Grade Centre\" width=\"308\" height=\"517\" srcset=\"https:\/\/i0.wp.com\/sites.reading.ac.uk\/tel-support\/wp-content\/uploads\/sites\/30\/2019\/01\/Anonymous-Blackboard-Assignment-View-Grade-History-1.png?w=308&amp;ssl=1 308w, https:\/\/i0.wp.com\/sites.reading.ac.uk\/tel-support\/wp-content\/uploads\/sites\/30\/2019\/01\/Anonymous-Blackboard-Assignment-View-Grade-History-1.png?resize=89%2C150&amp;ssl=1 89w\" sizes=\"(max-width: 308px) 100vw, 308px\" \/><\/p>\n<p>By downloading this into Excel it should be fairly simple to view the spread of marks awarded, and identify which\u00a0papers should be moderated.<\/p>\n<p><img data-attachment-id=\"4807\" data-permalink=\"https:\/\/sites.reading.ac.uk\/tel-support\/2019\/01\/25\/internal-moderation-large-cohorts-and-multiple-markers\/anonymous-blackboard-assignment-view-grade-history-2\/\" data-orig-file=\"https:\/\/i0.wp.com\/sites.reading.ac.uk\/tel-support\/wp-content\/uploads\/sites\/30\/2019\/01\/Anonymous-Blackboard-Assignment-View-Grade-History-2.png?fit=925%2C728&amp;ssl=1\" data-orig-size=\"925,728\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}\" data-image-title=\"Anonymous Blackboard Assignment &#8211; View Grade History\" data-image-description=\"\" data-image-caption=\"\" data-medium-file=\"https:\/\/i0.wp.com\/sites.reading.ac.uk\/tel-support\/wp-content\/uploads\/sites\/30\/2019\/01\/Anonymous-Blackboard-Assignment-View-Grade-History-2.png?fit=925%2C728&amp;ssl=1\" data-large-file=\"https:\/\/i0.wp.com\/sites.reading.ac.uk\/tel-support\/wp-content\/uploads\/sites\/30\/2019\/01\/Anonymous-Blackboard-Assignment-View-Grade-History-2.png?fit=925%2C728&amp;ssl=1\" decoding=\"async\" loading=\"lazy\" class=\"alignnone size-full wp-image-4807\" src=\"\/wp-content\/uploads\/sites\/30\/2019\/01\/Anonymous-Blackboard-Assignment-View-Grade-History-2.png\" alt=\"Anonymous Blackboard Assignment - View Grade History\" width=\"925\" height=\"728\" srcset=\"https:\/\/i0.wp.com\/sites.reading.ac.uk\/tel-support\/wp-content\/uploads\/sites\/30\/2019\/01\/Anonymous-Blackboard-Assignment-View-Grade-History-2.png?w=925&amp;ssl=1 925w, https:\/\/i0.wp.com\/sites.reading.ac.uk\/tel-support\/wp-content\/uploads\/sites\/30\/2019\/01\/Anonymous-Blackboard-Assignment-View-Grade-History-2.png?resize=768%2C604&amp;ssl=1 768w, https:\/\/i0.wp.com\/sites.reading.ac.uk\/tel-support\/wp-content\/uploads\/sites\/30\/2019\/01\/Anonymous-Blackboard-Assignment-View-Grade-History-2.png?resize=150%2C118&amp;ssl=1 150w, https:\/\/i0.wp.com\/sites.reading.ac.uk\/tel-support\/wp-content\/uploads\/sites\/30\/2019\/01\/Anonymous-Blackboard-Assignment-View-Grade-History-2.png?resize=366%2C288&amp;ssl=1 366w, https:\/\/i0.wp.com\/sites.reading.ac.uk\/tel-support\/wp-content\/uploads\/sites\/30\/2019\/01\/Anonymous-Blackboard-Assignment-View-Grade-History-2.png?resize=770%2C606&amp;ssl=1 770w\" sizes=\"(max-width: 925px) 100vw, 925px\" \/><\/p>\n<p><img data-attachment-id=\"4806\" data-permalink=\"https:\/\/sites.reading.ac.uk\/tel-support\/2019\/01\/25\/internal-moderation-large-cohorts-and-multiple-markers\/anonymous-blackboard-assignment-grade-history-downloaded\/\" data-orig-file=\"https:\/\/i0.wp.com\/sites.reading.ac.uk\/tel-support\/wp-content\/uploads\/sites\/30\/2019\/01\/Anonymous-Blackboard-Assignment-Grade-History-downloaded.png?fit=723%2C177&amp;ssl=1\" data-orig-size=\"723,177\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}\" data-image-title=\"Anonymous Blackboard Assignment &#8211; Grade History downloaded\" data-image-description=\"\" data-image-caption=\"\" data-medium-file=\"https:\/\/i0.wp.com\/sites.reading.ac.uk\/tel-support\/wp-content\/uploads\/sites\/30\/2019\/01\/Anonymous-Blackboard-Assignment-Grade-History-downloaded.png?fit=723%2C177&amp;ssl=1\" data-large-file=\"https:\/\/i0.wp.com\/sites.reading.ac.uk\/tel-support\/wp-content\/uploads\/sites\/30\/2019\/01\/Anonymous-Blackboard-Assignment-Grade-History-downloaded.png?fit=723%2C177&amp;ssl=1\" decoding=\"async\" loading=\"lazy\" class=\"alignnone size-full wp-image-4806\" src=\"\/wp-content\/uploads\/sites\/30\/2019\/01\/Anonymous-Blackboard-Assignment-Grade-History-downloaded.png\" alt=\"Anonymous Blackboard Assignment - Grade History downloaded\" width=\"723\" height=\"177\" srcset=\"https:\/\/i0.wp.com\/sites.reading.ac.uk\/tel-support\/wp-content\/uploads\/sites\/30\/2019\/01\/Anonymous-Blackboard-Assignment-Grade-History-downloaded.png?w=723&amp;ssl=1 723w, https:\/\/i0.wp.com\/sites.reading.ac.uk\/tel-support\/wp-content\/uploads\/sites\/30\/2019\/01\/Anonymous-Blackboard-Assignment-Grade-History-downloaded.png?resize=150%2C37&amp;ssl=1 150w, https:\/\/i0.wp.com\/sites.reading.ac.uk\/tel-support\/wp-content\/uploads\/sites\/30\/2019\/01\/Anonymous-Blackboard-Assignment-Grade-History-downloaded.png?resize=366%2C90&amp;ssl=1 366w\" sizes=\"(max-width: 723px) 100vw, 723px\" \/><\/p>\n<p>&nbsp;<\/p>\n<p>However it is not particularly easy for the moderator to then locate the required papers in the Grade Centre.<\/p>\n<p>For further detail please see our Internal Moderation guidance page\u00a0<a href=\"https:\/\/sites.reading.ac.uk\/tel-support\/2018\/10\/25\/internal-moderation-workflow-blackboard-anonymous-marking-anonymous-moderation-inside-15-days\/\">Bb 01: Blackboard Anonymous Marking + Anonymous Moderation within 15 days<\/a><\/p>\n<p>&nbsp;<\/p>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>Turnitin For Turnitin assignments with multiple markers, the\u00a0Turnitin Assignments by Groups\u00a0feature can be used to distribute markers to papers. This can be used with both Named and Anonymous marking. The Moderator can then use Turnitin Assignments by Groups\u00a0to view all papers marked by each marker. Anonymous Moderation This is possible with both Named and Anonymous moderation, but when anonymity is enabled you cannot easily see the spread of marks for individual markers, or identify papers on grade boundaries. If Moderation is to be carried out with anonymity enabled, the Module Convenor will have to ask each marker to record on an Excel sheet the marker\u2019s name paper ID mark awarded for all papers marked. The moderator can then identify markers who may have marked too harshly or too generously which papers they wish to moderate. To access papers for moderation Make a note of which Group was allocated to the marker in question. Make a note of (or copy) the paper ID. Use Turnitin Assignments by Group to locate the relevant Group. Use the search function to locate the specific paper For more information please see\u00a0Internal Moderation of a Turnitin Assignment. See also our suggested workflow for situations where\u00a0multiple markers moderate each other\u2019s work. &nbsp; Blackboard Assignments The information below relates to assignments where individual students submit work, not to Blackboard Group Assignments. Named Marking As with Turnitin, markers can be assigned to papers by setting up\u00a0Manual Enrol or\u00a0Random Enrol\u00a0Groups. These Groups do not have to be made visible to the students. Markers can then access the relevant papers via a Smart View\u00a0in\u00a0the Grade Centre. Moderators can use the same approach to access the papers marked by each marker. For further details, see our Internal Moderation guide\u00a0Bb 03: Blackboard Named Marking + Named Moderation within 15 days. Anonymous Marking It is not possible to use Groups in this way when Anonymous marking is enabled. To record who has marked which papers, and to see the spread of marks awarded, each marker will need to note the Paper ID and mark on a spreadsheet\/form, and send this to the moderator when marking is complete. Alternatively, the moderator can access the Grade History for the Blackboard Assignment, and view the marker&#8217;s name and grade awarded. By downloading this into Excel it should be fairly simple to view the spread of marks awarded, and identify which\u00a0papers should be moderated. &nbsp; However it is not particularly easy for the moderator to then locate the required papers in the Grade Centre. For further detail please see our Internal Moderation guidance page\u00a0Bb 01: Blackboard Anonymous Marking + Anonymous Moderation within 15 days &nbsp;<\/p>\n","protected":false},"author":64,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"image","meta":{"om_disable_all_campaigns":false,"_lmt_disableupdate":"","_lmt_disable":"","_exactmetrics_skip_tracking":false,"_exactmetrics_sitenote_active":false,"_exactmetrics_sitenote_note":"","_exactmetrics_sitenote_category":0,"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_newsletter_tier_id":0,"jetpack_publicize_message":"","jetpack_is_tweetstorm":false,"jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","enabled":false}},"_links_to":"","_links_to_target":""},"categories":[228,231],"tags":[],"jetpack_publicize_connections":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v21.8.1 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Internal moderation: Large cohorts and multiple markers - Blackboard Help for Staff - University of Reading<\/title>\n<meta name=\"robots\" content=\"noindex, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Internal moderation: Large cohorts and multiple markers - Blackboard Help for Staff - University of Reading\" \/>\n<meta property=\"og:description\" content=\"Turnitin For Turnitin assignments with multiple markers, the\u00a0Turnitin Assignments by Groups\u00a0feature can be used to distribute markers to papers. This can be used with both Named and Anonymous marking. The Moderator can then use Turnitin Assignments by Groups\u00a0to view all papers marked by each marker. Anonymous Moderation This is possible with both Named and Anonymous moderation, but when anonymity is enabled you cannot easily see the spread of marks for individual markers, or identify papers on grade boundaries. If Moderation is to be carried out with anonymity enabled, the Module Convenor will have to ask each marker to record on an Excel sheet the marker\u2019s name paper ID mark awarded for all papers marked. The moderator can then identify markers who may have marked too harshly or too generously which papers they wish to moderate. To access papers for moderation Make a note of which Group was allocated to the marker in question. Make a note of (or copy) the paper ID. Use Turnitin Assignments by Group to locate the relevant Group. Use the search function to locate the specific paper For more information please see\u00a0Internal Moderation of a Turnitin Assignment. See also our suggested workflow for situations where\u00a0multiple markers moderate each other\u2019s work. &nbsp; Blackboard Assignments The information below relates to assignments where individual students submit work, not to Blackboard Group Assignments. Named Marking As with Turnitin, markers can be assigned to papers by setting up\u00a0Manual Enrol or\u00a0Random Enrol\u00a0Groups. These Groups do not have to be made visible to the students. Markers can then access the relevant papers via a Smart View\u00a0in\u00a0the Grade Centre. Moderators can use the same approach to access the papers marked by each marker. For further details, see our Internal Moderation guide\u00a0Bb 03: Blackboard Named Marking + Named Moderation within 15 days. Anonymous Marking It is not possible to use Groups in this way when Anonymous marking is enabled. To record who has marked which papers, and to see the spread of marks awarded, each marker will need to note the Paper ID and mark on a spreadsheet\/form, and send this to the moderator when marking is complete. Alternatively, the moderator can access the Grade History for the Blackboard Assignment, and view the marker&#8217;s name and grade awarded. By downloading this into Excel it should be fairly simple to view the spread of marks awarded, and identify which\u00a0papers should be moderated. &nbsp; However it is not particularly easy for the moderator to then locate the required papers in the Grade Centre. For further detail please see our Internal Moderation guidance page\u00a0Bb 01: Blackboard Anonymous Marking + Anonymous Moderation within 15 days &nbsp;\" \/>\n<meta property=\"og:url\" content=\"https:\/\/sites.reading.ac.uk\/tel-support\/2019\/01\/25\/internal-moderation-large-cohorts-and-multiple-markers\/\" \/>\n<meta property=\"og:site_name\" content=\"Blackboard Help for Staff - University of Reading\" \/>\n<meta property=\"article:published_time\" content=\"2019-01-25T10:03:53+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2019-01-25T10:05:31+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/sites.reading.ac.uk\/wp-content\/uploads\/sites\/30\/2019\/01\/Turnitin-by-Groups-search-by-Paper-ID.png\" \/>\n<meta name=\"author\" content=\"andyturner\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@UniRdg_TEL\" \/>\n<meta name=\"twitter:site\" content=\"@UniRdg_TEL\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"andyturner\" \/>\n\t<meta name=\"twitter:label2\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/sites.reading.ac.uk\/tel-support\/2019\/01\/25\/internal-moderation-large-cohorts-and-multiple-markers\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/sites.reading.ac.uk\/tel-support\/2019\/01\/25\/internal-moderation-large-cohorts-and-multiple-markers\/\"},\"author\":{\"name\":\"andyturner\",\"@id\":\"https:\/\/sites.reading.ac.uk\/tel-support\/#\/schema\/person\/1d09060138ab1f1c4edd0c81ae508fd5\"},\"headline\":\"Internal moderation: Large cohorts and multiple markers\",\"datePublished\":\"2019-01-25T10:03:53+00:00\",\"dateModified\":\"2019-01-25T10:05:31+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/sites.reading.ac.uk\/tel-support\/2019\/01\/25\/internal-moderation-large-cohorts-and-multiple-markers\/\"},\"wordCount\":438,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/sites.reading.ac.uk\/tel-support\/#organization\"},\"articleSection\":[\"Assessment &amp; Feedback\",\"Managing Assessment\"],\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/sites.reading.ac.uk\/tel-support\/2019\/01\/25\/internal-moderation-large-cohorts-and-multiple-markers\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/sites.reading.ac.uk\/tel-support\/2019\/01\/25\/internal-moderation-large-cohorts-and-multiple-markers\/\",\"url\":\"https:\/\/sites.reading.ac.uk\/tel-support\/2019\/01\/25\/internal-moderation-large-cohorts-and-multiple-markers\/\",\"name\":\"Internal moderation: Large cohorts and multiple markers - Blackboard Help for Staff - University of Reading\",\"isPartOf\":{\"@id\":\"https:\/\/sites.reading.ac.uk\/tel-support\/#website\"},\"datePublished\":\"2019-01-25T10:03:53+00:00\",\"dateModified\":\"2019-01-25T10:05:31+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/sites.reading.ac.uk\/tel-support\/2019\/01\/25\/internal-moderation-large-cohorts-and-multiple-markers\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/sites.reading.ac.uk\/tel-support\/2019\/01\/25\/internal-moderation-large-cohorts-and-multiple-markers\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/sites.reading.ac.uk\/tel-support\/2019\/01\/25\/internal-moderation-large-cohorts-and-multiple-markers\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/sites.reading.ac.uk\/tel-support\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Internal moderation: Large cohorts and multiple markers\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/sites.reading.ac.uk\/tel-support\/#website\",\"url\":\"https:\/\/sites.reading.ac.uk\/tel-support\/\",\"name\":\"Blackboard Help for Staff - University of Reading\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\/\/sites.reading.ac.uk\/tel-support\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/sites.reading.ac.uk\/tel-support\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-GB\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/sites.reading.ac.uk\/tel-support\/#organization\",\"name\":\"University of Reading\",\"url\":\"https:\/\/sites.reading.ac.uk\/tel-support\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\/\/sites.reading.ac.uk\/tel-support\/#\/schema\/logo\/image\/\",\"url\":\"\/wp-content\/uploads\/sites\/30\/2018\/10\/rdg.jpg\",\"contentUrl\":\"\/wp-content\/uploads\/sites\/30\/2018\/10\/rdg.jpg\",\"width\":317,\"height\":317,\"caption\":\"University of Reading\"},\"image\":{\"@id\":\"https:\/\/sites.reading.ac.uk\/tel-support\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/twitter.com\/UniRdg_TEL\",\"https:\/\/www.youtube.com\/channel\/UCem8bKo2tjqIZnyGA4aNizw\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/sites.reading.ac.uk\/tel-support\/#\/schema\/person\/1d09060138ab1f1c4edd0c81ae508fd5\",\"name\":\"andyturner\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\/\/sites.reading.ac.uk\/tel-support\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/2ef9ae2d05713fd78512b439c4d78735?s=96&d=retro&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/2ef9ae2d05713fd78512b439c4d78735?s=96&d=retro&r=g\",\"caption\":\"andyturner\"},\"description\":\"Senior TEL Applications Manager, University of Reading\",\"url\":\"https:\/\/sites.reading.ac.uk\/tel-support\/author\/andyturner\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Internal moderation: Large cohorts and multiple markers - Blackboard Help for Staff - University of Reading","robots":{"index":"noindex","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"og_locale":"en_GB","og_type":"article","og_title":"Internal moderation: Large cohorts and multiple markers - Blackboard Help for Staff - University of Reading","og_description":"Turnitin For Turnitin assignments with multiple markers, the\u00a0Turnitin Assignments by Groups\u00a0feature can be used to distribute markers to papers. This can be used with both Named and Anonymous marking. The Moderator can then use Turnitin Assignments by Groups\u00a0to view all papers marked by each marker. Anonymous Moderation This is possible with both Named and Anonymous moderation, but when anonymity is enabled you cannot easily see the spread of marks for individual markers, or identify papers on grade boundaries. If Moderation is to be carried out with anonymity enabled, the Module Convenor will have to ask each marker to record on an Excel sheet the marker\u2019s name paper ID mark awarded for all papers marked. The moderator can then identify markers who may have marked too harshly or too generously which papers they wish to moderate. To access papers for moderation Make a note of which Group was allocated to the marker in question. Make a note of (or copy) the paper ID. Use Turnitin Assignments by Group to locate the relevant Group. Use the search function to locate the specific paper For more information please see\u00a0Internal Moderation of a Turnitin Assignment. See also our suggested workflow for situations where\u00a0multiple markers moderate each other\u2019s work. &nbsp; Blackboard Assignments The information below relates to assignments where individual students submit work, not to Blackboard Group Assignments. Named Marking As with Turnitin, markers can be assigned to papers by setting up\u00a0Manual Enrol or\u00a0Random Enrol\u00a0Groups. These Groups do not have to be made visible to the students. Markers can then access the relevant papers via a Smart View\u00a0in\u00a0the Grade Centre. Moderators can use the same approach to access the papers marked by each marker. For further details, see our Internal Moderation guide\u00a0Bb 03: Blackboard Named Marking + Named Moderation within 15 days. Anonymous Marking It is not possible to use Groups in this way when Anonymous marking is enabled. To record who has marked which papers, and to see the spread of marks awarded, each marker will need to note the Paper ID and mark on a spreadsheet\/form, and send this to the moderator when marking is complete. Alternatively, the moderator can access the Grade History for the Blackboard Assignment, and view the marker&#8217;s name and grade awarded. By downloading this into Excel it should be fairly simple to view the spread of marks awarded, and identify which\u00a0papers should be moderated. &nbsp; However it is not particularly easy for the moderator to then locate the required papers in the Grade Centre. For further detail please see our Internal Moderation guidance page\u00a0Bb 01: Blackboard Anonymous Marking + Anonymous Moderation within 15 days &nbsp;","og_url":"https:\/\/sites.reading.ac.uk\/tel-support\/2019\/01\/25\/internal-moderation-large-cohorts-and-multiple-markers\/","og_site_name":"Blackboard Help for Staff - University of Reading","article_published_time":"2019-01-25T10:03:53+00:00","article_modified_time":"2019-01-25T10:05:31+00:00","og_image":[{"url":"https:\/\/sites.reading.ac.uk\/wp-content\/uploads\/sites\/30\/2019\/01\/Turnitin-by-Groups-search-by-Paper-ID.png"}],"author":"andyturner","twitter_card":"summary_large_image","twitter_creator":"@UniRdg_TEL","twitter_site":"@UniRdg_TEL","twitter_misc":{"Written by":"andyturner","Estimated reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/sites.reading.ac.uk\/tel-support\/2019\/01\/25\/internal-moderation-large-cohorts-and-multiple-markers\/#article","isPartOf":{"@id":"https:\/\/sites.reading.ac.uk\/tel-support\/2019\/01\/25\/internal-moderation-large-cohorts-and-multiple-markers\/"},"author":{"name":"andyturner","@id":"https:\/\/sites.reading.ac.uk\/tel-support\/#\/schema\/person\/1d09060138ab1f1c4edd0c81ae508fd5"},"headline":"Internal moderation: Large cohorts and multiple markers","datePublished":"2019-01-25T10:03:53+00:00","dateModified":"2019-01-25T10:05:31+00:00","mainEntityOfPage":{"@id":"https:\/\/sites.reading.ac.uk\/tel-support\/2019\/01\/25\/internal-moderation-large-cohorts-and-multiple-markers\/"},"wordCount":438,"commentCount":0,"publisher":{"@id":"https:\/\/sites.reading.ac.uk\/tel-support\/#organization"},"articleSection":["Assessment &amp; Feedback","Managing Assessment"],"inLanguage":"en-GB","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/sites.reading.ac.uk\/tel-support\/2019\/01\/25\/internal-moderation-large-cohorts-and-multiple-markers\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/sites.reading.ac.uk\/tel-support\/2019\/01\/25\/internal-moderation-large-cohorts-and-multiple-markers\/","url":"https:\/\/sites.reading.ac.uk\/tel-support\/2019\/01\/25\/internal-moderation-large-cohorts-and-multiple-markers\/","name":"Internal moderation: Large cohorts and multiple markers - Blackboard Help for Staff - University of Reading","isPartOf":{"@id":"https:\/\/sites.reading.ac.uk\/tel-support\/#website"},"datePublished":"2019-01-25T10:03:53+00:00","dateModified":"2019-01-25T10:05:31+00:00","breadcrumb":{"@id":"https:\/\/sites.reading.ac.uk\/tel-support\/2019\/01\/25\/internal-moderation-large-cohorts-and-multiple-markers\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/sites.reading.ac.uk\/tel-support\/2019\/01\/25\/internal-moderation-large-cohorts-and-multiple-markers\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/sites.reading.ac.uk\/tel-support\/2019\/01\/25\/internal-moderation-large-cohorts-and-multiple-markers\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/sites.reading.ac.uk\/tel-support\/"},{"@type":"ListItem","position":2,"name":"Internal moderation: Large cohorts and multiple markers"}]},{"@type":"WebSite","@id":"https:\/\/sites.reading.ac.uk\/tel-support\/#website","url":"https:\/\/sites.reading.ac.uk\/tel-support\/","name":"Blackboard Help for Staff - University of Reading","description":"","publisher":{"@id":"https:\/\/sites.reading.ac.uk\/tel-support\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/sites.reading.ac.uk\/tel-support\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-GB"},{"@type":"Organization","@id":"https:\/\/sites.reading.ac.uk\/tel-support\/#organization","name":"University of Reading","url":"https:\/\/sites.reading.ac.uk\/tel-support\/","logo":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/sites.reading.ac.uk\/tel-support\/#\/schema\/logo\/image\/","url":"\/wp-content\/uploads\/sites\/30\/2018\/10\/rdg.jpg","contentUrl":"\/wp-content\/uploads\/sites\/30\/2018\/10\/rdg.jpg","width":317,"height":317,"caption":"University of Reading"},"image":{"@id":"https:\/\/sites.reading.ac.uk\/tel-support\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/twitter.com\/UniRdg_TEL","https:\/\/www.youtube.com\/channel\/UCem8bKo2tjqIZnyGA4aNizw"]},{"@type":"Person","@id":"https:\/\/sites.reading.ac.uk\/tel-support\/#\/schema\/person\/1d09060138ab1f1c4edd0c81ae508fd5","name":"andyturner","image":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/sites.reading.ac.uk\/tel-support\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/2ef9ae2d05713fd78512b439c4d78735?s=96&d=retro&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/2ef9ae2d05713fd78512b439c4d78735?s=96&d=retro&r=g","caption":"andyturner"},"description":"Senior TEL Applications Manager, University of Reading","url":"https:\/\/sites.reading.ac.uk\/tel-support\/author\/andyturner\/"}]}},"modified_by":"andyturner","jetpack_sharing_enabled":true,"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/p9WwLV-1fg","_links":{"self":[{"href":"https:\/\/sites.reading.ac.uk\/tel-support\/wp-json\/wp\/v2\/posts\/4790"}],"collection":[{"href":"https:\/\/sites.reading.ac.uk\/tel-support\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sites.reading.ac.uk\/tel-support\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sites.reading.ac.uk\/tel-support\/wp-json\/wp\/v2\/users\/64"}],"replies":[{"embeddable":true,"href":"https:\/\/sites.reading.ac.uk\/tel-support\/wp-json\/wp\/v2\/comments?post=4790"}],"version-history":[{"count":0,"href":"https:\/\/sites.reading.ac.uk\/tel-support\/wp-json\/wp\/v2\/posts\/4790\/revisions"}],"wp:attachment":[{"href":"https:\/\/sites.reading.ac.uk\/tel-support\/wp-json\/wp\/v2\/media?parent=4790"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sites.reading.ac.uk\/tel-support\/wp-json\/wp\/v2\/categories?post=4790"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sites.reading.ac.uk\/tel-support\/wp-json\/wp\/v2\/tags?post=4790"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}