{"id":1367,"date":"2022-04-08T16:37:22","date_gmt":"2022-04-08T14:37:22","guid":{"rendered":"https:\/\/comproved.com\/uncategorized\/what-is-comparative-judgement\/"},"modified":"2023-12-07T12:40:04","modified_gmt":"2023-12-07T10:40:04","slug":"what-is-comparative-judgement","status":"publish","type":"post","link":"https:\/\/comproved.com\/en\/assessment\/what-is-comparative-judgement\/","title":{"rendered":"What is comparative judgement?"},"content":{"rendered":"<div class=\"wpb-content-wrapper\"><p>[vc_row css_animation=&#8221;&#8221; row_type=&#8221;row&#8221; use_row_as_full_screen_section=&#8221;no&#8221; type=&#8221;full_width&#8221; angled_section=&#8221;no&#8221; text_align=&#8221;left&#8221; background_image_as_pattern=&#8221;without_pattern&#8221;][vc_column][vc_column_text]<strong>Why assessing complex skills is so difficult is explained in <a href=\"https:\/\/comproved.com\/en\/education-and-assessment\/why-is-assessing-so-difficult\/\" target=\"_blank\" rel=\"noopener\">this article<\/a>. The good news is that there is an alternative assessment method that is more in tune with how the human brain works. How do you naturally make decisions, after all? Indeed: by making comparisons. And that is exactly what comparative judgement does.<\/strong><\/p>\n<p>If you are going to buy shoes, for example, chances are small that you will go to a shoe shop with a typed-out criteria list on which you are going to judge all the shoes. What you are more likely to do, and without thinking, is to compare pairs of shoes, or compare that one pair of shoes with an ideal image in your head.<\/p>\n<p>When teachers and lecturers assess, they do the same. Give them one student&#8217;s product, and it is difficult to make a quality assessment. Offer them products in pairs, ask them to compare them with each other and yes, they will effortlessly answer the question of which product is the best of the two. Because of their expertise, they quickly see which opinion piece is better argued, which source research is more in-depth or which visual work is more creative.[\/vc_column_text][vc_empty_space][\/vc_column][\/vc_row][vc_row css_animation=&#8221;&#8221; row_type=&#8221;row&#8221; use_row_as_full_screen_section=&#8221;no&#8221; type=&#8221;full_width&#8221; angled_section=&#8221;no&#8221; text_align=&#8221;left&#8221; background_image_as_pattern=&#8221;without_pattern&#8221;][vc_column][vc_column_text]<\/p>\n<h4>Comparative judgement is making comparisons<\/h4>\n<p>And you do this almost without thinking. For example, it is impossible to estimate the altitude of an overflying aircraft. But if two planes fly over, you can quickly see which one is highest in the sky. So, using the same principle, you don&#8217;t assess students&#8217; works as separate products, but in relation to each other. From two products, you choose the best one. By comparing all products in pairs this way, you will finally arrive at a ranking from &#8216;least good&#8217; to &#8216;best&#8217;.[\/vc_column_text][vc_empty_space][\/vc_column][\/vc_row][vc_row css_animation=&#8221;&#8221; row_type=&#8221;row&#8221; use_row_as_full_screen_section=&#8221;no&#8221; type=&#8221;full_width&#8221; angled_section=&#8221;no&#8221; text_align=&#8221;left&#8221; background_image_as_pattern=&#8221;without_pattern&#8221;][vc_column][vc_column_text]<\/p>\n<h4>Comparative judgement is the counterpart of absolute judgement<\/h4>\n<p>With absolute judgement you look at one task, whereas with comparative judgement you situate the task in relation to other tasks. In addition, with comparative judgement you also choose for a holistic approach. Which means that you assess the task as a whole. This is in contrast to analytical methods that usually work with criterion lists: a piece of work is analysed in detail by looking at different aspects and sub-competences.[\/vc_column_text][vc_empty_space][\/vc_column][\/vc_row][vc_row css_animation=&#8221;&#8221; row_type=&#8221;row&#8221; use_row_as_full_screen_section=&#8221;no&#8221; type=&#8221;full_width&#8221; angled_section=&#8221;no&#8221; text_align=&#8221;left&#8221; background_image_as_pattern=&#8221;without_pattern&#8221;][vc_column][vc_column_text]<\/p>\n<h4>Comparative judgement reflects the consensus between assessors<\/h4>\n<p>And that without lengthy discussions, but simply by the statistical model (Bradley-Terry-Luce) underlying the method. It calculates a quality scale from lesser to better quality. It also becomes quickly clear which assessors deviate from the consensus. Who chooses regularly different and about which products are the opinions strongly divided? This provides useful information that can be further explored.[\/vc_column_text][vc_empty_space][\/vc_column][\/vc_row]<\/p>\n<\/div>","protected":false},"excerpt":{"rendered":"<p>Comparative judgement is a method that is more in line with the natural workings of the human brain. How do you naturally make decisions, after all? By making comparisons! <\/p>\n","protected":false},"author":8,"featured_media":1157,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[8,62],"tags":[70,81,79],"class_list":["post-1367","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-assessment","category-background-comparative-judgement","tag-comparative-judgement-en-2","tag-evaluating-competences","tag-pairwise-comparisons"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v26.1.1 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>What is comparative judgement? - Comproved<\/title>\n<meta name=\"description\" content=\"By nature, we make decisions by comparing. That is exactly what comparative judgement does.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/comproved.com\/en\/assessment\/what-is-comparative-judgement\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"What is comparative judgement? - Comproved\" \/>\n<meta property=\"og:description\" content=\"By nature, we make decisions by comparing. That is exactly what comparative judgement does.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/comproved.com\/en\/assessment\/what-is-comparative-judgement\/\" \/>\n<meta property=\"og:site_name\" content=\"Comproved\" \/>\n<meta property=\"article:published_time\" content=\"2022-04-08T14:37:22+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-12-07T10:40:04+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/comproved.com\/wp-content\/uploads\/2022\/04\/Untitled-design-4.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"630\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Tine Stoop\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Tine Stoop\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/comproved.com\/en\/assessment\/what-is-comparative-judgement\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/comproved.com\/en\/assessment\/what-is-comparative-judgement\/\"},\"author\":{\"name\":\"Tine Stoop\",\"@id\":\"https:\/\/comproved.com\/en\/#\/schema\/person\/1747a40cacf0036b326438475bf29c8c\"},\"headline\":\"What is comparative judgement?\",\"datePublished\":\"2022-04-08T14:37:22+00:00\",\"dateModified\":\"2023-12-07T10:40:04+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/comproved.com\/en\/assessment\/what-is-comparative-judgement\/\"},\"wordCount\":613,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/comproved.com\/en\/#organization\"},\"image\":{\"@id\":\"https:\/\/comproved.com\/en\/assessment\/what-is-comparative-judgement\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/comproved.com\/wp-content\/uploads\/2022\/04\/Untitled-design-4.png\",\"keywords\":[\"#comparative judgement\",\"evaluating competences\",\"pairwise comparisons\"],\"articleSection\":[\"Assessment\",\"Background comparative judgement\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/comproved.com\/en\/assessment\/what-is-comparative-judgement\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/comproved.com\/en\/assessment\/what-is-comparative-judgement\/\",\"url\":\"https:\/\/comproved.com\/en\/assessment\/what-is-comparative-judgement\/\",\"name\":\"What is comparative judgement? - Comproved\",\"isPartOf\":{\"@id\":\"https:\/\/comproved.com\/en\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/comproved.com\/en\/assessment\/what-is-comparative-judgement\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/comproved.com\/en\/assessment\/what-is-comparative-judgement\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/comproved.com\/wp-content\/uploads\/2022\/04\/Untitled-design-4.png\",\"datePublished\":\"2022-04-08T14:37:22+00:00\",\"dateModified\":\"2023-12-07T10:40:04+00:00\",\"description\":\"By nature, we make decisions by comparing. That is exactly what comparative judgement does.\",\"breadcrumb\":{\"@id\":\"https:\/\/comproved.com\/en\/assessment\/what-is-comparative-judgement\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/comproved.com\/en\/assessment\/what-is-comparative-judgement\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/comproved.com\/en\/assessment\/what-is-comparative-judgement\/#primaryimage\",\"url\":\"https:\/\/comproved.com\/wp-content\/uploads\/2022\/04\/Untitled-design-4.png\",\"contentUrl\":\"https:\/\/comproved.com\/wp-content\/uploads\/2022\/04\/Untitled-design-4.png\",\"width\":1200,\"height\":630,\"caption\":\"comparative judgement\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/comproved.com\/en\/assessment\/what-is-comparative-judgement\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/comproved.com\/en\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"What is comparative judgement?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/comproved.com\/en\/#website\",\"url\":\"https:\/\/comproved.com\/en\/\",\"name\":\"Comproved\",\"description\":\"Beoordeel beter. Leer meer.\",\"publisher\":{\"@id\":\"https:\/\/comproved.com\/en\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/comproved.com\/en\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/comproved.com\/en\/#organization\",\"name\":\"Comproved\",\"url\":\"https:\/\/comproved.com\/en\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/comproved.com\/en\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/comproved.com\/wp-content\/uploads\/2019\/09\/comproved_logo_rgb_rect.png\",\"contentUrl\":\"https:\/\/comproved.com\/wp-content\/uploads\/2019\/09\/comproved_logo_rgb_rect.png\",\"width\":183,\"height\":40,\"caption\":\"Comproved\"},\"image\":{\"@id\":\"https:\/\/comproved.com\/en\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/comproved.com\/en\/#\/schema\/person\/1747a40cacf0036b326438475bf29c8c\",\"name\":\"Tine Stoop\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/comproved.com\/en\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/cc1e3824c6b8bc37742b6b07816aa4f53ffcc2855214c139b1dfa54edbecfc4f?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/cc1e3824c6b8bc37742b6b07816aa4f53ffcc2855214c139b1dfa54edbecfc4f?s=96&d=mm&r=g\",\"caption\":\"Tine Stoop\"},\"url\":\"https:\/\/comproved.com\/en\/author\/tine\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"What is comparative judgement? - Comproved","description":"By nature, we make decisions by comparing. That is exactly what comparative judgement does.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/comproved.com\/en\/assessment\/what-is-comparative-judgement\/","og_locale":"en_US","og_type":"article","og_title":"What is comparative judgement? - Comproved","og_description":"By nature, we make decisions by comparing. That is exactly what comparative judgement does.","og_url":"https:\/\/comproved.com\/en\/assessment\/what-is-comparative-judgement\/","og_site_name":"Comproved","article_published_time":"2022-04-08T14:37:22+00:00","article_modified_time":"2023-12-07T10:40:04+00:00","og_image":[{"width":1200,"height":630,"url":"https:\/\/comproved.com\/wp-content\/uploads\/2022\/04\/Untitled-design-4.png","type":"image\/png"}],"author":"Tine Stoop","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Tine Stoop","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/comproved.com\/en\/assessment\/what-is-comparative-judgement\/#article","isPartOf":{"@id":"https:\/\/comproved.com\/en\/assessment\/what-is-comparative-judgement\/"},"author":{"name":"Tine Stoop","@id":"https:\/\/comproved.com\/en\/#\/schema\/person\/1747a40cacf0036b326438475bf29c8c"},"headline":"What is comparative judgement?","datePublished":"2022-04-08T14:37:22+00:00","dateModified":"2023-12-07T10:40:04+00:00","mainEntityOfPage":{"@id":"https:\/\/comproved.com\/en\/assessment\/what-is-comparative-judgement\/"},"wordCount":613,"commentCount":0,"publisher":{"@id":"https:\/\/comproved.com\/en\/#organization"},"image":{"@id":"https:\/\/comproved.com\/en\/assessment\/what-is-comparative-judgement\/#primaryimage"},"thumbnailUrl":"https:\/\/comproved.com\/wp-content\/uploads\/2022\/04\/Untitled-design-4.png","keywords":["#comparative judgement","evaluating competences","pairwise comparisons"],"articleSection":["Assessment","Background comparative judgement"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/comproved.com\/en\/assessment\/what-is-comparative-judgement\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/comproved.com\/en\/assessment\/what-is-comparative-judgement\/","url":"https:\/\/comproved.com\/en\/assessment\/what-is-comparative-judgement\/","name":"What is comparative judgement? - Comproved","isPartOf":{"@id":"https:\/\/comproved.com\/en\/#website"},"primaryImageOfPage":{"@id":"https:\/\/comproved.com\/en\/assessment\/what-is-comparative-judgement\/#primaryimage"},"image":{"@id":"https:\/\/comproved.com\/en\/assessment\/what-is-comparative-judgement\/#primaryimage"},"thumbnailUrl":"https:\/\/comproved.com\/wp-content\/uploads\/2022\/04\/Untitled-design-4.png","datePublished":"2022-04-08T14:37:22+00:00","dateModified":"2023-12-07T10:40:04+00:00","description":"By nature, we make decisions by comparing. That is exactly what comparative judgement does.","breadcrumb":{"@id":"https:\/\/comproved.com\/en\/assessment\/what-is-comparative-judgement\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/comproved.com\/en\/assessment\/what-is-comparative-judgement\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/comproved.com\/en\/assessment\/what-is-comparative-judgement\/#primaryimage","url":"https:\/\/comproved.com\/wp-content\/uploads\/2022\/04\/Untitled-design-4.png","contentUrl":"https:\/\/comproved.com\/wp-content\/uploads\/2022\/04\/Untitled-design-4.png","width":1200,"height":630,"caption":"comparative judgement"},{"@type":"BreadcrumbList","@id":"https:\/\/comproved.com\/en\/assessment\/what-is-comparative-judgement\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/comproved.com\/en\/"},{"@type":"ListItem","position":2,"name":"What is comparative judgement?"}]},{"@type":"WebSite","@id":"https:\/\/comproved.com\/en\/#website","url":"https:\/\/comproved.com\/en\/","name":"Comproved","description":"Beoordeel beter. Leer meer.","publisher":{"@id":"https:\/\/comproved.com\/en\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/comproved.com\/en\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/comproved.com\/en\/#organization","name":"Comproved","url":"https:\/\/comproved.com\/en\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/comproved.com\/en\/#\/schema\/logo\/image\/","url":"https:\/\/comproved.com\/wp-content\/uploads\/2019\/09\/comproved_logo_rgb_rect.png","contentUrl":"https:\/\/comproved.com\/wp-content\/uploads\/2019\/09\/comproved_logo_rgb_rect.png","width":183,"height":40,"caption":"Comproved"},"image":{"@id":"https:\/\/comproved.com\/en\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/comproved.com\/en\/#\/schema\/person\/1747a40cacf0036b326438475bf29c8c","name":"Tine Stoop","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/comproved.com\/en\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/cc1e3824c6b8bc37742b6b07816aa4f53ffcc2855214c139b1dfa54edbecfc4f?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/cc1e3824c6b8bc37742b6b07816aa4f53ffcc2855214c139b1dfa54edbecfc4f?s=96&d=mm&r=g","caption":"Tine Stoop"},"url":"https:\/\/comproved.com\/en\/author\/tine\/"}]}},"_links":{"self":[{"href":"https:\/\/comproved.com\/en\/wp-json\/wp\/v2\/posts\/1367","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/comproved.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/comproved.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/comproved.com\/en\/wp-json\/wp\/v2\/users\/8"}],"replies":[{"embeddable":true,"href":"https:\/\/comproved.com\/en\/wp-json\/wp\/v2\/comments?post=1367"}],"version-history":[{"count":3,"href":"https:\/\/comproved.com\/en\/wp-json\/wp\/v2\/posts\/1367\/revisions"}],"predecessor-version":[{"id":1370,"href":"https:\/\/comproved.com\/en\/wp-json\/wp\/v2\/posts\/1367\/revisions\/1370"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/comproved.com\/en\/wp-json\/wp\/v2\/media\/1157"}],"wp:attachment":[{"href":"https:\/\/comproved.com\/en\/wp-json\/wp\/v2\/media?parent=1367"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/comproved.com\/en\/wp-json\/wp\/v2\/categories?post=1367"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/comproved.com\/en\/wp-json\/wp\/v2\/tags?post=1367"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}