{"id":1617,"date":"2023-04-07T10:33:25","date_gmt":"2023-04-07T08:33:25","guid":{"rendered":"https:\/\/comproved.com\/uncategorized\/when-is-comparative-judgement-useful\/"},"modified":"2023-12-07T12:22:45","modified_gmt":"2023-12-07T10:22:45","slug":"when-is-comparative-judgement-useful","status":"publish","type":"post","link":"https:\/\/comproved.com\/en\/assessment\/when-is-comparative-judgement-useful\/","title":{"rendered":"When is comparative judgement useful?"},"content":{"rendered":"

[vc_row css_animation=”” row_type=”row” use_row_as_full_screen_section=”no” type=”full_width” angled_section=”no” text_align=”left” background_image_as_pattern=”without_pattern”][vc_column][vc_column_text]As a teacher, you have a range of assessment methods to choose from when assessing tests and tasks. Comparative judgement is one of them. But when is it a good idea to use this method? We will tell you in this article.<\/strong>[\/vc_column_text][vc_empty_space height=”25px”][vc_column_text]<\/p>\n

Complex competences<\/h4>\n

The choice of assessment method depends on the learning goals and the test or task you use to assess the extent to which your students achieve those goals. For example, knowledge is easily assessed using multiple-choice or closed-ended questions. Such tests are easy to assess reliably. Assessors will always arrive at very similar results, after all.<\/p>\n

Comparative judgement is particularly interesting when the competence<\/a> is too complex to be well captured in one or a few aspects. Think of reflection strategies, action plans, solution strategies, internship films, visual works, musical pieces, presentations, theses or portfolios. To try to grasp this complexity, a tendency towards the use of criteria lists and rubrics emerged. However, such analytical assessment methods often fall short in terms of reliability and validity. For instance, there is often overlap between different criteria or they are sometimes interpreted in different ways.<\/p>\n

Therefore, for assessing complex competences, comparative judgement has received increasing attention in recent years. This method more closely matches the way the human brain works and is thus cognitively easier. As a result, assessors make more consistent decisions, which in turn leads to more reliable results.[\/vc_column_text][vc_empty_space height=”25px”][vc_column_text]<\/p>\n

A larger number of products<\/h4>\n

Comparative judgement with an assessment tool only makes sense from 16 products onwards. After all, a smaller number of products can still be perfectly ranked manually from least good to best. From 16 products onwards, it becomes confusing and thus more difficult to compile a ranking yourself. A tool that supports comparative ranking is then a useful aid.<\/p>\n

In addition, it is important for the reliability of the assessment that products can be compared several times with several other products. To achieve sufficiently reliable results, a minimum number of 16 products is required. With fewer products, you need more comparisons than all possible pairs that can be formed. With a larger number of products, you already have enough data with a fraction of all possible combinations to reliably estimate the ranking.[\/vc_column_text][vc_empty_space height=”25px”][vc_column_text]<\/p>\n

Multiple assessors<\/h4>\n

In principle, you can also establish a rank order by yourself or with two assessors. However, it makes more sense to include multiple perspectives in the assessment. To ensure that all aspects of the competency are taken into account and thus that the validity of the assessment is on point, it is recommended to work with a minimum of four assessors.[\/vc_column_text][vc_empty_space height=”25px”][vc_column_text]<\/p>\n

Various formats<\/h4>\n

Comparative judgement is suitable for assessing different formats. And that because you are not bound by a rigid assessment framework. So not only texts, but also videos, music, drawings or images are suitable for comparative judgement. Suppose you assign your students to introduce themselves in a creative way. One sends in a video and the other a poem. With comparative judgement, these can be perfectly assessed together in an assessment.[\/vc_column_text][vc_empty_space height=”25px”][\/vc_column][\/vc_row]<\/p>\n<\/div>","protected":false},"excerpt":{"rendered":"

As a teacher, you have a range of assessment methods to choose from when assessing tests and tasks. Comparative judgement is one of them. But when is it a good idea to use this method?<\/p>\n","protected":false},"author":8,"featured_media":1595,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[8,62],"tags":[70,64,105,68,110,79],"class_list":["post-1617","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-assessment","category-background-comparative-judgement","tag-comparative-judgement-en-2","tag-assessing-competences","tag-assessment-tool","tag-comparative-judgement-en","tag-multiple-assessors","tag-pairwise-comparisons"],"yoast_head":"\nWhen is comparative judgement useful? - Comproved<\/title>\n<meta name=\"description\" content=\"Comparative judgement is one of many assessment methods. But when is it a good idea to use this method?\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/comproved.com\/en\/assessment\/when-is-comparative-judgement-useful\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"When is comparative judgement useful? - Comproved\" \/>\n<meta property=\"og:description\" content=\"Comparative judgement is one of many assessment methods. But when is it a good idea to use this method?\" \/>\n<meta property=\"og:url\" content=\"https:\/\/comproved.com\/en\/assessment\/when-is-comparative-judgement-useful\/\" \/>\n<meta property=\"og:site_name\" content=\"Comproved\" \/>\n<meta property=\"article:published_time\" content=\"2023-04-07T08:33:25+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-12-07T10:22:45+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/comproved.com\/wp-content\/uploads\/2023\/04\/beoordelaarseffecten-2.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"630\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Tine Stoop\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Tine Stoop\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/comproved.com\/en\/assessment\/when-is-comparative-judgement-useful\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/comproved.com\/en\/assessment\/when-is-comparative-judgement-useful\/\"},\"author\":{\"name\":\"Tine Stoop\",\"@id\":\"https:\/\/comproved.com\/en\/#\/schema\/person\/1747a40cacf0036b326438475bf29c8c\"},\"headline\":\"When is comparative judgement useful?\",\"datePublished\":\"2023-04-07T08:33:25+00:00\",\"dateModified\":\"2023-12-07T10:22:45+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/comproved.com\/en\/assessment\/when-is-comparative-judgement-useful\/\"},\"wordCount\":596,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/comproved.com\/en\/#organization\"},\"image\":{\"@id\":\"https:\/\/comproved.com\/en\/assessment\/when-is-comparative-judgement-useful\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/comproved.com\/wp-content\/uploads\/2023\/04\/beoordelaarseffecten-2.png\",\"keywords\":[\"#comparative judgement\",\"assessing competences\",\"assessment tool\",\"comparative judgement\",\"multiple assessors\",\"pairwise comparisons\"],\"articleSection\":[\"Assessment\",\"Background comparative judgement\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/comproved.com\/en\/assessment\/when-is-comparative-judgement-useful\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/comproved.com\/en\/assessment\/when-is-comparative-judgement-useful\/\",\"url\":\"https:\/\/comproved.com\/en\/assessment\/when-is-comparative-judgement-useful\/\",\"name\":\"When is comparative judgement useful? - Comproved\",\"isPartOf\":{\"@id\":\"https:\/\/comproved.com\/en\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/comproved.com\/en\/assessment\/when-is-comparative-judgement-useful\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/comproved.com\/en\/assessment\/when-is-comparative-judgement-useful\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/comproved.com\/wp-content\/uploads\/2023\/04\/beoordelaarseffecten-2.png\",\"datePublished\":\"2023-04-07T08:33:25+00:00\",\"dateModified\":\"2023-12-07T10:22:45+00:00\",\"description\":\"Comparative judgement is one of many assessment methods. But when is it a good idea to use this method?\",\"breadcrumb\":{\"@id\":\"https:\/\/comproved.com\/en\/assessment\/when-is-comparative-judgement-useful\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/comproved.com\/en\/assessment\/when-is-comparative-judgement-useful\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/comproved.com\/en\/assessment\/when-is-comparative-judgement-useful\/#primaryimage\",\"url\":\"https:\/\/comproved.com\/wp-content\/uploads\/2023\/04\/beoordelaarseffecten-2.png\",\"contentUrl\":\"https:\/\/comproved.com\/wp-content\/uploads\/2023\/04\/beoordelaarseffecten-2.png\",\"width\":1200,\"height\":630,\"caption\":\"comparatief beoordelen\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/comproved.com\/en\/assessment\/when-is-comparative-judgement-useful\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/comproved.com\/en\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"When is comparative judgement useful?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/comproved.com\/en\/#website\",\"url\":\"https:\/\/comproved.com\/en\/\",\"name\":\"Comproved\",\"description\":\"Beoordeel beter. Leer meer.\",\"publisher\":{\"@id\":\"https:\/\/comproved.com\/en\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/comproved.com\/en\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/comproved.com\/en\/#organization\",\"name\":\"Comproved\",\"url\":\"https:\/\/comproved.com\/en\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/comproved.com\/en\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/comproved.com\/wp-content\/uploads\/2019\/09\/comproved_logo_rgb_rect.png\",\"contentUrl\":\"https:\/\/comproved.com\/wp-content\/uploads\/2019\/09\/comproved_logo_rgb_rect.png\",\"width\":183,\"height\":40,\"caption\":\"Comproved\"},\"image\":{\"@id\":\"https:\/\/comproved.com\/en\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/comproved.com\/en\/#\/schema\/person\/1747a40cacf0036b326438475bf29c8c\",\"name\":\"Tine Stoop\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/comproved.com\/en\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/cc1e3824c6b8bc37742b6b07816aa4f53ffcc2855214c139b1dfa54edbecfc4f?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/cc1e3824c6b8bc37742b6b07816aa4f53ffcc2855214c139b1dfa54edbecfc4f?s=96&d=mm&r=g\",\"caption\":\"Tine Stoop\"},\"url\":\"https:\/\/comproved.com\/en\/author\/tine\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"When is comparative judgement useful? - Comproved","description":"Comparative judgement is one of many assessment methods. But when is it a good idea to use this method?","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/comproved.com\/en\/assessment\/when-is-comparative-judgement-useful\/","og_locale":"en_US","og_type":"article","og_title":"When is comparative judgement useful? - Comproved","og_description":"Comparative judgement is one of many assessment methods. But when is it a good idea to use this method?","og_url":"https:\/\/comproved.com\/en\/assessment\/when-is-comparative-judgement-useful\/","og_site_name":"Comproved","article_published_time":"2023-04-07T08:33:25+00:00","article_modified_time":"2023-12-07T10:22:45+00:00","og_image":[{"width":1200,"height":630,"url":"https:\/\/comproved.com\/wp-content\/uploads\/2023\/04\/beoordelaarseffecten-2.png","type":"image\/png"}],"author":"Tine Stoop","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Tine Stoop","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/comproved.com\/en\/assessment\/when-is-comparative-judgement-useful\/#article","isPartOf":{"@id":"https:\/\/comproved.com\/en\/assessment\/when-is-comparative-judgement-useful\/"},"author":{"name":"Tine Stoop","@id":"https:\/\/comproved.com\/en\/#\/schema\/person\/1747a40cacf0036b326438475bf29c8c"},"headline":"When is comparative judgement useful?","datePublished":"2023-04-07T08:33:25+00:00","dateModified":"2023-12-07T10:22:45+00:00","mainEntityOfPage":{"@id":"https:\/\/comproved.com\/en\/assessment\/when-is-comparative-judgement-useful\/"},"wordCount":596,"commentCount":0,"publisher":{"@id":"https:\/\/comproved.com\/en\/#organization"},"image":{"@id":"https:\/\/comproved.com\/en\/assessment\/when-is-comparative-judgement-useful\/#primaryimage"},"thumbnailUrl":"https:\/\/comproved.com\/wp-content\/uploads\/2023\/04\/beoordelaarseffecten-2.png","keywords":["#comparative judgement","assessing competences","assessment tool","comparative judgement","multiple assessors","pairwise comparisons"],"articleSection":["Assessment","Background comparative judgement"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/comproved.com\/en\/assessment\/when-is-comparative-judgement-useful\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/comproved.com\/en\/assessment\/when-is-comparative-judgement-useful\/","url":"https:\/\/comproved.com\/en\/assessment\/when-is-comparative-judgement-useful\/","name":"When is comparative judgement useful? - Comproved","isPartOf":{"@id":"https:\/\/comproved.com\/en\/#website"},"primaryImageOfPage":{"@id":"https:\/\/comproved.com\/en\/assessment\/when-is-comparative-judgement-useful\/#primaryimage"},"image":{"@id":"https:\/\/comproved.com\/en\/assessment\/when-is-comparative-judgement-useful\/#primaryimage"},"thumbnailUrl":"https:\/\/comproved.com\/wp-content\/uploads\/2023\/04\/beoordelaarseffecten-2.png","datePublished":"2023-04-07T08:33:25+00:00","dateModified":"2023-12-07T10:22:45+00:00","description":"Comparative judgement is one of many assessment methods. But when is it a good idea to use this method?","breadcrumb":{"@id":"https:\/\/comproved.com\/en\/assessment\/when-is-comparative-judgement-useful\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/comproved.com\/en\/assessment\/when-is-comparative-judgement-useful\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/comproved.com\/en\/assessment\/when-is-comparative-judgement-useful\/#primaryimage","url":"https:\/\/comproved.com\/wp-content\/uploads\/2023\/04\/beoordelaarseffecten-2.png","contentUrl":"https:\/\/comproved.com\/wp-content\/uploads\/2023\/04\/beoordelaarseffecten-2.png","width":1200,"height":630,"caption":"comparatief beoordelen"},{"@type":"BreadcrumbList","@id":"https:\/\/comproved.com\/en\/assessment\/when-is-comparative-judgement-useful\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/comproved.com\/en\/"},{"@type":"ListItem","position":2,"name":"When is comparative judgement useful?"}]},{"@type":"WebSite","@id":"https:\/\/comproved.com\/en\/#website","url":"https:\/\/comproved.com\/en\/","name":"Comproved","description":"Beoordeel beter. Leer meer.","publisher":{"@id":"https:\/\/comproved.com\/en\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/comproved.com\/en\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/comproved.com\/en\/#organization","name":"Comproved","url":"https:\/\/comproved.com\/en\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/comproved.com\/en\/#\/schema\/logo\/image\/","url":"https:\/\/comproved.com\/wp-content\/uploads\/2019\/09\/comproved_logo_rgb_rect.png","contentUrl":"https:\/\/comproved.com\/wp-content\/uploads\/2019\/09\/comproved_logo_rgb_rect.png","width":183,"height":40,"caption":"Comproved"},"image":{"@id":"https:\/\/comproved.com\/en\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/comproved.com\/en\/#\/schema\/person\/1747a40cacf0036b326438475bf29c8c","name":"Tine Stoop","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/comproved.com\/en\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/cc1e3824c6b8bc37742b6b07816aa4f53ffcc2855214c139b1dfa54edbecfc4f?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/cc1e3824c6b8bc37742b6b07816aa4f53ffcc2855214c139b1dfa54edbecfc4f?s=96&d=mm&r=g","caption":"Tine Stoop"},"url":"https:\/\/comproved.com\/en\/author\/tine\/"}]}},"_links":{"self":[{"href":"https:\/\/comproved.com\/en\/wp-json\/wp\/v2\/posts\/1617","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/comproved.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/comproved.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/comproved.com\/en\/wp-json\/wp\/v2\/users\/8"}],"replies":[{"embeddable":true,"href":"https:\/\/comproved.com\/en\/wp-json\/wp\/v2\/comments?post=1617"}],"version-history":[{"count":3,"href":"https:\/\/comproved.com\/en\/wp-json\/wp\/v2\/posts\/1617\/revisions"}],"predecessor-version":[{"id":2627,"href":"https:\/\/comproved.com\/en\/wp-json\/wp\/v2\/posts\/1617\/revisions\/2627"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/comproved.com\/en\/wp-json\/wp\/v2\/media\/1595"}],"wp:attachment":[{"href":"https:\/\/comproved.com\/en\/wp-json\/wp\/v2\/media?parent=1617"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/comproved.com\/en\/wp-json\/wp\/v2\/categories?post=1617"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/comproved.com\/en\/wp-json\/wp\/v2\/tags?post=1617"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}