Getting started with Comproved
Making the switch to comparative judgement may feel overwhelming. It doesn’t have to be! From preparation to concrete implementation, you’ll find everything you need to get started with Comproved right here.
Prefer to get this information during a workshop?
From idea to action
Five concrete tips to turn your idea into action and actually get started with comparative judgement.
Getting your colleagues on board
Six tips for getting your colleagues on board with comparative judgement
Preparing your students
Tips for preparing your students for working with comparative judgement
Eliminating misconceptions
Sometimes, students (and teachers) have some misconceptions about comparative judgement. We have collected the most important ones.
Checklist to set up an assessment
Check your assessment idea with this list and get started with Comproved without a hitch!
Working with Comproved
What does an assessment in Comproved look like and what can you do with it? We outlined three possible applications of the comparing tool.
Setting up the assessment
You set up an assessment. You enable the option for students to formulate a feedback question when submitting their work. In addition, each student provides peer feedback on four works. For maximum learning gains, you configure that students can see the full ranking and feedback on all submitted works (anonymously).
Students give feedback
Students upload their work into Comproved. Then they compare the number of works you have predefined. Students also provide feedback on the predetermined number of works.
Rank order
After comparing, the rank order is shared. Students can see their own place on the ranking. All other results (feedback, other works) are shown anonymously.
Feedback
Students see the feedback given on their work. They receive feedback from multiple peers, so feedback may contradict each other. Students will need to actively engage with their feedback.
Action plan
After all the feedback has been reviewed, students can create an action plan. They sort the feedback into self-selected categories and make a plan of how they will improve their work.
Further improvement
To improve their work further, students can use all peer works as well as the feedback on these works as inspiration.
Follow-up actions teacher
In Comproved, you can easily see how long each student took to make the comparisons, how much feedback was given/received, and the quality of the action plans. You can use this information for your next lesson.
Select examples
You select three to five sample works from previous years, ranging in quality from inadequate to good.
Setting up the assessment
For the assessment, you add the students as assessors. You upload the examples yourself.
Student assignment
Students compare the works. This can be done before class or during, depending on how much time you have.
Make explicit
Ask your students to write down after each comparison what they are paying attention to when they make a comparison: what makes one work better or less good than another?
Discussing together
To make the comparing process more explicit, have students discuss with a fellow student first: did you write down the same thing? Any additions?
Discuss the rank order
When all the information has been gathered, share the rank order the students have made of the examples. The students' ranking is probably the same as your ranking in levels of the works: so they can already estimate quality well! Are there any differences? Also interesting to discuss.
Establish the criteria list
Use students' notes to create a criteria list for the assignment together: what are important aspects by which you can tell the quality of the work?
Or: have a say in criteria list
You can also share a pre-prepared criteria list or rubric and present it to the students: do they agree or are adjustments needed? Incorporate their input so they have a say in how they will be assessed.
Summative assessment
You are teaching a course with 300 students and 10 teachers. Students complete a group assignment. You want to ensure the reliability of the assessment.
Setting up the assessment
The assignment you want to assess is a group assignment. In setting up the assessment, you will define the groups so that the students can submit one work per group.
Number of comparisons
You determine the number of comparisons through the rules of thumb in Comproved. There are 75 works to check. A 70% reliability requires +/- 570 comparisons. Divided by 10 teachers, this is 57 comparisons per teacher.
Adding benchmarks
You add two additional works to Comproved. These can be works from the previous year that have been graded already. These judgements have been calibrated with all teachers.
Compare
Students submitted their work and teachers can start comparing. They can do this independent of time and place. You yourself set a deadline when the work must be finished.
Too late?
There is a group of students with some delay. They only turned in their work when the comparisons have already started. That's not a problem.
Rank order
The comparing is finished. The rank order becomes visible. The reliability is also visible and appears to be 72%. You can see in Comproved how long the comparisons took for each teacher.
Determining scores
You want to convert the rank order into scores. You enter the scores of the benchmarks into Comproved. The system calculates the rest of the scores. You randomly check yourself that the scores do indeed match the level.