Robotics Education & Competition Foundation
Inspiring students, one robot at a time.

2559: Remote Interview Feedback to Award Judges


David Sankey (Event Partner)
21-Feb-2025

Initial Judges are supposed to give candidates for awards without ranking them.
Judge Advisors are supposed to compile some information from the initial interviews.

Would it be appropriate to share the rubrics filled out by the initial judges? They could be seen as "ranking" as they have scores on them and they would be able to compare and thus "rank" them. Would it be appropriate to share written judges notes? Should the initial judges be told that these are the notes that will be shared with the Award judges at the event?

Are there any best practices for passing on information from the initial remote judges to the award judges at the event?

Relevant Passages:

From bottom of Page 33:

The end result is a short list of award candidates without rankings to differentiate them.

From Page 39

Remote Initial Team Interviews

...

● The goal of initial remote Team Interviews is to identify nominees for each award (step 1 of the deliberation process).

● Judge Advisors should set up a way to collate judging notes to assist in final deliberations.

Answered by Competition Judging Committee
24-Feb-2025

Stepping back and looking at the bigger picture: The role of either In-Person or Remote Initial Team Interviews is to identify candidates for each award - reducing the number of (follow-up) interviews needed to finalize the shortlisted candidates into a ranked order to determine award winners.

While some of the initial team interview information may appear be useful for the judges performing follow-up interviews, allowing the initial interviews to exert too much influence can compound any initial biases - including the unavoidable factor that different teams will likely have had their initial interviews done by different judges with different perspectives.

As such, while there is no blanket prohibition written in the Guide to Judging that directly addresses whether or not judges performing follow-up interviews should be looking at initial interview judging notes and rubrics, a better result may be achieved by allowing the fact that a team is shortlisted for an award be the starting point for a clean slate for the follow-up interview.

The notes from the initial interview could be more useful in final deliberations, adding the perspective of the initial interviewers to the final deliberations process without unduly influencing the judges performing the follow-up interviews before those judges have had an opportunity to form their own observations.