Performance Metric Usage When Determining Excellence Award Winner : Robot Events

Performance Metric Usage When Determining Excellence Award Winner

Dale Nacianceno

19-Jun-2024

Page 8:

Qualitative Judgement Judges are expected to apply qualitative judgment to award criteria when making final decisions on all Judged Awards. As such, a particular or overall score on a rubric is not an automatic disqualification for any Judged Award. For example, while completing the Engineering Notebook Rubric results in a quantitative score, Judges must still deliberate and apply qualitative judgement when ranking teams to determine the Design Award winner.

In the 2023-2024 Guide to Judging, the following is stated on page 19:

Excellence Award criteria, including performance metrics, are intended as a threshold for eligibility. Qualitative judgment on the part of judges is needed to discern an Excellence Award winner from among eligible candidates.

This verbiage does not seem to be in the 2024-2025 Guide to Judging.

During final deliberations, are judges allowed to use Qualification Rankings, Skills Challenge Rankings, and Autonomous Coding Skills Rankings as a way to aid judges in discerning an Excellence Award winner from among eligible candidates?

Answered by Competition Judging Committee

1-Jul-2024

During deliberations, Judges are allowed to use performance metrics, including scores, as one of the many factors that go into their qualitative judgement of final award winners.

How different factors are individually weighted relative to one another is something that is qualitative in nature and is a natural part of the deliberation process.

It is not the intent of the process outlined in the Guide to Judging for any score or metric to be an automatic deciding factor for any teams that meet award criteria. However, it is appropriate for that information, along with all other award criteria and factors, to be considered in the qualitative deliberation process.