1962: Sorting the Engineering Notebooks : Robot Events

1962: Sorting the Engineering Notebooks

Gina Wade (Event Partner)

19-Feb-2024

In the Guide to Judging, the notebook sorting process is described as a process the judges perform.
"Judges perform a quick scan of all the Engineering Notebooks and divide them into two categories: Developing and Fully Developed." (pg 26)

The Guide goes on the describe that judges who are uncertain should consult other judges. "If it is unclear whether a notebook should be categorized as Developing or Fully Developed, either another Judge can help make that determination, or the notebook should be given the benefit of the doubt and scored using the rubric." (pg 26)

If there are time constraints that make it easier for the Judge Advisor to perform the sort (let's say while the judges are conducting initial interviews), is this acceptable, or must the sorting of notebooks be performed by judges?

If the Judge Advisor is permitted to perform the sort, are there any best practices you recommend to ensure that one person is not singularly choosing which notebooks will be scored and which will not?

Answered by Competition Judging Committee

20-Feb-2024

It is acceptable for the Judge Advisor to assist the judging process where needed.

A best practice is to set up a system of "One Yes and Two No's".

One "Yes" passes a notebook to the next level of sorting if the reviewer deems it to be "Fully Developed."

If a notebook does not pass (is given a "No") then it gets checked by another judge, who may also review it with a "No", thereby putting it in the "Developing" category, or a "Yes" putting it in the "Fully Developed" Category.

This system can save time by having some notebooks initially sorted by a single person, but removing a notebook from further consideration requires two different reviewers, lessening the chances of a notebook not getting reviewed further when it probably should have been.