FINALLY!
After two additional days of delay, all the evaluations are done and can be viewed here! We hope that it was worth the wait, and apologize for falling behind schedule. We will also be holding off for a couple days on releasing the feedback form, as we would like to give entrants and attendees ample time to review the quality of evaluations first. It will be out by the end of the week, and that’s a promise I intend to keep.
So, with that out of the way… I think we owe you guys an explanation on why the evaluations are late again this year and why it’s been a challenge to get them out on-time for the last several contest years.
The way that we have traditionally handled assignment of evaluations among Judges is… thorough to a fault. Judges use an internal spreadsheet to select which base games they are familiar with, and what titles they are comfortable reviewing entries based on. However, signing up for a game means that unless the Judge needs to be excused from evaluating a particular entry due to direct involvement or other valid reasons, they are assigned to play and review every Judged entry based on the games that they sign up for. For most Judges this year, that meant they had an average of 15 entries, though some were assigned as many as 30 or more!
To put that in context, that meant that Judges had around a month to:
…no pressure though, right?
If it’s not obvious, this is bonkers and is not a sustainable way for us to continue dividing up the workload each year. In addition to being a brutal trial-by-fire that manufactures burnout with ruthless efficiency, for a number of entries, the amount of Judges tasked to write a review is overkill. Judges should obviously still play everything they cast votes on and nominate of course, and diversity of opinions among the Judging body is obviously important… but does someone really need 10 reviews, with most of them expressing nearly identical points? Probably not.
While we have not hashed out specifics yet, we will be changing the way we assign our Judges to write entry evaluations next year to reign this in, because while time-management and personal responsibility is certainly still a factor in why some evaluations were delivered late, the bulk of the problem is that the current system is fundamentally incompatible with the time we actually have as a body of responsible adults. I would say that, for next year’s contest, you should expect that only a handful of Judges reviewing entries based on the more popular titles will be tasked with writing a written evaluation for any given entry.
We will provide further updates on this when we are ready to announce next year’s contest during the spring of 2027. For now though, that’s all I have. Enjoy the evaluations from us and keep an eye out for the feedback form!