Suggestion to make jury votes for contests invisible for everyone, including jurors, until the voting is finished.
On “Voting” stage, only the number of votes for every submission is shown and all jurors activity(i.e. total points awarded, avg score, comments etc) is hidden.
When the voting ends, the scores/comments and all other related data will be automatically made public for everyone.
That way jurors will be unbiased when casting their votes and the bandwagon effect is entirely removed, i.e. no jury member would subconsciously want to give high/low score just because everyone else did the same, because that juror would simply not be able to see other jurors’ votes.
Edit: I have to clarify that this proposal is for Governance 2.0 in case this feature is not planned already. I think we don’t have to waste time on current version of governance, since 2.0 is already in the works.
A good idea. I also think that we need to create more tools for monitoring juries work. I have a suspicion that some of the juries have done manipulations.
I agree with the idea to hide score, but I do not agree with hiding comments.
Since the comments allow judges who haven’t yet voted to take into account any flaws that they may have missed, but the judges who had already voted didn’t miss.
I find this early flaw detection system very important. By abandoning it, we will make the judging system much more vulnerable to various forms of abuse.
So I suggest:
to hide the score;
do not hide the comments of the judges;
prevent judges from writing score in comments: if a judge indicated a score in a comment, he does not receive his fee.
Hiding comments and rejects can lead to a lot of chaos and outrage in the community. Not all judges will notice some critical flaws in the proposals. As a result, prizes will be taken by participants that should not have taken them. Do we need chaos in such a delicate matter?
We do not solve a problem that does not exist, we create a new problem that does not exist yet.
I understand your point of view. Of course, judges must be held accountable. The downside to this, however, is that the system loses a number of filters that increase its accuracy.
I think we need to alternate different approaches to voting in order to understand which one is really better.
The truth, however, is that both approaches have their disadvantages. We need to come up with something third, that will be devoid of both disadvantages.