It's unbelievable, in ever contests the judges never give similar scores to my levels, always have one to give a much lower score than fucks with my placement. I agree than it's odd sezixor and FireLink don't reach top20.
I have an intuition that good levels may have be in the 30th-20th placements, and we can find a bad level in top 15, I hope than no, I no want this.
I'm not like my score, but...okay.
Al least, I got pleasure Chad, so got a decent score from a great designer and experient judge.
I hope than zlaker win.
I remember Sux mentioning that there's always one judge who gives his level a lower score than the others [EDIT: ninja'd by Sux] and...ever since he said that, I've been noticing this trend as well. The most surprising thing (to me, at least) is that it was bossedit8 who gave the lower score, so I'm really curious to know how bossedit8 judges levels.
21. HenryRichard - Now YOU'RE the Space Invader! (7.57/10)
Henry, is that the level you said you'd make based on my SVLC entry?
Imaynotbehere4long wrote:is that it was bossedit8 who gave the lower score, so I'm really curious to know how bossedit8 judges levels.
Why do you always focus on bossedit8? Every judge has his own judge skills some do it like this others do it not and thats how bossedit does it.
I remember the last time when bossedit was judge and someone questioned it 2 much how he judges it escalated into a shitstorm.
Some changes to the judge roster next contest would be interesting to see. I'd like to see some new faces amongst the judges. If you're afraid of "unfair scores because of inexperienced judges", just add in a rubric system as a guideline for the judges to follow. Makes determining the score easier for everyone, and may in some cases avoid these spikes. (Even if the rubric will never be officially required in these contests, I still recommend judges to try it out, be it in a CC or not).
This contest, I've seen every judge have some fluctuating scores, so don't pin down a single person like bossedit. It'd be much better if you quoted the review you're questioning and want the judge to elaborate on their decision.
Oh, that's what it's called. I never knew the proper name for it. That would be a good idea. But it would be SO MUCH EXTRA WORK for the judges, especially considering this contest gathered 85 submissions. That's a lot of levels to review. I don't think they'd be happy to have to do extra work for each level.
Sinem wrote:don't worry they already say words also so it's 2late
Good point. Ok, go ahead, become the AVGN reviewing Dr. Jekyll for NES.
Oh, that's what it's called. I never knew the proper name for it. That would be a good idea. But it would be SO MUCH EXTRA WORK for the judges, especially considering this contest gathered 85 submissions. That's a lot of levels to review. I don't think they'd be happy to have to do extra work for each level.
Sinem wrote:don't worry they already say words also so it's 2late
Good point. Ok, go ahead, become the AVGN reviewing Dr. Jekyll for NES.
It's actually no extra work, but rather taking some work off the judges' shoulders. Instead of getting an overall score for the level, which is often a number made up from these rubrics, they know how strong they should rate each part of it, which makes the score more precise. Judges rate each part of a level anyways, but without this system the balance might vary.
mariogeek2 wrote:
Oh, that's what it's called. I never knew the proper name for it. That would be a good idea. But it would be SO MUCH EXTRA WORK for the judges, especially considering this contest gathered 85 submissions. That's a lot of levels to review. I don't think they'd be happy to have to do extra work for each level.
It's actually no extra work, but rather taking some work off the judges' shoulders. Instead of getting an overall score for the level, which is often a number made up from these rubrics, they know how strong they should rate each part of it, which makes the score more precise. Judges rate each part of a level anyways, but without this system the balance might vary.
I don't understand how it would be less work for the judges. For me, whenever I judge a level, after playing through it, I can somewhat rate it on a scale of one to ten. It's easier to say how good or bad a level is than it is to specify each thing that's good or bad and and how good or bad it is, which the judges already sort of do with their reviews, but not to the point that a rubric system would require.
Enjl wrote:It's actually no extra work, but rather taking some work off the judges' shoulders. Instead of getting an overall score for the level, which is often a number made up from these rubrics, they know how strong they should rate each part of it, which makes the score more precise. Judges rate each part of a level anyways, but without this system the balance might vary.
I don't understand how it would be less work for the judges. For me, whenever I judge a level, after playing through it, I can somewhat rate it on a scale of one to ten. It's easier to say how good or bad a level is than it is to specify each thing that's good or bad and and how good or bad it is, which the judges already sort of do with their reviews, but not to the point that a rubric system would require.
Judges tend to lean towards one or two rubrics in their reviews which vary from level to level. The rubric system is to keep that consistent and reduce bias caused by stuff like level style, gimmick or music to a minimum. (Yes, music can cause bias, and it often actually does.) Keep in mind I'm suggesting this system together with a few new judges to freshen up the roster. So it's also to help them out.
I personally don't see how splitting a huge number (final score) into small numbers (score for each rubric) and then adding them together doesn't pay off if the alternative is sloppy and imprecise scores. I also still don't see how it's more work, as it splits the review up and instead of judging the level in one go, you objectively look at each aspect and add the numbers together. Like I said, judges kind of do that anyways, but in their mind.
Last edited by Emral on Thu Aug 13, 2015 5:10 pm, edited 1 time in total.
MECHDRAGON777 wrote:
Uhh, why would my level be hard to navigate?
From what I've read you don't even know where to go in the level.
I will proof it with my ToB10 Speed Run
I mean, it'd make sense that YOU know how the level works because you designed it. An important thing to remember when making a level is that, while you know how everything works, OTHER people might not be able to pick up on it.
