AGS rating panel

[Ethan D]

Before I say anything else let me make clear that I am not being impatient I am just curious.  I was wondering how long it takes for the AGS rating panel to rate games or what system they use.  I saw the game Heed uploaded by Ben304 on July 15th and it got a rating before the end of the month if I remember correctly Whereas The Devil's Shroud part I came out on the 24th of January and yet has no rating.  My guess is they wait for a certain number of downloads or something.  Can anyone else shed some light on this?

-Thanks!

[Gilbert]

AFAIK, the panel would rate all games whenever possible. However, the ink for Devil's Shroud is currenty reported as broken and I think this is the reason it is not rated yet. (Note that the Rating Panel is a quite recent idea, so it came after many of the games had been released.)

[Dataflashsabot]

When does a game get moved into the correct category? Is it when it gets rated? Because:

When the game author submits their game here, they can choose which category to put it in, but if you think the game is out of place please say so here.

I certainly didn't get that option

[Ethan D]

Devil's shroud isn't the only one without a rating there are plenty there from June and some from May without a rating.  I think that there is a good reason for the panel to wait to give a rating simply because if the game gets two cups or one then a lot less people will download it and the author won't get as much feedback for improvement.

But my game for instance has gotten 1057 downloads and still has no AGS panel rating. 

When does a game get moved into the correct category? Is it when it gets rated? Because:

When the game author submits their game here, they can choose which category to put it in, but if you think the game is out of place please say so here.

I certainly didn't get that option

I don't know it might be determined by votes, it could also be determined by the AGS panel as well but it seems more likely that user votes decide which category it goes into.

[IndieBoy]

I think the main reason is that it is summer, which means people have more time, and for the panel its more time not rating games. Although since now the summer months are coming to an end and because of your post, we might see the panel back their proper stride. As of your delay rating idea, I quite like it. However I'm unsure if you could put a kind of timer in a database. At the end of the day I think a lot of people just take the ratings as subjective and want to make thier own opinions which I'm sure can be very constructive.

[LimpingFish]

No big mystery, really.

Some games, short ones in particular, might get rated faster simply because a panel member can play and rate them fairly quickly. Or, since we also play these games for fun, a panel member might choose something that especially appeals to them, even though other unrated games may have been in the database for a longer period of time.

To be frank, if we happen to be playing a full-length game that's proving to be a bit of a slog, it may take us longer to get around to forming a complete and fair opinion of that game.

Regardless, we have a finite amount of free time to devote to rating these games, but we try to maintain a fair balance.

When a game is rated, its correct categories, as determined by the panel member, will be set if needed.

Plus, you always have the user ratings to keep you going.

But we're always happy to hear people's opinions about the database, and we're always open to new ideas.

I certainly didn't get that option

You weren't asked to choose a game length?

[Shane 'ProgZmax' Stevens]

Rating order has nothing to do with votes, downloads, or anything like that.  The circumstances for rating are:

1.  Availability of the panel members

2.  Interest in a particular game


Yes, the panel judges are human and have lives to deal with, so they naturally rate games that seem interesting to them first.  Regardless, all of the games will be rated, and complaining won't make it happen any sooner or more efficiently.

[Ethan D]

You weren't asked to choose a game length?

I didn't get that option either when uploading the game I think that's only there when you vote.

[LimpingFish]

I didn't get that option either when uploading the game I think that's only there when you vote.

Ah, my mistake. The ability for the author to set the game length was done away with, and the "newly added" tag was introduced.

So yes, newly added games will be labeled as such until they are rated by the panel.

And like ProgZmax has said, votes or downloads are in no way connected to how the panel operates.

[Dualnames]

My game got rated in a week time, don't push the people working on playing games and rating them too hard!!

[Ethan D]

My game got rated in a week time, don't push the people working on playing games and rating them too hard!!

I'm really not trying to come off as impatient.  I was only curious how it worked.  I would be lying if I wasn't wondering what rating they will give my game but in the end it's not something that is driving me crazy.

Sorry if I sounded impatient I am not trying to rush anyone on the AGS panel.

[Mr Flibble]

If games that the panel wants to play are played first, that'd sort of mean that having any rating at all  (even 1/5) would be affirmation of your concept. If not your execution.

[Dualnames]

The rating panel has agreed to (play all the games (even the really bad ones) and rate them all), Hell my older games got rated despite of the number of downloads. It's a really random process, and I'm sure they are really as objective as possible.

[Andail]

Usually, the panel rates the games of friends and family first. And highest. Some members pay a little fee to have their games rated quick and high. Moderators, mitteneers and competition winners are also high on the priority list.

[Shane 'ProgZmax' Stevens]

The secret's out at last.  Nice going, Andail