Howdy, Stranger!
It looks like you're new here. If you want to get involved, click one of these buttons!
Quick Links
MMORPG.com Game List Ranking System is Flawed
yewsef
Member CommonPosts: 335
The highest game in the list currently has a score of 8.72 and scrolling down to the middle of the list the score is at 7.72 but I look at the games in between and I see HUGE DIFFERENCE between them. Based on many variables some game should not be rated in such order. In the current state of the game list it serves no purpose for the reader. It gives you zero indication of ANYTHING when I see the top game I can't tell if this game is popular or good or worth playing or bad or anything. Might as well remove the scoring system and it's still the same to me.
I think the guys behind MMORPG.com should revamp their gaming list. It is the #1 reason I visit the website is to check how game X is doing in comparison but because the system is vote-based it's not doing its job. I recommend you guys to make your own scoring system (a group of authors scoring the game based on specific criterias like Gameplay, Graphics, STability, Support and what have you).
Comments
OK, what's your favorite game and how far down the list is it?
Oderint, dum metuant.
No matter who rates it...the users of mmorpg.com, critics or stuff in the end it is still someone’s opinion...critics and mmorpg.com staff are not robots.
It will not fix anything.
March on! - Lets Invade Pekopon
It is even more flawed/complicated then we even know (my opinion). When a new game 1st comes out, it is usually rate 9.9 sometimes even at 10. So when that happens, a game that was previously rated at 7.0 will get bumbed down to to the mid 6's.
I asked about this in the past and all I got was a bunch of people must have also gave zero's to everyone else while they voted for their game to be on top.
In the end though, all ratings get normalized after two or three hundred voted into the game.
I Reject your Reality and Substitute it with My Own!
Yewsef: www.metacritic.com
I don't think mmorpg.com has the resources to rate each game themselves, and aging reviews which may or may not represent the state of the game wouldn't be any better indication than ratings on current system.
But I agree with you that ratings really aren't good indication. Personally I think they indicate the fans VS haters war if anything.
It's silly to even think that any sort of rating system for video games is without flaws.
REALITY CHECK
mmorpg.com rating system somehow adjusts the ratings to have greater dispersion. If the system has 3 games which are really rated 4, 5 and 6, then the system might display them as rated 4, 6 and 8. But if one game is rated higher, like true ratings 4, 5 and 9, the dispersion is already so large that the system adjusts the displayed ratings less.
So when one game gets hyped high, ratings of other games are displayed as lower, even though the true rating hasn't changed.
Arent all ratings based on that? you either like it or you dont
I agree with the op. The rating system here is flawed and I simply ignore it all together. Hate wars, fan boys make the rating system useless. Each game should be rated or reviewed by an editor first and then a player score can be placed under it. Most user ratings come closer to the editor's ratings when they know how idiotic their score will look if it isn't fairly rated.
I have the right to like what I want!
They kinda do here, GW for instance have 8.1 from mmorpg and 8.3 from users
mmorpg.com does do reviews but they only have a few, mmorpg.com is a small site compared to say IGN or Gamespot.
It is unrealistic for them to review the 400 games they have on this site.
March on! - Lets Invade Pekopon
I think you missed some of what it is, not saying it isn't flawed, but the information you are asking for, cannot usually be obtained, as it is a 'hype' meter, and its usually games that are not released or in NDA...Thus no one can legally say how it runs, if it crashes, if its any good ect....As if that isn't a whole nother problem.
Its not a is game 'x' good list, its a 'I am excited about game 'x'' list.
I don't think haters kill the list too much, swtor is pretty high and only seperated from the #2 spot usually by a few hundreths, for every hater, you have probably 2-3 fans, so it all evens out, people probably hate on all of them so the list self-corrects probably.
I don't know, I take the scores for what they are - a way to gauge the quality of a game as seen by the majority of users on this site. I can then go on and read to individual comments for more specifics on the game or the 'professional' review by one of the editors. Anything beyond that (e.g. annual re-reviews etc) would be unreasonable to expect from a site like this.
In my opinion the largest problem here is skewing by all max and all lowest scores. You can watch dozens of those pile in daily when a new game launches... and I've yet to play any game that deserved all 10s or all 1s and to watch dozens of either roll in is just people attempting to game the system and largely-- they can, they can push a score up or down ~2-3 points. The simple reality is there is no good way to fix it... but it's very broken. *shrug*.
Shadus
maybe you should stop using it if it's so meaninless.
the ranking is made by mmorpg.com visitor, and some of the people from the game company itself might come vote for their game.
I don't see how that is very useful.
I don't think flawed is the proper term really.
Let me explain.
I bet it works all well and good as designed. But you have to factor in what kind of traffic comes and goes from the site and that it's all based on opinion anyway.
So flawed is a good word for it, but I think trivial functions a little better in a critique of the system. Because one could argue that it works functionally well, but there's a lot of x factors that no one has control over involved.
I thank you all for your participation. Obviously I am not the only one who finds the game list ranking useless. Like some of you say the haters and fanboys war destroys honest statistics. I prefer MMORPG.com over IGN or GameSpot because for one it is dedicated to MMORPGs and second the community. Don't underestimate the game list of MMORPG.com I bet you a lot of people used to take it into consideration back in the days but now it is getting ridiculous. The community need a list like that but instead of public voters I think if we can find a way to make editors or authors and people who are capable of rating a game properly. You don't need to review it you just need to rate it based on a list of charectaristics. Someone or some people who played the game (for at least 20+ hours) give their opinion and rating regarding the game's Performance, Fun Factor, Graphics, Sound and what have you.
It's just a list, don't worry about it. Besides, they're using some wacky logic to produce the resulting figures.
If you're into grade lists, there are some better around.
The ACTUAL size of MMORPG worlds: a comparison list between MMO's
The ease with which predictions are made on these forums:
Fratman: "I'm saying Spring 2012 at the earliest [for TOR release]. Anyone still clinging to 2011 is deluding themself at this point."
First its just a player ranked voting system. If you want better see the MMORPG.COM staff rating.
Also what game do you play?
Another great example of Moore's Law. Give people access to that much space (developers and users alike) and they'll find uses for it that you can never imagine. "640K ought to be enough for anybody" - Bill Gates 1981
I do not know, seems to keep in the same rate area as the "professional review sites" when information is provided in the forums. In fact, I really like coming on to the site and checking to see which game here is most popular and compare the rank with my own. It is like any other public site that offers information and helps me decide if I am going to end up throwing my money away on a "new AAA release" that is half developed or uses cut/paste on most of its game. Not to mention the comments that the ranking system offers by gamers often provides more accurate information on games that may not be released with the advertised content....missing. Most recently, I save a ton of money not having to upgrade my pc, purchuse operating devices and spend hours figureing out how to play a game because, I came here and learned of its...status on the ranking system.
Its from people who bother to vote, thats going to be the fanboys and haters. So its wildly random, if you want to find out about a game check the forum not the rating.
Its only as flawed as the community makes it. It doesnt reflect what the staff here thinks, but the community. I dont think theres any fixing to do. Only fixing what you take from it. If some fan boy wants to rank a game high, thats his opinion. If a hater of said game ranks it low, its his opinion. If either think that voting that way causes them to win..... They both fail. And if anyone here in there right mind bases their opinions on what the staff and community here think, they fail harder. Nuff said. Make your own opinions.