Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!

Review Policy Suggestions

StraddenStradden Managing EditorMember CommonPosts: 6,696

Please use this thread to post constructive suggestions as to our policies concerning reviews. How can we make reviews better for you?

 

Cheers,
Jon Wood
Managing Editor
MMORPG.com

«1

Comments

  • KhalathwyrKhalathwyr Member UncommonPosts: 3,133

    I may have more suggestions later, but the one I wanted to get out at this moment is that of having 2 or 3 persons review a game. That way there is a greater chance of covering multiple playstyles, likes and systems. You can also structure the review with questions, kind of like an interview with multiple devs. Either you or another senior staff member asks the questions and all three give their take or lay out a list of certain game features and have them write a paragraph or two on them.

    I think it should be anonymous, in that all involved not know the other is playing. That way they can't influence each other. As far as the numerical value, I'm not even near the world's most mediocre when it comes to numbers. Maybe an average of all three scores?

    Either way, having one person give a review is a disservice to the games and their developers I think. Having a small group (2-3) of anonymous reviewers with varying systems would be a step forward, I think.

     

    Edit: I can't spell paragraph, amongst other things...

    "Many nights, my friend... Many nights I've put a blade to your throat while you were sleeping. Glad I never killed you, Steve. You're alright..."

    Chavez y Chavez

  • Haggis13Haggis13 Member Posts: 117

    Ha, kudos on this thread! What would improve reviews for me is:

    General scoring guidelines for the reviewers. While this may seem like an obvious point, let me illustrate it with two examples of what I mean by "guidelines". Firstly, one could conceive guidelines that say something alike "motivate your score" in the sense that we should prevent minor issues with a game (such as performance issues on PCs which are on par or even below minimum system specs, hint hint) from being too influential on the final score. Secondly, you should be aware that scoring values differ per culture and by that I do not just mean a difference between X/5, X/10, and X/20 systems; a French student would probably marvel at a 14/20 in much the same way as a Dutch student would gloat at an 8/10, in turn much like how a German student will not find the same sense of accomplisment unless he has been graded a 9/10. Point being: although these scores differ proportionally, they are regarded with similar admiration, simply because French use high grades very sparingly and Germans think a 10/10 should always be attainable.

    Have a review and perhaps the game itself looked at by more than one person in order to establish a more objective view on the game. This could be as simply as including a small box saying "Second Opinion" with that person's grade and their pros and cons in it.

    Have the forum users grade a review. This could be as simple as a Dig/Bury system (comparable to the screenshot section, actually) for the reviews themselves, where uninformed players only have to look at the amount of Digs and Buries in order to avoid becoming MISinformed players. However, I would much prefer a scaled, X/10 grading system (for registered users only). The idea here would be that, once a review receives enough bad grades (say 5.0 or below on average, 20 or perhaps 50 grades minimum), the review is removed or at least very clearly (big, red, flashing neon letters) marked as being thought inaccurate by the vast majority of players.

    Have consequences for reviewers who underperform. I can understand trustworthy reviewers are perhaps hard to come by, but it would serve the MMO community as a whole better when you post no reviews rather than flawed reviews (although this is obviously very indesirable). Make a clear line (for instance a 5.0/10 average review grade with a minimum of, say, 10 reviews) and if a reviewer's average is below this line, simply do not accept any more reviews from them.

    Obviously the grades in the previous two points should be adjusted according to how players rate the reviews. A 'trial period' where the only function or grades is accumulating data on average grades given by players is a fine option, there.

    For goodness sake, have a competent person spellcheck all reviews. What some reviewers manage to write up is absolutely appalling, containing unthinkable grammatical mistakes, obvious punctuation errors, and even incomplete sentences.

    That's just my two cents, then. I furthermore think some form of supervising should be implemented due to the viability of the scores as listed in the Game List of MMORPG.com.

  • shamus252shamus252 Member UncommonPosts: 226
    Originally posted by Khalathwyr


    I may have more suggestions later, but the one I wanted to get out at this moment is that of having 2 or 3 persons review a game. That way there is a greater chance of covering multiple playstyles, likes and systems. You can also structure the review with questions, kind of like an interview with multiple devs. Either you or another senior staff member asks the questions and all three give their take or lay out a list of certain game features and have them write a paragraph or two on them.
    I think it should be anonymous, in that all involved not know the other is playing. That way they can't influence each other. As far as the numerical value, I'm not even near the world's most mediocre when it comes to numbers. Maybe and average of all three scores?
    Either way, having one person give a review is a disservice to the games and their developers I think. Having a small group (2-3) of anonymous reviewers with varying systems would be a step forward, I think.
     
    Edit: I can't spell paragraph, amongst other things...

    I also like the idea of have around 2 people do a review on a game. Few other thing make reviewers summit dxdiag report so you can be sure that they meet the system req, for the game that they are reviewing. Another thing might be if game servers are USA based make sure the person is located in the US, and not euro.

     

    Sic semper tyrannis "Democracy broke down, not when the Union
    ceased to be agreeable to all its constituent States, but when it was upheld, like any other Empire, by force of arms."

  • blakavarblakavar Member Posts: 304

    *Shakes fist at Khal* You posted my idea before I could. :p

    I agree maybe 2-3 reviewers to catch any gross discreptancies due to latency or hardware as well as a better average.

    You might want to add a extra week play time for reviewers since so many games can change after a certain level is attained or area reached, for good or bad. Also I don't know how you guys do it, but a certain minimum of playtime for a review should be enforced and have it posted on the article, ie "Based on 8 hours playtime/based on 20 hours playtime" etc etc.

  • nickelpatnickelpat Member Posts: 661

     A couple things from me:

    1. These are MMORPGs and they are made for long play. I would recommend that your reviewer play the game for at least 30 days. Preferably, make it to the level cap.

    2. Have multiple people review the game. MMORPGs, unlike other games, supports multiple, very different, play styles.

    3. Make sure all of their rigs meet the minimum specs.

    4. Proofread and spell check each review twice over.

    5. Have a senior staff member take all of the reviews, and combine them. The senior staff member cannot be one who played the game at all, and their opinion cannot get into the rewrite. Make all of the original reviews available in their full length, as well.

    6. Maybe follow sites like IGN and don't review a game until it's been out for a month (IGN used to do this, I don't think they do now). This way what you're reviewing is a game that's not buggy and has been patched.

    7. Make sure each reviewer plays the game at different settings. If they all play it at "Low" graphics, then you get a skewed result on the graphics.

    8. Log the number of hours each reviewer plays and posts them on the review.

    9. Include videos and screenshots.

    10. Possibly also do a video review.

    Thank You,

     

     

     - Eric

    ____________________________
    Telthalion Rohircil - Guardian - Elemandir - Lord of The Rings Online
    ---
    == RIP == Torey - Commando - Orion - Tabula Rasa == RIP ==
    ---
    Jordaniel Torey - Navy Megathron, Active Armor Tank - Tranquility - EVE Online
    ---
    Torey Scott - Rifleman - Fallen Earth
    ____________________________

    "I know not with what weapons World War III will be fought, but I know World War IV will be fought with sticks and stones." - Albert Einstein

  • VultureSkullVultureSkull Member UncommonPosts: 1,774

    Hi guys,

    MMORPG policy on reviews is clear, the reviewer awards the score.

    This is fine if the reviewer takes into consideration all other relevant reviews on the site. As the fundamental reason for reviewing products side by side on one site is for readers to make an informed decision on what game to buy, play etc.

    A lot of good suggestion have been made above on how to improve the quality of reviews, as not only are the scores seen to be inconsistent but the quality of the reviews are low.

    MMORPG.com is considered by many as the definitive source of information on the genre, and attracts a hardcore fan base that demand this quality. At the moment it seems other sites are giving better reviews, Eurogamer, IGN not dedicated  MMO sites should not have better reviews than MMORPG.com! For the sake of the integerity of the site it is better to have no review than a bad review.

     

     

  • KhalathwyrKhalathwyr Member UncommonPosts: 3,133
    Originally posted by blakavar


    *Shakes fist at Khal* You posted my idea before I could. :p
    I agree maybe 2-3 reviewers to catch any gross discreptancies due to latency or hardware as well as a better average.
    You might want to add a extra week play time for reviewers since so many games can change after a certain level is attained or area reached, for good or bad. Also I don't know how you guys do it, but a certain minimum of playtime for a review should be enforced and have it posted on the article, ie "Based on 8 hours playtime/based on 20 hours playtime" etc etc.

    I'm just happy I'm not the only one who thinks it's a good way to go, lol!

    I liked a lot of what you guys posted as well, especially the logging the hours played part.

    "Many nights, my friend... Many nights I've put a blade to your throat while you were sleeping. Glad I never killed you, Steve. You're alright..."

    Chavez y Chavez

  • daylight01daylight01 Member Posts: 2,250

     I would say 1 thing Jon,when you see a review that is clearly a bad call,bad review,or indeed like the FE review coming from a gimped system be big enough to say "hey we made a mistake and are pulling the review" then look into your mistake's and make a new review.

    Mistake's happen all the time in life but the way you guy's ignore your mistake's make matter's worse...far more shame in ignoring the mistake than correcting it.

    image

    If someone had came up to me in 1980 when I was on my Atari 2600 and said we will be playing games with thousands of people at the same time.I guess my response would have been,"but I only have 2 joysticks"

    http://www.mmorpg.com/discussion2.cfm/thread/235780/page/8

  • ste2000ste2000 Member EpicPosts: 6,194

    Nice one Jon.

    Here my humble suggestions:



    1) Do not allow people who follow the game to write the main review, this is the easy route, but not the wisest. (this will avoid the Aion incident, I still can't digest that 9.3)



    2) Pick always a mix of 2-3 people who follow different genres to score the games........a 9 should only be given to a game who can be  enjoyed even by people who usually would not play that kind of game, in which case it is necessary to ask the opinion of people with different playstyles.



    3) There should be a main reviewer with the other 2 people chipping in to correct or support the main reviewer. The main reviewer should write the article but all 3 needs to agree with the score (and as point 1, the main reviewer should never be someone who is following the game).



    4) The reviewers should be able to put themselves in the shoes of the target audiance of the game.....reviewing Darkfall with the same measures you use to review WoW doesn't make sense, and of course will put DF in disavantage from the start.

    "What DF doesn't have autoloot????" - There is a reason why DF doesn't have autoloot, the reviewer should be able to know the reason, instead of comparing it with the WoW system and coming to the conclusion that DF UI is poor designed.

    That's a simple example to make, I hope it helps explaining what I mean..



    5) The review should not be the reviewer personal opinion, he should be able to state his disliking for a particular feature, whilst at the same time acknowledge the same feature can be fun for another category of players (so they are still entitled to express their opinion as long it doesn't influence the final score)

    Remember my(our) opinion is always better than anyone else (even the reviewer), so the reviewer needs to stick with objective points if he wants to convince me and the other players that he is talking sense.

    If he states just his opinion, then he becomes just another bloke who is spouting rubbish(trash) on the net.



    6) The system specs of the reviewer should always be way above the minimun requirements, but that should be a given.



    7) If you get hundreds of posts disagreing with the review, you should have the guts to re-review the game by another team...........sometimes normal players are right, particularly in forums like this one where everyone has a decent experience in MMORPG and aren't exactly noobs who you can fool easily.



    8) Reviewers have to have played at least halfway through the game (if it s level based), or they should have played for a month for an average of 30 hours a week, they should clearly state for how long did they play or which level they reached.



    9) You need to award a bonus for innovation. In the MMORPG market is much needed nowadays. A game like Fallen Earth should be praised for the effort of doing something different. Aion should not be rewarded for being a WoW copycat (9.3?), not penalised either but certainly a game who brings nothing new to the genre should not be awarded a 9.



    10) Reviewers should be realistic. They should take into consideration that a game developed by a small Indie will never be as polished as a game developed by a major publisher, for obvious reasons.

    Of course I am not saying that a crappy game should be given the befit of the doubt if it is developed by an Indie, but an "expert" should be able to spot a game that has potential in the short/medium term , even if the release is a bit bumpy.



    Lastly Jon, MMORPG.com is a marketing tool for developers whether you like it or not, so it is important you guys take responsability for your reviews.

    A good or bad score on MMORPG.com can make or break a game, in particular if it's a small Indie like Icarus Studios or Aventurine.

    It is paramount you guys take this review issue seriously, this is not an amateurish site anymore.

    I do not read IGN for MMORPG news, I always check here first.

    When you type MMORPG in Google this is the site that comes on top, so if someone is looking for MMORPG info in a way or another ends up here.

    Hope you realise that (I know you do)

  • mrcalhoumrcalhou Member UncommonPosts: 1,444
    Originally posted by Khalathwyr


    I may have more suggestions later, but the one I wanted to get out at this moment is that of having 2 or 3 persons review a game. That way there is a greater chance of covering multiple playstyles, likes and systems. You can also structure the review with questions, kind of like an interview with multiple devs. Either you or another senior staff member asks the questions and all three give their take or lay out a list of certain game features and have them write a paragraph or two on them.
    I think it should be anonymous, in that all involved not know the other is playing. That way they can't influence each other. As far as the numerical value, I'm not even near the world's most mediocre when it comes to numbers. Maybe an average of all three scores?
    Either way, having one person give a review is a disservice to the games and their developers I think. Having a small group (2-3) of anonymous reviewers with varying systems would be a step forward, I think.
     
    Edit: I can't spell paragraph, amongst other things...



     

    This, but don't average the reviewers scores together...Well, I guess you would have to with the way the scores are set up on other parts of the site.

    --------
    "Chemistry: 'We do stuff in lab that would be a felony in your garage.'"

    The most awesomest after school special T-shirt:
    Front: UNO Chemistry Club
    Back: /\OH --> Bad Decisions

  • thunderathundera Member Posts: 16
    Originally posted by ste2000


    Nice one Jon.

    Here my suggestions:



    1) Do not allow people who follow the game to write the main review, this is the easy route, but not the wisest. (this will avoid the Aion incident, I still can't digest that 9.3)



    2) Pick always a mix of 2-3 people who follow different genres to score the games........a 9 should only be given to a game who can be played even by people who usually would not play that kind of game, in which case it is necessary to ask the opinion of those people.



    3) There should be a main reviewer with the other 2 people chipping in to correct or support the main reviewer. The main reviewer should write the article but all 3 needs to agree with the score.



    4) The reviewers should be able to put themselves in the shoes of the target audiance of the game.....reviewing Darkfall with the same measures you use to review WoW doesn't make sense, and of course will put DF in disavantage from the start.



    5) The review should not be the reviewer personal opinion, he should be able to state his disliking for a particular feature, whilst at the same time acknowledge the same feature can be fun for another category of players (so they are still entitled to express their opinion as long it doesn't influence the final score)



    6) The system specs of the reviewer should always be way above the minimun requirements, but that should be a given.


    7) If you get hundreds of posts disagreeng with the review, you should have the guts to re-review the game by another team...........you know sometimes normal players are right, particularly in forums like this one where everyone has a decent experience in MMORPG and aren't exactly noobs who you can fool easily.



    8) Reviewers have to have played at least halfway through the game (if it s level based), or they should have played for a month for an average of 30 hours a week, they should clearly state for how long did they play or which level they reached.



    9) You need to award a bonus for innovation. In the MMORPG market is much needed nowadays. A game like Fallen Earth should be praised for the effort of doing something different. Aion should not be rewarded for being a WoW copycat (9.3?), not penalised either but certainly a game who brings nothing new to the genre should not be awarded a 9.



    10) Reviewers should be realistic. They should take into consideration that a game developed by a small Indie will never be as polished as a game developed by a major publisher, for obvious reasons.

    Of course I am not saying that a crappy game should be given the befit of the doubt if it is developed by an Indie, but an "expert" should be able to spot a game that has potential in the short/medium term , even if the release is a bit bumpy.



    Lastly Jon, MMORPG.com is a marketing tool for developers whether you like it or not, so it is important you guys take responsability for your reviews.

    A good or bad score on MMORPG.com can make or break a game, in particular if it's a small Indie like Icarus Studios or Aventurine.

    It is paramount you guys take this review issue seriously, this is not an amateurish site anymore.

    Hope you realise that.

     

     

    This mostly sums up my own thoughts. I have been unhappy with your reviews on many games. I'm also tired of hearing from reviewers than have not played many MMOs or computer game genres in general. Why? these people make comparisons to the few games they have played without knowing the full history of said feature or its use in other games or genres.

    Also you need to be reviewing for a target audience, If your reviewer loves wow and Aion and thats all they have played much they probably wont have high thoughts about a indi game like Fallen Earth. This does NOT mean the reviewer should be a fanboy forum nerd of the game they a reviewing for the same reasons.

    Lets get a little professionalism around here, its not a small site for people to shout out uniformed opinions anymore.

  • StraddenStradden Managing EditorMember CommonPosts: 6,696
    Originally posted by daylight01


     I would say 1 thing Jon,when you see a review that is clearly a bad call,bad review,or indeed like the FE review coming from a gimped system be big enough to say "hey we made a mistake and are pulling the review" then look into your mistake's and make a new review.
    Mistake's happen all the time in life but the way you guy's ignore your mistake's make matter's worse...far more shame in ignoring the mistake than correcting it.

    When I was talking about the mistakes, i wasn't talking about the score. I've explained my position on that. i was talking about the minimum requirements thing. Once I verified that he did indeed have the required specs, I re-posted the review.

    I never said I was pulling it due to the score.

    Cheers,
    Jon Wood
    Managing Editor
    MMORPG.com

  • WSIMikeWSIMike Member Posts: 5,564

     Here's a copy-n-paste of a post I made from this thread (with an edit or two)... Consider it my two cents worth :-p....

    In my humble opinion, I think mmorpg.com does need to seriously re-think how they present their reviews.... revise their review criteria, set an objective standard that every reviewer has to stick to - at least as closely as possible... *Something* to inject some kind of consistency into it.

    I understand when Stradden says "different people review the games and have different opinions than other reviewers". That sounds great on its face. But... here's the problem...

    When people see a review here, they see it as "MMORPG.com's review of XYZ game". When developer websites highlight reviews and comments and scores about their game, they cite "MMORPG.COM" as the source... not the name of the reviewer. The same would go for ads in magazines, on the back of retail boxes, etc.

    Do you see what's going on? Every review that's put out by this site is seen as being the official opinion of mmorpg.com as a whole - not merely the person who wrote it.



    I think it's time the folks at mmorpg.com realize this site's "grown up". You're not a small, upstart site like you were some years back. Your name (for better or worse) carries weight and anything you put out in terms of reviews is seen as being the collective opinion of the site... just like IGN's, or any gaming magazine.

    I think this is why people react the way they do to such all over the place reviews... You're trying to cling to that "individuals' reviews" approach, but your website has grown way beyond that. It's far bigger than the sum of its parts. Beyond this site, MMORPG.com is a presence unto itself, it's beyond the individuals who edit or write for it. So when you defend the reviews by saying "well that's what those individuals think", it sounds very disingenuous, like a cop-out.



    Again.. just my thoughts... but I think you guys and gals should seriously reassess the way you approach reviews and rate games. A good place to start might be what was suggested by someone else here.... do away with number scores. Those seem to create the most uproar - unless that's what you're after, of course.

     

     

    "If you just step away for a sec you will clearly see all the pot holes in the road,
    and the cash shop selling asphalt..."
    - Mimzel on F2P/Cash Shops

    image

  • httptrashcanhttptrashcan Member Posts: 16

     Get rid of unnecessary ratings.

     

    Value?

    Most people are willing to spend money on good games. I certainly am not shopping around for bargain MMO games.

     

    Service?

    Seriously, how can you rate this if you have never had a serious in game or billing problem? If you can't rate it then what score do people give it? If they just give it any old score then they are throwing the ratings off.

     

    Role-Playing?

    I would guess that only about 25% of people know what real role playing is and care about doing it. I may not be accurate here but this is a possible score that can throw the total rating off.

     

    Have the reviewers give their category rating scores so we can really see the math behind the review.

     

    User Rating Ideas: If you are going to list categories that the player may have never experienced such as Service then have the option to Not rate categories such as Value, Service, and Role Playing. Then just change the math based on the categories that they chose to rate. Some categories you may choose to be impossible to exclude.

     

    I am thinking that a couple final questions on the rating may prove to be useful. First being: Do you still play the game? Second: How long did you play? You would then have to display these different categories of raters. This information gives the user of your website detailed information about who is rating the game and why. If people are still playing the game then they are obviously going to be giving a better rating. If the total number of user ratings is 75% people still playing the game then that will throw the final rating score off. Showing both sets of numbers may be useful in this case or possibly only using equal number of “quitters” and “players” to set the final rating score which can be increased as more data is gathered.

     

    I am quite honestly usually more concerned with what the majority says when it comes to game reviews. It is my opinion that 100 gamer reviews are better than 1 gamer review. I just would like to have more information about who those 100 gamers are. IE. Quitters or Players and how long they have played the game, etc.
  • KhalathwyrKhalathwyr Member UncommonPosts: 3,133

    I've seen it said or hinted at a few times, but I think it'd be a great idea to also add the playing history of the reviewers. It's quantifies their experience and give the viewer, and potential customer, some background on the person expressing their opinions about the piece. That way we can match our own gaming style preferences to theirs and see if they enjoy most of the things we do. If they do, then we may have a better idea of what a game has to offer us. If their past gaming experiences and preferences are vastly different, then that may spark our interest into trying the game as well.

    "Many nights, my friend... Many nights I've put a blade to your throat while you were sleeping. Glad I never killed you, Steve. You're alright..."

    Chavez y Chavez

  • grunt187grunt187 Member CommonPosts: 956

    I only have one suggestion

    2 reviewers one with a high end set up,the second with a low end(still within specs)

    That way we will have a better understanding of how our experiance might be compared to the reviewers

    ie: low end reviewer has massive lagg/fps/studder but high end reviewer doesnt the game is not at fault.

    Also we get two perspectives on the game and can better see the intent of the devs

    The following statement is false
    The previous statement is true

  • dsebutchrdsebutchr Member Posts: 245

    Only thing I can suggest after all this...do not have another review by Joe.  He has little to no credibility on this forum anymore considering the travesty that MMORPG contributed to by not removing the problem and leaving it removed.

    We don't know if he lied or not.  But why read more crap from him when we can choose not to.  His opinion is at odds with the folks involved and so is his validity in the subject matter based on how the entire matter was handled...poorly.

    Retracting the review would have been the best choice.  Posting it again on the front page was a great big PISS OFF to the people who comprise your audience.

    Frankly why would customers put up with that more than once?

     

  • risenbonesrisenbones Member Posts: 194

    My first suggestion would be get rid of the numbers all together.  Seriously they mean nothing it's just what lazy people use to "research" what game they want to play next.  My opinion is that reviewers are supposed to be communicators.  Let them do that let them tell me what they found that worked and what they found that didn't.  Let them communicate to me with their words what is what with the games without throwing on some random number between 1 and 10 that for all I know they got by rolling a 10 sided dice a couple of times.   Lets face it the last couple of reviews the words didn't measure up to the numbers presented at the end.  Heck reading the FE review and looking at the numbers I got the impresion the reviewer didn't play the game but cobbled together a bunch of press releases about the game and tacked on a bit about how bad the lag was at the end that they got off the Fallen Earth forums back at release and when asked to give a number thought of their favourite number 69 put a dot in the middle and called it a day.

     

    Secondly if your going to review the games tell me a bit about yourself.  Reviewers need an up to date profile listing the games they play and have played so I know where your coming from preferably with a nice little link to said profile.  If you play Everquest alot then I'm going to take what you say about Mortal Online differently than if you play Ultima Online.  Conversly if you play DAOC I'm going to take what you say about Aion differently than if you play WOW.

     

    I think thats about it.

    The lesser of two evils is still evil.

    There is nothing more dangerous than a true believer.

  •  

    There is no doubt that numbers are helpful. That's why they are so common. I think you should keep them. Equally helpful, as suggested in the previous post, is background on the reviewer. Multiple reviewers with shorter reviews is also good. I think 4 is an ideal number of reviewers to have.

     

    The answer, believe it or not Jon, may lie in porn. :)

     

    I am not kidding. Take a look at some of the award winning internet sites that are dedicated to reviewing the plethora of adult sites on the internet and you will see what I mean (you don't have to look at the pictures). The review process is truly amazing, and there is no doubt in my mind that any sort of site reviewing anything can learn a few things here.

     

    I am not at all drawing a comparison between porn and mmo games, merely pointing out that publishing consistent, helpful reviews is a well trodden path and trying to add a little light humour while doing so :). The review process has undergone a long improvement process in all sorts of industries.

     

    The current style of review on mmorpg is a bit like a newspaper publishing a book review. A book review is meant to be written in an entertaining way, and really does not pretend to be anything other than an opinion. In that case the quality of the author of the opinion is what really counts and people get to know book and film reviewers and either take notice of them or don't. You will note though that book reviews do not tend to give a mark out of 10.

     

    In the end, I would say that you either allocate proper resources to get serious about doing consistent, helpful reviews or simply stop doing them.

  • PapadamPapadam Member Posts: 2,102

    I posted this in the FE thread but I copy it here:

    I think MMORPG.COM should change their scorig to just 1-5 stars to just reflect the overall quality of the game and make the score less controversial. But Im sure they want their reviews to be controversial just to generate traffic and get more money from adds

    This how I would like to see the score scale here:

    1 Star - Some really bad asian grinder (A bad game which noone should bother with)

    2 Stars - Darkfall (not a very good game but a small group of players will love it)

    3 Stars - Fallen Earth, Champions (Good game but is lacking polish, content)

    4 Stars - Aion, LotrO (Solid, high quality game but not perfect)

    5 Stars - No MMO deserves it yet. (Great game , both different/innovative and highly polished with all the features we expect from a great MMO and caters to alot of playstyles in a good way)

     

    Also I would like the "second opinion" that alot of reviews on IGN.com have. If you get  a review with a pretty low score, check with your other writers if anyone can give another view on the game so we can get 2 differnt perspectives.

    If WoW = The Beatles
    and WAR = Led Zeppelin
    Then LotrO = Pink Floyd

  • daylight01daylight01 Member Posts: 2,250
    Originally posted by Stradden

    Originally posted by daylight01


     I would say 1 thing Jon,when you see a review that is clearly a bad call,bad review,or indeed like the FE review coming from a gimped system be big enough to say "hey we made a mistake and are pulling the review" then look into your mistake's and make a new review.
    Mistake's happen all the time in life but the way you guy's ignore your mistake's make matter's worse...far more shame in ignoring the mistake than correcting it.

    When I was talking about the mistakes, i wasn't talking about the score. I've explained my position on that. i was talking about the minimum requirements thing. Once I verified that he did indeed have the required specs, I re-posted the review.

    I never said I was pulling it due to the score.

    Originally posted by lestaticon



    He stated 2GB of Corsair system RAM in the AoC review in July and again in the WoW review earlier this year and over a year ago in the Hellgate review. Same system, same amount of RAM stated. 

    Look... I understand the ego and pride of writing a review piece and putting it up on a gaming site, but I don't think it's very fair to mislead. Just accept your system wasn't up to snuff and you made a little mistake. Remove the review and move on. These things can happen. You just learn and keep on going. 

    So he has made this mistake a few time's it seem's and now he say's he was mixed up with his graphic cards and the RAM?

    Come on Jon,do you really buy this?

    Like I said far better to admit a mistake,correct it and move on.

    Just to add...

     

    Joe Iuliani system specs: aoc re-review

    I am running AoC with Windows Vista Ultimate on a Dual Core E6750 @2.66, Dual ATI Radeon HD 3850, 2 Gig Corsair RAM and cable modem.

    http://www.mmorpg.com/gamelist.cfm/game/15/view/reviews/load/67/World-of-Warcraft-Wrath-of-the-Lich-King-Review.html

    Joe Iuliani system specs Wotlk:

    Performance/Lag:

    I am running the game with Windows Vista Ultimate on a Dual Core E6750 @2.66, Dual ATI Radeon HD 3850, 2 Gig Corsair RAM and cable modem.

     

    http://www.mmorpg.com/gamelist.cfm/game/15/view/reviews/load/67/World-of-Warcraft-Wrath-of-the-Lich-King-Review.html

    Joe Iuliani Dungeon Runners:

    I am running the game with Windows Vista Ultimate on a Dual Core E6750 @2.66, Dual ATI Radeon HD 3850, 2 Gig Corsair RAM and cable modem.

    http://www.mmorpg.com/gamelist.cfm/game/247/view/reviews/load/59/Dungeon-Runners-Dungeon-Runners-Review.html

    Joe Iuliania: Hellgate London

    I am running the game with Windows Vista Ultimate on a Dual Core E6750 @2.66, Dual ATI Radeon HD 3850, 2 Gig Corsair RAM and cable modem.

    http://www.mmorpg.com/gamelist.cfm/game/314/view/reviews/load/60/Hellgate-London-Review.html

     

    Every review he state's LAG! as a con,now tell me you do not find that just a bit strange?

    He only had 2gb RAM he has maybe went out and bought another 2gb with the money you paid him for this review so he can cover his track's.Do the right thing and pull the review of Fallen Earth and have someone else write a new 1.

    image

    If someone had came up to me in 1980 when I was on my Atari 2600 and said we will be playing games with thousands of people at the same time.I guess my response would have been,"but I only have 2 joysticks"

    http://www.mmorpg.com/discussion2.cfm/thread/235780/page/8

  • EvelknievelEvelknievel Member UncommonPosts: 2,964

    Just simply use 5 STAR Rating system like the movies do, if you want to play it safe.

    However..

    The 1 through 10 rating system approach allows you to choose every game based on a %. It is almost an accurate percentage. But, the problem is the psychology in things. With so many choices, it makes it difficult to rate a game.

    A 5 out of 10 almost sounds like bad game when in fact is is just average.

     

     

  • madeuxmadeux Member Posts: 1,786

    We need a few things

    1) A Standard Review Format

    2) Multiple Reviews (All using the Standard Review Format)

    3) A quick reference to see how a reviewer has rated other games, so we can see if he's generous or too hard on games.

  • TetheredTethered Member UncommonPosts: 55

    Standardize the review format broken down into levels of play/depth

    First Impression

    10-20hr Playtime Review

    In Depth Review

    Expansion Review

     

    Write the format based on the above or something similar  and have each part of the format should have a rating level...ie.

    Graphics - 1 to 10

    Animation - 1 to 10

    Lag - 1 to 10 (lol sorry could not help myself)

    But at the end of the review, the scores are averaged and would the true score of the reviewers, have the moderators read the reviews and make sure they scoring is objective and fits the reviewers information..pretty basic stuff..I had thought it was something like this before but I guess we all live and learn.

    You know you are old when the dev's on the games you play are almost young enough to be your grand-kids.

  • MordacaiMordacai Member Posts: 309

    As a suggestion, to be counted in the list of ideas, I'd rate and do rate games on the way I play them. I pretty much play every P2P game that comes along and give it its free month, not many make it past that month but some do and then they get a full 3 months further view, sometimes up to 5+yrs if it really gets me. Anyway, I'd like to post these  thoughts on my own internal review and usually what I put out to others if I were to rate it.

    1=i would take it out back for target practice, while 10=Glory to thy name you are the 2nd coming

     

    1. Gameplay- Is it fun, what was my fun factor, how long did It take to get bored, did grinding start right away, was in difficult or hard to level, was there a new twist on mechanics that made it interesting. Twists to guild tools, UI differences good/bad. Is there more then one race to play, a few classes, many skills, FPS? Is there interesting things to do other then combat pve/pvp? is there a crafting system, how deep is the crafting system, how weak? (Rate 1-10)

    2. Sound-Does the sound jive with the world, is it just a compilation of crap standard music, do sounds happen when they should (i.e. animations sequences)., Does it sound choreographed, does the sound help me immerse myself into the world and really get into it and lose tract of hours.  (Rate 1-10)

    3. Video-Does it have stuttering, does it chunk my card and make it crawl in FPS, does it have to high requirements to be good for casual gamers or too low. Do I have to go spend money on upgrades to really play this properly, and is it worth it to do so. (Rate 1 - 10)

    4. Quest System-Is it kill 10 rats and fetch quests repeated exponentially, is it realistic, does it make sense, does it change the world, does it do anything different to expand the genre. Is the quest system linear, open, no quests, few quests, significant quest story lines/arc that feed into an epic real quest line that shakes the foundations of the world on discovery?  (Rate 1-10)

    5. Visually Appealing-Does the textures and background make sense for the world, is it appealing, does it flow properly or look patched and hacked together, are there seams ready to burst open. Does the overall art design follow the vision of the game and flow together right, to cartoony, too reaslistic, to over shaded.. (Rate 1 - 10)

    6. Combat (PVE) -general feeling of combat is fun and immersive, does it give everyone soemthing to do to feel a part of a group, a party or effective as a solo player. Does it feel like i have to grind incessantly to reach end-game to compete or have fun. Is it a race or casual game where it occurs naturally.      (Rate 1 - 10)

    7. Combat (PVP)-Balanced? Fair, Zerg Fest, ganksquads, FFA, does it fit the world, does it make sense, is it all instanced or world pvp, does it support other areas of the gameworld, does it only happen at end-game highest level, is it a race to the end game to compete?    (Rate 1 - 10)

    8. Roleplay-Does the game support role play, is it immersive enough to encourage roleplay, does the community support roleplay, are there us and thems? Pickup roleplay groups? are there tools that assist roleplayers in doing what they like, is it an open enough world to facilitate events.   (Rate 1 - 10)

    9. World/Environment-Overall world design makes sense, does the world look different then other games, is it a clone? Are there glitches? To much instancing, zoning, phasing, or to little?       (Rate  1 - 10)

    10. Support-Community, forums, customer service ticket response, helpful forums or chat areas, trade and tech areas in chat, ingame voice support, in-game gm support, quickness of response time? Helpful community leaders, designated helpers? Asshats? Barrens Chats?      (Rate  1 - 10)

     

     

    I take these 10, rate them and then add together and divide by 10 and there ya go you got your score and a pretty overall fair rating touching most elements of the game.  Granted many of these kinda of slide over each other but try to stay unbiased as possible while still getting the idea across of how you feel about a game to say guildies or what not and I have used that method before in the past.

Sign In or Register to comment.