Skip to main content
RuneSR2
Honored Contributor
July 28, 2018
Question

The destructive force of GREAT VR games getting mediocre or no reviews

When telling my friends and colleagues that VR is mankind's most impressive invention since the wheel, I keep hearing that many will consider buying a VR headset when great games arrive. I can then tell them about the many awesome VR games, but the problem arises when I have to show some reviews of such great VR games. Often there're no reviews or the authors of VR game reviews seem keen to do their very best bashing most VR games for not being good enough - quite contrary to my experiences.

I know Oculus took great pride getting a top-ranked VR game on Metacritic, and they succeeded with Lone Echo last year. But where do we stand this summer? - Here's today's list of the best PC games, including VR games, from Metacritic (and my friends read such lists):



According to that list there are no games you can't play without a VR headset. The only game on the list you can play in VR is The Forest, but it works in 2D too. If the list is expanded to show all current games, Gunheart also receives 83 points like The Forest, and again you don't need a VR headset to play Gunheart. My friends easily conclude that since there're no VR-only high-ranking games on the Metacritic list, it's because current VR games are of poor quality and VR is something no one truly needs. 

I can't blame them for drawing such conclusions, and even showing 2D trailers don't help much, because you can't communicate the greatness of VR games using a 2D video.

I think it's a great problem that new and awesome VR games don't get good reviews or do not get reviewed at all. Let's take Moss - it's a VR-only game arriving a few months ago:

Moss Metacritic Score for PC: No score due to insufficient number of reviews.
Moss User Score in the Oculus Store: About 96% average. 

There're just 3 Moss reviews for PC VR on Metacritic, scoring the game at 79, 80 or 90 % - which in no way reflects user experiences. And often I see a similar trend. 

The reason behind the few Moss PC reviews are probably that many reviewers reviewed the PS4 version and then didn't want to do another review for PC VR. Thus compared to the 3 reviews for the Rift/Vive version, there're 62 reviews of the PS4 version! Interestingly many reviewers have no problem reviewing different game versions for PS4, XBox One and PC - like Battlefield 1, Fifa 18 and Rise of the Tomb Rader just to name a few titles. Why didn't Moss PC VR get a similar treatment?

This is a great problem - Moss for the Rift and Vive is not the same as the PS4 version; PS4 has no controllers matching the Rift or Vive, and the PS4 has much lower resolution (also when using high levels of super-sampling on the Rift and Vive). But the greatness of Moss PC VR was never communicated to the masses, because there're almost no published reviews of one of the greatest VR games so far - and certainly the best one thus far in 2018!

Another problem of mixing VR and 2D games on Metacritic is to compare apples and oranges, or probably more to compare grapes and watermelons 😉

To illustrate: Is Subnautica 2D the same as Subnautica VR? Is Elite Dangerous 2D the same as Elite Dangerous VR? I'd personally consider Subnautica VR about 10 times better than Subnautica 2D, even if the VR version does have some problems. So should we rate Subnautica 2D at 10 % and the VR version at 100 % ? Of course this would not be fair, but I'd have no problem rating Subnautica 2D at 65 % and the VR version at 95 %, if we really want to compare apples and oranges - and want to rate both on the same scale. 
I believe that many reviewers rate VR games just as if the games were in 2D. Comparing 2D and VR games, I'd have a hard time rating a 2D game more than 70 % - and that would be for the very best AAA 2D games, while I'd have a hard time rating any high-quality VR game below 90 %. This is due to the fact that VR games are so incredibly more visually impressive and immersive than any 2D game can be - and Touch controllers add a lot to provide a truly unique VR experience. For example I'd have no problem rating a 2D version of Marvel Powers United at maybe 60 %, and to rate the VR version at 90 %, because the immersion - the feeling of being present in the game world - is so much better in VR. 

If reviewers fail to clearly communicate how much better VR games are compared to 2D games, how are persons - who know very little about VR - going to know how much better VR games are compared to 2D games? The current bashing of Marvel Powers United is a great example of this - and it's a great destructive force limiting VR adoption when VR game reviewers constantly criticize gameplay as if a VR game wasn't different from a 2D game. A new VR game which is the best within it's genre - compared to other VR games in the same genre - is per definition the new reference and should carry a rating reflecting that position. - And such a VR game should not carry a rating that reflects a reviewers preference for 2D games in the genre. 

I think it would be great if Oculus representatives could ask Metacritic not to mix 2D and VR games; there are plenty of VR games to support having their own category.
We need to stop comparing apples and oranges. 

Finally we could take a look on the current top three PC games on Metacritic, namely these:

Into the Breach - rated 89 %


Pillars of Eternity II: Deadfire - rated 88 %


Final Fantasy XV - Windows - rated at 85 %


I do think that some of these games look impressive, but are these games way better than the latest and greatest Rift games? Personally I'd consider the following games so much better; compared to 2D games I'd happily rate Moss at 97 %, Seeking Dawn at 93 % and Marvel Powers United VR at 90 %



    132 replies

    Zenbane
    Honored Contributor
    August 1, 2018
    I think that when it comes to all forms of review sites and whatever rating system they employ, in the end the person looking at the review is simply trying to make a quick decision.
    • Someone wants a Metacritic score to be 80 and above.
    • Someone wants a 5-star system rating to yield 4 stars and above.

    Those are the folks that need to feel that they are purchasing a "must have" product. On the other side of the spectrum, there are those consumers who just want to make sure something doesn't suck terribly.
    • Avoid a metacritic score below 50.
    • Avoid 2 stars and below in a 5-star system.

    Everything else is fodder (imo).
    Honored Contributor
    August 1, 2018
    >50 is a pass
    <50 is a fall 

    Thats the proper system really. 
    Zenbane
    Honored Contributor
    August 1, 2018

    Digikid1 said:

    >50 is a pass
    <50 is a fall 

    Thats the proper system really. 



    For a game or a movie maybe, but not for measuring the output quality of the human brain coupled with an individual's raw talent, acquired skill, mental fortitude, and overall ability to apply commitment, discipline, and dedication.

    In that case, something slightly more intricate than a 2-point system should be used.
    RuneSR2
    RuneSR2Author
    Honored Contributor
    August 1, 2018

    Digikid1 said:

    >50 is a pass
    <50 is a fall 

    Thats the proper system really. 


    I have limited time for the hobby due to work and family. I often use Metacritic to see if new great (2D) games have arrived; normally I do not spend time on anything below 80, maybe even 85 (except VR games). For VR games I check Oculus Store and Steam user reviews. In the Oculus Store I prefer to see a game or app get at least 4/5 and more than 20 reviews (it kept me from getting Red Matter so far - I'll probably get that game soon though). I read reviews because I don't have the time to personally check out all new Rift arrivals and more - and I try to avoid apps and games that will provide me with poor, annoying or even frustrating experiences. 

    Of course there're exceptions to my rules, at least Seeking Dawn and MPU got me to jump in without reading reviews, but I have strong personal reasons to like these games, and Oculus has a nice refund policy :)
    Oculus Rift CV1, Valve Index & PSVR2, Asus Strix OC RTX™ 3090, i9-10900K (5.3Ghz), 32GB 3200MHz, 16TB SSD "Ask not what VR can do for you, but what you can do for VR"
    Inspiring
    August 1, 2018
    never mind
    Johnny's Scale Models Showcase i5 9600k @4.5GHz; 16GB DDR4 3200; 6xSSD; RTX2080ti; Gigabyte Z390D Mobo Rift CV1; Index; Quest; Quest 2
    Zenbane
    Honored Contributor
    August 1, 2018
    Agreed @RuneSR2

    I think a 2-point system (similar to what Digikid suggested) can have its place. Take Netflix for example,

    It uses a Thumbs Up vs Thumbs Down system.




    However, look at the Green Font below the title... it says 95% Match.

    Netflix uses the 2-point system (Up/Down or "50 above" vs "50 below") in order to make a Recommendation; but that Recommendation is based on a 100-point system. The 95% Match in the screenshot is displayed because the User gave a Thumbs Up on a previous title of a similar nature. For example, if the user gave a Thumbs Up on "The Borgias" then "The Crown" is a 95% match of a similar viewing experience.

    But it is that 95% match that determines whether you'll actually watch it or not!
    RuneSR2
    RuneSR2Author
    Honored Contributor
    August 1, 2018
    Only user reviews in the Oculus Store seem to reflect my preferences. At least I fully agree with these average scores - below is a list of current Rift games obtaining at least 90 % (= grade "A" ;-) according to average Rift user ratings:

    Today's highest average scores for Rift user reviews with solid statistics (=more than 40 reviews):

    Beat Saber - 98 % (1385 reviews, that's an A+ ;-)
    Lone Echo - 94% (2284 reviews)
    Moss - 94 % (122 reviews)
    Robo Recall - 94 % (5185 reviews)
    Keep Talking and Nobody Explodes - 92 % (173 reviews)
    Super Hot - 92 % (1758 reviews)
    Space Pirate Trainer - 92 % (424 reviews)
    The Invisible Hours - 92 % (159 reviews)
    Elite Dangerous - 90% (1508 reviews)
    Onward - 90 % (411 reviews)
    Form - 90 % (111 reviews)
    In Death - 90 % (299 reviews)
    Catan VR - 90 % (49 reviews)

    Honorable mention:

    Merry Snowballs - 96 % (31 reviews - guess statistics are ok, and seem to improve each month)

    I guess the above is a list of current Rift killer apps - there may be more, I only checked today's best-selling Rift games in the Oculus Store. Maybe Oculus could do more to let the masses know we have all these super-amazing killer apps. 

    And I guess we should all own the games on the list o:)
    Oculus Rift CV1, Valve Index & PSVR2, Asus Strix OC RTX™ 3090, i9-10900K (5.3Ghz), 32GB 3200MHz, 16TB SSD "Ask not what VR can do for you, but what you can do for VR"
    Zenbane
    Honored Contributor
    August 1, 2018
    Agreed. I've played most of those titles and those scores share my sentiment. Good stuff!
    RuneSR2
    RuneSR2Author
    Honored Contributor
    August 1, 2018
    I used Google to quickly find the ratings and number of reviews - unfortunately I got slightly tricked, thus ratings for Kin and Virtual Virtual Reality were for Go, not Rift. On the Rift neither of these games qualified to be on the list, and I've removed them - although they nearly qualified. Now I've carefully double-checked all relevant games, and all ratings are from Rift users. 

    When I find the time, I might try to make a complete list of all Rift games and apps with at least 40 reviews and 4.5/5+ ratings. The "A"-list :)
    Oculus Rift CV1, Valve Index & PSVR2, Asus Strix OC RTX™ 3090, i9-10900K (5.3Ghz), 32GB 3200MHz, 16TB SSD "Ask not what VR can do for you, but what you can do for VR"
    Honored Contributor
    August 1, 2018


    60-69 is a D?
    wow! either exams are too easy or that is some harsh marking there.

    this is what we have in blighty.

    Alevels

    A 80
    B 70
    C 60
    D 50
    E 40

    then fail

    Advanced Highers
    • A: Best possible grade, excellent (around 70–100%)
    • B: Above average grade, very good (around 60–70%)
    • C: Minimum pass, improvement needed (around 50–60%)
    • D: Close fail (between 40% and 49%)
    • N/A: Fail/No Pass (0–40%)

    to me 60 - 70 I would consider fairly good.
    70-80%  very good
    80 - 90& excellent
    and 90%+ extraordinary and only for truly stand out titles (or in the case of exams pupils)

    imo if 69% is considered poor it is a reflection that too many reviewers routinely review too high....

    now, of course this difference in opinion is a problem. IF I reviewed it and gave a 69% to me that would be, "worth a closer look for most and definitely worth a buy if you are a fan of the genre".    IF someone else reviewed it, it would seem to mean stay away.

    this is why i like that reviews often no longer give a score, but just say the strengths and weaknesses and then leave it to the punter to then decide if it is for them.



    I grew up in the 80s and 90s in the US.  The grading scale that RuneSR2 posted is what all of us here in the states used in at least both of those decades.  Anything other than that seems odd to me, but of course that's because I grew up understanding the one we use.