Skip to main content
RuneSR2
Honored Contributor
July 28, 2018
Question

The destructive force of GREAT VR games getting mediocre or no reviews

When telling my friends and colleagues that VR is mankind's most impressive invention since the wheel, I keep hearing that many will consider buying a VR headset when great games arrive. I can then tell them about the many awesome VR games, but the problem arises when I have to show some reviews of such great VR games. Often there're no reviews or the authors of VR game reviews seem keen to do their very best bashing most VR games for not being good enough - quite contrary to my experiences.

I know Oculus took great pride getting a top-ranked VR game on Metacritic, and they succeeded with Lone Echo last year. But where do we stand this summer? - Here's today's list of the best PC games, including VR games, from Metacritic (and my friends read such lists):



According to that list there are no games you can't play without a VR headset. The only game on the list you can play in VR is The Forest, but it works in 2D too. If the list is expanded to show all current games, Gunheart also receives 83 points like The Forest, and again you don't need a VR headset to play Gunheart. My friends easily conclude that since there're no VR-only high-ranking games on the Metacritic list, it's because current VR games are of poor quality and VR is something no one truly needs. 

I can't blame them for drawing such conclusions, and even showing 2D trailers don't help much, because you can't communicate the greatness of VR games using a 2D video.

I think it's a great problem that new and awesome VR games don't get good reviews or do not get reviewed at all. Let's take Moss - it's a VR-only game arriving a few months ago:

Moss Metacritic Score for PC: No score due to insufficient number of reviews.
Moss User Score in the Oculus Store: About 96% average. 

There're just 3 Moss reviews for PC VR on Metacritic, scoring the game at 79, 80 or 90 % - which in no way reflects user experiences. And often I see a similar trend. 

The reason behind the few Moss PC reviews are probably that many reviewers reviewed the PS4 version and then didn't want to do another review for PC VR. Thus compared to the 3 reviews for the Rift/Vive version, there're 62 reviews of the PS4 version! Interestingly many reviewers have no problem reviewing different game versions for PS4, XBox One and PC - like Battlefield 1, Fifa 18 and Rise of the Tomb Rader just to name a few titles. Why didn't Moss PC VR get a similar treatment?

This is a great problem - Moss for the Rift and Vive is not the same as the PS4 version; PS4 has no controllers matching the Rift or Vive, and the PS4 has much lower resolution (also when using high levels of super-sampling on the Rift and Vive). But the greatness of Moss PC VR was never communicated to the masses, because there're almost no published reviews of one of the greatest VR games so far - and certainly the best one thus far in 2018!

Another problem of mixing VR and 2D games on Metacritic is to compare apples and oranges, or probably more to compare grapes and watermelons 😉

To illustrate: Is Subnautica 2D the same as Subnautica VR? Is Elite Dangerous 2D the same as Elite Dangerous VR? I'd personally consider Subnautica VR about 10 times better than Subnautica 2D, even if the VR version does have some problems. So should we rate Subnautica 2D at 10 % and the VR version at 100 % ? Of course this would not be fair, but I'd have no problem rating Subnautica 2D at 65 % and the VR version at 95 %, if we really want to compare apples and oranges - and want to rate both on the same scale. 
I believe that many reviewers rate VR games just as if the games were in 2D. Comparing 2D and VR games, I'd have a hard time rating a 2D game more than 70 % - and that would be for the very best AAA 2D games, while I'd have a hard time rating any high-quality VR game below 90 %. This is due to the fact that VR games are so incredibly more visually impressive and immersive than any 2D game can be - and Touch controllers add a lot to provide a truly unique VR experience. For example I'd have no problem rating a 2D version of Marvel Powers United at maybe 60 %, and to rate the VR version at 90 %, because the immersion - the feeling of being present in the game world - is so much better in VR. 

If reviewers fail to clearly communicate how much better VR games are compared to 2D games, how are persons - who know very little about VR - going to know how much better VR games are compared to 2D games? The current bashing of Marvel Powers United is a great example of this - and it's a great destructive force limiting VR adoption when VR game reviewers constantly criticize gameplay as if a VR game wasn't different from a 2D game. A new VR game which is the best within it's genre - compared to other VR games in the same genre - is per definition the new reference and should carry a rating reflecting that position. - And such a VR game should not carry a rating that reflects a reviewers preference for 2D games in the genre. 

I think it would be great if Oculus representatives could ask Metacritic not to mix 2D and VR games; there are plenty of VR games to support having their own category.
We need to stop comparing apples and oranges. 

Finally we could take a look on the current top three PC games on Metacritic, namely these:

Into the Breach - rated 89 %


Pillars of Eternity II: Deadfire - rated 88 %


Final Fantasy XV - Windows - rated at 85 %


I do think that some of these games look impressive, but are these games way better than the latest and greatest Rift games? Personally I'd consider the following games so much better; compared to 2D games I'd happily rate Moss at 97 %, Seeking Dawn at 93 % and Marvel Powers United VR at 90 %



    132 replies

    Zenbane
    Honored Contributor
    July 17, 2021

    Regarding the reason UploadVR gave RoboRecall a 7.5 out of 10 Score, they spell it out quite clearly:

     

    But this replayability also points to the game’s biggest flaw: repetition. The nine levels aren’t really that different, except for a handful of new enemies that come up and the boss fights on every third level. That is a nearly identical bossfight in missions 1-3, 2-3, and 3-3. And within the levels you are either shooting freely, shooting within a time limit, capturing within a time limit, or fighting the boss. More variety would be appreciated. There is mod support available for users to tinker with, but who knows how much variety that will really bring over time — it’s up to the community.

     

    I agree with this completely. I loved RoboRecall, but it was very repetitive, and I didn't replay it much at all due to the repetition. Upgrading the GPU doesn't magically erase the fact that just about every level is the same and a huge bulk of the game is repetitive.

    nalex66
    Honored Contributor
    July 21, 2021

    I must say, that sort of review is much more useful to me than a long-winded examination of the minutia of graphics settings. I don't particularly care whether it was played on an OLED or LCD screen (and I don't believe that most developers even think about that). I'm not bothered about what GPU was used by the reviewer, except to get a rough expectation of performance. If a review is going to touch on settings, I'm more interested to hear about the control options, because as a lefty, that potentially affects my ability to enjoy the game. But mainly, I want to know about the gameplay; tell me whether the core experience is fun and engaging to play. That's what's going to keep me coming back.

     

    I think I like eye-candy as much as the next guy. If I buy a cross-buy game, I'll usually play the PC version first, to allow it the chance to make its best first impression (if it's a graphics-focused game). I'll crank the settings all the way up, see how it runs, and turn things down a bit if necessary. Beyond that first session though, all that really matters to me is whether I enjoyed playing it. The visual differences between graphics settings or headsets are minor variations of the same experience. If the main gameplay loop hooks me, then I'm just as happy to play the Quest version. I can get more immersed in Ancient Dungeon or Superhot than the prettiest chore-to-play grindfest.

     

    Part of the appeal of VR over traditional AAA games is that it's a new medium that can offer unique experiences. I want to see developers innovate with interesting mechanics (like Superhot's time manipulation), new ways to move through a virtual world (like Echo VR), or more immersive interactions (manually reloading weapons rather than simple button-presses). I want reviews to focus more on those aspects of games, which have often come from indie devs who don't necessarily have the resources to compete with the visuals of typical AAA games. Flat games have stagnated somewhat in recent years, with little to differentiate them except the latest graphical bells and whistles. Trying to shoehorn VR into that same mindset risks missing out on some real gems.

     

    I agree with the original premise of this thread, that poor reviews are harmful to great VR games. Clearly we all have our own ideas about what constitutes a great game. I appreciate reviews that try to take a balanced approach and evaluate the experience as a whole--if some aspect like visual fidelity is underwhelming, its fine to point that out, but it's also helpful to highlight what a game does well. Devs are people too, and hearing their hard work described as "garbage" can really discourage them from continuing to develop for a platform that already offers meager returns for the effort involved.

    DK2, CV1, Go, Quest, Quest 2, Quest 3. Try my game: Cyclops Island Demo
    July 21, 2021

    Well personally I think the OP was referring more to like professional type of reviews rather than your everyday user reviews.  An individual user that wants to share his/her experience with a game is going to share what attracts them - and for the OP obviously graphics play a large roll. For another it may be the single player aspect, or a multiplayer aspect. Or the depth of the gameplay, or the length of the gameplay. Different folks are attracting to different aspects of the game.

     

    Not sure it is fair to expect more from an everyday user taking his time to post a review of his impressions of a game. I enjoy and appreciate the OP taking the time to post his views on a game along with images as well. I find it helpful to some degree, knowing what he mostly looks for in a game and keeping that in mind. I would think if anyone did not care for one's style in posting their experience with a game, then easy enough to not bother reading it. It would certainly be nice if more everyday users shared their experiences with their games as well.

     

     

    Zenbane
    Honored Contributor
    July 21, 2021

    Anonymous wrote:

    Well personally I think the OP was referring more to like professional type of reviews rather than your everyday user reviews. 

     


     

    Professional reviewers are also every day users like us. But that aside, your argument seems to suggest that it makes sense to hold people who write reviews to a higher standard than you would hold yourself when you write reviews. That seems highly counter-intuitive and self-defeating.

     

    No only that, but it also suggests that an every day user should be free to intentionally ignore 99% of what they are reviewing in order to focus on one single thing, while also expecting what you call "professional reviewers" to incorporate the rest of the 99% more fairly. Well, I say that it makes far more sense to simply... lead by example and practice what you preach.

     

    Rune will criticize a VR App based solely on high-end graphic support, yet he will also criticize professional reviewers for unfairly rating VR Apps low.

     

    This is a rather huge contradiction that cannot be explained away, nor excused, by simply trying to use labels such as "professional reviewer vs every day reviewer."

     

    Rather than defend this rather obvious contradiction, it seems like it would be more beneficial to acknowledge it and strive to do better. On more than one occasion, Rune has expressed concern over his review threads not receiving much community feedback. Perhaps if he considered taking a different approach and incorporate the same expectations he has for "professional reviews" in to his own "every day reviews," then he would see an increase in positive activities around the reviews he creates? Just a thought.

     

     

    "Not sure it is fair to expect more from an everyday user taking his time to post a review of his impressions of a game."

     

    I don't think anyone is saying that they expect "more" from Rune's reviews; quite the contrary, the suggestions are that Rune incorporate the same amount of consideration that he expects from other reviewers.

     

    Do you really see value in the following approach:

    "I believe professional reviewers should be more fair in writing VR App reviewers, although I should be fully allowed to rate VR Apps low if they don't have graphics that meet my personal expectations"

     

    ??

    July 21, 2021

    No not really gang...

    But you go on with what you do. It is all very transparent.

    Zenbane
    Honored Contributor
    July 21, 2021

    Anonymous wrote:

     

    you go on with what you do. It is all very transparent.


    A bit pot/kettle, no?

    Honored Contributor
    July 21, 2021

     I for one truly value Rune's reviews. I believe he has bias in some areas as does everyone including myself.  Even batman is allowed to be human.  

    Gigabyte  AB350 Ryzen 2700x, 32gb ddr 4 3200, 2080ti. HP Reverb G2, Index controllers, Quest 1 and 2x Quest 2. 65" 3DTV HD3D DLP projector.
    July 21, 2021

    ohgrant wrote:

     I for one truly value Rune's reviews. I believe he has bias in some areas as does everyone including myself.  Even batman is allowed to be human.  


    Amen to that.

    Honored Contributor
    July 22, 2021

    I would certainly rate Zen equally enthusiastic in the areas that most interest him. Both are really what's keeping the forums interesting to me. 

    Gigabyte  AB350 Ryzen 2700x, 32gb ddr 4 3200, 2080ti. HP Reverb G2, Index controllers, Quest 1 and 2x Quest 2. 65" 3DTV HD3D DLP projector.
    RuneSR2
    RuneSR2Author
    Honored Contributor
    September 4, 2021

    Seems things haven't changed much for awesome PCVR games getting no reviews, lately - this year we can observe:

     

    Myst PCVR (even includes the 2D version): 1 review

    https://www.metacritic.com/game/pc/myst

     

    Blair Witch PCVR: 0 reviews

    https://www.metacritic.com/game/pc/blair-witch-vr

     

    Furious Seas: 0 reviews

    https://www.metacritic.com/game/pc/furious-seas

     

    A Wake Inn: 2 reviews

    https://www.metacritic.com/game/pc/a-wake-inn

     

    Sam'n Max VR did get some though, but mostly bad ones (Metascore 65): 5 reviews

    https://www.metacritic.com/game/pc/sam-max-this-time-its-virtual!

     

    Surv1v3: 0 reviews

    https://www.metacritic.com/game/pc/surv1v3

     

    All of the above are games no longer in early access (left early access in 2021). Usually getting out of early access means reviews start to arrive, but unfortunately not for PCVR games - seems PCVR games often get most exposure at launch even if early access (but early access means no reviews), and these game don'r get much more attention. 

     

    In fact, of the recent great PCVR titles released this year, Maskmaker and I Expect You to Die 2 may be close to the only games getting some attention:

     

    Maskmaker: 10 reviews

    https://www.metacritic.com/game/pc/maskmaker

     

    I Expect You to Die 2: 9 reviews

    https://www.metacritic.com/game/pc/i-expect-you-to-die-2-the-spy-and-the-liar

     

    That's is why I do my best trying to give the devs more attention, making VR games these days isn't easy, and even if there're more hmds sold than ever, many PCVR games don't get noticed and end up not selling well. 

     

    Got a nice response from the devs behind A Wake Inn after posting some screenshots from their amazing game on Reddit:

     

    "Hey Runesr2!
    Maciek from VRBros here, the studio behind the "A Wake Inn".
    I just want to say we are EXTREMLY happy and grateful for your kind words about our game! You actually might not have an idea how reviews like yours are motivating us, indie developers, for even harder work! 🙂 So THANK YOU for that. We were so pleased reading that you are enjoying many aspects of the game!
    Maciek VRBros"

     

    Nice to get such feedback also illustrating the need for more attention toward many PCVR games. Thus even if I don't think this game looks great, I'll probably buy it just to support the devs:

     

    https://forums.oculusvr.com/t5/Games-and-Apps/Legendary-Tales-launching-September-9/td-p/883444

     

    Btw, strangely enough, Myst hasn't even sold 20k copies yet - and that includes the 2D version, does not look good to me, but many have complained about high hardware requirements and maybe to many it's old wine in a new bottle - but to me Myst PCVR is one of the best PCVR games ever made, especially within its genre.

     

    https://steamspy.com/app/1255560

    Oculus Rift CV1, Valve Index & PSVR2, Asus Strix OC RTX™ 3090, i9-10900K (5.3Ghz), 32GB 3200MHz, 16TB SSD "Ask not what VR can do for you, but what you can do for VR"
    RuneSR2
    RuneSR2Author
    Honored Contributor
    July 26, 2024

    Some 6 years later - could be fun to see some PCVR Metascores and number of reviews. Highest PCVR Metascores go to (games with less than 10 reviews marked in bold):

     

    Alyx - Metascore 93, 78 reviews

    Beat Saber - Metascore 93, 10 reviews

    Tetris Effect: Connected - Metascore 93, 6 reviews

    Lone Echo - Metascore 89, 14 reviews

    Asgard's Wrath - Metascore 88, 15 reviews

    Red Matter 2 - Metascore 84, 8 reviews

    Saints and Sinners - Metascore 81, 28 reviews

    Stormland - Metascore 81, 17 reviews

    Moss - Metascore 81, 5 reviews

    Arizona Sunshine 2 - Metascore 80, 7 reviews

    Lone Echo 2 - Metascore 78, 13 reviews

    Room VR - Metascore 78, 12 reviews

    Brass Tactics - Metascore 78, 8 reviews

    Chronos - Metascore 77, 13 reviews

    Wilson's Heart - Metascore 77, 12 reviews

    Boneworks - Metascore 72, 6 reviews

    Edge of Nowhere - Metascore 71, 12 reviews

    Arktika.1 - Metascore 71, 8 reviews

     

    No Metascore due to less than 4 reviews:

    Gorilla Tag

    Vertigo 2

    Hubris

    Madison VR

    Undead Citadel

    Underdogs

    Kayak VR: Mirage

    Blade & Sorcery

    7th Guest VR

    Moss Book 2

    VTOLVR  (2nd highest-rated VR game on Steam with 98% positives by 15,000 user reviews)

    Walkabout Minigolf

     

    Only Alyx and Saints & Sinners got more than 20 reviews, most 2D gamers will probably have no clue of which new awesome VR games are arriving. 

    The discrepancy between Metascores and user ratings is huge. Room VR has 97-98% user rating (both Steam and Rift Store), while Metascore is only 78. 

    Blade & Sorcery has 96% average positive ratings based on moren than 50,000 ratings. Not one professional review site took the time to write a review when the full game launched 1.5 months ago. Not even UploadVR or RoadToVR, shame on them. 

    Thus no wonder VR has a hard time increasing adoption - no one knows about the content, and the most awesome content (apart from Alyx and Beat Saber) get mediocre reviews nowhere in line with user experiences.  

     

    Oculus Rift CV1, Valve Index & PSVR2, Asus Strix OC RTX™ 3090, i9-10900K (5.3Ghz), 32GB 3200MHz, 16TB SSD "Ask not what VR can do for you, but what you can do for VR"