Early Reviews Are Vital For Healthy Criticism, and Bethesda Know It

Early Reviews Are Vital For Healthy Criticism, and Bethesda Know It

Bethesda are the first publisher to codify the withholding of review copies until just prior to launch as official policy; but this has been sporadic, unofficial publisher policy for years. 2K’s recent actions with Mafia 3 and Civilization VI, Ubisoft with Assassin’s Creed Unity and The Division, and EA in general (with regards to most PC code, frankly) all provide examples of launch day reviews being rendered impossible by publisher actions.

It should be clear why this is damaging to the industry. A medium which only allows marketing and marketing-affiliated voices (and I’d include previews under this heading) to speak ahead of release is not a healthy one.

Publishers have always held the majority of the arsenal in the fight between hype and legitimate criticism. They have near total control over access, and they have vastly higher budgets than gaming publications to spend on blanket marketing (a lot of which, it must be said, ends up on those same publications and YouTube channels), and retailer-partnered pre-order incentives. Being an independent voice in games criticism is already a case of fighting a tank with a sword. Removing early review copies from the equation shifts that power imbalance even further. It’s more like fighting two tanks with a cursed sword that only lets you stab yourself.

tanks-sword
Artist’s impression.

Consider the purpose of a review. For ‘review’ here, I really mean any pre-release coverage that has an independent, critical slant. Scored text, critical video analysis, insightful prose without a score; whatever form it happens to take.

Game reviews tend to have a couple of overlapping forms. They’re usually part consumer product review (how does the game perform, what are its features) and part cultural/design criticism (similar to a book or film review). That’s a generalisation, but the majority of review and review-like coverage of games will take one or both of those angles. The purpose in either case is to inform a prospective player about the game from a critical perspective, and give them a wider understanding of whether it may interest them. In cases like No Man’s Sky, Assassin’s Creed Unity or Aliens: Colonial Marines they can also serve as a straightforward klaxon warning.

Readers and viewers absorb multiple marketing materials and critical pieces (or marketing materials disguised as critical pieces in some duplicitous cases), to form a holistic view of the game they’re pursuing. Removing the critical voices (or delaying them to the point where they’re stifled) skews the pre-release coverage even more disproportionately towards uncritical hype.

no man's sky pc 4k (1)
We might have been able to warn you, but we never got code.

Artificially delaying review coverage hurts the ‘product review’ style article, and thus the prospective buyer, a little more than the ‘cultural dive’, but both ultimately suffer. It implies a situation where a large company like Bethesda parent Zenimax is terrified of negative criticism from a publication like ours. While flattering to some extent, it’s representative of a pathetic cowardice in the face of independent critique.

Let me hand over to PC Invasion’s Paul Younger here for a second, who can outline an example of active, pre-release criticism to a game being unacceptable in the eyes of publishers and PR.

“I have dealt with this first hand with Diablo 3. For up to a year before Diablo 3 released we criticised the game’s direction, the lack of customisation and the Auction House. Blizzard paid no attention to our comments and criticism, and in fact we were asked by Blizzard PR to stop writing negative things about the game. Naturally we carried on as usual, which eventually led to Blizzard pulling the plug and blackballing their longest running community site for the game for a few years. Blizzard knew bad press could hurt sales and they wanted to stamp it out no matter what.”

diablo3-auctionhouse
We did warn you about this one. Or our sister site did, anyway.

I want to make it clear that this isn’t just an extended whinge about not getting special treatment. I’m in my mid-30s, and all of us here at PC Invasion are well beyond the age where we have any interest in the materialist aspects of receiving early review code. I just want to be able to do my job; and doing that job effectively tends to require an early review copy of a given game. There are certain exceptions, of course. Multiplayer-focused titles can absolutely benefit from delayed reviews. It’s much better to wait and judge the game on actual play, with real people, on real servers, than on the basis of some stage-managed review event against other journalists.

The suggestion that people should just wait several days (or longer, in the case of heftier RPGs and the like) for post-launch reviews is a nice idealistic fantasy. But coming from Bethesda, it’s just outright hypocrisy.

This is the same company whose marketing forces are directed, one hundred percent, towards encouraging players to pre-order games. Everything – every single thing – in their advertising campaigns are designed to get people’s cash before any actual criticism has been penned or recorded. I’m not going to hammer on the ‘beware pre-ordering!’ button for too long here, but I hope it’s clear that shifting the blame to a customer impatience that has been systematically cultivated by publishers is not a solution. We already have a system in place which can help to steer people away from pre-orders. It’s called independent pre-release reviews, and it’s the thing Bethesda is trying to kill off.

Dishonored 2 gameplay video shows two minutes of mayhem
Will Dishonored 2 be any good? Find out several days after launch!

The maddening thing is, a relatively reasonable model for pre-launch reviews had settled into place over the last few years. Our best experiences with review code at PC Invasion go like this: review code arrives a week or two in advance (depending on game length), and there’s an NDA/embargo date for publication of text and video a few days ahead of the game’s launch. That leaves plenty of time for a game to be finished and a review written; it provides a definitive ‘nothing before this date’ to prevent idiots immediately putting up some rushed paragraphs/footage with a traffic-baiting score; and it gives a nice buffer of a day or three before launch so prospective players have time to absorb plenty of varied critical opinions. As long as most honour the arrangement (there’s always some clown streaming stuff stupidly early for the hits), this works very well.

In our experience, Paradox, SEGA, and Square Enix are all pretty excellent when it comes to early PC code. Capcom and Namco Bandai do okay. Ubisoft are a little hit and miss. Until recently, Bethesda weren’t too bad either. EA are rubbish, 2K have slid towards hopelessness of late, and I think Activision have forgotten we exist. It’s not always possible to provide PC code early, so we always accept non-malicious reasons for review copies being delayed. That’s very different from a deliberate policy of withholding code.

Coverage of the entertainment industries is always a bit of a devil’s bargain. Publishers want pre-release hype, ‘news’ stories, marketing-affiliated videos, and uncritical previews. Publications swallow those pills (or parts of them) in order to keep reader and viewer traffic ticking over, and on the understanding that the pay-off will be a chance to critique the product itself in a timely manner. And (if necessary) pour water on the hype-fire instead of stoking it. By yanking this away, Bethesda are reneging on their end of the deal. They still want all the coverage, but they don’t want to see any actual criticism (at least until they already have the money in hand). That’s bad for publications, bad for players, and bad for an industry which already has major problems with transparency and the separation of marketing from actual criticism.

Related to this article
  • Fallout 76 To Use A “Nuke Loop” As Endgame Content
  • Related to this article
  • Quake Champions Introduces Slipgate Mode And Festival
  • Related to this article
  • Fallout 76 Won’t Allow You To Respec Your Character

    • ManuBiggs

      I already know weeks ahead if I am buying a game on launch day, and after getting in on the pre-launch hype, no review is going to sway me. I’ve been waiting – I’m playing that baby at midnight. Where a positive early review serves the industry well, is when the game is not on my radar and that gets my attention. BF1 was not going to be a day one purchase for me, but the early reviews convinced me otherwise-whereas I had been waiting for Mafia 3 and even if the reviews came out earlier I was still getting it day 1 (and Im glad I didnt listen to those reviews cause I liked it a lot). Watchdogs 2, Dishonored 2, South Park I will be getting day 1 regardless of reviews. Reviews will only matter for the other titles not on my day 1 list.

      • Martin

        That’s beside the point, since you apparently buy anything triple AAA regardless. The point here is that Bethesda wants to squeeze those preorders and ‘day 1 buyers’ as much as possible before any negative mainstream review is out.

        Thankfully there’s still user Steam and Metacritic reviews, they can’t do anything about those, and more people are realizing that paying attention to mainstream reviews/youtubers is a waste of time.

        • Shawn

          Ugh Steam reviews… I avoid them like the plague lately. The “Waaaaaaaaa the game won’t run on my 10 year-old CPU and I demand a patch RIGHT NOW or I’m going to give you a bad review!” crap going on is getting old. And with the steam return policy, the same jackasses are buying the game, not even playing it and then giving it a bad review before returning it. There are a few games I’ve bought to play on day one, Fallout 4 for example. However I usually don’t fall for the season pass scam right out the gate, since by the time I need the extra content there has always been a sale on it. I bought the Fallout 4 season pass on sale for 19 dollars…

          • Martin

            Well if you somehow have problems ignoring those user ‘reviews’, you can always look at the ‘helpful’ rating. It’s there.

            Still beats the mainstream shill reviews OMG GOTY CITIZEN KANE OF GAMING 11/10!!!!!

            • Shawn

              Oh that’s true as well, but lately its been just as I’ve said for most of the AAA games released. I think age has a lot to do with it. I’ve been gaming since the Tandy TRS-80 Model 1 and I am used to having to work hard to get my games to work. If I see that a game is buggy but still fun I’ll work at making it run. So far I’ve not had a game I wasn’t able to tweak to get it to run close to the way I want it. But then again I always make sure i’m close to the recommended specs before buying one in the first place.

      • Paul Younger

        Yep, that’s absolutely cool. You are in the group that is fully on-board no matter what the outcome. Any publisher’s ideal customer.

    • jimbo3298

      Its a business decision, they need to make money. It’s on consumers now to be more careful with their purchases. Buyer beware, especially PC gamers whose options in returning a game limited as compared to Console gamers.

      • Dorjjodvo Batkhuu

        I don’t really feel affected by all of this because I pirate all my single player games and only buy multiplayer games…..All the dlc, pre order bonus and other shits are really getting out of hand so I am even more inclined to pirate games these days

    • Larry Gall

      I wait until they’ve been out a week or two anyway. I don’t take any published review seriously, and wait until I see someone playing on YouTube and making a player review. I think amateurs are just better at it. The so called “Pros” just seem to miss the point, and often don’t realize there are different tastes. I love stealth games, and I’ve seen reviewers call some stealth games slow and boring. That’s funny, because that’s just how I’d describe their “review” lol. I’m with Bethesda on this.

    • Asgard

      PC Gamer and their Overwatch “news” are good examples of pure fanboyism toward blizzard or simply paid articles.

      • Paul Younger

        I simply don’t get the Overwatch hype. Sure, it’s a good game but by all means not spectacular. It is Blizzard though and they could fart in a bottle and people would buy it.