The PS5's Surround Sound May Need Photos of Your Ears to Reach Its Full Potential

The PS5's Surround Sound May Need Photos of Your Ears to Reach Its Full Potential

Maybe the next generation will see the rise of ASMR games.

The big standout news from today's PlayStation 5 technical presentation revolved around harddrive space, load times, and GPU power, but Sony's system architect Mark Cerny also dedicated some time to what may prove to be the new console's most transportive feature in the long run: it's audio capability.

On today's stream and in conversation with Digital Foundry, Cerny discussed the PS5's new approach to 3D audio with the Tempest Engine. In a nutshell, the Tempest Engine will let the PS5 deliver more unique sound sources simultaneously, all at a higher fidelity. The example Digital Foundry presents is the sound of rain. In a current generation game, most studios would opt to use the limited sound channels and processing capabilities at their disposal to have one general rainshower sound playing. But with the PS5, you could simulate the sounds of individual raindrops.

To really create a sense of presence, especially with simple stereo headphones on, Sony will need more than just the capability for more audio. For that, Tempest will use Head-related Transfer Functions, or HRTFs. An HRTF takes into account the shape and size of your ears and head to mix the audio in such a way that it sounds like it would if your body was in the game world. It seems like a fitting comparison would be the differences between listening to audio recorded on a simple stereo microphone, listening to audio recorded with a binaural microphone with two silicone ear covers (like those used by YouTube ASMR creators), and actually hearing sounds live in-person with your own ears.

"When using headphones and my HRTF, I occasionally get fooled and even think a sound is coming from the real world when it's actually coming from the game," Cerny says.

Processing an HRTF is not easy, so the Tempest Engine is "effectively a re-engineered AMD GPU compute unit" with about the same power as all the cores in a PS4. Sony is planning to launch the PS5 with profiles for five different HRTF settings at launch, but there's the possibility that players might be able to customize their HRTF down the line, perhaps by taking photos or video to let the console analyze their ear and head shapes. Sony already does a process like this for its headphone products that support "360 Reality Audio," so there's presumably some tech overlap there that could be applied to the PS5 down the road.

Microsoft also wants the Xbox Series X to deliver advancements in game audio. The Series X will also have its own dedicated audio chip, and as Xbox Director of Program Management Jason Ronald recently revealed on an episode of Major Nelson Radio, the Series X will also let developers use its dedicated ray tracing hardware for "things like spatial audio."

Cerny also says that he hopes the Tempest Engine improvements will be noticeable for players using conventional speakers and virtual surround sound systems. Still, saying the PS5 will deliver such a huge leap forward with basic stereo headphones—no upgrade required—right out of the box is a pretty big claim. Hopefully it pans out, especially if we'll be throwing down hundreds of dollars to expand the PS5's storage space.

Sometimes we include links to online retail stores. If you click on one and make a purchase we may receive a small commission. See our terms & conditions.

Mathew Olson

Reporter

Mathew Olson is a writer formerly of Digg, where he blogged and reported about all things under the umbrella of internet culture (including games, of course). He lives in New York, grew up under rain clouds and the influence of numerous games studios in the Pacific Northwest, and will talk your ear off about Half-Life mods, Talking Heads or Twin Peaks if you let him.

Related articles

Ruined King, a League of Legends RPG, Is Coming in Early 2021

It's a single-player adventure from the makers of Battle Chasers: Nightwar.

Half-Life Remake Black Mesa Now Has a Definitive Edition Out in Beta

Hitting 1.0 after 15 years wasn't ambitious enough!

Ubisoft Says Several of Its PS4 Games Won't Be Compatible With PS5

These titles, including Assassin's Creed Syndicate, didn't appear on Sony's official exemption list.

Crunch is a Flat Circle at CD Projekt Red

THIS WEEK IN BUSINESS | Cyberpunk 2077 developer stays true to form.

You may also like

USG Game of the Month: Amnesia: Rebirth

Frictional Games's deeply unsettling horror game stands out in an otherwise underwhelming month.

11 Games That Will Help You Get in the Halloween Spirit

Celebrate the season with the best virtual Halloween festivities.

What's the Best Horror Game of All Time?

COMMUNITY QUESTION | There are lots of jump scares and eerie mists, but who does it best?

Researchers May Have Found a Way Around Oculus Quest 2's Facebook Requirement

The method hasn't been made public yet for fear of legal action from Facebook.