Tag Archives: headphones

Video Game Composers: The Tech of Music in Virtual Reality (GDC 2018)

Posted by Winifred Phillips on

Video game composer Winifred Phillips, pictured in her music production studio.

By Winifred Phillips | Contact | Follow

The Game Developers Conference is almost here! I’m looking forward to giving my presentation soon on “Music in Virtual Reality” (Thursday, March 22nd at 3pm in room 3002 West Hall, Moscone Center, San Francisco).  Over the course of the last two years, I’ve composed a lot of music for virtual reality projects, some of which have already hit retail, and some of which will be getting released very soon!  As a result, I’ve spent a lot of time thinking about what role music should play in a virtual reality game. During my GDC talk in March, I’ll be taking my audience through my experiences composing music for four very different VR games –the Bebylon: Battle Royale game from Kite & Lightning, the Dragon Front strategy game from High Voltage Software, the Fail Factory comedy game from Armature Studio, and the Scraper: First Strike RPG-Shooter hybrid from Labrodex Inc.  In preparing my GDC presentation, I made sure my talk addressed some of the most important creative and technical hurdles facing video game composers working in VR.  However, time constraints ensured that some interesting info ended up ‘on the cutting room floor,’ so to speak.  So, I’ve written two articles that explore some of the best topics that didn’t make it into my GDC presentation.

My previous article focused on some abstract, creative concerns facing video game music composers and audio folks working in VR.  In this article, we’ll be turning our attention to more concrete technical issues.  Ready?  Let’s go.

New Binaural Developments

Illustration of popular binaural developments in VR audio, from the article by composer Winifred Phillips for video game composers.VR games currently focus on binaural audio to immerse players in the awesome soundscapes of their virtual worlds.  As we know, binaural recording techniques use two microphones, often embedded in the artificial ears of a dummy head (pictured right).  By virtual of the popular binaural recording technique and/or binaural encoding technologies, game audio teams can plunge VR players into convincing aural worlds where sounds are spatially localized in a way that conforms with real world expectations.  The technology of binaural sound continually improves, and recently the expert developers of the Oculus Rift VR headset have refined the quality of their VR sound with two significant upgrades.

Continue reading →

Music Composers and Sound Designers in VR: The Headphones Problem

Posted by Winifred Phillips on

headphones-690685_1280

Over the past few months I’ve taken several opportunities to blog about the role that music and sound may play in the virtual reality systems and games that have become famous in the media of late, and which will begin to hit retail during the holidays this year.  Today I encountered a very interesting research paper that warns of a possible problem that may face game developers as they attempt to deliver three-dimensional audio for virtual reality experiences.  I explored some issues regarding three-dimensional game audio in my book, A Composer’s Guide to Game Music, and as game composers, I thought that audio for VR might be of particular interest to us.  So, I’m going to share what I learned about the issue from this research paper, including a conclusion which may indicate an imminent problem for some VR gamers.

All of the popular VR systems rely on headphones for audio delivery, but only one (the Oculus Rift) will include built-in headphones as a part of the system.  The rest will allow the consumer to use their own headphones, and even the Oculus Rift allows for its attached headphones to be removed so that the user can replace them with their own “high quality” headphones.

The Oculus Rift, shipping with detachable headphones.

The Oculus Rift, shipping with detachable headphones.

So, here’s where things start to get tricky.

What do the words “high quality headphones” mean to the modern gamer?  Well, the gaming website Kotaku held a survey last year so that its hardcore gaming community could vote to determine the very best gaming headphones.  The winner (by a wide margin) was the Astro A50 7.1 Wireless Surround Sound headset, followed by the Logitech G930 Wireless 7.1-Channel Surround Sound headset.  Two surround-sound models had come out on top.  Of the other headsets in the survey, most were stereo rather than surround, and the only other surround-sound headset in the survey was wired rather than wireless.  Clearly, the community had told us what “high quality” meant – and that was a surround sound experience.

The Astro A50 Wireless 7.1 Surround Sound Headset.

The Astro A50 Wireless 7.1 Surround Sound Headset.

Now, here’s where we hit upon the problem, and it’s explored in the paper “Challenges of the Headphone Mix in Games,” written by Aristotel Digenis (lead audio programmer with FreeStyleGames), who presented his paper in February 2015 at the Audio Engineering Society’s International Conference on Audio for Games in London.  Virtual reality games will be offering binaural audio to simulate a fully three-dimensional listening environment.  While binaural audio can present an awesome level of immersion and realism, the technology of binaural sound isn’t the same as that of surround sound.  In fact, they’re fundamentally different.  If gamers have opted to use their own “high quality” surround sound headsets, then they may be experiencing a lower-quality sound environment than the game developers intended.

Many of the highest quality surround sound headphones include the ability to process an incoming non-surround audio signal into a compatible surround-sound mix (essentially imitating surround sound by virtue of some built-in digital signal processing).  If this processing were applied to the binaural soundscape of a virtual reality game, the effect would cause the immersive quality of the audio to deteriorate rather than improve.  Gamers would be left wondering why their stellar top-of-the-line headphones are making their VR game sound lousy.

So far I haven’t heard any reps from the three VR system manufacturers address this issue, and gamers should definitely be warned that “high quality” headphones for VR will need to be stereo, rather than surround.  VR enthusiasts who are hoping for the ultimate virtual reality experience may need to purchase some excellent stereo headphones, if they don’t already own them.  Without a warning about this issue, some VR gamers may be set up for a nasty sonic surprise.

border-159926_640_white

Studio1_GreenWinifred Phillips is an award-winning game music composer with more than 11 years of experience in the video game industry.  Her projects include Assassin’s Creed Liberation, God of War, the LittleBigPlanet franchise, and many others.  She is the author of the award-winning bestseller A COMPOSER’S GUIDE TO GAME MUSIC, published by the Massachusetts Institute of Technology Press.  Follow her on Twitter @winphillips.