Video Game Music Composer: Music and Sound in VR Headphones (Part Two)

Photo of game composer Winifred Phillips in her music production studio, from the article "Video Game Music Composer: Music and Sound in VR Headphones (Part Two)"My work as a video game composer has lately included some projects for virtual reality games (more info on that in the coming months), and as a result I’ve been thinking a lot about the awesome potential of VR, and have also been writing lots of articles on the subject.  Earlier this month I began a two-part article that focuses on the experience of the end user, and the gear with which they’ll be enjoying our video game music and audio content (you can read part one here). So, let’s now continue our discussion about the new generation of headphones designed specifically for VR!

In this article, we’ll be discussing two headphone models:

  • Entrim 4D
  • Plantronics RIG 4VR

So let’s get underway!

Entrim 4D headphones

Photo of the Entrim 4D, from the VR headphones article by Winifred Phillips (award-winning game music composer)This March at the famous SXSW convention in Austin, Samsung showed off a piece of experimental technology promising to bring a new dimension of immersion to virtual reality.  It’s designed specifically to complement their popular Samsung Gear VR device, and it works by virtue of electrodes that send electrical signals right into the wearer’s head!  As if virtual reality itself weren’t futuristic enough, now we’re talking about a device that zaps us to make the VR feel more real!  It’s called Entrim 4D (pictured right).  We’re talking about it here because (among other things) Entrim 4D is a pair of audio headphones built specifically for VR.

Continue reading

VR Game Composer: Music Beyond the Virtual

Photo of video game music composer Winifred Phillips, from the article entitled "VR Game Composer: Music Beyond the Virtual."Welcome to the third installment in our series on the fascinating possibilities created by virtual reality motion tracking, and how the immersive nature of VR may serve to inspire us as video game composers and afford us new and innovative tools for music creation.  As modern composers, we work with a lot of technological tools, as I can attest from the studio equipment that I rely on daily (pictured left). Many of these tools communicate with each other by virtue of the Musical Instrument Digital Interface protocol, commonly known as MIDI – a technical standard that allows music devices and software to interact.

Image depicting VR apps from the article by Winifred Phillips, Game Music Composer.In order for a VR music application to control and manipulate external devices, the software must be able to communicate by way of the MIDI protocol – and that’s an exciting development in the field of music creation in VR!

This series of articles focuses on what VR means for music composers and performers. In previous installments, we’ve had some fun exploring new ways to play air guitar and air drums, and we’ve looked at top VR applications that provide standalone virtual instruments and music creation tools.  Now we’ll be talking about the most potentially useful application of VR for video game music composers – the ability to control our existing music production tools from within a VR environment.

We’ll explore three applications that employ MIDI to connect music creation in VR to our existing music production tools. But first, let’s take a look at another, much older gesture-controlled instrument that in ways is quite reminiscent of these motion-tracking music applications for VR:

Continue reading

VR Game Composer: Music Inside the Machine

Illustration for an article in the VR Game Composer series, written by video game composer Winifred PhillipsWelcome to part two of our ongoing exploration of some interesting possibilities created by the motion tracking capabilities of VR, and how this might alter our creative process as video game composers.

In part one we discussed how motion tracking lets us be awesome air guitarists and drummers inside the virtual space.  In this article, we’ll be taking a look at how the same technology will allow us to make interesting music using more serious tools that are incorporated directly inside the VR environment – musical instruments that exist entirely within the VR ‘machine.’

Our discussion to follow will concentrate on three software applications: Soundscape, Carillon, and Lyra.  Later, in the third article of this ongoing series, we’ll take a look at applications that allow our VR user interfaces to harness the power of MIDI to control some of the top music devices and software that we use in our external production studios. But first, let’s look at the ways that VR apps can function as fully-featured musical instruments, all on their own!

Soundscape

Let’s start with something simple – a step sequencer with a sound bank and signal processing tools, built for the mobile virtual reality experience of the Samsung Gear VR.

Video game composer Winifred Phillips demonstrating the Samsung Gear VR headset during the AES convention in NYC.I got a chance to demo the Samsung Gear VR during the Audio Engineering Society Convention in NYC last year, and while it doesn’t offer the best or most mind-blowing experience in VR (such as what we can experience from products like the famous Oculus Rift), it does achieve a satisfying level of immersion. Plus, it’s great fun!  The Soundscape VR app was built for Samsung Gear VR by developer Sander Sneek of the Netherlands.  It’s a simple app designed to enable users to create dance loops using three instruments from a built-in electro sound library, a pentatonic step sequencer that enables the user to create rhythm and tone patterns within the loops, and a collection of audio signal processing effects that let the user warp and mold the sounds as the loops progress, adding variety to the performance.

Continue reading

VR Game Composer: Music in the Air

Illustration for the article by game music composer Winifred Phillips, entitled "VR Game Composer: Music in the Air"Since I’ve been working recently on music for a Virtual Reality project (more info in the coming months), I’ve been thinking a lot about VR technology and its effect on the creative process.  Certainly, VR is going to be a great environment in which to be creative and perform tasks and skills with enhanced focus, according to this article from the VR site SingularityHub.  I’ve written in this blog before about the role that music and sound will play in the Virtual Reality gaming experience.  It’s clear that music will have an impact on the way in which we experience VR, not only during gaming experiences, but also when using the tools of VR to create and be productive.  With that in mind, let’s consider if the opposite statement may also be true – will VR impact the way in which we experience music, not only as listeners, but also as video game composers?

Game composer Winifred Phillips tries out the VR experience of Google Cardboard (pictured here in her music production studio).Simple VR technologies like the popular Google Cardboard headset can be a lot of fun – as I personally experienced recently (photo to the left).  However, they offer only the rudimentary visual aspects, which omits some of the most compelling aspects of the VR experience.  When motion tracking (beyond simple head movement) is added to the mix, the potential of VR explodes.  Over the next three articles, we’ll be exploring some interesting possibilities created by the motion tracking capabilities of VR, and how this might alter our creative process.  In the first article, we’ll have some fun exploring new ways to play air guitars and air drums in the VR environment. In the second article, we’ll take a look at ways to control virtual instruments and sound modules that are folded into the VR software.  And finally, in the third article we’ll explore the ways in which VR motion tracking is allowing us to immersively control our existing real-world instruments using MIDI. But first, let’s take a look at the early days of VR musical technology!

Continue reading

VR Audio: Past, Present & Future

VR Audio (article by award winning video game music composer Winifred Phillips)In this blog, I thought we might take a quick look at the development of the three dimensional audio technologies that promise to be a vital part of music and sound for a virtual reality video game experience. Starting from its earliest incarnations, we’ll follow 3D audio through the fits and starts that it endured through its tumultuous history.  We’ll trace its development to the current state of affairs, and we’ll even try to imagine what may be coming in the future!  But first, let’s start at the beginning:

3D Audio of the Past

Alan Blumlein (article by award winning video game music composer Winifred Phillips)In the 1930s, English engineer and inventor Alan Blumlein invented a process of audio recording that involved a pair of microphones that were coincident (i.e. placed closely together to capture a sound source).  Blumlein’s intent was to accurately reflect the directional position of the sounds being recorded, thus attaining a result that conveyed spatial relationships in a more faithful way.  In reality, Blumlein had invented what we now call stereo, but the inventor himself referred to his technique as “binaural sound.”  As we know, stereo has been an extremely successful format, but the fully realized concept of “binaural sound” would not come to fruition until much later.

Continue reading

Can Game Music and Sound Combat VR Sickness?

dizzyVirtual Reality Sickness: the nightmare of VR developers everywhere.  We all know the symptoms.  Nausea.  Headache.  Sweating. Pallor.  Disorientation. All together, these symptoms are a perfect recipe for disaster. No one wants their game to make players feel like they’ve been spinning on a demon-possessed merry-go-round.  So, how do we keep this affliction from destroying the brand new, awesome VR industry before it even gets a chance to get off the ground?

In response to this possible VR apocalypse, the top manufacturers have taken big steps to improve their popular devices.  Oculus improved the display on its famous Rift device, Valve introduced a motion-tracking system that helps us orient ourselves and not get nauseous when wearing the Vive, and PlayStation VR incorporated a wider field of view designed to make players feel more comfortable. Even with these efforts, players are still reporting motion sickness symptoms, and the creators of the VR systems have responded by pointing the finger of blame at game developers.  So, if the developers of VR games have to solve the problem, then how can the music and sound folks help? Can game music and sound combat VR sickness?

Continue reading

VR for the Game Music Composer – What’s New?

google-cardboard_winifred-phillipsRecently I bought my first VR headset, and since then I have been adventuring in the world of virtual reality courtesy of Google Cardboard. For something as high tech and impressive as the VR experience, Google Cardboard makes the whole process easy, low-cost and accessible.  While Google provides instructions for users who’d like to make their own headsets from scratch using simple craft materials, I opted to purchase a version made by the good folks at IMCardboard.com.  Pictured to the right, you see me wearing their EVA 2.0 headset, made from a rubber-like material that’s very comfortable and lightweight.  Despite the more sophisticated look and materials, this headset still adheres to the Google Cardboard specs in terms of its design.  Coupling the immersive visuals offered by this headset with powerful music and sound from my trusty pair of Sennheiser HD 650 headphones, I was now ready to go adventuring in cyberspace.

I don’t know if 2016 is going to be the year of virtual reality, but since I’ve taken my first step into the VR world, I thought we could use this blog to touch base with developments in the VR world.  We’ll look at a brand new audio tech conference that should be particularly interesting to VR folks.  We’ll also get an overview of a couple of top audio technologies for virtual reality video games.  One of these new technologies pertains directly to Google Cardboard, so that’s where we’ll begin:

Continue reading

Game Music Composer Guide to Upcoming VR Events

VR-Future-Is-Now

In a new report released January 5, 2016, the research analysis firm SuperData issued a forecast of the future of Virtual Reality gaming in the coming year.  Among the results: 5.1 billion dollars are predicted to be spent on VR hardware in 2016, and 55.8 million consumers will have adopted some version of a VR platform by year’s end.  The report also predicts that inexpensive VR gaming on mobile devices will prove the most popular in the short-term, dominating the market in 2016. The report also suggests that small indie studios may benefit by jumping into VR development early (since the top publishers are proving to be a bit more reticent). These are awesome times to be in the video game industry, and there will certainly be lots to learn as we go boldly into the world of VR.  In this blog, I’ve collected information about upcoming video game conferences – some that are already famous and some that are brand new.  These events might help us to learn more about our role in the creation of VR music and audio.

Continue reading

VR for the Game Music Composer – Artistry and Workflow

Since the game audio community is abuzz with popular excitement about the impending arrival of virtual reality systems, I’ve been periodically writing blogs that gather together top news about developments in the field of audio and music for VR.  In this blog we’ll be looking at some resources that discuss issues relating to artistry and workflow in audio for VR:

  • We’ll explore an interesting post-mortem article about music for the VR game Land’s End.  
  • We’ll be taking a closer look at the 3DCeption Spatial Workstation.
  • We’ll be checking out the Oculus Spatializer Plugin for DAWs.

Designing Sound for Virtual Reality

In these early days of VR, postmortem articles about the highs and lows of development on virtual reality projects are especially welcome.  Freelance audio producer and composer Todd Baker has written an especially interesting article about the audio development for the Land’s End video game, designed for the Samsung Gear VR system.

Here, you see me trying out the Samsung Gear VR, as it was demonstrated on the show floor at the Audio Engineering Society Convention in 2015.

Here, you see me trying out the Samsung Gear VR, as it was demonstrated on the show floor at the Audio Engineering Society Convention in 2015.

Todd Baker is best known for his audio design work on the whimsical Tearaway games, and his work as a member of the music composition team for the awesome LittleBigPlanet series. His work on Land’s End for Ustwo Games affords him an insightful perspective on audio for virtual reality. “In VR, people are more attuned to what sounds and feels right in the environment, and therefore can be equally distracted by what doesn’t,” writes Baker.  In the effort to avoid distraction, Baker opted for subtlety in regards to the game’s musical score. Each cue began with a gentle fade-in, attracting little notice at first so as to blend with the game’s overall soundscape in a natural way.

Continue reading