Video Game Composers: The Tech of Music in Virtual Reality (GDC 2018)

Video game composer Winifred Phillips, pictured in her music production studio.

By Winifred Phillips | Contact | Follow

The Game Developers Conference is almost here! I’m looking forward to giving my presentation soon on “Music in Virtual Reality” (Thursday, March 22nd at 3pm in room 3002 West Hall, Moscone Center, San Francisco).  Over the course of the last two years, I’ve composed a lot of music for virtual reality projects, some of which have already hit retail, and some of which will be getting released very soon!  As a result, I’ve spent a lot of time thinking about what role music should play in a virtual reality game. During my GDC talk in March, I’ll be taking my audience through my experiences composing music for four very different VR games –the Bebylon: Battle Royale game from Kite & Lightning, the Dragon Front strategy game from High Voltage Software, the Fail Factory comedy game from Armature Studio, and the Scraper: First Strike RPG-Shooter hybrid from Labrodex Inc.  In preparing my GDC presentation, I made sure my talk addressed some of the most important creative and technical hurdles facing video game composers working in VR.  However, time constraints ensured that some interesting info ended up ‘on the cutting room floor,’ so to speak.  So, I’ve written two articles that explore some of the best topics that didn’t make it into my GDC presentation.

My previous article focused on some abstract, creative concerns facing video game music composers and audio folks working in VR.  In this article, we’ll be turning our attention to more concrete technical issues.  Ready?  Let’s go.

New Binaural Developments

Illustration of popular binaural developments in VR audio, from the article by composer Winifred Phillips for video game composers.VR games currently focus on binaural audio to immerse players in the awesome soundscapes of their virtual worlds.  As we know, binaural recording techniques use two microphones, often embedded in the artificial ears of a dummy head (pictured right).  By virtual of the popular binaural recording technique and/or binaural encoding technologies, game audio teams can plunge VR players into convincing aural worlds where sounds are spatially localized in a way that conforms with real world expectations.  The technology of binaural sound continually improves, and recently the expert developers of the Oculus Rift VR headset have refined the quality of their VR sound with two significant upgrades.

Continue reading

Video Game Composers: The Art of Music in Virtual Reality (GDC 2018)

Video game composer Winifred Phillips, pictured in her music production studio.

 

By Winifred Phillips | Contact | Follow

Once again, the Game Developers Conference is almost upon us!  GDC 2018 promises to be an awesome event, chock full of great opportunities for us to learn and grow as video game music composers.  I always look forward to the comprehensive sessions on offer in the popular GDC audio track, and for the past few years I’ve been honored to be selected as a GDC speaker.  Last year I presented a talk that explored how I built suspense and tension through music I composed for such games as God of War and Homefront: The Revolution.  This year, I’m tremendously excited that I’ll be presenting the talk, “Music in Virtual Reality.” The subject matter is very close to my heart!  Throughout 2016 and 2017, I’ve composed music for many virtual reality projects, some of which have hit retail over the past year, and some of which will be released very soon.  I’ve learned a lot about the process of composing music for a VR experience, and I’ve given a lot of thought to what makes music for VR unique.  During my GDC talk in March, I’ll be taking my audience through my experiences composing music for four very different VR games –the Bebylon: Battle Royale arena combat game from Kite & Lightning, the Dragon Front strategy game from High Voltage Software, the Fail Factory comedy game from Armature Studio, and the Scraper: First Strike Shooter/RPG from Labrodex Inc.  I’ll talk about some of the top problems that came up, the solutions that were tried, and the lessons that were learned.  Virtual Reality is a brave new world for game music composers, and there will be a lot of ground for me to cover in my presentation!

In preparing my talk for GDC, I kept my focus squarely on composition techniques for VR music creation, while making sure to supply an overview of the technologies that would help place these techniques in context.  With these considerations in mind, I had to prioritize the information I intended to offer, and some interesting topics simply wouldn’t fit within the time constraints of my GDC presentation.  With that in mind, I thought it would be worthwhile to include some of these extra materials in a couple of articles that would precede my talk in March.  In this article, I’ll explore some theoretical ideas from experts in the field of VR, and I’ll include some of my own musings about creative directions we might pursue with VR music composition.  In the next article, I’ll talk about some practical considerations relating to the technology of VR music.

Continue reading

Variation for the video game composer: the music of Little Lords of Twilight

Pictured: video game music composer Winifred Phillips at the BKOM booth during GDC 2017.

Since one of my most recent projects, Little Lords of Twilight, became available worldwide earlier this year and was recently greenlit on the famous Steam platform, I thought I’d write this article to share some of my creative and technical process in composing the music for this game. In particular, this project presents a great opportunity to look at how compositional variation (as we understand it from music theory) can be useful for the structure of interactive music.

Developed by BKOM Studios, Little Lords of Twilight won a Best in Play Award at GDC 2017, a Best Designed Mobile App Platinum Award from the BMA Awards, a Communicator Award for Best Mobile App, and has appeared on numerous “Best of” lists, including those published by PocketGamer, Explore Gadgets, and GameInOnline.  As a player-versus-player turn-based strategy game, Little Lords of Twilight offers a unique gameplay mechanic influenced by the in-game passage of time.  Day and night cycles dramatically alter your character’s appearance and abilities. Depending on whether it is currently day or night in the game, your character will have access to a completely different complement of awesome skills and spells to wield on the battlefield.

Continue reading

Composing video game music to build suspense, part 5: semi silence

Winifred Phillips - video game music composer - working on the music of The Da Vinci Code video game in her music production studio.

By Winifred Phillips | Contact | Follow

Welcome to the fifth and final installment of my five-part article series on music composition techniques for stimulating tension and suspense in video games.  These articles are based on the presentation I gave this year at the popular Game Developers Conference in San Francisco, entitled Homefront to God of War: Using Music to Build Suspense.  If you haven’t yet read the previous four articles, you’ll find them here:

Now that we’ve considered the power of Ominous Ambiences, Jarring Jolts, Creepy Clusters, and Drones of Dread, let’s take a look at the last item on our list of suspenseful music composition techniques – Semi Silence.

Continue reading

Composing video game music to build suspense, part 4: drones of dread

Winifred Phillips, video game music composer, at work in her studio on the music of the original God of War.

By Winifred Phillips | Contact | Follow

Welcome to the fourth installment of my five-part article series discussing music composition techniques that heighten tension and suspense for video game projects.  These articles are based on the presentation I gave at this year’s Game Developers Conference in San Francisco, entitled Homefront to God of War: Using Music to Build Suspense.  If you haven’t read the previous three articles, you’ll find them here:

Before we move on to the next music composition technique in our suspense-building arsenal, I’d like to briefly revisit a video game project we discussed in our last article; the popular Dragon Front VR game for the Oculus Rift, developed by High Voltage Software.

Continue reading

Composing video game music to build suspense, part 3: creepy clusters

Winifred Phillips (video game music composer) working in her studio on the music of the Dragon Front video game.

By Winifred Phillips | Contact | Follow

Welcome back to our five part discussion of the role that video game music can play in enhancing tension and promoting suspenseful gameplay!  These articles are based on the presentation I gave at this year’s Game Developers Conference in San Francisco, entitled Homefront to God of War: Using Music to Build Suspense.  If you haven’t read the previous two articles, you’ll find them here:

So, now that we’ve discussed ominous atmospheres and jarring jolts, let’s look at the next technique in our arsenal:

The Creepy Cluster technique

From game composer Winifred Phillips' article on suspenseful game music - an illustration of the 'clusters' technique.As we know, tone clusters are collections of notes packed together to produce unnerving dissonant effects. While it might seem like any cat can walk across a piano and produce unpleasant clusters, well-executed dissonance is actually one of the trickiest techniques we can employ.  It’s tremendously potent when used with expert precision.

Why do human beings respond so intensely to dissonance? Professor Michael Epstein of Northeastern University’s Auditory Modeling and Processing Lab has devoted over 20 years of expert research into why certain sounds have the power to instantly incite and deepen fear in listeners.  He tells Boston Magazine that “common musical intervals, changed slightly to create dissonance, are immediately disconcerting.” According to Epstein, “very precise noises trigger human fear and discomfort.”

Continue reading

Composing video game music to build suspense, part 2: jarring jolts

Winifred Phillips, composer of video game music, shown in her studio working on the music of the Assassin's Creed Liberation video game.

By Winifred Phillips | Contact | Follow

Welcome back to our five-part discussion of some of the best techniques that video game composers can use to enhance tension and promote suspenseful gameplay.  These articles are based on the presentation I gave at this year’s Game Developers Conference in San Francisco, entitled Homefront to God of War: Using Music to Build Suspense.  If you haven’t read our previous discussion of Ominous Ambiences in part one of this series, please go check that article out.

Are you back?  Good!  Let’s continue!

We’ve already talked about how to create an edgy, ominous atmosphere. By carefully nurturing the player’s suspense and anxiety, we can prime the player with an assortment of quietly unnerving sounds, until the player is perfectly ready for…

The Jarring Jolt technique

This is the second technique we’ll be discussing in our five-part article series on the role of music in building suspense. Like the Ominous Ambience (which we discussed in part one), the Jarring Jolt also owes a debt to the expert work of sound designers.  In fact, the Ominous Ambience and the Jarring Jolt are fairly interdependent. One doesn’t work that well without the other.

Continue reading

Composing video game music to build suspense, part 1: ominous ambience

Winifred Phillips (video game composer), working in her studio on the music of the Homefront: The Revolution video game.

By Winifred Phillips | Contact | Follow

At this year’s Game Developers Conference in San Francisco, I was honored to give a presentation entitled Homefront to God of War: Using Music to Build Suspense.  While I’ve certainly discussed techniques for building suspense in this blog before, the talk I gave at GDC expanded significantly on that discussion and included lots more research and practical examples that we haven’t previously examined here.  With that in mind, I’m excited to begin a five-part article series based on my GDC 2017 presentation!  During the course of these five articles, we’ll be taking a look at some of the best techniques that enable video game music composers to introduce suspense into their music, control tension levels during gameplay and keep players engaged.

So, let’s start by defining the core concept.  What exactly is suspense?

A physiological reaction

We all can agree that music is one of the most effective ways to produce emotional reactions. But suspense, particularly in the field of game development, isn’t just about an emotional state. It’s also a unique physiological reaction – a tension rising out of the uncertainty that we’re encountering during gameplay.

Continue reading

More Business Advice for the Game Music Composer

Winifred Phillips (video game composer) working in her music studio.Every so often, I like to grab some time between music composition gigs to gather together the current general wisdom regarding career strategies for game music composers (since so many of my readers are new to the industry and looking for guidance).  In this article, I’ve included some of the stand-out ideas garnered from three online resources – a Gamasutra article by a former audio designer for Rockstar North, an awesome discussion thread on Reddit about effective communication strategies (found in the GameAudio subreddit), and a roundtable discussion at GameSoundCon about best business practices for game audio pros.

Make some noise! Getting a job creating sound and music for videogames

Audio Director Will Morton of Solid Audioworks (formerly a senior audio designer and dialogue supervisor at the famous Rockstar North development studio), has written a comprehensive article for the game industry site Gamasutra about getting jobs in the game audio field.  The article, entitled “Make Some Noise! Getting a Job Creating Sound and Music for Videogames,” focuses on the importance of experience, networking and a polished presentation in order to sufficiently impress a potential employer/client.  While much of the article is solid advice that might apply to a job seeker in any industry, a few areas impressed me as particularly interesting for game composers to bear in mind.

Continue reading

Video game composers can make you smarter! (The music of Dragon Front) Pt. 3

Winifred Phillips, video game music composer, pictured at the GDC 2016 display for the Dragon Front virtual reality game.

By Winifred Phillips | Contact | Follow

Welcome to the third (and final) article in this three-part discussion of how video game composers (like us) can make strategy gamers smarter!  We’ve been exploring the best ways that the music of game composers can help strategy gamers to better concentrate while making more sound tactical decisions. During this discussion, I’ve shared my personal perspective as the composer for the popular Dragon Front strategy game for VR.

In part one, we discussed the concept of ‘music-message congruency,’ so if you haven’t read that article yet, you can read it here.  In part two, we explored the meaning of ‘cognition-enhancing tempo’ – you can read that article here.  Please make sure to read both those articles first and then come back.

Are you back?  Awesome!  Let’s launch into a discussion of the third technique for increasing the smarts of strategy gamers!

Tension-regulating affect

From the article by game composer Winifred Phillips, an illustration of 'psychological affect.'In psychology, the term ‘affect’ refers to emotion, particularly in terms of the way in which such emotional content is displayed.  Whether by visual or aural means, an emotion can not be shared without some kind of ‘affect’ that serves as its mode of communication from one person to another.  When we’re happy, we smile.  When we’re angry, we frown.

Continue reading