VR Game Composer: Music Inside the Machine

Illustration for an article in the VR Game Composer series, written by video game composer Winifred PhillipsWelcome to part two of our ongoing exploration of some interesting possibilities created by the motion tracking capabilities of VR, and how this might alter our creative process as video game composers.

In part one we discussed how motion tracking lets us be awesome air guitarists and drummers inside the virtual space.  In this article, we’ll be taking a look at how the same technology will allow us to make interesting music using more serious tools that are incorporated directly inside the VR environment – musical instruments that exist entirely within the VR ‘machine.’

Our discussion to follow will concentrate on three software applications: Soundscape, Carillon, and Lyra.  Later, in the third article of this ongoing series, we’ll take a look at applications that allow our VR user interfaces to harness the power of MIDI to control some of the top music devices and software that we use in our external production studios. But first, let’s look at the ways that VR apps can function as fully-featured musical instruments, all on their own!

Soundscape

Let’s start with something simple – a step sequencer with a sound bank and signal processing tools, built for the mobile virtual reality experience of the Samsung Gear VR.

Video game composer Winifred Phillips demonstrating the Samsung Gear VR headset during the AES convention in NYC.I got a chance to demo the Samsung Gear VR during the Audio Engineering Society Convention in NYC last year, and while it doesn’t offer the best or most mind-blowing experience in VR (such as what we can experience from products like the famous Oculus Rift), it does achieve a satisfying level of immersion. Plus, it’s great fun!  The Soundscape VR app was built for Samsung Gear VR by developer Sander Sneek of the Netherlands.  It’s a simple app designed to enable users to create dance loops using three instruments from a built-in electro sound library, a pentatonic step sequencer that enables the user to create rhythm and tone patterns within the loops, and a collection of audio signal processing effects that let the user warp and mold the sounds as the loops progress, adding variety to the performance.

Continue reading →

VR Game Composer: Music in the Air

Illustration for the article by game music composer Winifred Phillips, entitled "VR Game Composer: Music in the Air"Since I’ve been working recently on music for a Virtual Reality project (more info in the coming months), I’ve been thinking a lot about VR technology and its effect on the creative process.  Certainly, VR is going to be a great environment in which to be creative and perform tasks and skills with enhanced focus, according to this article from the VR site SingularityHub.  I’ve written in this blog before about the role that music and sound will play in the Virtual Reality gaming experience.  It’s clear that music will have an impact on the way in which we experience VR, not only during gaming experiences, but also when using the tools of VR to create and be productive.  With that in mind, let’s consider if the opposite statement may also be true – will VR impact the way in which we experience music, not only as listeners, but also as video game composers?

Game composer Winifred Phillips tries out the VR experience of Google Cardboard (pictured here in her music production studio).Simple VR technologies like the popular Google Cardboard headset can be a lot of fun – as I personally experienced recently (photo to the left).  However, they offer only the rudimentary visual aspects, which omits some of the most compelling aspects of the VR experience.  When motion tracking (beyond simple head movement) is added to the mix, the potential of VR explodes.  Over the next three articles, we’ll be exploring some interesting possibilities created by the motion tracking capabilities of VR, and how this might alter our creative process.  In the first article, we’ll have some fun exploring new ways to play air guitars and air drums in the VR environment. In the second article, we’ll take a look at ways to control virtual instruments and sound modules that are folded into the VR software.  And finally, in the third article we’ll explore the ways in which VR motion tracking is allowing us to immersively control our existing real-world instruments using MIDI. But first, let’s take a look at the early days of VR musical technology!

Continue reading →

How Music Can Intensify Video Games, Part Two

Welcome back to our two-part exploration of the role of tension and intensity in a musical score, and the techniques that can best and most effectively accentuate our audience’s nervous excitement.  If you haven’t read Part One yet, please read that article first, and then come back for the continuation of our discussion.

Video game composer Winifred Phillips, composing music for the triple-A first person shooter HOMEFRONT: THE REVOLUTION in her music studio.In Part One we explored how popular narrative genres such as horror benefit from a tense musical score, and we studied effective techniques for horror music composition as a model for musical tension-building in any narrative genre. We learned about some techniques from the world of sound design that can add intensity and emotional pressure to our music. We listened to a couple of musical examples that I composed as a member of the music team for Homefront: The Revolution (pictured right).  We also consulted the opinions of some top experts in the field to better understand how amplifying tension can make any story feel like a more awesome, satisfying experience.  Now, let’s move on to the more musical meat-and-bones of the topic: the actual harmonic textures and chord structures of our compositions.

Continue reading →

How Music Can Intensify Video Games: Part One

Tension has always served a crucial role in music composition and performance.  My next two blog articles will focus on how music works to shape tension and intensity in a dramatic presentation such as a video game.

Composer Winifred Phillips, working on music for Homefront: The Revolution in her music studio.During these blogs, we’ll be consulting with lots of top experts on the subject, and I’ll be sharing my experiences in regards to the tension-filled music that I composed as a member of the music team of Homefront: The Revolution – an open world, triple-A first person shooter game that was just released by Deep Silver/Dambuster Studios.  Along the way we’ll check out some excerpts from music tracks I composed (in my music production studio, pictured right) for Homefront: The Revolution, and we’ll talk about multiple techniques to build tension in a piece of music, with the goal of inciting the most emotional intensity possible in our audience. With that in mind, let’s start things off with a great quote from philosopher Henry David Thoreau:

“The fibers of all things have their tension and are strained like the strings of an instrument.”

Image illustrating anxiety (from the article by award-winning video game composer Winifred Phillips)Thoreau not only saw the connection between music and tension, but also made a good point about the stresses and strains in our lives – we all possess our own inner emotional pressure. The more fervently we pursue our goals and struggles, the higher the tension grows. Taken to the extreme, it can feel as though our insides are wound up as taut as clockworks. As game composers, our job has always been to induce players to care about what’s happening in the game, and that includes inciting and escalating the nervous anxiety associated with an awesome investment of emotion and empathy.  So let’s explore the best ways we can make players feel the tension!

Continue reading →

Interactive Music for the Video Game Composer

Game Composer Winifred Phillips works in her studio on the music of the popular Spore Hero video game As a speaker in the audio track of the Game Developers Conference this year, I enjoyed taking in a number of GDC audio sessions — including a couple of presentations that focused on the future of interactive music in games.  I’ve explored this topic before at length in my book (A Composer’s Guide to Game Music), and it was great to see that the game audio community continues to push the boundaries and innovate in this area! Interactive music is a worthwhile subject for discussion, and will undoubtedly be increasingly important in the future as dynamic music systems become more prevalent in game projects.  With that in mind, in this blog I’d like to share my personal takeaway from two sessions that described very different approaches to musical interactivity. After that, we’ll discuss one of my experiences with interactive music for the video game Spore Hero from Electronic Arts (pictured above).

Musical Intelligence

Baldur BaldurssonPhoto of Baldur Baldursson, the audio director for Icelandic game development studio CCP Games (part of the article by game composer Winifred Phillips) (pictured left) is the audio director for Icelandic game development studio CCP Games, responsible for the EVE Online MMORPG.  Together with Professor Kjartan Olafsson of the Iceland Academy of Arts, Baldursson presented a talk at GDC 2016 on a new system to provide “Intelligent Music For Games.”

Baldursson began the presentation by explaining why an intelligent music system for games can be a necessity.  “We basically want an intelligent music system because we can’t (or maybe shouldn’t really) precompose all of the elements,” Baldursson explains. He describes the conundrum of creating a musical score for a game whose story is still fluid and changeable, and then asserts,  “I think we should find ways of making this better.”

Continue reading →

Comedic Sound for the Game Music Composer

In this week’s blog, I’d like to explore the role that comedy can play in a video game, and how we as game composers can use some of the techniques from comedic sound design to our best advantage.  Along the way, we’ll be looking at an interesting essay article by pop culture critic Christopher Gates, a presentation by game sound designer Luca Fusi at the December 2015 Vancouver Sound Design Meetup, and an interview with film sound designer Chris Scarabosio.

Game Composer Winifred Phillips works in her studio on the music of The Maw video game.I’ll also be sharing some of my experiences applying comedic sound design techniques during music composition for the video game The Maw – an award-winning and very funny game that was developed by Twisted Pixel Games.  To the left, you can see that I’m working hard to give The Maw its proper dose of comedic wackiness… but more on that later.

First, let’s get a broad perspective on the role of comedy in gaming.

Continue reading →

From Total War to Assassin’s Creed: Music from my GDC Talk

From Total War to Assassin's Creed: Music from my GDC Talk (article by Winifred Phillips, video game composer)Last week, it was my honor and pleasure to give a presentation at the Game Developers Conference in San Francisco. My talk was entitled “From Total War to Assassin’s Creed: Music for Mobile Games.” The talk focused on the best and most effective methods for composition and implementation of music in portable gaming.  The talk was structured for the benefit of video game composers and game audio pros, and as a part of the presentation, I played short excerpts of music that I composed for several of my top mobile and handheld video game projects. Now that GDC is over, I thought I’d provide streaming links to some of the complete music tracks that I featured during my presentation, in case attendees were curious about the complete pieces of music. So, without further ado, here are tracks from my GDC 2016 talk!

Assassin’s Creed Liberation

The Assassin’s Creed Liberation game was released by Ubisoft for the PlayStation Vita, and delivered an immersive experience from the popular Assassin’s Creed franchise. The game was designed specifically for a portable system, and as such, all aspects of the design were adjusted to cater specifically to a portable gaming experience, including the music.

Game composer Winifred Phillips speaking about the music of Assassin's Creed Liberation at GDC 2016

Continue reading →

Video Game Music Concert Tours

Colbert presents The Legend of Zelda Concert (article by Winifred Phillips, video game composer)This week I thought we’d check in with some of the top orchestral video game music concert tours currently underway.  We’ll take a look at some reviews of 2015 performances from the respective tours, and we’ll also take a look at video from some of the most recent concert performances.

The Legend of Zelda: Symphony of the Goddesses

Legend of Zelda Symphony of the Goddesses marquee (article by game composer Winifred Phillips)Originating as a simple four-minute overture performed at a Nintendo press event in 2011, Symphony of the Goddesses kicked off as a full-fledged concert tour in January 2012 and currently has 33 dates scheduled for 2016 that will take the popular tour all around the world.  The concert’s program lineup focuses exclusively on famous music from the Legend of Zelda games.  In a review of the September 25th 2015 performance at the Providence Performing Arts Center in Rhode Island, Broadway World critic Andria Tieman wrote, “Overall, this was a night of fantastic music, excellent people-watching and a fun, visual performance. This is something that Zelda fans should certainly seek out.” Here’s a video clip from the Oct. 30th 2015 broadcast of the Late Show with Stephen Colbert, in which the Symphony of the Goddesses tour performed their Legend of Zelda Medley:

Continue reading →

VR Audio: Past, Present & Future

VR Audio (article by award winning video game music composer Winifred Phillips)In this blog, I thought we might take a quick look at the development of the three dimensional audio technologies that promise to be a vital part of music and sound for a virtual reality video game experience. Starting from its earliest incarnations, we’ll follow 3D audio through the fits and starts that it endured through its tumultuous history.  We’ll trace its development to the current state of affairs, and we’ll even try to imagine what may be coming in the future!  But first, let’s start at the beginning:

3D Audio of the Past

Alan Blumlein (article by award winning video game music composer Winifred Phillips)In the 1930s, English engineer and inventor Alan Blumlein invented a process of audio recording that involved a pair of microphones that were coincident (i.e. placed closely together to capture a sound source).  Blumlein’s intent was to accurately reflect the directional position of the sounds being recorded, thus attaining a result that conveyed spatial relationships in a more faithful way.  In reality, Blumlein had invented what we now call stereo, but the inventor himself referred to his technique as “binaural sound.”  As we know, stereo has been an extremely successful format, but the fully realized concept of “binaural sound” would not come to fruition until much later.

Continue reading →

VR for the Game Music Composer – What’s New?

google-cardboard_winifred-phillipsRecently I bought my first VR headset, and since then I have been adventuring in the world of virtual reality courtesy of Google Cardboard. For something as high tech and impressive as the VR experience, Google Cardboard makes the whole process easy, low-cost and accessible.  While Google provides instructions for users who’d like to make their own headsets from scratch using simple craft materials, I opted to purchase a version made by the good folks at IMCardboard.com.  Pictured to the right, you see me wearing their EVA 2.0 headset, made from a rubber-like material that’s very comfortable and lightweight.  Despite the more sophisticated look and materials, this headset still adheres to the Google Cardboard specs in terms of its design.  Coupling the immersive visuals offered by this headset with powerful music and sound from my trusty pair of Sennheiser HD 650 headphones, I was now ready to go adventuring in cyberspace.

I don’t know if 2016 is going to be the year of virtual reality, but since I’ve taken my first step into the VR world, I thought we could use this blog to touch base with developments in the VR world.  We’ll look at a brand new audio tech conference that should be particularly interesting to VR folks.  We’ll also get an overview of a couple of top audio technologies for virtual reality video games.  One of these new technologies pertains directly to Google Cardboard, so that’s where we’ll begin:

Continue reading →