The Game Developers Conference is almost here! I’m looking forward to giving my presentation soon on “Music in Virtual Reality” (Thursday, March 22nd at 3pm in room 3002 West Hall, Moscone Center, San Francisco). Over the course of the last two years, I’ve composed a lot of music for virtual reality projects, some of which have already hit retail, and some of which will be getting released very soon! As a result, I’ve spent a lot of time thinking about what role music should play in a virtual reality game. During my GDC talk in March, I’ll be taking my audience through my experiences composing music for four very different VR games –the Bebylon: Battle Royale game from Kite & Lightning, the Dragon Front strategy game from High Voltage Software, the Fail Factory comedy game from Armature Studio, and the Scraper: First Strike RPG-Shooter hybrid from Labrodex Inc. In preparing my GDC presentation, I made sure my talk addressed some of the most important creative and technical hurdles facing video game composers working in VR. However, time constraints ensured that some interesting info ended up ‘on the cutting room floor,’ so to speak. So, I’ve written two articles that explore some of the best topics that didn’t make it into my GDC presentation.
My previous article focused on some abstract, creative concerns facing video game music composers and audio folks working in VR. In this article, we’ll be turning our attention to more concrete technical issues. Ready? Let’s go.
New Binaural Developments
VR games currently focus on binaural audio to immerse players in the awesome soundscapes of their virtual worlds. As we know, binaural recording techniques use two microphones, often embedded in the artificial ears of a dummy head (pictured right). By virtual of the popular binaural recording technique and/or binaural encoding technologies, game audio teams can plunge VR players into convincing aural worlds where sounds are spatially localized in a way that conforms with real world expectations. The technology of binaural sound continually improves, and recently the expert developers of the Oculus Rift VR headset have refined the quality of their VR sound with two significant upgrades.
Recently, I’ve been composing music for some VR projects (more info on that soon), so I’ve been giving virtual reality a lot of thought, and have simultaneously been writing some articles here on the subject. Those have included a discussion of some interesting uses of virtual reality technology to benefit and inspire video game composers, and some of the top issues of concern for video game music composers and game audio folks creating content for VR projects.
In this article I’d like to turn our attention towards the experience of the end user, and specifically, the primary interface with which users will be enjoying our audio content. So, let’s talk about headphones! More specifically, let’s talk about the newest incarnation of this device… headphones built specifically for VR!
This will be a two-part article (since there’s a lot of ground to cover!) In part one, we’ll be discussing these two headphone models:
- OSSIC X
- CEEKARS 4D
So let’s get started!
In this blog, I thought we might take a quick look at the development of the three dimensional audio technologies that promise to be a vital part of music and sound for a virtual reality video game experience. Starting from its earliest incarnations, we’ll follow 3D audio through the fits and starts that it endured through its tumultuous history. We’ll trace its development to the current state of affairs, and we’ll even try to imagine what may be coming in the future! But first, let’s start at the beginning:
3D Audio of the Past
In the 1930s, English engineer and inventor Alan Blumlein invented a process of audio recording that involved a pair of microphones that were coincident (i.e. placed closely together to capture a sound source). Blumlein’s intent was to accurately reflect the directional position of the sounds being recorded, thus attaining a result that conveyed spatial relationships in a more faithful way. In reality, Blumlein had invented what we now call stereo, but the inventor himself referred to his technique as “binaural sound.” As we know, stereo has been an extremely successful format, but the fully realized concept of “binaural sound” would not come to fruition until much later.