VR Headphones Update 2018: Video Game Music Composers

In this article written for video game composers, Winifred Phillips (composer of music for God of War) is here pictured working in her music production studio.

By Winifred Phillips | Contact | Follow

Glad you’re here!  I’m videogame composer Winifred Phillips.  My work as a game music composer has included music for projects released on nearly all of the gaming platforms, from one of my most recent projects (a Homefront game released on all the latest consoles and PCs) to one of my earliest projects (a God of War game released on PlayStation 2, PlayStation 3, and PlayStation Vita, pictured above).  An image of the September 2018 cover of Music Connection Magazine featuring the article "Video Game Composers Speak!" - features interviews of famous game music composers, including popular game music composer Winifred Phillips.You can read about my work as a video game composer in an interview I gave to Music Connection Magazine for this month’s issue (pictured right).

Lately, I’ve also been creating lots of video game music for awesome virtual reality games developed for the Oculus Rift, Oculus Go, HTC Vive, Samsung Gear VR, PlayStation VR, and lots of other top VR platforms.  One of the things I’ve noticed while working in VR is the immense importance of the audio delivery mechanism.

When audio is painstakingly spatialized, it becomes crucial to convey that carefully-crafted spatialization to the player with as little fidelity loss as possible.  With the importance of this issue in mind, for the past few years I’ve been periodically writing about headphones in relation to their use in virtual reality.

Illustration depicting a set of headphones, from the article by Winifred Phillips for video game composersAs game audio experts, we want to make sure that players are using the best kind of headphones, so that our work isn’t distorted or deteriorated.  To that end, in these articles we’ve been taking a look at new types of headphones that offer technology designed to enhance the VR experience.  We’ve also been considering how consumers use headphones, and some end-user problems that might come up along the way.  In this article, I’d like to revisit some topics we first touched upon in previous years, so that we can see how that tech is progressing.  Let’s get started!

Audeze iSINE

Audeze debuted its iSINE Virtual Reality Headphones in January 2017 at the Consumer Electronics Show in Las Vegas. These in-ear headphones touted planar magnetic technology as the driving factor behind their ability to deliver more convincing 3D audio for VR. While most headphones deliver sound by virtue of the standard dynamic driver (a.k.a. the moving coil driver), iSINE has focused its attention on planar magnetic technology.  For a discussion of what planar magnetic technology offers and why it may be significant to the VR gamer, you can read about the Audeze iSINEs in my article from last year.

A depiction of the Mobius headphones created by the popular Audeze manufacturer, from the article for video game composers by Winifred Phillips (game music composer).So, what’s new with Audeze?  Well, Audeze has taken their product line one step further by announcing a new set of over-the-ear headphones that they’re branding as the ultimate headphones for gamers.  The Audeze Mobius headphones (pictured right) bring the planar magnetic technology forward into a dedicated gaming product, featuring the enhanced clarity of spatialization that makes this tech uniquely applicable to VR uses. While the Mobius headphones can also simulate surround sound, gamers will want to turn that function off when using these headphones in VR.  Along with the sound quality and increased spatialization promised by the planar magnetic drivers, the Mobius also features 3D head-tracking and a detachable microphone for in-game chat.  All these specs come at a price, however, and the Mobius headphones will be selling for $399 when they begin shipping to consumers at the end of September.  This might seem steep, but coming from a high-end headphone manufacturer whose top-of-the-line models sell for nearly four thousand dollars, the pricing for the Audeze Mobius is relatively accessible.  Here’s a video produced by Engadget about the Audeze Mobius:

Audeze completed an Indiegogo campaign for the Mobius in March, raising over a million dollars from over four thousand backers. It will be interesting to see if a Mobius success story might inspire more manufacturers of gaming headphones to begin incorporating planar magnetic technology into their products.  Of course, we can’t forget that crowdfunding campaigns can be risky (as shown by the unfortunate story of the OSSIC X later in this article), but since Audeze is an established headphone manufacturer with a well-known track record, we shouldn’t have to worry about the Mobius failing to ship.  For a very different story, let’s now get an update on the fate of two prototype VR headphones we discussed a year ago.

The OSSIC X and the Entrim 4D

I have the sad duty to report on the demise of two promising headphone models.  These products announced themselves during the height of popular enthusiasm for the nascent VR industry, and for awhile it seemed like they had seized their opportunity at just the right time.  Let’s start off the discussion with the OSSIC X.

OSSIC X

In this article for video game composers, Winifred Phillips explains the circumstances behind the premature demise of the famous OSSIC X headphones.Back in 2016, I first wrote about the OSSIC X headphones, which were being described by OSSIC founder and CEO Jason Riggs as the “Oculus for audio headphones.”  When the Kickstarter campaign for OSSIC X netted a whopping $2.7 million dollars in April 2016, the press began hailing the famous prototype headphones for their historic achievement in breaking Oculus’ record as the largest VR crowdfunding campaign to date.  OSSIC followed this up with an additional $500 thousand dollar Indiegogo campaign, and everything looked promising for awhile.  The headphones were purported to calibrate to each wearer’s unique ears by virtue of what the OSSIC folks were calling “individual anatomy calibration.”  Using eight discrete drivers, the headphones would be able to play back sound to the correct portion of the ear, fully simulating the natural Head Related Transfer Functions of each wearer.  For a fuller explanation of Head Related Transfer Functions, check out this article I wrote back in 2015.

A year later, I checked back in with the OSSIC X to see how things were going, and I interviewed OSSIC’s creative director Sally Kellaway.  We discussed some of the features of the forthcoming headphones, and Kellaway clarified a few issues in regards to the required developer-side plugin that would enable a VR game to fully avail itself of the OSSIC X’s Head Related Transfer Functions.  While all these details painted an appealingly sunny and optimistic picture for the OSSIC X, some dark clouds were beginning to appear on the horizon.

OSSIC began announcing delays in their production schedules, and prospective purchasers discovered that they could no longer pre-order the product. Then, in April the company raised an additional $100 thousand dollars on the StartEngine crowdfunding site as they prepared their product for mass production.  Why was OSSIC going back into fundraising mode at this stage?

Capture from the popular Kickstarter page for the OSSIC X headphones, in the article written by Winifred Phillips for video game composers.A month later, all these portents of doom were fully realized.  On May 19th 2018, OSSIC announced via its Kickstarter and Indiegogo pages that it would be unable to deliver the OSSIC X headphones it had promised (as pictured right).  So, what went wrong?  After an historically successful crowdfunding campaign, OSSIC managed to fully design the product and ship just eighty units to some developers and a few early backers.  With only a smattering of units delivered, the OSSIC team explained that “the product still requires significantly more capital to ramp to full mass production, and the company is out of money.”  Whereupon OSSIC abruptly shuttered its company, leading to an outcry from the tens of thousands of product backers who had contributed over $3.7 million dollars to the crowdfunding campaign.  The Washington Post published an article about the failure of the OSSIC X to keep its mass production promises, and backers of the OSSIC X launched a Facebook page for a planned class-action lawsuit.

The situation couldn’t be any messier, or sadder.  The OSSIC folks had an intriguing idea regarding customized HRTF and increased fidelity of spatialization.  Perhaps another company will take up these ideas and execute them with a more cautious and frugal business plan.  The story of the OSSIC X may provide a useful case study, as well as a cautionary tale, to those audio technology companies who may aspire to create a revolutionary headphone product for VR.

Entrim 4D

Depiction of the Entrim 4D headphone system, from the article by Winifred Phillips for video game composersThen there’s the story of the Entrim 4D. First announced by Samsung over two years ago, we initially discussed the Entrim 4D headphones in an article from September 2016.  Like the OSSIC X, the Entrim 4D headphones are designed specifically for VR.  However, that’s where any similarities end.  Unlike other headphones, the Entrim 4D wasn’t designed to blaze new trails in audio quality and spatialization.  Instead, they were designed to literally rock our world.

The Entrim 4D directs low level electrical impulses into the wearer’s inner ear in a process known as Galvanic Vestibular Stimulation.  Once these impulses reach the nerve regulating balance, they work to create the illusion that the wearer is moving.  Depending on the nature of the pulses, the wearer may feel varying types of movement, and these sensations can be customized to match the kinetic activities within a VR environment.  In other words, the Entrim 4D claimed to solve the inherent problem causing VR nausea – that our visually-perceived movements do not match our physically-perceived movements.

The Entrim 4D headphones made a few appearances at some technology conventions such as SXSW 2016 and the Samsung Developers Conference. And then… nothing.  If you’ve been a regular reader of these articles, you’ll recall that we’ve been revisiting this subject periodically to see if the Entrim 4D headphones might eventually pop up again in the news, or make another appearance at a technology event.  At this point, with such a long period of silence firmly behind us, I think we can comfortably draw the conclusion that the Entrim 4D headphones will not be seeing a retail release.

An animated illustration of the vMocion 3v system of Galvanic Vestibular Stimulation, from the article for video game composers by Winifred Phillips (game music composer).However, that doesn’t mean that the idea of Galvantic Vestibular Stimulation in VR has been abandoned.  During the most recent SIGGRAPH conference, an Osaka University team lead by Dr. Kazuma Aoyama demonstrated a system called GVS RIDE that uses Galvanic Vestibular Stimulation to induce the sensations of roll, pitch, and yaw.  The GVS RIDE consists of a set of four electrodes delivering pulses to influence the vestibular system.  Similarly, the VMocion 3v System (pictured above) also uses a set of four electrodes to induce the sensation of physical movement within VR. Developed by the Mayo Clinic’s Aerospace Medicine and Vestibular Research laboratory team in Arizona, the VMocion 3v system is currently available for license to VR game studios.  Here’s a video produced by the makers of the VMocion 3v System to explain the virtues of Galvanic Vestibular Stimulation:

 

While all these developments are intriguing, they unfortunately don’t involve any sort of integration into audio headphones (as the Entrim 4D would have).  So at this point, let’s move on to an entirely different topic relating to the use of audio headphones in VR.

The Headphones Problem

In this article for video game composers, Winifred Phillips discusses the incompatible technologies of Surround Sound systems and the famous Virtual Reality platforms.Back in 2015 I wrote about a tricky issue associated with the use of headphones in VR… or, more specifically, a popular misperception about the use of headphones in VR.  At the time, I’d noticed that many gamers and game journalists were recommending surround sound headphones for VR use.  This is, as we know, completely wrong.  Surround sound (as pictured left) interferes with the binaural signal of the VR game, degrading the quality of the positional audio that the game is trying to deliver.  Back in 2015, the message hadn’t really gotten out that surround sound headphones are incompatible with VR.  In fact, there was some confusion regarding what the difference was between surround sound and other formats (binaural, ambisonic, etc).  This kind of confusion is exactly what leads consumers to waste money on expensive surround sound headphones for use with their brand-new VR rig.  So, as a part of this update article, I thought I’d revisit the issue and see if the situation has improved.  Are people still talking about surround-sound formats and spatialized VR audio as though they’re the same thing?

Well, the problem certainly hasn’t gone away.  For instance, Scientific American published an article last year about advances in VR sound with the title “New VR Tech Aims to Take Surround-Sound to the Next Level.”  The article itself discusses the importance of headphone-delivered spatial audio in achieving a sensation of presence in virtual reality.  The title, however, serves to perpetuate a misconception that surround sound and other types of spatial audio are essentially synonymous when used with headphones, when they are definitely not.  These kind of false equivalencies continue to be drawn by publications such as The Verge, which described ambisonics as a “full-sphere surround sound technique,” that works to “trick your brain” into “assigning positions and distance to sounds, even when wearing something like headphones.”  Describing ambisonics as a “surround sound technique” and suggesting that this surround sound works great in VR when you’re wearing headphones is a problem – it may confuse players into thinking that surround-sound headphones are viable for VR.  In a similar vein, the technology site Tech.co began an article about VR gaming by suggesting that the reader might “put on a VR headset and add over-ear 7.1 surround sound headphones.”  We all know that applying 7.1 surround sound encoding to VR audio would seriously degrade the sound quality.

And, of course, let’s not forget the products that are still on the market, claiming to enhance the experience of VR by virtue of surround sound headphone technology.  As a fun example, let’s look at a bizarre product advertising itself as an ideal solution for VR sound.  Illustration of the HaloSurround product, from the article written by Winifred Phillips for video game composers.The ‘HaloSurround‘ (pictured) has an amusingly peculiar visual aesthetic.  It combines a set of in-ear headphones with a black hoop-shaped contraption worn on the top of the head like a hat.  Resembling a ‘halo’ only in the vaguest sense, the HaloSurround headphones deliver 5.1 surround sound through the six speakers mounted inside the ‘halo’ perched on top of the wearer’s head.

Just to complete the overall weirdness of this product, the HaloSurround is available in a model that includes its own Google Cardboard-style VR headset designed for “VR apps”.  So again, what we’re seeing here is a false connection drawn between surround-sound headphones and VR.

At the moment, it seems that most gamers are resorting to online forums to sort out their confusion in regards to whether surround sound headphones should be used in VR.  While the PlayStation VR has always included information about this in the FAQ area of their web site, the Oculus and HTC Vive sites offer no easily-discernible guidance on this issue.  Considering how much effort and care are devoted to the creation of convincing aural worlds for VR, it would be a shame if some players missed out on the experience because they were using the wrong headphones.  I’ll be keeping an eye on this issue, in the hopes that some more definitive guidance may be forthcoming from the VR headset manufacturers.

Conclusion

In this article we’ve revisited topics of interest connected to VR headphones, and we’ve been brought up to speed on current developments with several headphone models.  In my next article, I’ll be exploring what’s brand new in the world of headphones for VR.  In the meantime, please feel free to share your thoughts in the comments section below!

 

Photo of video game composer Winifred Phillips in her music production studio.Winifred Phillips is an award-winning video game music composer whose recent projects include the triple-A first person shooter Homefront: The Revolution.  Her latest video game credits also include numerous Virtual Reality games, including Scraper: First Strike, Bebylon: Battle Royale, Fail Factory, Dragon Front, and many more. She has composed music for games in five of the most famous and popular franchises in gaming: Assassin’s Creed, LittleBigPlanet, Total War, God of War, and The Sims. She is the author of the award-winning bestseller A COMPOSER’S GUIDE TO GAME MUSIC, published by the MIT Press. As a VR game music expert, she writes frequently on the future of music in virtual reality games. Follow her on Twitter @winphillips.

Composing video game music for Virtual Reality: Comfort versus performance

In this article series for video game composers, Winifred Phillips is depicted in this photo working in her music production studio.

By Winifred Phillips | Contact | Follow

Delighted you’re here!  I’m videogame composer Winifred Phillips, and I’m happy to welcome you back to this four-part article series exploring the role of music in VR games! These articles are based on the presentation I gave at this year’s game Developer’s Conference in San Francisco, entitled Music in Virtual Reality (I’ve included the official description of my talk at this end of this article). If you haven’t read the previous three articles, you’ll find them here:

During my GDC presentation, I focused on three important questions for VR game music composers:

  • Do we compose our music in 3D or 2D?
  • Do we structure our music to be Diegetic or Non-Diegetic?
  • Do we focus our music on enhancing player Comfort or Performance?

In the course of exploring these questions during my GDC presentation, I discussed my work on four of my own VR game projects –the Bebylon: Battle Royale arena combat game from Kite & Lightning, the Dragon Front strategy game from High Voltage Software, the Fail Factory comedy game from Armature Studio, and the Scraper: First Strike shooter/RPG from Labrodex Inc.

Continue reading

Composing video game music for Virtual Reality: Diegetic versus Non-diegetic

In this article for and about the craft of video game composers, Winifred Phillips is pictured in this photo working in her music production studio.

By Winifred Phillips | Contact | Follow

So happy you’ve joined us!  I’m videogame composer Winifred Phillips.  Welcome back to our four part discussion of the role that music plays in Virtual Reality video games! These articles are based on the presentation I gave at this year’s gathering of the famous Game Developer’s Conference in San Francisco.  My talk was entitled Music in Virtual Reality (I’ve included the official description of my talk at this end of this article). If you haven’t read the previous two articles, you’ll find them here:

During my GDC presentation, I focused on three important questions for VR video game composers:

  • Do we compose our music in 3D or 2D?
  • Do we structure our music to be Diegetic or Non-Diegetic?
  • Do we focus our music on enhancing player Comfort or Performance?

While attempting to answer these questions during my GDC talk, I discussed my work on four of my own VR game projects – the Bebylon: Battle Royale arena combat game from Kite & Lightning, the Dragon Front strategy game from High Voltage Software, the Fail Factory comedy game from Armature Studio, and the Scraper: First Strike shooter/RPG from Labrodex Inc.

In these articles, I’ve been sharing the discussions and conclusions that formed the basis of my GDC talk, including numerous examples from these four VR game projects.  So now let’s look at the second of our three questions:

Continue reading

Composing video game music for Virtual Reality: 3D versus 2D

In this article written for video game composers, Winifred Phillips is here pictured working in her music production studio.

Welcome!  I’m videogame composer Winifred Phillips, and this is the continuation of our four-part discussion of the role that music can play in Virtual Reality video games.  These articles are based on the presentation I gave at this year’s Game Developer’s Conference in San Francisco, entitled Music in Virtual Reality (I’ve included the official description of my talk at this end of this article).  If you missed the first article exploring the history and significance of positional audio, please go check that article out first.

Are you back?  Great!  Let’s continue!

During my GDC talk, I addressed three questions which are important to video game music composers working in VR:

  • Do we compose our music in 3D or 2D?
  • Do we structure our music to be Diegetic or Non-Diegetic?
  • Do we focus our music on enhancing player Comfort or Performance?

Continue reading

Composing video game music for Virtual Reality: The role of music in VR

In this article for video game composers, Winifred Phillips is pictured working in her music production studio.

By Winifred Phillips | Contact | Follow

Hey everybody!  I’m video game composer Winifred Phillips.  At this year’s Game Developers Conference in San Francisco, I was pleased to give a presentation entitled Music in Virtual Reality (I’ve included the official description of my talk at the end of this article). While I’ve enjoyed discussing the role of music in virtual reality in previous articles that I’ve posted here, the talk I gave at GDC gave me the opportunity to pull a lot of those ideas together and present a more concentrated exploration of the practice of music composition for VR games.  It occurred to me that such a focused discussion might be interesting to share in this forum as well. So, with that in mind, I’m excited to begin a four-part article series based on my GDC 2018 presentation!

Continue reading

Video Game Composers: The Tech of Music in Virtual Reality (GDC 2018)

Video game composer Winifred Phillips, pictured in her music production studio.

By Winifred Phillips | Contact | Follow

The Game Developers Conference is almost here! I’m looking forward to giving my presentation soon on “Music in Virtual Reality” (Thursday, March 22nd at 3pm in room 3002 West Hall, Moscone Center, San Francisco).  Over the course of the last two years, I’ve composed a lot of music for virtual reality projects, some of which have already hit retail, and some of which will be getting released very soon!  As a result, I’ve spent a lot of time thinking about what role music should play in a virtual reality game. During my GDC talk in March, I’ll be taking my audience through my experiences composing music for four very different VR games –the Bebylon: Battle Royale game from Kite & Lightning, the Dragon Front strategy game from High Voltage Software, the Fail Factory comedy game from Armature Studio, and the Scraper: First Strike RPG-Shooter hybrid from Labrodex Inc.  In preparing my GDC presentation, I made sure my talk addressed some of the most important creative and technical hurdles facing video game composers working in VR.  However, time constraints ensured that some interesting info ended up ‘on the cutting room floor,’ so to speak.  So, I’ve written two articles that explore some of the best topics that didn’t make it into my GDC presentation.

My previous article focused on some abstract, creative concerns facing video game music composers and audio folks working in VR.  In this article, we’ll be turning our attention to more concrete technical issues.  Ready?  Let’s go.

New Binaural Developments

Illustration of popular binaural developments in VR audio, from the article by composer Winifred Phillips for video game composers.VR games currently focus on binaural audio to immerse players in the awesome soundscapes of their virtual worlds.  As we know, binaural recording techniques use two microphones, often embedded in the artificial ears of a dummy head (pictured right).  By virtual of the popular binaural recording technique and/or binaural encoding technologies, game audio teams can plunge VR players into convincing aural worlds where sounds are spatially localized in a way that conforms with real world expectations.  The technology of binaural sound continually improves, and recently the expert developers of the Oculus Rift VR headset have refined the quality of their VR sound with two significant upgrades.

Continue reading