Game Music and Empathy: How Game Composers Can Enhance Virtual Presence (Pt. 3)

This photo shows video game composer Winifred Phillips working in her music production studio. Phillips has composed music for titles in five of the most popular franchises in gaming (Assassin's Creed, God of War, Total War, LittleBigPlanet, The Sims).

By Winifred Phillips | Contact | Follow

Delighted you’re here!  I’m video game music composer Winifred Phillips.  Welcome back to our four part discussion of how game music can enhance presence in awesome virtual reality video games! These articles are based on the presentation I gave at this year’s gathering of the famous Game Developer’s Conference in San Francisco.  My talk was entitled How Music Enhances Virtual Presence (I’ve included the official description of my talk at this end of this article). If you haven’t read the previous two articles, you’ll find them here:

In my GDC talk, I discussed Virtual Presence in connection with seven of the virtual reality games and experiences that I’ve scored, which have either released within the past year or will be released within the coming months.  These include Audioshield (Audiosurf LLC), Bebylon Battle Royale (Kite & Lightning), Fail Factory (Armature Studio), The Haunted Graveyard (Holospark), Life Hutch VR (Next Stop Willoughby), Scraper: First Strike (Labrodex Inc), and Shattered State (Supermassive Games).  Using examples from these games, I discussed a model for how gamers can best develop the psychological attachment necessary to most effectively achieve Virtual Presence. The psychological model consists of three stages:

This image depicts the three components to the model of psychological attachment -- engagement, engrossment, and empathy (from the article by video game music composer Winifred Phillips).

In the previous two articles of this series, we discussed the roles of engagement and engrossment, so now let’s look at the third and final stage:

Empathy

As we all know, when we feel empathy we’re experiencing compassion towards other people. However, according to the researchers from University College London, when we’ve achieved empathy as a component of Virtual Presence, we’re not feeling compassion for other characters – but rather, for ourselves.

An image accompanying a discussion of empathy as a component of psychological attachment needed to attain Virtual Presence (from the article for video game composers by Winifred Phillips (game music composer).As the main character in our own virtual adventure, we feel empathy for our own in-game situation, and for the character that we currently inhabit. Once we’ve achieved that fullest expression of personal empathy, we’ve reached the final stage that enables Virtual Presence. As game music composers and game audio experts, how can we best help players achieve this specific form of personal empathy?

Music is great at triggering and stoking this emotion in some tried-and-true ways. We simply have to get players to root for themselves. We have to build them up, and make them feel emotionally invested in their own success. Let’s take a look at a couple of simple but effective examples.

The logo of the Fail Factory VR game for the Oculus Go, from the article about Virtual Presence by video game music composer Winifred Phillips.First, let’s take a look at Fail Factory, developed by Armature Studio and released for the popular Oculus Go and Samsung Gear VR devices. In Fail Factory, players assume high-stress jobs in a giant robot factory. Keeping up with the rapidly accelerating assembly lines and conveyor belts is a constant challenge, resulting in lots of wacky failures. While the pandemonium is a big part of the game’s appeal, it’s still important to keep players motivated to succeed. Players need to empathize with their own character’s accomplishments. Since this kind of emotional investment enhances Virtual Presence, it becomes very important to boost player assurance and self-esteem.

As composers, one way we can uplift player confidence is by musically reinforcing moments of success. In Fail Factory, I encouraged players to root for themselves by composing some overtly-confident music for those times in which players receive their gameplay results and view their scores. While the music still conveys the silliness we’ve come to expect from the musical score I composed for the rest of the game, the music I composed for gameplay results places the emphasis on confidence and swagger. Let’s see what that was like:

As another example of affirming music, let’s check out some gameplay from one of my other VR projects – the upcoming Bebylon Battle Royale game, currently in development by Kite & Lightning for VR.

In this article for video game composers, Winifred Phillips discusses her music for the Bebylon Battle Royale VR game.Confidence is a running theme in Bebylon Battle Royale. That’s because the characters in the world of Bebylon are coping with a pretty humiliating fact-of-life – they’re babies. Immortal babies in the future, trying to assert their dominance, reach the top of their social structure and become the epitome of cool. When composing the music for Bebylon Battle Royale, I focused on musical styles that emphasize self-assurance and swagger. Here’s some video that Kite & Lightning released of one of their baby characters getting his groove on to music I composed for Bebylon Battle Royale:

So now we’ve considered how empathy can contribute to the psychological attachment necessary to achieving Virtual Presence.  In our next article, we’ll consider the role of game music in regulating and attenuating mood in order to create the right psychological circumstances for Virtual Presence to take hold of the players’ consciousness.  Thanks for reading!


 

How Music Enhances Virtual Presence

Compilation of images depicting popular game titles for VR platforms that are included in the GDC 2019 lecture of game composer Winifred Phillips.

Virtual Presence is defined as a state in which gamers fully accept the virtual world around them and their existence within it. This talk, “How Music Enhances Virtual Presence,” will explore how highly effective game music can enhance the sensation of Virtual Presence in VR gaming.

The talk will begin with an exploration of both the Flow Theory of Mihaly Csikszentmihalyi and the research of Dr. Paul Cairns on psychological engagement in video gaming. By understanding how the mental activity of players interacts with the way a game is designed, composers can create music intended to induce psychological states conducive with the formation of Virtual Presence.

The talk will include a discussion of techniques aimed at drawing attention to mission objectives, facilitating effective concentration, enhancing emotional empathy and intensifying player focus. The discussion will also include an exploration of some inherent drawbacks to Virtual Presence, including its fragility when exposed to negative emotional states, and its possible susceptibility to inducing the “event boundary” phenomenon. Musical solutions to these problems will be explored.

Phillips’ talk will offer techniques for composers and audio directors who seek to employ music as a tool to enhance Virtual Presence for their players.

Takeaway

Using examples from several games, Phillips will explore how music can influence the mental states of players through specific effects documented in scientific research. Study data will be discussed in regards to the interaction between music and cognition. Phillips will offer strategies and tips for composers seeking to use their music to influence the player’s mental state, thus facilitating the formation of Virtual Presence.

Intended Audience

This session is intended to inspire and stimulate composers seeking to employ their music towards enhancing player engagement and enjoyment, with a particular emphasis on VR games. Includes overview of Flow Theory and the psychological components of Virtual Presence, which may be useful to other disciplines within game development. Talk will be approachable for all levels (advanced composers may better appreciate the specific composition techniques discussed).

 

Photo of video game composer Winifred Phillips in her game composers production studio.Popular music from composer Winifred Phillips’ award-winning Assassin’s Creed Liberation score will be performed live by a top 80-piece orchestra and choir as part of the Assassin’s Creed Symphony World Tour, which kicks off in 2019 with its Los Angeles premiere at the famous Dolby Theatre. As an accomplished video game composer, Phillips is best known for composing music for games in five of the most famous and popular franchises in gaming: Assassin’s Creed, LittleBigPlanet, Total War, God of War, and The Sims.  Phillips’ other notable projects include the triple-A first person shooter Homefront: The Revolution, and numerous virtual reality games, including Scraper: First Strike, Dragon Front, and many more.   She is the author of the award-winning bestseller A COMPOSER’S GUIDE TO GAME MUSIC, published by the MIT Press. As a VR game music expert, she writes frequently on the future of music in virtual reality games. Phillips’ is a sought-after public speaker, and she has been invited to speak about her work as a game composer at the Library of Congress, the Game Developers Conference, the Audio Engineering Society, the Society of Composers and Lyricists, and many more.  Follow her on Twitter @winphillips.

Game Music and Psychological Attachment: How Game Composers Can Enhance Virtual Presence (Pt. 2)

Photo of video game music composer Winifred Phillips working in her music production studio on the musical score of the Shattered State VR game from Supermassive Games.

By Winifred Phillips | ContactFollow

So happy you’ve joined us!  I’m video game composer Winifred Phillips, and this is the continuation of our four-part discussion of how music can enhance presence in virtual reality.  These articles are based on the presentation I gave at this year’s Game Developer’s Conference in San Francisco, entitled How Music Enhances Virtual Presence (I’ve included the official description of my talk at this end of this article). In my GDC talk, I discussed Virtual Presence in connection with seven of the virtual reality games and experiences that I’ve scored, which have either released within the past year or will be released within the coming months.  These include Audioshield (Audiosurf LLC), Bebylon Battle Royale (Kite & Lightning), Fail Factory (Armature Studio), The Haunted Graveyard (Holospark), Life Hutch VR (Next Stop Willoughby), Scraper: First Strike (Labrodex Inc), and Shattered State (Supermassive Games).  If you missed the first article exploring how Flow can support Virtual Presence in VR gaming, please go check that article out first.

Are you back?  Great!  Let’s continue!

Now that we’ve taken a look at how Flow can best enable Virtual Presence in VR, let’s look at the second mechanism by which music enables Virtual Presence:

Psychological Attachment

Image illustrating the three states contributing to the attainment of Virtual Presence (Engagement, Engrossment, and Empathy) -- from the article by video game composer Winifred Phillips.In a paper presented at the Computer-Human Interaction conference, a research team from Carnegie-Mellon defined Virtual Presence as “the extent to which a person’s Cognitive and perceptual systems are tricked into believing they are somewhere other than their physical location.” This assertion formed the jumping-off point for two researchers from University College London, who set out to define what specific circumstances could lead to Virtual Presence in gaming. They developed a model for how gamers developed the psychological attachment necessary to achieve Virtual Presence.  Their model consists of three stages:

  • Engagement
  • Engrossment
  • Empathy

So let’s start with the first stage.

Continue reading

Video game music composer gives lecture at the Library of Congress

Photo of video game music composer Winifred Phillips giving a lecture at the Library of Congress (Whittall Pavilion, Thomas Jefferson Building, Washington DC). Winifred Phillips' lecture was the first video game music composition lecture given at the Library of Congress.

By Winifred Phillips | Contact | Follow

On April 6th I was honored to give a lecture at the Thomas Jefferson Building of the Library of Congress in Washington DC (pictured right).  As a video game composer, I’d been invited to speak by the Music Division of the Library of Congress.  I’d be delivering the concluding presentation during their Popular video game music composer Winifred Phillips is here shown outside the Thomas Jefferson Building (Library of Congress, Washington DC), where she gave the first-ever video game music composition lecture at the invitation of the music division of the Library of Congress.premiere event celebrating popular video game music.  My lecture would be the very first video game music composition lecture ever given at the Library of Congress.  I was both honored and humbled to accept the invitation and have my lecture included in the 2018-2019 season of concerts and symposia from the Library of Congress.

In my presentation, I included many topics that I’ve written about in previous articles.  My lecture topics included horizontal resequencing, vertical layering, and interactive MIDI-based composition. I explored the various roles that music has played in famous games from the earliest days of game design (like Frogger and Ballblazer).  I also discussed how music has been implemented in some of the awesome games from the modern era (like one of my own projects, Assassin’s Creed Liberation).

My lecture was supported by a full house in the Whittall Pavilion at the Library of Congress. The audience gave me both a warm welcome and lots of great questions following the conclusion of my lecture.  Afterwards, the discussion continued during a book signing event that was kindly hosted by the Library of Congress shop.  During the book signing event, I was pleased to sign copies of my book A Composer’s Guide to Game Music. I also got to talk personally with quite a few audience members.  Such an engaging and insightful crowd!  It was a pleasure getting to know these lovely people.  I really enjoyed the lively conversation – I had the best time!!

Continue reading

Video Game Composers: How Music Enhances Virtual Presence (GDC 2019)

In this article about Virtual Presence in VR written for video game composers, Winifred Phillips (video game composer) is here pictured working in her music production studio.

By Winifred Phillips | Contact | Follow

Delighted you’re here!  I’m very pleased to share that over the next two months I’ll be speaking at two fantastic events focusing on music in video games!  My two presentations will explore the unique structure and character of video game music, and how it helps to better envelop players in the worlds that game designers have created.  I thought that this article might be a good opportunity to delve into some of the ideas that form the basis of my two upcoming talks.  First, I’d like to share some details about the presentations I’ll be giving.

The Library of Congress logo, included in an article discussing popular game conferences, from the article for video game composers by Winifred Phillips (game music composer).The Library of Congress has invited me to speak this April as a part of their “Augmented Realities” video game music festival. My presentation, “The Interface Between Music Composition and Game Design,” will take place at the Library of Congress in Washington DC. I’m very excited to participate in this event, which will be the first of its kind hosted by the “Concerts from the Library” series at the Library of Congress! The “Augmented Realities” video game music festival will also include panels on video game music history and preservation presented by distinguished curators and archivists at the Library of Congress, a special documentary screening that explores the ChipTunes movement, and a live “game creation lab.” My presentation will be the concluding lecture of the festival, and I’m honored to speak at such an illustrious event!  If you find yourself in the Washington DC area on April 6th 2019, you’re very welcome to come to my lecture at the Library of Congress!  Tickets are free (first come, first served), and they’re available now via EventBrite.

The GDC logo, accompanying the discussion of networking at such famous game conferences, from the article for video game composers by Winifred Phillips (game music composer).But before my lecture at the Library of Congress, I’ll be making a trip to San Francisco for the famous Game Developers Conference that takes place this month. For the past few years I’ve been excited and honored to be selected as a Game Developers Conference speaker in the Game Audio track, and I’m happy to share that I’ll be speaking again this month in San Francisco at GDC 2019! My talk this year is entitled “How Music Enhances Virtual Presence.

Continue reading

Video Game Composers: The Tech of Music in Virtual Reality (GDC 2018)

Video game composer Winifred Phillips, pictured in her music production studio.

By Winifred Phillips | Contact | Follow

The Game Developers Conference is almost here! I’m looking forward to giving my presentation soon on “Music in Virtual Reality” (Thursday, March 22nd at 3pm in room 3002 West Hall, Moscone Center, San Francisco).  Over the course of the last two years, I’ve composed a lot of music for virtual reality projects, some of which have already hit retail, and some of which will be getting released very soon!  As a result, I’ve spent a lot of time thinking about what role music should play in a virtual reality game. During my GDC talk in March, I’ll be taking my audience through my experiences composing music for four very different VR games –the Bebylon: Battle Royale game from Kite & Lightning, the Dragon Front strategy game from High Voltage Software, the Fail Factory comedy game from Armature Studio, and the Scraper: First Strike RPG-Shooter hybrid from Labrodex Inc.  In preparing my GDC presentation, I made sure my talk addressed some of the most important creative and technical hurdles facing video game composers working in VR.  However, time constraints ensured that some interesting info ended up ‘on the cutting room floor,’ so to speak.  So, I’ve written two articles that explore some of the best topics that didn’t make it into my GDC presentation.

My previous article focused on some abstract, creative concerns facing video game music composers and audio folks working in VR.  In this article, we’ll be turning our attention to more concrete technical issues.  Ready?  Let’s go.

New Binaural Developments

Illustration of popular binaural developments in VR audio, from the article by composer Winifred Phillips for video game composers.VR games currently focus on binaural audio to immerse players in the awesome soundscapes of their virtual worlds.  As we know, binaural recording techniques use two microphones, often embedded in the artificial ears of a dummy head (pictured right).  By virtual of the popular binaural recording technique and/or binaural encoding technologies, game audio teams can plunge VR players into convincing aural worlds where sounds are spatially localized in a way that conforms with real world expectations.  The technology of binaural sound continually improves, and recently the expert developers of the Oculus Rift VR headset have refined the quality of their VR sound with two significant upgrades.

Continue reading

Music Game Plan: Tactics for the Video Game Composer (Part Three)

video game music composer Winifred Phillips, working in her studio on the music of The Maw video game.Welcome to the third installment of my four-part article series on the core principles of music interactivity, including video demonstrations and supplementary supporting materials that take these abstract concepts and make them more concrete.  In Part One of this series, we took a look at a simple example demonstrating the Horizontal Re-Sequencing model of musical interactivity, as it was used in the music I composed for the Speed Racer Videogame from Warner Bros. Interactive. Part Two of this series looked at the more complex Horizontal Re-sequencing music system of the Spore Hero game from Electronic Arts.  So now let’s move on to another major music interactivity model used by video game composers – Vertical Layering.

Continue reading

From Total War to Assassin’s Creed: Music from my GDC Talk

From Total War to Assassin's Creed: Music from my GDC Talk (article by Winifred Phillips, video game composer)Last week, it was my honor and pleasure to give a presentation at the Game Developers Conference in San Francisco. My talk was entitled “From Total War to Assassin’s Creed: Music for Mobile Games.” The talk focused on the best and most effective methods for composition and implementation of music in portable gaming.  The talk was structured for the benefit of video game composers and game audio pros, and as a part of the presentation, I played short excerpts of music that I composed for several of my top mobile and handheld video game projects. Now that GDC is over, I thought I’d provide streaming links to some of the complete music tracks that I featured during my presentation, in case attendees were curious about the complete pieces of music. So, without further ado, here are tracks from my GDC 2016 talk!

Assassin’s Creed Liberation

The Assassin’s Creed Liberation game was released by Ubisoft for the PlayStation Vita, and delivered an immersive experience from the popular Assassin’s Creed franchise. The game was designed specifically for a portable system, and as such, all aspects of the design were adjusted to cater specifically to a portable gaming experience, including the music.

Game composer Winifred Phillips speaking about the music of Assassin's Creed Liberation at GDC 2016

Continue reading