SAM is the most critical member of our team here at Relative Motion. This tiny bit of kit represents someone important standing at the heart of every story that we tell. That someone is YOU!
You are the Single Audience Member (SAM) who participates in the VR stories we create. This acronym reminds all of us at Relative Motion, from directors and producers, to technical creatives and actors, that the camera is more than a camera in narrative VR. So regardless of SAM’s costume, be it a Go Pro Fusion (as pictured), an Insta360 Pro2, Yi-Halo, or even a virtual camera in our CGI endeavours, this little co-creator keeps us honest and compels to remember that we make our work for you!
Looking forward to sharing our next adventure with you… details coming soon!
Relative Motion took part in Wired Sussex's "VR Show and Tell" event at The Fusebox, Brighton on Thursday. We were there to show and discuss our Shakespeare VR project with the excitingly passionate and diverse community of creative and technical minds in the area.
Chris Lane introduced our team and the project, giving a very quick overview of our process and discoveries. There's a mini-summary of his presentation below. For the rest of the evening, our headsets were VERY thoroughly used as we shared our work! We met some super-interesting folk and we very much enjoyed all the discussions that ensued.
Our sincere thanks to Jasmin, Chris and Rosalie at The Fusebox for hosting us and this thriving community!
What we’re showing today…
What did we learn/discover?
What else are we up to?
So adventures with an actor, Shakespeare and VR ensued on Thursday 1st February. We (Andy Purves and I) took over CentrE17 for the day to interrogate how best to work with an actor in a space/volume in relation to the 360° camera… or as I prefer to call it, S.A.M. (Single Audience Member). I firmly believe that when we create stories in virtual performance spaces we have to remember that there will be a person at the centre of that experience who participates both intellectually and physiologically. That’s where S.A.M. comes in… a gentle, gender-neutral reminder that we are developing our creations around a human being and not a camera. Keeping the human being in mind means that we will be more aware of inadvertently and unnecessarily moving S.A.M. and we will also start to use their physiological responses as another tool in our storytelling arsenal.
So upon arrival at CentrE17 we radially mapped out the floor in 1m, 2.5m and 4.5m rings (like a dart board) so that once we transferred the footage to a headset we would have measurable markers to determine actual distance as it relates to the success of the storytelling (i.e.: proximity of the actor, in this case Richard Pryal, to S.A.M.). Whilst we’ve yet to do an HMD test of the material, from what we could tell from the room, the closer Rich was to S.A.M. the more immediate and engaging the text was. We are capturing performances at this stage using a Go Pro Fusion 360° Camera. The camera links to an app for the iPhone (Android soon to come I believe) and from the app you can remotely control the camera and view the capture in real time which is profoundly helpful for noting/tweaking the performance. So the day resulted in the exploration of four monologues: the Poor Tom speech from King Lear, ‘To be thus is nothing…’ from Macbeth, York’s speech to the Queen of France from Henry VI Part 3, and the opening speech from Richard III. We captured several versions of each and are in the process now of creating a rough prototype of our Shakespeare VR experience from the best takes of each speech. It should be mentioned that each capture was a single take as internal editing is near impossible in 360° VR. This is the reason for using theatre actors in VR… they are great at working with long stretches of text and fixing things on the fly.
The learning never seems to stop on this project. Some things are huge, like coming to understand the ins and outs of editing with Premiere Pro, understanding and integrating ambisonic sound and, from a directing perspective, learning what virtual spaces and editing software add to my storytelling tool kit. This week I’m undertaking an exploration of VR transition tools that are now part of Premiere Pro so that I can plan staging/blocking with them in mind; early days have already made me a fan of the VR Iris Wipe and the Mobius Zoom. I’ve also begun research into proxemics and their effects on the physiological responses of S.A.M. (more on this to come).
Getting back to S.A.M., it was a unique experience for both Rich and I working with S.A.M.. As Rich noted, he has never had to work in this particular actor/audience configuration and a good deal of our first hour of actual work (after our floor tape-out) was spent discussing who S.A.M. would be to Rich’s character. One of the reasons I chose to use Shakespeare as the base texts is that I believe they lend themselves well to VR. Shakespeare wrote these plays for a round space that puts a good deal of audience at the centre of the performance. When you stand on stage at The Globe it is apparent that audience share that space with you. Shakespeare wrote for the specifics of this architecture in that he crafted narratives that consistently and seamlessly acknowledged the audience-participants (a great number of S.A.M.’s if you will) who were sharing the space with the performers. Soliloquies and asides are the obvious points of relevance here. As an actor I was told by my coaches to you use the audience as the character’s conscience where soliloquies and asides were concerned. This seemed to put us right for three of the four pieces and gave Rich the freedom to live in the solitary moment of these speeches whilst still being able to deliberately connect with S.A.M. In our exploration of York, we actually cast S.A.M. as the Queen of France and I stood in to play Northumberland so that as the queen, S.A.M. had a confederate in the space. Even from watching the playbacks in Premiere Pro, this casting of S.A.M. as a character has huge potential and gives S.A.M. a physical sense of the play that cannot be achieved from being an outside observer or as the universal conscience for the play’s characters. I still have questions about how to effectively cast S.A.M. and how we establish the rules of the world that one participates in when we continually change S.A.M.’s/your role within the story... some things to ponder as we explore.
On the news front, we will be speaking at the Digital Catapult VR Storytelling meet up at the FuseBox space in Brighton on April 5th and we are aiming to have a solid prototype of a soliloquy experience done for that event so that people can try it out (and we can learn from their experience of it). I also have to say that I met up with Henry Stuart at Visualise last Wednesday and his/their active involvement in this project is going to really advance the work that we do. I’m very grateful for their support, knowledge and enthusiasm.
Since starting this journey, I have consistently seen VR as a new theatrical space and not as an extension of filmmaking (although there are aspects of filmmaking that directly and necessarily apply). Theatre makers will often talk about being in 'the space' and working & playing with 'the space'. We can often be precious about 'the space' as well. From my theatre director vantage point I see VR as a virtual performance space. It’s a place where the story happens around the audience, not simply in front of them - it is immersive theatre in its most holistic form.
What I find exciting is that this immersion opens up several new frontiers. Firstly, the role of audience member becomes a dynamic new landscape to explore. The audience's presence, agency and empathy become important factors in how we include them in the storytelling design and process. Secondly, there is more exciting terrain to traverse in determining what existing rules govern these spaces from a theatrical perspective and what new principles are emerging that will allow us to exploit these environments to their fullest. I want to turn to both of these issues in my next two posts.
Lastly, have a look at the following links as I think they provide a good backdrop for what is to come... I also find Chris Milk's talk rather inspiring.
ps. Click here to see more of the amazing work of Adrien M and Claire B.