How to build a #MixedReality experience for #Hololens
Posted on April 14th, 2017
4/14/2017 @MicrosoftReactorAtGrandCentral, 335 Madison Ave, NY, 4th floor
Mike Pell and John gave a roadmap for generating #MixedReality content. They started with general rules for generating content and how these rules apply to building MR content.
- Know your audience –
- Role of emotion in design – we want to believe in what is shown in a hologram.
- Think situation – where am I? at home you are comfortable doing certain things, but there are different needs and different things you are comfortable in public
- Think spatially – different if you can walk around the object
- Think inclusive – widen your audience
- Know Your medium
- For now you look ridiculous when wearing a VR headset– but maybe this eventually becomes like a welder shield which you wear when you are doing something specialized
- Breakthrough experience – stagecraft – so one can see what the hololens user is seeing
- Know Your palette
Interactive Story Design – a fast way to generate MR content
- Who is your “spect-actor” (normally someone who observers – have a sense of who the individual is for this moment – avoid blind spot, so pick a specific person. )
- Who are your “interactors” – will change as a result of the interaction – can be objects, text, people
- This creates a story
- Location – design depends on where this occurs
- Journey – how does participant change
How to bring the idea to life: how to develop the script for the MR experience
3-step micro sprints – 3 to 6 minute segments – so you don’t get attached to something that doesn’t work. Set 1 to 2 minute time limit for each step
- Parameters – limited resources help creative development
- Personify everything including text has a POV, feelings, etc.
- 3 emotional responses – what is the emotional response of a chair when you sit in it?
- 3 conduits
- Facial expression – everything has a face including interfaces and objects
- Body language
- Playtest – do something with it
- 3 perspectives
- Interacters – changes in personality over time
- 3 perspectives
- Audience – who is watching
- PMI – evaluative process – write on index cards (not as a feedback session) so everyone shares their perspective. Next loop back to the parameters (step 1)
- Plus – this is interesting
- Minus – this weak
- Interesting – neither of the above “this is interesting”
How to envision and go fast:
- Filming on location – randomly take pictures – look for things that speak to you as creating an interesting experience.
- Understand the experience – look at the people (i.e. people viewing art)
- Visualize it – put people into the scene (vector silhouette in different poses) put artwork into scene along with viewers.
- Build a prototype using Unity. Put on the Hololens and see how it feels
They then went through a example session in which a child is inside looking at a T-Rex in the MOMA outdoor patio. The first building block was getting three emotional responses for the T-Rex:
- Positive – joy looking at a potential meal: the child
- Negative – too bad the glass barrier is here
- Neutral – let me look around to see what is around me
To see where we should be going, look at what children want to do with the technology