mixed reality with hololens - sita · mixed reality with hololens sita innovation day 2016 rené...
TRANSCRIPT
Mixed Reality with HoloLensSita Innovation Day 2016
René SchulteDirector, Immersive Experiences
@rschu
Cloud and
InfrastructureCRM
Portals and
Collaboration
Enterprise
Social
Data and
Analytics
Custom
DevelopmentUser Experience
Formerly known
as IdentityMine
2
3© 2016 Valorem Consulting Group LLC
What we doWe create amazing user experiences. We design where others spec. We create where others just build.
Our first thought is not “what are the limitations of this device” but “how to empower every individual and every
organization to achieve more through Digital Transformation”. On top of that, we are technology innovators.
4© 2016 Valorem Consulting Group LLC
Immersive Overview
Comprehensive 3D Expertise
Valorem’s experienced design and development experts are fluent
in the 3D programming world.
• In-house 3D engine supporting Direct3D 9, 11 & 12
• Well versed with the various AR & VR devices and their specific
SDKs
• Unity Pro innovator – developing cross-platform and rapid
prototyping solutions
• In-house 3D artists for 3D content creation using 3D authoring
tools like 3ds Max, Maya, ZBrush, etc.
• 8 years of experience in 3D visualizations
.
5
6© 2016 Valorem Consulting Group LLC
User Experience First
Define the experience, then go build it
UX and Technology Innovators
Don’t allow technical blockers to impede creativity
The Right Talent at the Right Time
From enterprise to game development, our user experience design
and development experts come from diverse backgrounds
Why Valorem?
One of seven agencies accepted into the first Microsoft HoloLens
Academy / Agency Readiness Program
6© 2015 IdentityMine Inc. | Design Process
Guiding Principles
Immersive Technology
Immersive Device Landscape
Oculus RiftSamsung Gear VR Microsoft HoloLensGoogle Cardboard HTC Vive
9© 2016 Valorem Consulting Group LLC.
VR – Virtual Reality
Fully immersive multimedia experience
10© 2016 Valorem Consulting Group LLC.
AR – Augmented Reality
Not fully immersive
Real world enhanced with virtual elements
Microsoft HoloLens Spans Realities
Augmented Reality Mixed Reality Virtual Reality
Augments the real world with helpful information
Blends holograms with your real world
Can transport you to a virtual world
Replaces the real world
Why HoloLens?
17© 2016 Valorem Consulting Group LLC.
HoloLens Input
18© 2016 Valorem Consulting Group LLC.
Developing for HoloLens
Direct3D with C++ or C# via SharpDX
Highly efficient workflow
Built-in VR and HoloLens support
First class citizen for HoloLens development
Free for personal use
HoloLens Portfolio
Exciting and cool videos
Engineering and Communication
HoloLens chemical plant
Architecture and Construction
HoloLens architectural model
Manufacturing and Training
HoloLens Assembly Line
Product Design and Presentation
HoloTire
Education and Entertainment
HoloDino
Entertainment
TowerBlocks
Aviation and GIS Data Visualization
HoloFlight
28© 2016 Valorem Consulting Group LLC.
29© 2016 Valorem Consulting Group LLC.
There’s even more outside the box…
30© 2016 Valorem Consulting Group LLC.
31© 2016 Valorem Consulting Group LLC.
32© 2016 Valorem Consulting Group LLC.
Immersive UX Envisioning
Immersive Demo Day
Learn about the HoloLens and other
VR/AR/MR technologies with hands-
on demos and discussions
Envisioning Video
See your HoloLens concept come to
life with a video simulating the future
experience
Onsite Workshop
Collaborative sessions that help to
determine project goals, define criteria
for success and engage with immersive
design, production and technical
experts
Interactive Prototype
Rapid prototyping and POC (proof of
concept) development allows you to
quickly experience, interact and iterate
with your HoloLens application
34
Immersive UX Envisioning Options
35© 2016 Valorem Consulting Group LLC
Demonstration of new technology and existing applications by creative
and engineering experts
Activities
• Overview of up to three VR/AR/MR devices and production methods
• Hands-on demonstration of the technology and applications
Deliverables
• On-site demo(s)
• Demo devices provided
35© 2015 IdentityMine Inc. | Design Process
Immersive Demo Day
36© 2016 Valorem Consulting Group LLC 36© 2015 IdentityMine Inc. | Design Process
HTC Vive
Discovery workshop to identify and clearly understand your business
goals, user workflows, scenarios and assess any platform challenges.
Activities
• Questionnaire & agenda development
• Industry research
Onsite Concepting & Envisioning
• Demonstration of HoloLens device and existing applications by creative and engineering experts
• Collaborative meetings to determine project goals and define criteria for success
• Brainstorming / sketching and whiteboarding
• Key personas, scenarios, and primary use case development
Onsite Workshop
37© 2016 Valorem Consulting Group LLC
Deliverables (delivered 2 weeks after onsite)
Primary User Personas
Fictitious identities that reflect your user groups
Key Scenarios
Your persona’s journey and where your app fits in
Primary Use Cases
Outline of specific tasks your users wish to achieve with your app
Annotated Storyboards
Series of concepts that illustrate application experience and user interactions (up to
two (2) concepts with up to seven (7) medium fidelity illustrations)
Creative Brief
Documentation of all findings during the envisioning workshop
37© 2015 IdentityMine Inc. | Design Process
Onsite Workshop
38© 2016 Valorem Consulting Group LLC
Sample artifacts
3D Models Storyboard
Whiteboard sketches
Photographic storyboard3D grey box illustrations
Vector art storyboards
39© 2016 Valorem Consulting Group LLC 39© 2015 IdentityMine Inc. | Design Process
HTC Vive
A production video prototype that communicates your concept by
telling a story of how one or more persons would use the application.
Deliverables (2 weeks after onsite)
Pre-Production
Scripting, production planning, shot list development
3D Modeling
Basic non-interactive 3D modeling for use in the video
Video Production
Anticipated two (2) day video shoot with required equipment, shooting crew,
production crew, studio / set, talent, and props
Post-Production
Editorial, graphics, effects / compositing, finishing, audio, and reviews
Video Prototype (animatic)
Up to one minute HD video (animatic) utilizing live action and 3D elements to
simulate the final application
Envisioning Video
40© 2016 Valorem Consulting Group LLC
Sample artifacts
Video production
Video prototype
41© 2016 Valorem Consulting Group LLC
Sample video
42© 2016 Valorem Consulting Group LLC 42
Interactive prototype to help understand and visualize the requirements
of a solution in detail to ensure all goals will be met during a full
production effort
Deliverables
Functional Proof of Concept (POC)
An interactive visual holographic proof of concept which can be viewed on the
HoloLens device
Source Code
Application source code and binary builds
Quality Assurance
Quality assurance team will test the HoloLens proof of concept application to ensure
expected functionality and performance
Interactive Prototype
43© 2016 Valorem Consulting Group LLC
Kinect applications
Sample artifacts
HoloLens application
44© 2016 Valorem Consulting Group LLC
Immersive Project ExecutionProject Management
Presales / Kick-off
Brainstorming & Ideation
UX & 3D Design
UX Prototype• Project Discovery• Estimation
• Proposal
• Project Kick-off Meeting• UX Strategy• Persona Development
• User Interviews
• Concepting• Rapid prototyping
Development | Co-Development
Design Integration
Testing & QA
• Information Architecture • Wireframes
• Visual Design
Compositions• Style Guide
• 3D Modelling • Feasibility• Interactions & Animations
UI / UX to reality
• Dedicated Project Lead• Project Status Reviews/Reports
• Delivery Management
45
Demo Time!
Speaker
Visor
Cooling channel
Front hinge
Volume buttons
Back Hinge
Arm
Adjustment wheelPower button and charging
battery life indicators
Brightness buttons
Nose pad
HoloLens Device Features
Gestures Overview
60 Minutes
50 Minutes
40 Minutes
30 Minutes
20 Minutes
10 Minutes
Time’s Up!
55© 2016 Valorem Consulting Group LLC
56© 2016 Valorem Consulting Group LLC
57© 2016 Valorem Consulting Group LLC
58© 2016 Valorem Consulting Group LLC
59© 2016 Valorem Consulting Group LLC
60© 2016 Valorem Consulting Group LLC
61© 2016 Valorem Consulting Group LLC
62© 2016 Valorem Consulting Group LLC
Thank you
for your time.
René SchulteDirector, Immersive Experiences
@rschu