etna dev 2016 - introduction to mixed reality with hololens
TRANSCRIPT
-
Introduction to Mixed Reality with HoloLens
Clemente Giorio
Matteo Valoriani
Marco Dal Pino
-
Agenda
AR/VR/MR
HoloLens DEMO
Gestures, Input, Voice CommandsWeb Portal
HoloLens Inside
What NEXT?
-
AR/MR/VRWhat are the difference?
-
Apollo Guidance
Computer
2000 Transistor
4k Memory
-
CPU evolution
2015
2010
2005
1995 5M transistors/chip
160M transistors/chip
1B transistors/chip
71B transistors/chip (2B chip mobile)
-
UI Dimensions
Transactional
App = Code + Markup
Immersive
App GPU intensive
2D UI
Personal Assistant:Siri, Google Now, Echo, Cortana
Machine Learning Machine2Machine
1D UI
Virtual, Augmented and
Mixing Reality
3D UI
-
Reality virtualitycontinuum
The area between the two extremes, where both the real and the virtual are mixed, is called mixed reality.
This in turn is said to consist of both augmented reality, where the virtual augments the real, and augmented virtuality, where the real augments the virtual.
https://en.wikipedia.org/wiki/Mixed_realityhttps://en.wikipedia.org/wiki/Augmented_realityhttps://en.wikipedia.org/wiki/Augmented_virtuality -
Quiz
AR
AV
VR
https://www.google.it/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwil8suozOrPAhUEtRQKHZ0yDFAQjRwIBw&url=http://bgr.com/2016/07/06/pokemon-go-ios-android-download/&psig=AFQjCNHYN_Rfx-UEaOV1wizwhkEu4OmG-w&ust=1477094541096291 -
Quiz
AR
AV
VR
-
Quiz
AR
AV
VR
-
Quiz
AR
AV
VR
-
Quiz
AR
AV
VR
https://www.google.it/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwjjsLOkz-rPAhXC1hQKHZTgAHsQjRwIBw&url=http://fortune.com/2015/11/16/virtual-reality-journalism/&bvm=bv.136499718,d.ZGg&psig=AFQjCNFdAiBSB31PugmZzfuvqbO_AFF3gw&ust=1477095386617082 -
Quiz
AR
AV
VR
-
Quiz
AR
AV
VR
-
Quiz
AR
AV
VR
-
Quiz
AR
AV
VR
-
Quiz
AR
AV
VR
-
Recap
-
Introductionto HoloLens
-
Different Devices
-
Magic is in the air
advanced technology is indistinguishable from
(Arthur C. Clarke)
-
To be a new magician
You have to be a
good illusionist
https://www.youtube.com/watch?v=u_diRgwPCS8 -
DemoGestures, Input, Voice Commands
-
HoloLens Inside
-
HololensPrototype
-
HololensDevice - Confort
-
HololensDevice - Confort
-
HololensDevice Sensor Bar
-
HololensDevice Sensor Bar
Ambient Light
Sensor
2MP Photo (2048x1152)/ HD Video Camera (1408x792)
Depth CameraIR Camera based on Time-Of-FlyHands Tracking + Surface reconstruction + Object Position
4 Environment Understanding CameraGray Scale Cameras
Create Map of the Room
-
HololensDevice Optics
-
HololensDevice Optics
IMUGyroscope + Magnetometer + AccelerometerFast Position Updates (2.5k radiants(light points per radian)Automatic pupillary distance calibration
See-through holographic lenses (waveguides)R - G B Layers
-
HololensDevice InternalHardware
-
HololensDevice InternalHardware
Memory: 64GB Flash / 2GB RAM
Processor: Intel Atom x5-Z8100 1.04 GHz 64-bitIntel Airmont (14nm) 4 Logical
GPU: Intel 8086h, Dedicated Video Memory 114 MB, Shared System Memory 980 MB
Custom-built Microsoft Holographic Processing Unit (HPU 1.0)
Battery: 16,500 mWhWeight : 579g
-
HololensDevice 3D SpatialSound
-
HololensDevice 3D SpatialSound
Built-in speakers.A precise audio experience without
block out the real world.
Spatial sound.Using a scientific model that characterizes how the human ear receives sound from a specific location, MicrosoftHoloLens synthesizes sound so that you can hear holograms from anywhere in the room.
-
What Next?
-
Project Alloy
Wireless VR/MR device
2 RealSense for spatialand handstraking
-
Commercial optionsKiosk mode. With HoloLens kiosk mode, you can limit which apps to run to enable demo or showcaseexperiences.
Mobile Device Management (MDM) for HoloLens.Your IT department can manage multiple HoloLens devices simultaneously using solutions like Microsoft InTune. You will be able to manage settings, select apps to install and set security configurations tailored to your organization'sneed.
Identity.Azure Active Directory and next generation credentials with PINunlock.
Windows Update for Business.Controlled operating system updates to devices and support for long term servicingbranch.
Data security.BitLocker data encryption and secure boot is enabled on HoloLens to provide the same level of security protection as any other Windowsdevice.
Work access.Anyone in your organization can remotely connect to the corporate network through a virtual private network on a HoloLens. HoloLens can also access Wi-Fi networks that requirecredentials.
Windows Store for Business.Your IT department can also set up an
specific HoloLens usage. Securely distribute your enterprise software to selected group of enterpriseusers
-
Meta 2
-
Magic Leap
-
Daqri
-
HTC Vive / OculusRift2