nasa’s hybrid reality lab: one giant leap for full...

54
NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality Lab National Aeronautics and Space Administration Frank Delgado Project Lead/Hybrid Reality Lab National Aeronautics and Space Administration

Upload: vutu

Post on 06-Feb-2018

214 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic

NASA’s Hybrid RealityLab: One Giant Leap

for Full DiveMatthew Noyes

Software Lead/Hybrid Reality LabNational Aeronautics and Space Administration

Frank DelgadoProject Lead/Hybrid Reality Lab

National Aeronautics and Space Administration

Page 2: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic
Page 3: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic
Page 4: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic
Page 5: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic

What is Hybrid Reality?

Page 6: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic
Page 7: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic

From Star Trek TNG Technical Manual

3D print plastic objects as substitutes for NASA tools

“Matter conversion subsystem creates physical props using replicators. Replicated props are generally created when an object is likely to be touched by a participant.”

Page 8: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic
Page 9: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic

Consumer VR makes 3D printed objects look like the real thing

From Star Trek TNG Technical Manual

“Holodeck imagery subsystem creates three-dimensional images of simulated environments. Shaped forcebeamsgive physical substance to foreground objects so they

have the illusion of being solid.”

Page 10: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic
Page 11: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic

Recreate interactive tool displays and interfaces digitally. Animate moving

parts in software when possible.

From Star Trek TNG Technical Manual

“Some props are animated under computer control by precision-guided tractor beams.”

Page 12: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic
Page 13: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic
Page 14: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic

Real VirtualHybrid Reality

Page 15: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic
Page 16: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic

Tools

Page 17: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic

Create a low cost, scalable HR platform combining:

Head/Body Tracking + Visual FeedbackReduced GravityTactile Feedback

Realistic Graphics & SoundPhysics

Multiplayer

Page 18: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic

Create a low cost, scalable HR platform combining:

Head/Body Tracking + Visual FeedbackReduced GravityTactile Feedback

Realistic Graphics & SoundPhysics

Multiplayer

Page 19: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic

Original NASA VR Headsets

Page 20: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic

Modern NASA VR Headsets

Page 21: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic

Consumer VR Headsets

Page 22: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic

GOALCreate a low cost, scalable HR platform

combining:

Head/Body Tracking + Visual FeedbackReduced GravityTactile Feedback

Realistic Graphics & SoundPhysics

Multiplayer

Page 23: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic
Page 24: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic
Page 25: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic

GOALCreate a low cost, scalable HR platform

combining:

Head/Body Tracking + Visual FeedbackReduced GravityTactile Feedback

Realistic Graphics & SoundPhysics

Multiplayer

Page 26: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic

NVIDIA Graphics & Unreal Engine Rendering

Page 27: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic

Applications

Page 28: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic

International Space Station (ISS)

Page 29: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic
Page 30: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic
Page 31: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic
Page 32: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic
Page 33: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic
Page 34: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic
Page 35: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic
Page 36: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic
Page 37: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic
Page 38: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic
Page 39: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic
Page 40: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic
Page 41: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic
Page 42: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic

Object dynamics

3D printed tools

3D scanned tools

Microgravity fluid simulation

Page 43: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic

Realistic Earth Model built from satellite imagery

Eye adaptation

Page 44: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic

Planetary Surfaces

Page 45: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic

20 foot Habitat

Prototype habitat designs in Hybrid Reality

3 stories tall, 20’ diameter

Page 46: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic
Page 47: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic
Page 48: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic
Page 49: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic
Page 50: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic
Page 51: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic
Page 52: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic

Thank You

Page 53: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic

NASA Hybrid Reality Lab Contacts

Project [email protected]

Software [email protected]

Page 54: NASA’s Hybrid Reality Lab: One Giant Leap for Full Diveon-demand.gputechconf.com/gtc/...hybrid-reality-lab-one-giant-leap.pdf · From Star Trek TNG Technical Manual 3D print plastic

NASA Hybrid Reality Lab Contacts

Questions

Project [email protected]

Software [email protected]