nasa’s hybrid reality lab: one giant leap for full dive · 2017. 5. 18. · nasa’s hybrid...

54
NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality Lab National Aeronautics and Space Administration Frank Delgado Project Lead/Hybrid Reality Lab National Aeronautics and Space Administration

Upload: others

Post on 27-Mar-2021

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality

NASA’s Hybrid RealityLab: One Giant Leap

for Full DiveMatthew Noyes

Software Lead/Hybrid Reality LabNational Aeronautics and Space Administration

Frank DelgadoProject Lead/Hybrid Reality Lab

National Aeronautics and Space Administration

Page 2: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality
Page 3: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality
Page 4: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality
Page 5: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality

What is Hybrid Reality?

Page 6: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality
Page 7: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality

From Star Trek TNG Technical Manual

3D print plastic objects as substitutes for NASA tools

“Matter conversion subsystem creates physical props using replicators. Replicated props are generally created when an object is likely to be touched by a participant.”

Page 8: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality
Page 9: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality

Consumer VR makes 3D printed objects look like the real thing

From Star Trek TNG Technical Manual

“Holodeck imagery subsystem creates three-dimensional images of simulated environments. Shaped forcebeamsgive physical substance to foreground objects so they

have the illusion of being solid.”

Page 10: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality
Page 11: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality

Recreate interactive tool displays and interfaces digitally. Animate moving

parts in software when possible.

From Star Trek TNG Technical Manual

“Some props are animated under computer control by precision-guided tractor beams.”

Page 12: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality
Page 13: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality
Page 14: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality

Real VirtualHybrid Reality

Page 15: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality
Page 16: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality

Tools

Page 17: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality

Create a low cost, scalable HR platform combining:

Head/Body Tracking + Visual FeedbackReduced GravityTactile Feedback

Realistic Graphics & SoundPhysics

Multiplayer

Page 18: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality

Create a low cost, scalable HR platform combining:

Head/Body Tracking + Visual FeedbackReduced GravityTactile Feedback

Realistic Graphics & SoundPhysics

Multiplayer

Page 19: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality

Original NASA VR Headsets

Page 20: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality

Modern NASA VR Headsets

Page 21: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality

Consumer VR Headsets

Page 22: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality

GOALCreate a low cost, scalable HR platform

combining:

Head/Body Tracking + Visual FeedbackReduced GravityTactile Feedback

Realistic Graphics & SoundPhysics

Multiplayer

Page 23: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality
Page 24: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality
Page 25: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality

GOALCreate a low cost, scalable HR platform

combining:

Head/Body Tracking + Visual FeedbackReduced GravityTactile Feedback

Realistic Graphics & SoundPhysics

Multiplayer

Page 26: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality

NVIDIA Graphics & Unreal Engine Rendering

Page 27: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality

Applications

Page 28: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality

International Space Station (ISS)

Page 29: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality
Page 30: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality
Page 31: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality
Page 32: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality
Page 33: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality
Page 34: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality
Page 35: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality
Page 36: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality
Page 37: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality
Page 38: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality
Page 39: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality
Page 40: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality
Page 41: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality
Page 42: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality

Object dynamics

3D printed tools

3D scanned tools

Microgravity fluid simulation

Page 43: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality

Realistic Earth Model built from satellite imagery

Eye adaptation

Page 44: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality

Planetary Surfaces

Page 45: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality

20 foot Habitat

Prototype habitat designs in Hybrid Reality

3 stories tall, 20’ diameter

Page 46: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality
Page 47: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality
Page 48: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality
Page 49: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality
Page 50: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality
Page 51: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality
Page 52: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality

Thank You

Page 53: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality

NASA Hybrid Reality Lab Contacts

Project [email protected]

Software [email protected]

Page 54: NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive · 2017. 5. 18. · NASA’s Hybrid Reality Lab: One Giant Leap for Full Dive Matthew Noyes Software Lead/Hybrid Reality

NASA Hybrid Reality Lab Contacts

Questions

Project [email protected]

Software [email protected]