vr / ar fundamentals - amazon...
TRANSCRIPT
Michael Naimark Visiting Associate Arts Professor
Interactive Media Arts NYU Shanghai
VR / AR FundamentalsINTM-SHU 280C - 1 Topics in New Media & Entertainment Fall 2017
a practical guide to the big ideas
Jiayi Wang
Week 4: Other Senses (Haptic, Smell, Taste, Mind)
Fooling the other senses.
Week 1 - Introduction to VR and AR
Week 2 - FUNDAMENTALS 1: Audiovisual Resolution and Fidelity Fooling a single static eye and single static ear experiencing a framed representation.
Week 3 - FUNDAMENTALS 2: Audiovisual Spatiality and Immersion Fooling two static eyes and ears, then two moving eyes and ears, then removing the frame.
Week 4 - FUNDAMENTALS 3: Other Senses (Haptic, Smell, Taste, Mind) Fooling the other senses.
Week 5 - FUNDAMENTALS 4: Input and Interactivity Using our effectors as inputs and how they shape interactive experiences.
Week 6 - FUNDAMENTALS 5: Social and Liveness Being immersed with other people and live events.
Week 7 - Current Dilemmas This is a lead-in, “pre-production,” to the second half-semester.
First half semesterClass Structure
Michael Naimark Visiting Associate Arts Professor
Interactive Media Arts NYU Shanghai
VR / AR FundamentalsINTM-SHU 280C - 1 Topics in New Media & Entertainment Fall 2017
a practical guide to the big ideas
Jiayi Wang
Week 4: Other Senses (Haptic, Smell, Taste, Mind)
Fooling the other senses.
Jiayi Wang
VR / AR Fundamentals
Other Senses (Haptic, Smell, Taste, Mind) Fooling the other senses.
Haptics • Haptics & Force-Feedback • Seats & Motion Platforms • “4D" • Skin as Input • Hands & Controllers • Touching Real Things / MR • Non-Contact Haptics
Smell & Taste • Smell-O-Vision & the Food Simulator • Current Work
Mind • Remote Viewing (ESP), Brainstorm (the movie), & Science • Hacks
Issues • When is suggestion good enough? • Synaesthesia
Jiayi Wang
VR / AR Fundamentals
Other Senses (Haptic, Smell, Taste, Mind) Fooling the other senses.
Haptics • Haptics & Force-Feedback • Seats & Motion Platforms • “4D" • Skin as Input • Hands & Controllers • Touching Real Things / MR • Non-Contact Haptics
Smell & Taste • Smell-O-Vision & the Food Simulator • Current Work
Mind • Remote Viewing (ESP), Brainstorm (the movie), & Science • Hacks
Issues • When is suggestion good enough? • Synaesthesia
RideFilmBack to the Future ride, 1991
VR Roller Coaster
https://www.youtube.com/watch?v=2IASj7qvCjg
Jiayi Wang
VR / AR Fundamentals
Other Senses (Haptic, Smell, Taste, Mind) Fooling the other senses.
Haptics • Haptics & Force-Feedback • Seats & Motion Platforms • “4D" • Skin as Input • Hands & Controllers • Touching Real Things / MR • Non-Contact Haptics
Smell & Taste • Smell-O-Vision & the Food Simulator • Current Work
Mind • Remote Viewing (ESP), Brainstorm (the movie), & Science • Hacks
Issues • When is suggestion good enough? • Synaesthesia
Jiayi Wang
VR / AR Fundamentals
Other Senses (Haptic, Smell, Taste, Mind) Fooling the other senses.
Haptics • Haptics & Force-Feedback • Seats & Motion Platforms • “4D" • Skin as Input • Hands & Controllers • Touching Real Things / MR • Non-Contact Haptics
Smell & Taste • Smell-O-Vision & the Food Simulator • Current Work
Mind • Remote Viewing (ESP), Brainstorm (the movie), & Science • Hacks
Issues • When is suggestion good enough? • Synaesthesia
https://lmts.epfl.ch/haptics
https://tcnl.bme.wisc.edu/projects/completed/es-haptic
https://www.youtube.com/watch?v=7xnVchr5nhM
Facebook “Skin Hearing”
Haptic Displays
VR Haptic Suits
https://www.kickstarter.com/projects/morgansinko/hardlight-vr-suit-dont-just-play-the-game-feel-it
https://virtualrealitytimes.com/2017/02/28/list-of-full-body-virtual-reality-haptic-suits/
We’re not gonna talk about haptic VR sex
except . . .
http://comicbook.com/gaming/2017/09/22/oculus-vr-porn-hardware/
http://www.mirror.co.uk/news/weird-news/man-sex-inflatable-torso-demonstrates-11222433
Jiayi Wang
VR / AR Fundamentals
Other Senses (Haptic, Smell, Taste, Mind) Fooling the other senses.
Haptics • Haptics & Force-Feedback • Seats & Motion Platforms • “4D" • Skin as Input • Hands & Controllers • Touching Real Things / MR • Non-Contact Haptics
Smell & Taste • Smell-O-Vision & the Food Simulator • Current Work
Mind • Remote Viewing (ESP), Brainstorm (the movie), & Science • Hacks
Issues • When is suggestion good enough? • Synaesthesia
Haptic Game Controllers
Google Image search
Jiayi Wang
VR / AR Fundamentals
Other Senses (Haptic, Smell, Taste, Mind) Fooling the other senses.
Haptics • Haptics & Force-Feedback • Seats & Motion Platforms • “4D" • Skin as Input • Hands & Controllers • Touching Real Things / MR • Non-Contact Haptics
Smell & Taste • Smell-O-Vision & the Food Simulator • Current Work
Mind • Remote Viewing (ESP), Brainstorm (the movie), & Science • Hacks
Issues • When is suggestion good enough? • Synaesthesia
https://www.youtube.com/watch?v=XrpUvRSb2E0
https://tribecafilm.com/filmguide/draw-me-close-2017
Jiayi Wang
VR / AR Fundamentals
Other Senses (Haptic, Smell, Taste, Mind) Fooling the other senses.
Haptics • Haptics & Force-Feedback • Seats & Motion Platforms • “4D" • Skin as Input • Hands & Controllers • Touching Real Things / MR • Non-Contact Haptics
Smell & Taste • Smell-O-Vision & the Food Simulator • Current Work
Mind • Remote Viewing (ESP), Brainstorm (the movie), & Science • Hacks
Issues • When is suggestion good enough? • Synaesthesia
Air Vortex Rings
Ultrasoundhttps://www.ultrahaptics.com/
https://www.youtube.com/watch?v=GDra4IJmJN0
https://www.microsoft.com/en-us/research/project/airwave-non-contact-haptic-feedback-using-air-vortex-rings/
Jiayi Wang
VR / AR Fundamentals
Other Senses (Haptic, Smell, Taste, Mind) Fooling the other senses.
Haptics • Haptics & Force-Feedback • Seats & Motion Platforms • “4D" • Skin as Input • Hands & Controllers • Touching Real Things / MR • Non-Contact Haptics
Smell & Taste • Smell-O-Vision & the Food Simulator • Current Work
Mind • Remote Viewing (ESP), Brainstorm (the movie), & Science • Hacks
Issues • When is suggestion good enough? • Synaesthesia
Smell-O-Vision (1960) (and AromaRama, Odorama, & Aroma-Scope)
https://en.wikipedia.org/wiki/Smell-O-Vision
The Food Simulator (2003)
https://www.wired.com/2003/08/slideshow-wonders-aplenty-at-siggraph/
https://gizmodo.com/5608457/meta-cookie-uses-virtual-reality-to-make-a-cookie-taste-like-anything-you-want
Meta Cookie (2010)
http://www.dailymail.co.uk/sciencetech/article-3905258/Now-taste-FOOD-virtual-reality-Electrodes-stuck-face-let-users-feel-textures-sense-flavours.html
Virtual Sweetness
2016
Jiayi Wang
VR / AR Fundamentals
Other Senses (Haptic, Smell, Taste, Mind) Fooling the other senses.
Haptics • Haptics & Force-Feedback • Seats & Motion Platforms • “4D" • Skin as Input • Hands & Controllers • Touching Real Things / MR • Non-Contact Haptics
Smell & Taste • Smell-O-Vision & the Food Simulator • Current Work
Mind • Remote Viewing (ESP), Brainstorm (the movie), & Science • Hacks
Issues • When is suggestion good enough? • Synaesthesia
https://en.wikipedia.org/wiki/Remote_viewing
https://www.youtube.com/watch?v=FCc69jg9Kvc
Brainstorm (the movie) 1983
Jiayi Wang
VR / AR Fundamentals
Other Senses (Haptic, Smell, Taste, Mind) Fooling the other senses.
Haptics • Haptics & Force-Feedback • Seats & Motion Platforms • “4D" • Skin as Input • Hands & Controllers • Touching Real Things / MR • Non-Contact Haptics
Smell & Taste • Smell-O-Vision & the Food Simulator • Current Work
Mind • Remote Viewing (ESP), Brainstorm (the movie), & Science • Hacks
Issues • When is suggestion good enough? • Synaesthesia
The Phosphotron
http://www.vasulka.org/archive/4-30b/Seno(9007).pdf
Shaking the World
https://www.youtube.com/watch?v=Gt6EnYvH7eY
Galvanic Vestibular Stimulation As A Novel Sensation Interface” ACM SIGGRAPH 2005 Emerging Technologies, 2005
Jiayi Wang
VR / AR Fundamentals
Other Senses (Haptic, Smell, Taste, Mind) Fooling the other senses.
Haptics • Haptics & Force-Feedback • Seats & Motion Platforms • “4D" • Skin as Input • Hands & Controllers • Touching Real Things / MR • Non-Contact Haptics
Smell & Taste • Smell-O-Vision & the Food Simulator • Current Work
Mind • Remote Viewing (ESP), Brainstorm (the movie), & Science • Hacks
Issues • When is suggestion good enough? • Synaesthesia
http://www.ultimatetaxi.com/
The Screeching Tires trick
Jiayi Wang
VR / AR Fundamentals
Other Senses (Haptic, Smell, Taste, Mind) Fooling the other senses.
Haptics • Haptics & Force-Feedback • Seats & Motion Platforms • “4D" • Skin as Input • Hands & Controllers • Touching Real Things / MR • Non-Contact Haptics
Smell & Taste • Smell-O-Vision & the Food Simulator • Current Work
Mind • Remote Viewing (ESP), Brainstorm (the movie), & Science • Hacks
Issues • When is suggestion good enough? • Synaesthesia
https://en.wikipedia.org/wiki/Synesthesia
The Banff Crank
https://www.youtube.com/watch?v=l6M8xuH-uFU
VR / AR Fundamentals
Be prepared to set up and install!
Week 3: Assignment for Wednesday
VR / AR News of the Week Mon 25 Sep
VR / AR Fundamentals
Pimax Kickstarter exceeds $1M (+ “scent modules” and “eye tracking models” for “foveated rendering” via partners) Standalone VR Headsets Are On The Way! (note source)
Ars Electronica opens VR Lab
Oculus tweaks VR audio to seem closer and more realistic
China’s Largest Messaging App ‘WeChat’ is Creating its Own AR Platform (HT to Jack Hua Zhu) Google signs $1.1bn HTC smartphone deal (money goes to HTC VR dev?) 3 things you need to know about augmented reality in China
VR Industry Forum Draft Guidelines Push for Open Ecosystem