virtual reality : older than you think · components of 360-degree videos qoe. factors • system...

12
1 Ashutosh Singla, Stephan Fremerey, Werner Robitza, Alexander Raake Audiovisual Technology Group Technical University Ilmenau Germany VIRTUAL REALITY : OLDER THAN YOU THINK

Upload: others

Post on 11-Oct-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: VIRTUAL REALITY : OLDER THAN YOU THINK · Components of 360-degree Videos QoE. Factors • System • Resolution • Bit-rate • Encoding • Projection Format • Display Devices

1

Ashutosh Singla, Stephan Fremerey, Werner Robitza, Alexander Raake Audiovisual Technology GroupTechnical University Ilmenau Germany

VIRTUAL REALITY : OLDER THAN YOU THINK

Page 2: VIRTUAL REALITY : OLDER THAN YOU THINK · Components of 360-degree Videos QoE. Factors • System • Resolution • Bit-rate • Encoding • Projection Format • Display Devices

2

Outline

• Introduction of 360° videos

• History of VR

• VR Research @ AVT

Page 3: VIRTUAL REALITY : OLDER THAN YOU THINK · Components of 360-degree Videos QoE. Factors • System • Resolution • Bit-rate • Encoding • Projection Format • Display Devices

3

Introduction

• 360-degree = Omnidirectional = Virtual Reality videos• Interactive

– Allows viewers to change viewing direction– 3 Degrees of Freedom (DoF) – Future Applications : Gaming 6 DoF

• Immersive and Presence– “Transports” viewers from Physical World into Virtual World

Page 4: VIRTUAL REALITY : OLDER THAN YOU THINK · Components of 360-degree Videos QoE. Factors • System • Resolution • Bit-rate • Encoding • Projection Format • Display Devices

4

History of VR

• 1935 – Science fiction story “Pygmalion’s Spectacles” predicted VR– experience a fictional world along with touch, taste and smell

• 1960 Telesphere Mask – The first VR HMD– No motion tracking

• 1961 Headsight – First motion tracking HMD

• 1987 – VR was coined by Jaron Lanier

• 1995 – The Virtual Boy

• 21st Century VR – Vive, Rift

https://teslasuit.io/blog/history-of-virtual-reality-ultimate-guide/https://www.vrs.org.uk/virtual-reality/history.html

Page 5: VIRTUAL REALITY : OLDER THAN YOU THINK · Components of 360-degree Videos QoE. Factors • System • Resolution • Bit-rate • Encoding • Projection Format • Display Devices

5

In 1897 - Cineorama Projection

• Premiered at the Paris Exposition

• Used 10 synchronized projectors to arrange in a full 360°circle

• A viewing platform dressed like a hot air balloon, large enough to hold 200 people, was in the center

• Closed after only three days due to the extreme heat from the projectors

http://blog.abelcine.com/2015/06/11/the-curious-history-of-virtual-reality/

Page 6: VIRTUAL REALITY : OLDER THAN YOU THINK · Components of 360-degree Videos QoE. Factors • System • Resolution • Bit-rate • Encoding • Projection Format • Display Devices

6

In 1957 - Sensorama Simulator

• Made by Morton Heilig

• Built a 3D Video Machine – Feels like riding a virtual motor bike– Sounds, winds, vibrations– Smells of being on the road

http://www.techradar.com/news/wearables/forgotten-genius-the-man-who-made-a-working-vr-machine-in-1957-1318253

Page 7: VIRTUAL REALITY : OLDER THAN YOU THINK · Components of 360-degree Videos QoE. Factors • System • Resolution • Bit-rate • Encoding • Projection Format • Display Devices

7

VR Camera - Jump 360°

Page 8: VIRTUAL REALITY : OLDER THAN YOU THINK · Components of 360-degree Videos QoE. Factors • System • Resolution • Bit-rate • Encoding • Projection Format • Display Devices

8

In 1900 - The Lumière Photorama

Page 9: VIRTUAL REALITY : OLDER THAN YOU THINK · Components of 360-degree Videos QoE. Factors • System • Resolution • Bit-rate • Encoding • Projection Format • Display Devices

9

VR RESEARCH @ AVTResearch Goals

Page 10: VIRTUAL REALITY : OLDER THAN YOU THINK · Components of 360-degree Videos QoE. Factors • System • Resolution • Bit-rate • Encoding • Projection Format • Display Devices

10

Motivation and Research Goals

• Resolution limitation of HMD– Optimal Network Delivery– Provide insights into appropriate coding and resolution settings

• Simulator Sickness– Content– Resolution– Gender

• Behavioral Analysis– Favourable scene components (viewports) for the presented 360videos

Page 11: VIRTUAL REALITY : OLDER THAN YOU THINK · Components of 360-degree Videos QoE. Factors • System • Resolution • Bit-rate • Encoding • Projection Format • Display Devices

11

Components of 360-degree Videos QoE

Factors• System

• Resolution• Bit-rate• Encoding• Projection Format• Display Devices• Content• Lag• …

• User• Gender, Age• "States and traits"• Head Rotation/

Behaviour• …

• Physiological • Stress• Heart-rate• …..

Research• Subjective test methods• Identification of key

system factors and setting• Modelling

• Saliency• Relation QoE,

Simulator sickness, Behavior

• Recommendations for service operation

Page 12: VIRTUAL REALITY : OLDER THAN YOU THINK · Components of 360-degree Videos QoE. Factors • System • Resolution • Bit-rate • Encoding • Projection Format • Display Devices

12

Ashutosh Singla, Stephan Fremerey, Werner Robitza, Alexander Raake Audiovisual Technology GroupTechnical University Ilmenau Germany

Assessment of QoE and Subjective Quality of 360-degree Videoswith Head Mounted Displays