Reality ContinuumBenjamin Lok

University of Florida

October 2nd

What is What is VR?VR?

http://www.wiihaveaproblem.com/show_article.php?id=161

Ivan Sutherland’s The Ultimate Display

“Don’t think of that thing as a screen, think of it as a window, a window through which one looks into a virtual world. The challenge to computer graphics is to make that virtual world look real, sound real, move and respond to interaction in real time, and even feel real.”

Virtual Reality

Ideal for VR is that everything you experience is computer-generated.

Clinical Virtual Reality

The direct use of VR as a tool in the treatment or assessment of psychological

and physical disorders. (HITLab – UW)

Best VR? Why?

What are some goals for VR?

Virtual-ality Continuum

• Reality

Mixed Reality

Augmented Reality

Augmented Virtualality

• Virtual Reality

All Virtual Objects All Real Objects

Not everything is real

Paul Milgrim

USC ICT Flatworld

Classical Simulation

Classical simulation is a mix of real objects and computer generated stimuli.

All Virtual Objects All Real Objects

Mixed Reality

Merging of the real and virtual worlds

Why MR?Everything virtual not necessarily good

Examples?

Discuss a VR system to teach you how to change a lightbulb?

Benefits of real objects

Haptics

Active

Passive

Task Performance

Affordance

Augmented Virtualality

MR ComponentsMerged Space

Real World

Virtual World

Registration System

Example open Source library

ARToolKit

University of Washington HITLAB

Can be 1st person or 3rd person

Data FLowUSB Camera TabletPC

Graphics Rendering EngineOpenGL

Marker Tracking(ARToolKitPlus) User Interface

Dynamic Component Dynamic Component to your Physical to your Physical

StructuresStructures

1 marker for registration1-4ish markers for interaction

Anethesia Machine

Other MR Systems

Entertainment

Engineering

Medical

Other MR Systems

Physical Simulation

Human Patient Simulator

Mixed Reality HumansVirtual Humans

Tangible Interfaces

Artificial Reality (Myron Kruger)

Responsive Environment

Is an environment where human behavior is perceived by a computer which interprets what it observes and responds through intelligent visual and auditory displays

All Virtual Objects All Real Objects

Augmented RealityA combination of a real scene viewed by a user and a virtual scene generated by a computer that augments the scene with additional information. Ultrasound Visualization Research

atUNC – Chapel Hill

All Virtual Objects All Real Objects

Displaying data over the real world

Information

Heads Up Display

3D

Augmented Reality

Two-types

Optical See-Through

Video See-Through

Difficulties with AR/MR

Registration

User’s eye

Real and Virtual spaces

Tracking (additional to VR)

Display

Interfaces

Occlusion

Major AR Systems

Touring Machine

Feiner, Columbia

Major AR Systems

AR Toolkit+

Most popular AR system

Uses printable markers

Support for many video devices

Use as registration & interface element

Plasticity

HMD

TabletPC

PDA

Cellphone

AR Systems Leverage

Real world knowledge

Task training

Situational context

Less Modeling

Conferences

IEEE Virtual Reality

ACM Virtual Reality, Software, and Technology

IEEE/ACM International Symposium on Mixed and Augmented Reality

Medicine Meets Virtual Reality