![Page 1: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/1.jpg)
Eric Wittner
The Emerging Trends of
Augmented Reality and Virtual
Reality in Design
![Page 2: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/2.jpg)
What are we talking about?
Introduction & Terminology
![Page 3: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/3.jpg)
VR vs AR
![Page 4: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/4.jpg)
VR - Virtual Reality
Being there
![Page 5: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/5.jpg)
AR - Augmented Reality
Interacting with outside world
![Page 6: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/6.jpg)
MR - Mixed Reality
Mixed presence
![Page 7: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/7.jpg)
Immersive Computing
• Fundamental computer human interaction
that is better than anything else
• AR got breakthrough with Pokemon GO,
VR with Rift and Playstation VR
• Passive content / 360 experiences
lowest barrier entry for VR
• Terminologies are not yet clear
We are at the very beginning of this.
![Page 8: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/8.jpg)
![Page 9: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/9.jpg)
![Page 10: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/10.jpg)
Terminology
![Page 11: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/11.jpg)
“Experience”
The term “experience” is used for
apps or the actual content. Means it
is common industry jargon, e.g.
Oculus uses the term to list the
apps. As a consequence, people
refer to a VR Experience not only as
user experience but also as an
asset.
![Page 12: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/12.jpg)
Mobile VR vs Console VR vs Desktop VR
• Low price
• Broad reach
• Graphics limited
• Bandwidth limited
• Only 3 DoF
• Easy to use
• Entertainment
content
• Walled garden
business model
• High cost
• Complex setup
• Free movement
• Advanced input
capabilities
![Page 13: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/13.jpg)
Seated vs Standing vs Room-scale
![Page 14: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/14.jpg)
Locomotion & Teleportation
![Page 15: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/15.jpg)
Teleportation & Artificial Locomotion
• 45% of experiences avoid locomotion at all due to motion sickness
• 42% use teleportation / portals (= de-facto standard)
• 5% use artificial locomotion (game pads)
• 8% use other techniques
Source:
Teleportation and Locomotion from the Trenches: What Movement is Right for You. By Ram Ramakrishnan & Janet Brown. GDC 2017.
![Page 16: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/16.jpg)
Input Devices
![Page 17: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/17.jpg)
Applications and UsesWho is adopting
![Page 18: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/18.jpg)
VR/AR Market Trends
VR- Education, training, planning
• Mobile• Easy, cheap to distribute
• Desktop• Cheaper than travelling to a site• Best VR experience possible
AR/MR- Field operations, resource management, planning
• Handheld• Use existing mobile devices
• Head-mounted• In the field, full scale; In the office, small scale• Hands-free for rapid response• Most immersive, collaborative 3D experience possible
![Page 19: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/19.jpg)
Demo: Viewing a proposed building
![Page 20: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/20.jpg)
ArcGIS 360 VRMobile focused VR Experience
![Page 21: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/21.jpg)
ArcGIS 360o
VR - Vision
“Immersion made easy.”
“Putting the world in perspective,
past, present, and future
quickly and easily.”
(Currently an Esri Labs project, will evolve into a full offering)
![Page 22: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/22.jpg)
Use Cases
Simple creation of mobile VR demos for
the public To showcase urban redevelopments to the public, CityEngine
users like the City of Zurich are looking for a simple CE-
scene-to-VR solution that is easy to use (= one-click publish)
and easy to setup (= mobile VR that does not require high-
end PC). Planned to be used on trade shows / booths, public
show rooms / installation, and architectural competition
viewing events.
Quick immersion into design to experience
view impactCityEngine users interested in VR would like to quickly
immerse into their 3D scenes to review the design. However
they want a simple, iterate-able workflow and not a
complicated 3D data pipeline to Unity. Also they want to
share the VR experience (mainly for review by peers, not yet
by the public). The typical design question that VR can
answer better than every other visualization: “How does the
new neighboring building impact the view from the balcony?”.
![Page 23: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/23.jpg)
ArcGIS 360 VR Experience & 360 Viewer
• A new Esri supported format: .3VR
• Composed of multiple rendered photospheres
• Can store views from multiple locations
• Can switch between locations using visual bookmarks in scene
• Each location can store multiple states, such as design scenarios
• Can switch between scenarios
• How is it authored: Created from CityEngine scenes, with plans in the
future to support authoring from other applications, and consumption of
spherical photography
• How is it viewed: In a VR application for Samsung Galaxy (eventually
other devices). Additional support for viewing by a web app.
![Page 24: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/24.jpg)
![Page 25: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/25.jpg)
![Page 26: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/26.jpg)
Roadmap
Web app for VR Experience
Web app for simple screen viewing
360 Photo Support
Refined view to view selection
Measurement
Pop-Ups
Depth
Video/Animation
Near Term
Mid and
Longer Term
![Page 27: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/27.jpg)
ArcGIS 360 VR
Demo: BIM/IFC,
3D Utilities
![Page 28: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/28.jpg)
VR/AR with ArcGIS RuntimePrivate beta in progress …
![Page 29: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/29.jpg)
ArcGIS Runtime Beta to support Virtual and Augmented
Reality• Enhance existing ArcGIS Runtime SDKs
- VR: Add “stereo display” rendering mode
- AR: Transparent background to render on video/camera feed
- Private Beta began in November 2017
- .NET and iOS SDKs available today
➢ Email [email protected] to request invite to beta program
![Page 30: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/30.jpg)
![Page 31: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/31.jpg)
Research combining ArcGIS Runtime and Gaming engines
• Runtime can bring GIS content to existing gaming engines
• Good for VR/AR/MR but also any “gaming type” application that needs GIS
• Advantages:
- Easy cross hardware VR/AR development
- Mixed Reality (HoloLens) development
- Good VR/AR/MR UI design experience
- Integration with the existing VR/AR/MR community
- Physics and other 3D effects
• We need your feedback
- What type of apps would you build with this approach?
- How important is this architecture for your organization, your customers?
![Page 32: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/32.jpg)
Unity and Unreal
Desktop VR with Unity and Unreal
![Page 33: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/33.jpg)
Unity
• Cross-platform game engine
• For developing mobile, browser, console, and desktop games
• Affordable ($0/35/125 per month)
• (Relatively) Easy to use
• Used beyond entertainment e.g. for architectural visualization…
Entry point to develop VR apps for HTC Vive, Oculus Rift, Gear VR, Hololens, …
![Page 34: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/34.jpg)
CityEngine: Select, «Export Models...»
![Page 35: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/35.jpg)
Choose FBX, Tweak Settings, & Click Finish
![Page 36: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/36.jpg)
Unity: Drag&Drop FBX to Assets & into scene
![Page 37: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/37.jpg)
Move «Main Camera» to center
![Page 38: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/38.jpg)
Enable VR
• Edit, Project Settings, Player
• Check «Virtual Reality Supported»
• Add OpenVR Support
- Click «+», «OpenVR»
- Drag above «Oculus»
![Page 39: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/39.jpg)
Start in VR: Press «Play» and experience it in HTC Vive
![Page 40: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/40.jpg)
Scene Tweaks: Scale
• Click mesh in «Assets»
• Scale Factor «100»
• Apply
![Page 41: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/41.jpg)
Scene Tweaks: Tree Transparency
• In «Materials», select
all Tree Materials
• Set «Rendering Mode»
to «Cutout»
![Page 42: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/42.jpg)
VR: Add Locomotion
• Window, «Asset Store»
• Search «SteamVR Plugin»
• «Import»
• «SteamVR_Settings» Dialog
- «Accept All»
![Page 43: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/43.jpg)
Add «Player»
• Delete «Main Camera»
• Drag in
«SteamVr\
InteractionSystem\
Core\Prefabs\Player»
![Page 44: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/44.jpg)
Add «teleport» prefab
• Drag in
«SteamVr\
InteractionSystem\
Teleport\
Prefabs\Teleporting»
![Page 45: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/45.jpg)
Add Teleport Points
• Drag in multiple
«SteamVr\
InteractionSystem\
Teleport\
Prefabs\TeleportPoint»
• Optional: Increase
their scale
![Page 46: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/46.jpg)
In VR, Teleport Using Click on Wheel
![Page 47: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/47.jpg)
Teleport anywhere
• Click Mesh in Assets
• «Generate Colliders»
• «Apply»
![Page 48: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/48.jpg)
Teleport anywhere
• Double-click street
• Copy/Paste
• Drag
«SteamVr\
InteractionSystem\
Teleport\
Scripts\TeleportArea»
on street copy
![Page 49: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/49.jpg)
In VR, Teleport Anywhere on Street
![Page 50: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/50.jpg)
![Page 51: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/51.jpg)
CityEngine 2017.1 – Architectural Visualization with Unreal
Engine
![Page 52: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/52.jpg)
![Page 53: The Emerging Trends of Augmented Reality and Virtual ...€¦ · • For developing mobile, browser, console, and desktop games • Affordable ($0/35/125 per month) • (Relatively)](https://reader031.vdocuments.us/reader031/viewer/2022011822/5ece2f086bbfcd2591178c58/html5/thumbnails/53.jpg)