![Page 1: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View](https://reader031.vdocuments.us/reader031/viewer/2022040612/5f0387d57e708231d409832d/html5/thumbnails/1.jpg)
Making Augmented Reality Work Outdoors
www.edxtech.com
@edxtechnologies
Keith Bray
1
![Page 2: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View](https://reader031.vdocuments.us/reader031/viewer/2022040612/5f0387d57e708231d409832d/html5/thumbnails/2.jpg)
How to go from this… To this?
Top-Down 2D Map View First Person AR View 2
![Page 3: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View](https://reader031.vdocuments.us/reader031/viewer/2022040612/5f0387d57e708231d409832d/html5/thumbnails/3.jpg)
Or even just as simple as… this.
3
![Page 4: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View](https://reader031.vdocuments.us/reader031/viewer/2022040612/5f0387d57e708231d409832d/html5/thumbnails/4.jpg)
Why do we want this?
4
![Page 5: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View](https://reader031.vdocuments.us/reader031/viewer/2022040612/5f0387d57e708231d409832d/html5/thumbnails/5.jpg)
5
![Page 6: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View](https://reader031.vdocuments.us/reader031/viewer/2022040612/5f0387d57e708231d409832d/html5/thumbnails/6.jpg)
6
![Page 7: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View](https://reader031.vdocuments.us/reader031/viewer/2022040612/5f0387d57e708231d409832d/html5/thumbnails/7.jpg)
7
![Page 8: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View](https://reader031.vdocuments.us/reader031/viewer/2022040612/5f0387d57e708231d409832d/html5/thumbnails/8.jpg)
Outdoor AR Problems • Anchor point detection • Where in the world am I? • How am I oriented? • GPS accuracy • Compass/orientation accuracy • Camera Field-of-views • Poor depth perception range • AR placement relative to the world • AR object orientation (3D vs 2D) • Obstruction of view
8
![Page 9: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View](https://reader031.vdocuments.us/reader031/viewer/2022040612/5f0387d57e708231d409832d/html5/thumbnails/9.jpg)
9
Outdoor AR Use Case Example 1
![Page 10: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View](https://reader031.vdocuments.us/reader031/viewer/2022040612/5f0387d57e708231d409832d/html5/thumbnails/10.jpg)
Where exactly do I dig to find this 1” x 1” cable or pipe?
10
Outdoor AR Use Case Example 2
![Page 11: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View](https://reader031.vdocuments.us/reader031/viewer/2022040612/5f0387d57e708231d409832d/html5/thumbnails/11.jpg)
11
![Page 12: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View](https://reader031.vdocuments.us/reader031/viewer/2022040612/5f0387d57e708231d409832d/html5/thumbnails/12.jpg)
Well, we have to fix some problems • GPS is inaccurate to ~3m (10 ft) • Compass can be off 5 degrees or more
Initial Thoughts: • Add external, more accurate GPS/GNSS • Replace GPS w/Computer Vision
(ARCore/ARKit) – see if this helps • AI / ML
12
![Page 13: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View](https://reader031.vdocuments.us/reader031/viewer/2022040612/5f0387d57e708231d409832d/html5/thumbnails/13.jpg)
13
![Page 14: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View](https://reader031.vdocuments.us/reader031/viewer/2022040612/5f0387d57e708231d409832d/html5/thumbnails/14.jpg)
14
![Page 15: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View](https://reader031.vdocuments.us/reader031/viewer/2022040612/5f0387d57e708231d409832d/html5/thumbnails/15.jpg)
But what about GPS and compass accuracy?
15
![Page 16: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View](https://reader031.vdocuments.us/reader031/viewer/2022040612/5f0387d57e708231d409832d/html5/thumbnails/16.jpg)
By default, it’s bad
16
![Page 17: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View](https://reader031.vdocuments.us/reader031/viewer/2022040612/5f0387d57e708231d409832d/html5/thumbnails/17.jpg)
Distance Skewing
17
![Page 18: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View](https://reader031.vdocuments.us/reader031/viewer/2022040612/5f0387d57e708231d409832d/html5/thumbnails/18.jpg)
Bad data in, bad data out
18
![Page 19: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View](https://reader031.vdocuments.us/reader031/viewer/2022040612/5f0387d57e708231d409832d/html5/thumbnails/19.jpg)
19
![Page 20: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View](https://reader031.vdocuments.us/reader031/viewer/2022040612/5f0387d57e708231d409832d/html5/thumbnails/20.jpg)
20
(Pa1, Pb1) (Pa2, Pb2) (Pa3, Pb3)
Some eq: 123x + 456y = Lat 789x + 654y = Lng
Multiple Linear Regression
![Page 21: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View](https://reader031.vdocuments.us/reader031/viewer/2022040612/5f0387d57e708231d409832d/html5/thumbnails/21.jpg)
21
![Page 22: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View](https://reader031.vdocuments.us/reader031/viewer/2022040612/5f0387d57e708231d409832d/html5/thumbnails/22.jpg)
How do we get good/great?
Combine lots of solutions • Apply Some math to subject’s location
• Use CV to adjust GPS error • Use GPS to adjust CV error
• Use a digital twin for AR projection • Use external GNSS if you can • Manual alignment also valid
22
![Page 23: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View](https://reader031.vdocuments.us/reader031/viewer/2022040612/5f0387d57e708231d409832d/html5/thumbnails/23.jpg)
23
![Page 24: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View](https://reader031.vdocuments.us/reader031/viewer/2022040612/5f0387d57e708231d409832d/html5/thumbnails/24.jpg)
24
![Page 25: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View](https://reader031.vdocuments.us/reader031/viewer/2022040612/5f0387d57e708231d409832d/html5/thumbnails/25.jpg)
25
![Page 26: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View](https://reader031.vdocuments.us/reader031/viewer/2022040612/5f0387d57e708231d409832d/html5/thumbnails/26.jpg)
26
![Page 27: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View](https://reader031.vdocuments.us/reader031/viewer/2022040612/5f0387d57e708231d409832d/html5/thumbnails/27.jpg)
27
![Page 28: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View](https://reader031.vdocuments.us/reader031/viewer/2022040612/5f0387d57e708231d409832d/html5/thumbnails/28.jpg)
Do things get better with fancy equipment?
28
![Page 29: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View](https://reader031.vdocuments.us/reader031/viewer/2022040612/5f0387d57e708231d409832d/html5/thumbnails/29.jpg)
Expensive GPS/Camera equipment
29
![Page 30: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View](https://reader031.vdocuments.us/reader031/viewer/2022040612/5f0387d57e708231d409832d/html5/thumbnails/30.jpg)
30
![Page 31: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View](https://reader031.vdocuments.us/reader031/viewer/2022040612/5f0387d57e708231d409832d/html5/thumbnails/31.jpg)
31
![Page 32: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View](https://reader031.vdocuments.us/reader031/viewer/2022040612/5f0387d57e708231d409832d/html5/thumbnails/32.jpg)
32
![Page 33: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View](https://reader031.vdocuments.us/reader031/viewer/2022040612/5f0387d57e708231d409832d/html5/thumbnails/33.jpg)
33
Where to go from here?
AI | ML |Image recognition
![Page 34: Making Augmented Reality Work Outdoors...Making Augmented Reality Work Outdoors @edxtechnologies Keith Bray 1 How to go from this… To this? Top-Down 2D Map View First Person AR View](https://reader031.vdocuments.us/reader031/viewer/2022040612/5f0387d57e708231d409832d/html5/thumbnails/34.jpg)
Thanks you!
Keith Bray
@edxtechnologies www.edxtech.com
A geospatial computing company