scalable large, multi-resolution terrain real-time...

29
Outline DARTS lab Introduction SimScape Large terrain modeling CLOD visualization Conclusion Scalable Large, Multi-Resolution Terrain Real-Time Modeling and Visualization for Surface System Simulations Steven Myint Abhinandan Jain Jonathan Cameron Christopher Lim Jet Propulsion Laboratory, California Institute of Technology IROS 2011 http://dartslab.jpl.nasa.gov c 2011 California Institute of Technology. Government sponsorship acknowledged. S. Myint et al. JPL Scalable Large, Multi-Resolution Terrain Real-Time Modeling and Visualization for Surface System Simulations

Upload: others

Post on 21-Jul-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Scalable Large, Multi-Resolution Terrain Real-Time ...dartslab.jpl.nasa.gov/References/pdf/2011_iros... · Steven Myint, Abhinandan Jain, Jonathan Cameron, Christopher Lim Created

Outline DARTS lab Introduction SimScape Large terrain modeling CLOD visualization Conclusion

Scalable Large, Multi-Resolution TerrainReal-Time Modeling and Visualization for Surface

System Simulations

Steven Myint Abhinandan Jain Jonathan CameronChristopher Lim

Jet Propulsion Laboratory, California Institute of Technology

IROS 2011

http://dartslab.jpl.nasa.govc©2011 California Institute of Technology. Government sponsorship acknowledged.

S. Myint et al. JPL

Scalable Large, Multi-Resolution Terrain Real-Time Modeling and Visualization for Surface System Simulations

Page 2: Scalable Large, Multi-Resolution Terrain Real-Time ...dartslab.jpl.nasa.gov/References/pdf/2011_iros... · Steven Myint, Abhinandan Jain, Jonathan Cameron, Christopher Lim Created

Outline DARTS lab Introduction SimScape Large terrain modeling CLOD visualization Conclusion

1 DARTS lab

2 Introduction

3 SimScape

4 Large terrain modeling

5 CLOD visualization

6 Conclusion

S. Myint et al. JPL

Scalable Large, Multi-Resolution Terrain Real-Time Modeling and Visualization for Surface System Simulations

Page 3: Scalable Large, Multi-Resolution Terrain Real-Time ...dartslab.jpl.nasa.gov/References/pdf/2011_iros... · Steven Myint, Abhinandan Jain, Jonathan Cameron, Christopher Lim Created

Outline DARTS lab Introduction SimScape Large terrain modeling CLOD visualization Conclusion

DARTS lab

Dynamics And Real-Time Simulation(DARTS)

EDL simulations (DSENDS)

Rover simulations (ROAMS)

Airship simulations

Robotic arm simulations

S. Myint et al. JPL

Scalable Large, Multi-Resolution Terrain Real-Time Modeling and Visualization for Surface System Simulations

Page 4: Scalable Large, Multi-Resolution Terrain Real-Time ...dartslab.jpl.nasa.gov/References/pdf/2011_iros... · Steven Myint, Abhinandan Jain, Jonathan Cameron, Christopher Lim Created

Outline DARTS lab Introduction SimScape Large terrain modeling CLOD visualization Conclusion

DARTS lab examples (near earth object)

S. Myint et al. JPL

Scalable Large, Multi-Resolution Terrain Real-Time Modeling and Visualization for Surface System Simulations

Page 5: Scalable Large, Multi-Resolution Terrain Real-Time ...dartslab.jpl.nasa.gov/References/pdf/2011_iros... · Steven Myint, Abhinandan Jain, Jonathan Cameron, Christopher Lim Created

Outline DARTS lab Introduction SimScape Large terrain modeling CLOD visualization Conclusion

DARTS lab examples (ejecta)

S. Myint et al. JPL

Scalable Large, Multi-Resolution Terrain Real-Time Modeling and Visualization for Surface System Simulations

Page 6: Scalable Large, Multi-Resolution Terrain Real-Time ...dartslab.jpl.nasa.gov/References/pdf/2011_iros... · Steven Myint, Abhinandan Jain, Jonathan Cameron, Christopher Lim Created

Outline DARTS lab Introduction SimScape Large terrain modeling CLOD visualization Conclusion

DARTS lab examples (tethering near small body)

S. Myint et al. JPL

Scalable Large, Multi-Resolution Terrain Real-Time Modeling and Visualization for Surface System Simulations

Page 7: Scalable Large, Multi-Resolution Terrain Real-Time ...dartslab.jpl.nasa.gov/References/pdf/2011_iros... · Steven Myint, Abhinandan Jain, Jonathan Cameron, Christopher Lim Created

Outline DARTS lab Introduction SimScape Large terrain modeling CLOD visualization Conclusion

DARTS lab examples (surface operations)

S. Myint et al. JPL

Scalable Large, Multi-Resolution Terrain Real-Time Modeling and Visualization for Surface System Simulations

Page 8: Scalable Large, Multi-Resolution Terrain Real-Time ...dartslab.jpl.nasa.gov/References/pdf/2011_iros... · Steven Myint, Abhinandan Jain, Jonathan Cameron, Christopher Lim Created

Outline DARTS lab Introduction SimScape Large terrain modeling CLOD visualization Conclusion

DARTS lab examples (power analysis)

S. Myint et al. JPL

Scalable Large, Multi-Resolution Terrain Real-Time Modeling and Visualization for Surface System Simulations

Page 9: Scalable Large, Multi-Resolution Terrain Real-Time ...dartslab.jpl.nasa.gov/References/pdf/2011_iros... · Steven Myint, Abhinandan Jain, Jonathan Cameron, Christopher Lim Created

Outline DARTS lab Introduction SimScape Large terrain modeling CLOD visualization Conclusion

DARTS lab examples (spacecraft)

S. Myint et al. JPL

Scalable Large, Multi-Resolution Terrain Real-Time Modeling and Visualization for Surface System Simulations

Page 10: Scalable Large, Multi-Resolution Terrain Real-Time ...dartslab.jpl.nasa.gov/References/pdf/2011_iros... · Steven Myint, Abhinandan Jain, Jonathan Cameron, Christopher Lim Created

Outline DARTS lab Introduction SimScape Large terrain modeling CLOD visualization Conclusion

Large terrain modeling and visualization

S. Myint et al. JPL

Scalable Large, Multi-Resolution Terrain Real-Time Modeling and Visualization for Surface System Simulations

Page 11: Scalable Large, Multi-Resolution Terrain Real-Time ...dartslab.jpl.nasa.gov/References/pdf/2011_iros... · Steven Myint, Abhinandan Jain, Jonathan Cameron, Christopher Lim Created

Outline DARTS lab Introduction SimScape Large terrain modeling CLOD visualization Conclusion

Large terrain use cases

Our real-time simulations often requirelarge terrain modeling/visualizationsupport.

EDL simulations

Rover simulations

S. Myint et al. JPL

Scalable Large, Multi-Resolution Terrain Real-Time Modeling and Visualization for Surface System Simulations

Page 12: Scalable Large, Multi-Resolution Terrain Real-Time ...dartslab.jpl.nasa.gov/References/pdf/2011_iros... · Steven Myint, Abhinandan Jain, Jonathan Cameron, Christopher Lim Created

Outline DARTS lab Introduction SimScape Large terrain modeling CLOD visualization Conclusion

Large terrain use cases (continued)

Centimeter-resolution terraindata

Billions of vertices

Gigabytes of data

Too much data to load all atonce (due to time andmemory constraints)

Too much data to render inreal time (30 fps)

S. Myint et al. JPL

Scalable Large, Multi-Resolution Terrain Real-Time Modeling and Visualization for Surface System Simulations

Page 13: Scalable Large, Multi-Resolution Terrain Real-Time ...dartslab.jpl.nasa.gov/References/pdf/2011_iros... · Steven Myint, Abhinandan Jain, Jonathan Cameron, Christopher Lim Created

Outline DARTS lab Introduction SimScape Large terrain modeling CLOD visualization Conclusion

SimScape terrain framework

Models DEMs, planets, and arbitrary meshes

C++ and Python APIs

Store data in HDF5 (Hierarchical Data Format) for fastrandom access

Import data from various data formats (PDS, ISIS, GeoTiff,etc.)

S. Myint et al. JPL

Scalable Large, Multi-Resolution Terrain Real-Time Modeling and Visualization for Surface System Simulations

Page 14: Scalable Large, Multi-Resolution Terrain Real-Time ...dartslab.jpl.nasa.gov/References/pdf/2011_iros... · Steven Myint, Abhinandan Jain, Jonathan Cameron, Christopher Lim Created

Outline DARTS lab Introduction SimScape Large terrain modeling CLOD visualization Conclusion

Digital Elevation Maps

Regular rectangular height data

Fast access without mucharithmetic

Useful for modeling relatively smallareas

Used extensively in roversimulations

S. Myint et al. JPL

Scalable Large, Multi-Resolution Terrain Real-Time Modeling and Visualization for Surface System Simulations

Page 15: Scalable Large, Multi-Resolution Terrain Real-Time ...dartslab.jpl.nasa.gov/References/pdf/2011_iros... · Steven Myint, Abhinandan Jain, Jonathan Cameron, Christopher Lim Created

Outline DARTS lab Introduction SimScape Large terrain modeling CLOD visualization Conclusion

Planets

Grid of height data in sphericalcoordinates

Useful for larger areas when wemust consider planet curvature

S. Myint et al. JPL

Scalable Large, Multi-Resolution Terrain Real-Time Modeling and Visualization for Surface System Simulations

Page 16: Scalable Large, Multi-Resolution Terrain Real-Time ...dartslab.jpl.nasa.gov/References/pdf/2011_iros... · Steven Myint, Abhinandan Jain, Jonathan Cameron, Christopher Lim Created

Outline DARTS lab Introduction SimScape Large terrain modeling CLOD visualization Conclusion

Large terrain modeling

Support storing and loading oflarge planetary scale data

Support data sets that cannot fitinto memory

Support random access

Be able to access the data in realtime

S. Myint et al. JPL

Scalable Large, Multi-Resolution Terrain Real-Time Modeling and Visualization for Surface System Simulations

Page 17: Scalable Large, Multi-Resolution Terrain Real-Time ...dartslab.jpl.nasa.gov/References/pdf/2011_iros... · Steven Myint, Abhinandan Jain, Jonathan Cameron, Christopher Lim Created

Outline DARTS lab Introduction SimScape Large terrain modeling CLOD visualization Conclusion

Paging

Only a subset of terrain datais paged in

SimScape builds on top ofHDF5 to support paging

In the rover example, only asmall patch of data underthe rover is kept in memory

S. Myint et al. JPL

Scalable Large, Multi-Resolution Terrain Real-Time Modeling and Visualization for Surface System Simulations

Page 18: Scalable Large, Multi-Resolution Terrain Real-Time ...dartslab.jpl.nasa.gov/References/pdf/2011_iros... · Steven Myint, Abhinandan Jain, Jonathan Cameron, Christopher Lim Created

Outline DARTS lab Introduction SimScape Large terrain modeling CLOD visualization Conclusion

Data tiling

Large data sets are sometimesbroken up into separate tiles

Mainly useful when modifying andwriting data (less memoryconsumption at any one time)

Useful for parallel processing ofdata (running on supercomputer)

Many data sets (e.g. MOLA) comein tiled format

Transparent to the data loadingAPI

S. Myint et al. JPL

Scalable Large, Multi-Resolution Terrain Real-Time Modeling and Visualization for Surface System Simulations

Page 19: Scalable Large, Multi-Resolution Terrain Real-Time ...dartslab.jpl.nasa.gov/References/pdf/2011_iros... · Steven Myint, Abhinandan Jain, Jonathan Cameron, Christopher Lim Created

Outline DARTS lab Introduction SimScape Large terrain modeling CLOD visualization Conclusion

Continuous level of detail visualization

A continuous level of detail(CLOD) technique allows us torender high resolution data onlywhere we want it (e.g, where thecamera is pointing).

Render very large data setsthat can’t normally berendered all at once by thegraphics card

Render in real time

Unlike a discrete LODtechnique, transitionbetween levels is smooth (nopopping between levels)

S. Myint et al. JPL

Scalable Large, Multi-Resolution Terrain Real-Time Modeling and Visualization for Surface System Simulations

Page 20: Scalable Large, Multi-Resolution Terrain Real-Time ...dartslab.jpl.nasa.gov/References/pdf/2011_iros... · Steven Myint, Abhinandan Jain, Jonathan Cameron, Christopher Lim Created

Outline DARTS lab Introduction SimScape Large terrain modeling CLOD visualization Conclusion

Continuous level of detail visualization example

S. Myint et al. JPL

Scalable Large, Multi-Resolution Terrain Real-Time Modeling and Visualization for Surface System Simulations

Page 21: Scalable Large, Multi-Resolution Terrain Real-Time ...dartslab.jpl.nasa.gov/References/pdf/2011_iros... · Steven Myint, Abhinandan Jain, Jonathan Cameron, Christopher Lim Created

Outline DARTS lab Introduction SimScape Large terrain modeling CLOD visualization Conclusion

Clipmapping

S. Myint et al. JPL

Scalable Large, Multi-Resolution Terrain Real-Time Modeling and Visualization for Surface System Simulations

Page 22: Scalable Large, Multi-Resolution Terrain Real-Time ...dartslab.jpl.nasa.gov/References/pdf/2011_iros... · Steven Myint, Abhinandan Jain, Jonathan Cameron, Christopher Lim Created

Outline DARTS lab Introduction SimScape Large terrain modeling CLOD visualization Conclusion

Clipmapping

Concentric rings of data

Innermost rings have thehighest resolution data

Each ring is composed of aregular grid

S. Myint et al. JPL

Scalable Large, Multi-Resolution Terrain Real-Time Modeling and Visualization for Surface System Simulations

Page 23: Scalable Large, Multi-Resolution Terrain Real-Time ...dartslab.jpl.nasa.gov/References/pdf/2011_iros... · Steven Myint, Abhinandan Jain, Jonathan Cameron, Christopher Lim Created

Outline DARTS lab Introduction SimScape Large terrain modeling CLOD visualization Conclusion

Clipmapping takes advantage of perspective projection

S. Myint et al. JPL

Scalable Large, Multi-Resolution Terrain Real-Time Modeling and Visualization for Surface System Simulations

Page 24: Scalable Large, Multi-Resolution Terrain Real-Time ...dartslab.jpl.nasa.gov/References/pdf/2011_iros... · Steven Myint, Abhinandan Jain, Jonathan Cameron, Christopher Lim Created

Outline DARTS lab Introduction SimScape Large terrain modeling CLOD visualization Conclusion

Other advantages of using clipmapping

Each ring has the samebasic regular grid geometry

Nearly the same operationsdone to each vertex

Computation easilyparallelizable (amenable toGPU implementation)

Full resolutionHalf resolution

Quarter resolution

S. Myint et al. JPL

Scalable Large, Multi-Resolution Terrain Real-Time Modeling and Visualization for Surface System Simulations

Page 25: Scalable Large, Multi-Resolution Terrain Real-Time ...dartslab.jpl.nasa.gov/References/pdf/2011_iros... · Steven Myint, Abhinandan Jain, Jonathan Cameron, Christopher Lim Created

Outline DARTS lab Introduction SimScape Large terrain modeling CLOD visualization Conclusion

GPU implementation

Implementing clipmapping on the GPU allows usto utilize hundreds of GPU cores.

Upload height map data to the GPU as atexture

Vertex program computes vertexpositions/normals based on:

Center position of all clipmapsClipmap ring levelHeight map texture

Fragment program computes final pixel colorbased on:

Albedo sampled from textureSurface normal (passed in from vertexshader)

Vertexprocessor

Rasterization

Fragmentprocessor

Frame buffer

S. Myint et al. JPL

Scalable Large, Multi-Resolution Terrain Real-Time Modeling and Visualization for Surface System Simulations

Page 26: Scalable Large, Multi-Resolution Terrain Real-Time ...dartslab.jpl.nasa.gov/References/pdf/2011_iros... · Steven Myint, Abhinandan Jain, Jonathan Cameron, Christopher Lim Created

Outline DARTS lab Introduction SimScape Large terrain modeling CLOD visualization Conclusion

Moving clipmaps

The high resolution area is movedby moving all clipmap rings.

S. Myint et al. JPL

Scalable Large, Multi-Resolution Terrain Real-Time Modeling and Visualization for Surface System Simulations

Page 27: Scalable Large, Multi-Resolution Terrain Real-Time ...dartslab.jpl.nasa.gov/References/pdf/2011_iros... · Steven Myint, Abhinandan Jain, Jonathan Cameron, Christopher Lim Created

Outline DARTS lab Introduction SimScape Large terrain modeling CLOD visualization Conclusion

Overlays

Wheel tracks areoverlaid on theterrain byperturbing thesurface normals ona per-pixel basis.

S. Myint et al. JPL

Scalable Large, Multi-Resolution Terrain Real-Time Modeling and Visualization for Surface System Simulations

Page 28: Scalable Large, Multi-Resolution Terrain Real-Time ...dartslab.jpl.nasa.gov/References/pdf/2011_iros... · Steven Myint, Abhinandan Jain, Jonathan Cameron, Christopher Lim Created

Outline DARTS lab Introduction SimScape Large terrain modeling CLOD visualization Conclusion

Overlays (continued)

Height maps

Albedo maps

Slope maps

S. Myint et al. JPL

Scalable Large, Multi-Resolution Terrain Real-Time Modeling and Visualization for Surface System Simulations

Page 29: Scalable Large, Multi-Resolution Terrain Real-Time ...dartslab.jpl.nasa.gov/References/pdf/2011_iros... · Steven Myint, Abhinandan Jain, Jonathan Cameron, Christopher Lim Created

Outline DARTS lab Introduction SimScape Large terrain modeling CLOD visualization Conclusion

Summary and future work

Summary

With paging, we can work with arbitrarily large terrain datasetsWe can visualize these large terrains using continuous level ofdetailWe make use of the GPU’s multi-core architecture in ourimplementation of continuous level of detail

Future work

Support paging of high-resolution (albedo) textures (instead ofjust geometry)Improve efficiency of GPU programs by dynamicallyautogenerating them based what features are being used (likeheight maps)

S. Myint et al. JPL

Scalable Large, Multi-Resolution Terrain Real-Time Modeling and Visualization for Surface System Simulations