rpi / geo* / nga & darpa oct 1-2 2007 1 dem compression and terrain approximation; smugglers and...
TRANSCRIPT
![Page 1: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/1.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 20071
DEM Compression and Terrain Approximation; Smugglers and Border
Guards Prof W Randolph Franklin, Prof Frank Luk, Prof
Barbara Cutler, Prof Marcus Andrade, Metin Inanc, Zhongyi Xie, Dan Tracy, Jon Muckell
Rensselaer Polytechnic [email protected], 703-447-7808
![Page 2: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/2.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 20072
Complete Record
This version contains both the slides that I showed to NGA (on 10/1/2007), and to DARPA (on 10/2/2007). Therefore it is both a good introductory and detailed record of RPI’s performance to date.
http://www.ecse.rpi.edu/~wrf/pmwiki/GeoStar
contains most material ever given by RPI to DARPA or NGA.
Ask WRF for a password
![Page 3: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/3.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 20073
Team
Prof Randolph Franklin – helping everyone Prof Barbara Cutler – computer graphics Prof Frank Luk (on leave as Vice-President (Academic) of
Hong Kong Baptist U) – numerical analysis Prof Marcus Andrade – visiting from UF ViÇosa (Brazil) –
computational geometry
Metin Inanc – ODETLAP Zhongyi Xie – ODETLAP Dan Tracy – multiobserver siting, path planning Jon Muckell – hydrology.
Changes
![Page 4: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/4.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 20074
Potential Benefits
More compact terrain representations.• Store the ever larger amounts of terrain data. Spend time
on the compression (which is done once) to get most compact representation.
• Works on 16 bit topography.
Conflate overlapping inconsistent cells.• Overlay large, low precision cell by smaller high precision
cells => one unified elevation field.
Efficient routing by nonspecialists.• Route our aircraft away from antiaircraft batteries
Better hydrographic computations.• Flood prediction.
![Page 5: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/5.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 20075
An Inadequate Terrain Representation
![Page 6: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/6.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 20076
![Page 7: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/7.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 20077
Goal 1: DEM Compression and Terrain Approximation
ODETLAP: alternate terrain representation. Compact. Allows lossy - size / quality tradeoffs. Emphasized decompression speed. Evaluated on visibility, mobility metrics.
![Page 8: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/8.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 20078
Milestone Progress
Phase I: 10x compression while maintaining usefulness; Phase II: 100x
Reverse engineered HRTI Analysis Tool’s slope formula to avoid running HAT each time.
We gave before-and-after data to NGA demonstrating this.
Further improvements made since then. Fitting other components of proposal (e.g.,
hydrology) to correspond to milestones.
![Page 9: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/9.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 20079
Key Differentiating Factors
Smooth representation• no visible blockiness
Allows progressive transmission• longer transmission => more accurate reconstruction
Conflates inconsistent partially overlapping data.
Interpolates partial sets of elevation posts• generates continuous slopes even when the input
data consists of nested contour lines.
Infers local maxima inside the topmost contour.
![Page 10: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/10.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200710
ODETLAP Process
Since our first description of ODETLAP at the 1998 Spatial Data Handling Symposium, we’ve built this system.
![Page 11: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/11.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200711
ODETLAP Point Selection
Several options: Incremental TIN to
find most important points, then greedy insertion of worst points (Allows progressive transmission)
• Regular grid of points (more points, but compress better) (More compact) NEW
• Stream and ridgeline points (Preliminary) NEW
![Page 12: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/12.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200712
Other Point Selection Strategies
The following were not as good: Select highly visible points, or Random points, or Points based on histogram of heights with
boosted sampling for less frequent elevation bands and small connected components.
![Page 13: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/13.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200713
Incremental Triangulated Irregular Network (TIN)
Can process 108 points on a laptop.
Works in memory w/o needing to page data from disk.
Inserts points incrementally, in order of importance.
Can progressively transmit terrain.
Identifies ridge lines automatically.
![Page 14: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/14.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200714
Coding the Points to Reduce Space
Code (x,y) separately from z. NEW If (x,y) a regular grid: give its resolution Else: run-length encode the bitmap.
• 0100000011000010001 -> 16043
• Only about 1000 of 160,000 bits are 1.
Z: delta code, then bzip2.• 100 125 90 90 100 -> 100 25 -35 0 10
![Page 15: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/15.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200715
Traveling Salesman Path
NEW! Hypothesis: nearby points often have nearby
Z, which delta code better Find a traveling salesman path through the
selected points. Put the Z in that order and code them. (X,Y) coding is not affected. Status: have some preliminary results.
![Page 16: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/16.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200716
Info theoretic min for (x,y)
Assume that 1000 of 400x400 bits are 1, rest are 0.
Assuming no structure in the 1s, size is
lg(choose(160000,1000)) = 8754 bits We approach that within 20%. That’s why we separate (x,y) from (z).
![Page 17: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/17.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200717
Better Than the Info-Theor Limit?
The information theoretic limit was calculated assuming no structure in the points.
Is there a structure to exploit?• Scooping
• Grids of points
![Page 18: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/18.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200718
Reconstruction Context
Extension of classical Laplacian partial differential equation used to solve heat flow etc
Now possible with new numerical computation techniques on large sparse overdetermined systems of linear equations
Adds capabilities to the classical system
• Local maxima inference
• Inconsistent data conflation
![Page 19: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/19.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200719
ODETLAP Point Reconstruction
Solve an overdetermined variant of a Laplacian PDE.• Known pts: zij = hij
• All pts: 4zij = zi-1j + zi+1j + zij-1 + zij+1
Easily processes 400x400 arrays of elevation posts in Matlab (160,000 unknowns)
Process larger arrays with Page-Saunders technique
![Page 20: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/20.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200720
ODETLAP on Larger Cells
We could go to Page-Saunders if there is interest.
My masters student John Childs did this in 2003, before Geo*.
Goal: several-thousand-square cell.
![Page 21: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/21.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200721
Four Matlab Interpolation Techniques on Nested Square Contours
This difficult example was chosen to illustrate all these methods’ limitations.
Inverse distance Delauney, linear
Delauney, cubic Delauney, nearest neighbor
![Page 22: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/22.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200722
ODETLAP on Nested Squares
Surface now looks much better.Can tradeoff accuracy vs smoothness.
R=0.1, mean err=0.01%
R=1.0, mean err=0.8% R=3.0, mean err=2.7%
Original data
![Page 23: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/23.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200723
Terrain Test Data
Extracted from level 2 DEMs
Elevation range
![Page 24: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/24.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200724
Hill1
![Page 25: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/25.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200725
Hill2
![Page 26: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/26.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200726
Hill3
![Page 27: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/27.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200727
Mtn1
![Page 28: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/28.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200728
Mtn2
![Page 29: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/29.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200729
Mtn3
![Page 30: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/30.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200730
Accuracy Metrics
Since flatter cells are easier,Following slides and tables show
•RMS error, meters, or
• (RMS error) / (elevation range in the cell)
Slope computed using Zevenbergen-Thorne algorithm used in NGA HAT.
Slope error is always RMS degrees.
![Page 31: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/31.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200731
TIN + Greedy ODETLAP Results
DataSize, bytes
Com-pression ratio
RMS Elev
Error, mRMS Slope Error, deg
hill1 1880 170:1 2.83 3.53
hill2 1962 163:1 4.06 8.06
hill3 1739 184:1 1.66 1.65
mtn1 1979 162:1 3.77 14.0
mtn2 2006 160:1 4.31 14.1
mtn3 2004 160:1 4.58 13.3
![Page 32: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/32.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200732
TIN+Greedy Elevation Accuracy
![Page 33: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/33.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200733
TIN+Greedy Slope Accuracy
![Page 34: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/34.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200734
TIN+Greedy Elevation ComparisonMtn2 Dataset
7641 bytes => 42:1 compression ratio
![Page 35: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/35.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200735
Zevenbergen-Thorne Slope ComparisonMtn2 Dataset
7641 bytes => 42:1 compression ratio
![Page 36: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/36.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200736
Even Better Slope Representation
Idea: Extend the ODETLAP equations directly to incorporate the original representation’s vector gradient at critical points, instead of inferring slope from adjacent elevations.
Status: being designed.
![Page 37: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/37.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200737
Different Point Selection Strategies
Previous slides used TIN+greedy That can be made to allow progressive
transmission of the points, by replacing bitmap coding of the (X,Y) with a bzip2 compression.
Following slides use regular grid point selection.
That compresses better but doesn’t do progressive transmission.
![Page 38: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/38.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200738
Regular Grid ODETLAP Results
Dataset #
Points
Com-pressed
Size
Com-pression
Ratio
Elev RMS (m)
Slope RMS (deg)
Hill1 529 306 1046:1 9.63 4.32
Hill2 1600 807 397:1 9.98 6.54
Hill3 225 172 1860:1 9.71 3.04
Mtn1 4489 2194 146:1 9.66 10.13
Mtn2 4489 2027 158:1 9.95 10.34
Mtn3 4489 2013 159:1 9.91 9.85(Our second ODETLAP point insertion strategy)
![Page 39: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/39.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200739
Regular Grid ODETLAP Accuracy
![Page 40: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/40.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200740
Merged Point Selection Strategy
Start with regular grid Greedily add more points, Use overlapping local grids, like with
differential geometry coordinate frames. Status: being designed.
![Page 41: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/41.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200741
Missing Data Fillin
ODETLAP can fill in missing circles with r<=100.
Slopes are continuous across the boundary. Contours are realistic. Next slide compares ODETLAP to 3 Matlab
methods.
![Page 42: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/42.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200742
Fillin Comparison
ODETLAP Laplacian Thin plate
Matlab nearest Matlab linear Matlab cubic
![Page 43: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/43.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200743
Packaging ODETLAP
Current process is a group of programs combining Matlab, bzip2, C++.
Being packaged into a unified system for distribution to NGA.
We can complete this when needed.
![Page 44: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/44.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200744
More Terrain Representations
Scooping still has the greatest longterm potential.
Could use RPI’s BlueGene/L, the 2nd fastest computer in a university setting in the world. (source: http://top500.org/lists/2007/06)
Problem: It doesn’t run Matlab.
![Page 45: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/45.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200745
Goal 2: Smugglers and Border Guards (aka Siting & Path Planning)
![Page 46: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/46.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200746
Multiobserver siting steps
1. Compute approximate visibility index of every possible observer.
2. Compute exact viewsheds of the best.3. Greedily insert potential observers into the
final set of observers, maintaining a bitmap of the cumulative viewshed.
4. Intervisibility => insert only visible observers.
Key: fast bitmap operations allow hundreds of observers to be sited with hi-res viewsheds.
![Page 47: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/47.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200747
Sample Viewsheds
Note thelevel of detail
![Page 48: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/48.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200748
Viewshed uncertainty
![Page 49: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/49.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200749
With or w/o intervisibility
Color -> elevation; Black -> hidden.
Intervisibility enforced No intervisibility required
![Page 50: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/50.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200750
Siting Toolkit by ESRI
ArcGIS DLL toolkit: an operational class configurable to perform siting simulations on any platform with a C++ compiler.
Includes an ArcMap command application on Windows, to demonstrate its capabilities.
Both are functional and scalable. Marquee Tool:
![Page 51: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/51.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200751
ArcGIS DLL Dialog Box
![Page 52: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/52.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200752
Path Planning (Smugglers)
Find cheapest path between source and goal. Cost metric is not simply path length:
(Distance)
(Climbing costs)
(BIG penaltyfor being seen)
![Page 53: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/53.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200753
Path planning algorithm
Designed for hi-res, say 1000x1000, maps. Impossible to form the 106x106 cost matrix. Use A* to search for initial feasible, good, path. Iterate to optimize it. Doesn’t hang up on local optima. Compute many paths to evaluate compression
throughout the terrain. Note how complex our paths are. Video: multipath.wmv
![Page 54: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/54.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200754
Many Paths on Each Dataset
![Page 55: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/55.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200755
Many Paths on Hill1
Computed between 50 pairs of random start/end points
![Page 56: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/56.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200756
Many Paths on Mtn1
![Page 57: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/57.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200757
Many Paths on Mtn3
![Page 58: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/58.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200758
Path traversal video
RPI-path-planning.wmv
![Page 59: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/59.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200759
Alternate Terrain Representation Evaluation Using Path Planning
Q: Our alternate compressed representation has a good RMS elevation error. However, is it good for more sophisticated operations, like path planning?
If we compute a smugglers path on terrain stored in our alternate rep, how good is it really?
It’s not important if a computed path is very different from the optimal path, provided that its true cost is not much more expensive than the optimal path.
![Page 60: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/60.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200760
Smugglers Path Evaluation of ODETLAP
Size: size of compressed dataset in bytes. Original binary size=320KB.
Incr. cost: extra cost of optimal path computed on compressed dataset and evaluated on original dataset compared to optimal path computed on original dataset.
Data SizeCompr.
RatioIncr. Cost
hill1 1763 182:1 5.5%
hill2 1819 176:1 6.1%
hill3 1607 199:1 4.4%
mtn1 1925 166:1 19.2%
mtn2 1884 170:1 18.2%
mtn3 1946 164:1 17.0%
![Page 61: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/61.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200761
Path Planning for Road Construction
Goal: Construct an optimal road connecting two points.
Allowed: Material removal and deposition.
Constraint: Max allowable slope is bounded.
Objective function: Amount of material moved.
Method: A*
![Page 62: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/62.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200762
Several Computed Roads
![Page 63: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/63.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200763
Key Differentiating Factors – Smugglers and Border Guards
Can site hundreds of observers on the terrain. Observers' radius of interest may be several hundred
pixels. Visibility and navigation tool
• optimizes a sophisticated objective function consisting of the path's total distance, the amount of uphill travel, and the distance spent in sight of any observer.
Paths may be thousands of pixels long. Validates ODETLAP:
• Good RMS elevation error but wait, there’s more!• Can be used accurately to site observers and plan
paths.
![Page 64: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/64.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200764
Hydrology Problem
Compute streams from terrain, … Assuming water flows from each
cell to lower neighbors. Problem: many cells are local
minima trapping flow Why? Data errors; insufficient
sampling Effect: No long streams.
Just starting this Phase II task in the proposal.
![Page 65: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/65.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200765
Common Solution
Simulate gradually filling in the local minima until the water flows over the edge.
But: This is slow
Real-world implementation of this technique with the Taum Sauk
reservoir; before and after.
![Page 66: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/66.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200766
Our Techniques
Identify sinks & watershed boundaries with our very fast connected components program.
Solve for water flow as a sparse system of linear equations.
Invert elevations and solve for ridge rivers. Merge watersheds not blocked by significant
ridges. Input ridge and stream points to ODETLAP.
![Page 67: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/67.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200767
Fast Connected Components
Original application: Small block of concrete is stressed to failure while being CAT-scanned in Brookhaven synchrotron. First breaks into a few large blocks, …
Need the 3D structure to understand failure. Compute the connected components of the
threshholded 1000x1000x1000 CAT scan. Next slide: slices in 3 different directions look
quite different.
![Page 68: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/68.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200768
Slices in 3 Directions of Cracking Concrete Block
![Page 69: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/69.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200769
Method
Good implementation of union-find. Fundamental data structure is a 1-D run of
solid voxels. (assumes data coherence) Carefully designed, small and fast. Form connected components with a few
passes through the data.
![Page 70: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/70.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200770
Largest Test Run
Input: 1024x1088x1088=1,212,153,856 voxels, 50% empty.
20,216,828 1-D runs, averaging 30 voxels. Output: 4,539,562 components, averaging 4.5 runs. Largest component: 2993 runs, volume 23675. Many components: only one run and two voxels. Implementation: 2GHz IBM t43p laptop, linux, gcc. Virtual memory used: only 340MB Elapsed time: 51 CPU seconds. Times scale down: 0.1 secs for 100x100x100. Largest 2D test: 19000x19000
![Page 71: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/71.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200771
Connected Components to Detect Sinks
Identified Sinks
Drainage Network
![Page 72: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/72.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200772
Watershed Boundary
Drainage Network
![Page 73: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/73.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200773
Merging Watersheds not Blocked by Significant Ridges
![Page 74: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/74.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200774
=> Larger more realistic watersheds and drainage networks
Before merging After merging
![Page 75: RPI / Geo* / NGA & DARPA Oct 1-2 2007 1 DEM Compression and Terrain Approximation; Smugglers and Border Guards Prof W Randolph Franklin, Prof Frank Luk,](https://reader035.vdocuments.us/reader035/viewer/2022070410/56649f165503460f94c2caf4/html5/thumbnails/75.jpg)
RPI / Geo* / NGA & DARPA Oct 1-2 200775
Summary
Represent terrain in 1% of original binary space with compression ratios of 80:1 to 500:1 with 10m elevation and 5-10 degree slope error.
Site multiple observers (“border guards”) and then plot smugglers paths to avoid them.
Compute on the compressed terrain. Modify terrain to improve hydrology.