reconstructing 3d models from drone flights

18
Reconstructing 3D Models from Drone Flights or How I reconstructed a 3D model of a ruined church I’d never been to just using YouTube, Docker, VisualSFM and Meshlab, and you can too. Andrew Hatch @ashatch

Upload: andrew-hatch

Post on 14-Apr-2017

40 views

Category:

Technology


0 download

TRANSCRIPT

Page 1: Reconstructing 3d Models from Drone Flights

Reconstructing 3D Models from Drone Flights or How I reconstructed a 3D model of a ruined church I’d never been to just using YouTube, Docker, VisualSFM and Meshlab, and you can too.

Andrew Hatch

@ashatch

Page 2: Reconstructing 3d Models from Drone Flights
Page 3: Reconstructing 3d Models from Drone Flights

3D scanning with structured light

Page 4: Reconstructing 3d Models from Drone Flights

3D scanning with RGB-D sensors

Page 5: Reconstructing 3d Models from Drone Flights

Tang, Liang, Guo, Wang, "Photogrammetry-based two-dimensional digital image correlation with nonperpendicular camera alignment", Opt. Eng. 51(2), 2012

Page 6: Reconstructing 3d Models from Drone Flights

Pose estimation in PTAM

Page 7: Reconstructing 3d Models from Drone Flights
Page 8: Reconstructing 3d Models from Drone Flights
Page 9: Reconstructing 3d Models from Drone Flights

VisualSFM (Structure from Motion)http://ccwu.me/vsfm/

Page 10: Reconstructing 3d Models from Drone Flights

docker run -v /data -it ryanfb/visualsfm /bin/bash

$ avconv -i footage.mp4 -r 1/1 -qscale:v 1 stills/frame$08d.jpg $ VisualSFM sfm+pairs+pmvs stills/ redchurch.nvm @8

ryanfb.github.io

VisualSFM in Docker

Page 11: Reconstructing 3d Models from Drone Flights

point cloud

Page 12: Reconstructing 3d Models from Drone Flights

http://meshlab.sourceforge.net/

Page 13: Reconstructing 3d Models from Drone Flights

Processing point clouds

• Poisson Surface Reconstruction

• Mesh cleanup

• Fill/close holes

• Cleanup non-manifold edges and faces

• Texture from registered rasters

Page 14: Reconstructing 3d Models from Drone Flights

Mesh

Page 15: Reconstructing 3d Models from Drone Flights

Current Research

Page 16: Reconstructing 3d Models from Drone Flights

ElasticFusion: Dense SLAM Without A Pose Graph, T. Whelan, S. Leutenegger, R. F. Salas-Moreno, B. Glocker and A. J. Davison, RSS '15

Page 17: Reconstructing 3d Models from Drone Flights
Page 18: Reconstructing 3d Models from Drone Flights

Further info

• Workflow:

• https://ryanfb.github.io/etc/2014/10/22/drone_photogrammetry_workflow.html

• The Red Church Dating to the late 5th–early 6th century YouTube video by Kostadin Dimov

• PTAM: http://www.robots.ox.ac.uk/~gk/PTAM/

• VisualSFM http://ccwu.me/vsfm/

• ElasticFusion http://www.imperial.ac.uk/dyson-robotics-lab/downloads/elastic-fusion/