terrestrial lidar in urban data acquisition · the part of the point cloud on a t ät stut pp...

13
Institut für Photogrammetrie ifp Terrestrial LiDAR in Urban Data Acquisition tgart Dr. Jan Böhm Institute for Photogrammetry tät Stutt Universität Stuttgart [email protected] niversit Un Contents ifp Contents Motivation – Why do we need terrestrial LiDAR in urban modeling? How does this integrate with the final products (CityGML)? Direct visualization of terrestrial point clouds -> Point Splatting Modeling Facade Details from terrestrial LiDAR > LASERMAP tgart -> LASERMAP Modeling building interiors from terrestrial LiDAR -> Plane Sweeping & Cell Decomposition tät Stutt -> Plane Sweeping & Cell Decomposition New Sensor Developments -> Potential for better models niversit Un Dr.-Ing. Jan Böhm Phowo 2009 2

Upload: others

Post on 19-Oct-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

  • Institut für Photogrammetrie

    ifp

    Terrestrial LiDAR in Urban Data Acquisition

    tgar

    t Dr. Jan BöhmInstitute for Photogrammetry

    tät S

    tutt Universität Stuttgart

    [email protected]

    nive

    rsit

    Un

    Contentsifp

    Contents

    Motivation – Why do we need terrestrial LiDAR in urban modeling?

    How does this integrate with the final products (CityGML)? Direct visualization of terrestrial point clouds

    -> Point Splatting Modeling Facade Details from terrestrial LiDAR

    > LASERMAP

    tgar

    t

    -> LASERMAP Modeling building interiors from terrestrial LiDAR

    -> Plane Sweeping & Cell Decomposition

    tät S

    tutt -> Plane Sweeping & Cell Decomposition

    New Sensor Developments-> Potential for better models

    nive

    rsit

    Un

    Dr.-Ing. Jan Böhm Phowo 2009 2

  • Motivationifp

    Motivationtg

    art

    Intergraph DMC Image Burkert (2000)

    tät S

    tutt Intergraph DMC Image Burkert (2000)

    Aerial data capture is the „workhorse“ of urban data acquisition. Bird‘s-eye-view limits the geometry we can capture / reconstruct

    nive

    rsit Bird s-eye-view limits the geometry we can capture / reconstruct.

    Many applications visualize the data from a pedestrian's point-of-view (fly-through, mock-up, navigation, etc.).

    Un

    Dr.-Ing. Jan Böhm Phowo 2009 3

    Terrestrial LiDAR perfectly matches the pedestrian's point-of-view in data capture.

    Urban Modeling - CityGMLifp

    Urban Modeling CityGML

    LOD0 LOD1 LOD2

    tgar

    ttä

    t Stu

    ttni

    vers

    itU

    n

    Dr.-Ing. Jan Böhm Phowo 2009 4

    LOD3 LOD3 LOD4

  • Terrestrial Point Cloudsifp

    Terrestrial Point Clouds

    A colored point cloud acquired with the terrestrial LiDAR

    t HDS 3000system HDS 3000. The point cloud gives a good

    impression of the object from a p jfar away view point.

    When we zoom in the impression of a solid surface

    tgar

    t

    impression of a solid surface collapses.

    “Gaps” in-between the points

    tät S

    tutt become visible and the

    background dominates the foreground.

    nive

    rsit g

    To close the “gaps” we can use triangulation, which is often difficult and time consumingU

    n difficult and time-consuming.

    Dr.-Ing. Jan Böhm Phowo 2009 5

    Point Splattingifp

    Point Splatting

    When the number of triangles exceeds the number of pixels

    th t t i lon the screen, most triangles cover less than a pixel and the rasterization of the triangles becomes extremely expensive.

    Point-based methods have been proposed (Pfister 2000)

    tgar

    t

    been proposed (Pfister, 2000), which represent the surface by a point-wise sampling, where each point also stores the

    tät S

    tutt each point also stores the

    normal vector of the surface at this point.

    nive

    rsit Point-based geometry provides

    all processing needs, such as editing, filtering and texturing.

    Un

    Dr.-Ing. Jan Böhm 6

    editing, filtering and texturing.

    Phowo 2009

  • Façade Modelingifp

    Façade Modeling

    Terrestrial Laserscans are not the only available data source.

    Often we can reuse existing reference data.

    Georeferencing is essential forGeoreferencing is essential for data fusion.

    Coarse 3D building models can b d t / t

    tgar

    t

    be used to prepare / segment the point cloud.

    The part of the point cloud on a

    tät S

    tutt p p

    facade is resampled to a regular grid, aka LASERMAP

    nive

    rsit

    J. Böhm, 2007

    Un

    Phowo 2009Dr.-Ing. Jan Böhm 7

    Façade Modelingifp

    Façade Modeling

    Terrestrial Laserscans are not the only available data source.

    Often we can reuse existing reference data.

    Georeferencing is essential forGeoreferencing is essential for data fusion.

    Coarse 3D building models can b d t / t

    tgar

    t

    be used to prepare / segment the point cloud.

    The part of the point cloud on a

    tät S

    tutt p p

    facade is resampled to a regular grid, aka LASERMAP

    nive

    rsit

    J. Böhm, 2007

    Un

    Phowo 2009Dr.-Ing. Jan Böhm 8

  • Façade Modelingifp

    Façade Modeling

    Terrestrial Laserscans are not the only available data source.

    Often we can reuse existing reference data.

    Georeferencing is essential forGeoreferencing is essential for data fusion.

    Coarse 3D building models can b d t / t

    tgar

    t

    be used to prepare / segment the point cloud.

    The part of the point cloud on a

    tät S

    tutt p p

    facade is resampled to a regular grid, aka LASERMAP

    nive

    rsit

    J. Böhm, 2007

    Un

    Phowo 2009Dr.-Ing. Jan Böhm 9

    Separation of Geometryifp

    Separation of Geometry

    The planar facades of a coarse building model serve as a

    f f t tireference for segmentation. The true geometry of a surface

    is separated into p it’s coarse geometry, the normal map and the displacement map which

    tgar

    t

    the displacement map which contains the difference of the true geometry and the coarse geometry

    tät S

    tutt geometry.

    The displacement map and the normal map can be directly

    nive

    rsit used for visualization.

    Un

    Dr.-Ing. Jan Böhm 10Phowo 2009

  • LASERMAPifp

    LASERMAP

    The planar facades of a coarse building model serve as a

    f f t tireference for segmentation. The true geometry of a surface

    is separated into p it’s coarse geometry, the normal map and the displacement map which

    tgar

    t

    the displacement map which contains the difference of the true geometry and the coarse geometry

    tät S

    tutt geometry.

    The displacement map and the normal map can be directly

    nive

    rsit used for visualization.

    Un

    Dr.-Ing. Jan Böhm 11Phowo 2009

    Normal Mapifp

    Normal Map

    Blinn (1978) observed that the effect of fine surface details is “ i il d t th i ff t“primarily due to their effect on the direction of the surface normal … rather than their effect on the position of the surface”.

    Normal maps store only the

    tgar

    t

    Normal maps store only the normal of the surface at each position.Thi ffi i tl b d d

    tät S

    tutt This can efficiently be encoded

    in a raster color image. The Normal map image is

    nive

    rsit p gapplied to the geometry like a

    texture image using an appropriate render engineU

    n

    Dr.-Ing. Jan Böhm

    appropriate render engine.

    12Phowo 2009

  • Normal Mapifp

    Normal Map

    Blinn (1978) observed that the effect of fine surface details is “ i il d t th i ff t“primarily due to their effect on the direction of the surface normal … rather than their effect on the position of the surface”.

    Normal maps store only the

    tgar

    t

    Normal maps store only the normal of the surface at each position.Thi ffi i tl b d d

    tät S

    tutt This can efficiently be encoded

    in a raster color image. The Normal map image is

    nive

    rsit p gapplied to the geometry like a

    texture image using an appropriate render engineU

    n

    Dr.-Ing. Jan Böhm

    appropriate render engine.

    13Phowo 2009

    Displacement Mapifp

    Displacement Map

    Displacement Mapping creates true 3D geometry.

    Each vertex is displaced according to the difference stored in the displacement map.p p

    The vertices need not be stored explicitly in the model.Th t d th fl b

    tgar

    t

    They are created on-the-fly by the visualization soft- or hardware.

    tät S

    tutt

    Using a recursive algorithm the simple geometry of the facade is subdivided in smaller

    nive

    rsit is subdivided in smaller

    triangles.

    Un

    Phowo 2009Dr.-Ing. Jan Böhm 14

  • Indoor Modelingifp

    Indoor Modeling

    State-of-the-art in urban modeling is the reconstruction f th t t fof the outer geometry of a

    building. CityGML‘s LOD4 requires y q

    modeling of the interior structures of a building.

    We try to built upon our

    tgar

    t

    We try to built upon our experience of LOD3 modeling and fully automate the

    t ti f i d

    tät S

    tutt reconstruction of indoor

    models. Under the assumption of

    nive

    rsit phorizontal floors, ceilings and

    vertical walls, “Plane Sweeping” is a promising approachU

    n is a promising approach.

    Phowo 2009Dr.-Ing. Jan Böhm 15

    A. Budroni & J. Böhm, 2009

    Indoor Modelingifp

    Indoor Modeling

    State-of-the-art in urban modeling is the reconstruction f th t t fof the outer geometry of a

    building. CityGML‘s LOD4 requires y q

    modeling of the interior structures of a building.

    We try to built upon our

    tgar

    t

    We try to built upon our experience of LOD3 modeling and fully automate the

    t ti f i d

    tät S

    tutt reconstruction of indoor

    models. Under the assumption of

    nive

    rsit phorizontal floors, ceilings and

    vertical walls, “Plane Sweeping” is a promising approachU

    n is a promising approach.

    Phowo 2009Dr.-Ing. Jan Böhm 16

    A. Budroni & J. Böhm, 2009

  • Plane Sweepingifp

    Plane Sweeping

    Plane Sweeping is a simple segmentation method to detect h i t l d ti lhorizontal and vertical structures in a point cloud.

    In a „hypothesis-and-test“ „ ypapproach planes are tested at discrete positions for compatibility with the point

    tgar

    t

    compatibility with the point cloud.

    Peaks in the histogram indicate did t f l

    tät S

    tutt candidates for planes.

    nive

    rsit

    Un

    Phowo 2009Dr.-Ing. Jan Böhm 17

    A. Budroni & J. Böhm, 2009

    Cell Decompositionifp

    Cell Decomposition

    Horizontal planes form the floor and the ceiling.

    Vertical planes (extended to infinity) are used to decompose the whole space in separate p pcells.

    Each cell is tested, if it is part of the room or not

    tgar

    t

    the room or not. All the cells of a room are

    merged and the bounding

    tät S

    tutt surface is computed.

    nive

    rsit

    Un

    Phowo 2009Dr.-Ing. Jan Böhm 18

    A. Budroni & J. Böhm, 2009

  • Cell Decompositionifp

    Cell Decomposition

    Horizontal planes form the floor and the ceiling.

    Vertical planes (extended to infinity) are used to decompose the whole space in separate p pcells.

    Each cell is tested, if it is part of the room or not

    tgar

    t

    the room or not. All the cells of a room are

    merged and the bounding

    tät S

    tutt surface is computed.

    nive

    rsit

    Un

    Phowo 2009Dr.-Ing. Jan Böhm 19

    A. Budroni & J. Böhm, 2009

    Cell Decompositionifp

    Cell Decomposition

    Horizontal planes form the floor and the ceiling.

    Vertical planes (extended to infinity) are used to decompose the whole space in separate p pcells.

    Each cell is tested, if it is part of the room or not

    tgar

    t

    the room or not. All the cells of a room are

    merged and the bounding

    tät S

    tutt surface is computed.

    nive

    rsit

    Un

    Phowo 2009Dr.-Ing. Jan Böhm 20

    A. Budroni & J. Böhm, 2009

  • Cell Decompositionifp

    Cell Decomposition

    Horizontal planes form the floor and the ceiling.

    Vertical planes (extended to infinity) are used to decompose the whole space in separate p pcells.

    Each cell is tested, if it is part of the room or not

    tgar

    t

    the room or not. All the cells of a room are

    merged and the bounding

    tät S

    tutt surface is computed.

    nive

    rsit

    Un

    Phowo 2009Dr.-Ing. Jan Böhm 21

    A. Budroni & J. Böhm, 2009

    New Sensor Developments – Multi-Pulseifp

    New Sensor Developments Multi Pulse

    A colored point cloud acquired with a V-Line terrestrial laser

    f Ri l i hscanner from Riegl is shown on the right.

    The multi-pulse capability of the p p yscanner facilitates 3D edge detection shown to the right, by selecting first return pulses only

    tgar

    t

    selecting first return pulses only at multi-pulse points.

    LiDAR data is courtesy of RIEGL L M t

    tät S

    tutt RIEGL Laser Measurement

    Systems GmbH.

    nive

    rsit

    Un

    Phowo 2009Dr.-Ing. Jan Böhm 22Riegl Laser Measurement Systems GmbH

  • New Sensor Developments – TOF Cameraifp

    New Sensor Developments TOF Camera

    Indoor point clouds acquired with a terrestrial laser scanner h t l b lhave very accurate global geometry.

    However, the point cloud is , pincomplete due to self-occlusion.

    Each station for a terrestrial

    tgar

    t

    Each station for a terrestrial LiDAR system is associated with high costs (scan time,

    i t ti i t )

    tät S

    tutt registration, processing, etc.).

    nive

    rsit

    Un

    Phowo 2009Dr.-Ing. Jan Böhm 23

    New Sensor Developments – TOF Cameraifp

    New Sensor Developments TOF Camera

    TOF cameras capture point clouds at video rate.

    They are easy to set up and flexible to handle.

    Global accuracy is insufficientGlobal accuracy is insufficient. Local accuracy is good enough

    to complement laser scanners.

    tgar

    t Simple ICP can be used to merge data sets.

    tät S

    tutt

    nive

    rsit

    Un

    Phowo 2009Dr.-Ing. Jan Böhm 24

  • Summaryifp

    Summary

    Terrestrial LiDAR supplements nicely classical data acquisition methods to perfectly match visualizations from pedestrians‘ viewpoints.

    It is ideally suited to capture facade details and thus provides the data for realistic LOD3 modelsthe data for realistic LOD3 models.

    Terrestrial LiDAR is the most suitable data source for indoor data acquisition a prerequisite for LOD4 models

    tgar

    t

    data acquisition a prerequisite for LOD4 models. Modeling is still the bottle neck in the processing chain. Automated modeling solutions have been developed in the

    tät S

    tutt Automated modeling solutions have been developed in the

    research community for LOD3 models. LOD4 is a hot topic in research right now.

    nive

    rsit

    New sensors and capabilties need to be integrated with modeling algorithms to derive better models.

    Un

    Phowo 2009Dr.-Ing. Jan Böhm 25