urban area product simulation for the enmap hyperspectral sensor.ppt
TRANSCRIPT
![Page 1: URBAN AREA PRODUCT SIMULATION FOR THE ENMAP HYPERSPECTRAL SENSOR.ppt](https://reader035.vdocuments.us/reader035/viewer/2022070319/5584f5bad8b42a73618b5253/html5/thumbnails/1.jpg)
URBAN AREA PRODUCT SIMULATION FOR THE ENMAP HYPERSPECTRAL SENSOR
P.Gamba, A. Villa, A. Plaza,
J. Chanussot, J. A. Benediktsson
![Page 2: URBAN AREA PRODUCT SIMULATION FOR THE ENMAP HYPERSPECTRAL SENSOR.ppt](https://reader035.vdocuments.us/reader035/viewer/2022070319/5584f5bad8b42a73618b5253/html5/thumbnails/2.jpg)
OUTLINE
1) Introduction
2) The EnMap sensor
3) Experimental test
4) Conclusions and perspectives
![Page 3: URBAN AREA PRODUCT SIMULATION FOR THE ENMAP HYPERSPECTRAL SENSOR.ppt](https://reader035.vdocuments.us/reader035/viewer/2022070319/5584f5bad8b42a73618b5253/html5/thumbnails/3.jpg)
INTRODUCTION
Urban remote sensing is a crucial task :• Monitoring cities development• Infrastructure extraction• Land cover mapping Satellites provide cheap and timely data
Main challenges :• Urban land cover classes not well distinct• Heterogeneous areas lead to mixed pixels
Can hyperspectral data be helpul for such a task?
![Page 4: URBAN AREA PRODUCT SIMULATION FOR THE ENMAP HYPERSPECTRAL SENSOR.ppt](https://reader035.vdocuments.us/reader035/viewer/2022070319/5584f5bad8b42a73618b5253/html5/thumbnails/4.jpg)
INTRODUCTION
Can hyperspectral data be helpul for urban monitoring?
• Pro: very detailed spectral information of the scene• Con: tradeoff between spectral and spatial resolution
(~tens of meters)
A number of hyperspectral missions already planned:• PRISMA – ASI, 2014 (spatial res: 30 m)• EnMap – DLR, 2014 (spatial res: 30 m)• Hyper-J (JAXA) and HyspIRI (NASA) in the next future..
Need to assess the effectiveness of hyperspectral
data for urban monitoring!
![Page 5: URBAN AREA PRODUCT SIMULATION FOR THE ENMAP HYPERSPECTRAL SENSOR.ppt](https://reader035.vdocuments.us/reader035/viewer/2022070319/5584f5bad8b42a73618b5253/html5/thumbnails/5.jpg)
AIM OF THE WORK
• Preliminary investigation of hyperspectral sensors potentialities:
- Can urban structures be monitored with hyperspectral sensors?
- Is the rich spectral information of hyperspectral data useful for such a task?
• Two main issues addressed:
1) Creation of realistic urban scenes by considering EnMap PSF
2) Comparison with classical and advanced methods
![Page 6: URBAN AREA PRODUCT SIMULATION FOR THE ENMAP HYPERSPECTRAL SENSOR.ppt](https://reader035.vdocuments.us/reader035/viewer/2022070319/5584f5bad8b42a73618b5253/html5/thumbnails/6.jpg)
OUTLINE
1) Introduction
2) The EnMap sensor
3) Experimental test
4) Conclusions and perspectives
![Page 7: URBAN AREA PRODUCT SIMULATION FOR THE ENMAP HYPERSPECTRAL SENSOR.ppt](https://reader035.vdocuments.us/reader035/viewer/2022070319/5584f5bad8b42a73618b5253/html5/thumbnails/7.jpg)
EnMap mission
Dedicated imaging pushbroom hyperspectral sensor mainly based on modified existing or pre-developed technology
Broad spectral range from 420 nm to 1000 nm (VNIR) and from 900 nm to 2450 nm (SWIR) with high radiometric resolution and stability in both spectral ranges
Swath width 30km at high spatial resolution of 30 m x 30 m and off-nadir (30°) pointing feature for fast target revisit (4 days)
Sufficient on-board memory to acquire 1.000 km swath length per orbit and a total of 5.000 km per day.
S. Kaiser , B. Sang , J. Schubert , S. Hofer and T. Stuffler: "Compact prism spectrometer of pushbroom type for hyperspectral imaging", Proc. SPIE Conf. Imaging Spectrometry XIII, vol. 7100, p.710001, 2008.
![Page 8: URBAN AREA PRODUCT SIMULATION FOR THE ENMAP HYPERSPECTRAL SENSOR.ppt](https://reader035.vdocuments.us/reader035/viewer/2022070319/5584f5bad8b42a73618b5253/html5/thumbnails/8.jpg)
SYNTHETIC REALISTIC IMAGES
Original image Low resolution image
EnMap PSF (900 nm)
Spatial resolutiondegradation
1) Create realistic hyperspectral images by downscaling the spatialresolution according to the EnMap PSF
![Page 9: URBAN AREA PRODUCT SIMULATION FOR THE ENMAP HYPERSPECTRAL SENSOR.ppt](https://reader035.vdocuments.us/reader035/viewer/2022070319/5584f5bad8b42a73618b5253/html5/thumbnails/9.jpg)
Low resolution image
SVM
SVM-SU1
1. Villa et al., Spectral Unmixing to obtain classification maps at a finer resolution, Journal of Selected Topics in Signal Processing, 2011
Classificationmap
Classificationmap at finer
resolution
CLASSIFICATION COMPARISON
2) Evaluate the performances of traditional methods and sub-pixel techniques in terms of land cover classification
![Page 10: URBAN AREA PRODUCT SIMULATION FOR THE ENMAP HYPERSPECTRAL SENSOR.ppt](https://reader035.vdocuments.us/reader035/viewer/2022070319/5584f5bad8b42a73618b5253/html5/thumbnails/10.jpg)
SVM - SU
SVM – Spectral Unmixing(*):
1) Probabilistic SVM determines which pixels can be considered as pure (if prob > treshold)
2) Spectral unmixing is used to retrieve class abundances within mixed pixels
3) Final spatial regularization
(*)A. Villa, J. Chanussot, J.A. Benediktsson and C. Jutten., Spectral Unmixing to obtain classification maps at a finer resolution, Journal of Selected Topics in Signal Processing, vol. 5, n. 3, May 2011
![Page 11: URBAN AREA PRODUCT SIMULATION FOR THE ENMAP HYPERSPECTRAL SENSOR.ppt](https://reader035.vdocuments.us/reader035/viewer/2022070319/5584f5bad8b42a73618b5253/html5/thumbnails/11.jpg)
SVM - SU
SVM – Spectral Unmixing:
1) Probabilistic SVM determines which pixels can be considered as pure (if prob > treshold)
2) Spectral unmixing is used to retrieve class abundances within mixed pixelsand to fill “upsampled” sub-pixels
3) Final spatial regularization
![Page 12: URBAN AREA PRODUCT SIMULATION FOR THE ENMAP HYPERSPECTRAL SENSOR.ppt](https://reader035.vdocuments.us/reader035/viewer/2022070319/5584f5bad8b42a73618b5253/html5/thumbnails/12.jpg)
SVM - SU
SVM – Spectral Unmixing:
1) Probabilistic SVM determines which pixels can be considered as pure (if prob > threshold)
2) Spectral unmixing is used to retrieve class abundances within mixed pixelsand to fill “upsampled” sub-pixels
3) Final spatial regularization is performed (Cost function to be minimized: total perimeter of the connected areas )
The results is a thematic map at a finer resolution useful to assess possibilities offered by HSI at low-medium spatial resolution.
![Page 13: URBAN AREA PRODUCT SIMULATION FOR THE ENMAP HYPERSPECTRAL SENSOR.ppt](https://reader035.vdocuments.us/reader035/viewer/2022070319/5584f5bad8b42a73618b5253/html5/thumbnails/13.jpg)
OUTLINE
1) Introduction
2) The EnMap sensor
3) Experimental test
4) Conclusions and perspectives
![Page 14: URBAN AREA PRODUCT SIMULATION FOR THE ENMAP HYPERSPECTRAL SENSOR.ppt](https://reader035.vdocuments.us/reader035/viewer/2022070319/5584f5bad8b42a73618b5253/html5/thumbnails/14.jpg)
DATA SET• ROSIS Center data set:
• 1096 x 712 pixels, 102 spectral bands• Spatial resolution: 1.3 meters• Spatial resolution decreased of a factor 3 and 5
• Classification with SVM and SVM-SU, 100 samples per class.
![Page 15: URBAN AREA PRODUCT SIMULATION FOR THE ENMAP HYPERSPECTRAL SENSOR.ppt](https://reader035.vdocuments.us/reader035/viewer/2022070319/5584f5bad8b42a73618b5253/html5/thumbnails/15.jpg)
Reference data SVM SVM-SU
ROSIS Center (3x downscale)
OA (%) 98.11 79.56 81.89
Δ (%) - 19.55 - 16.22
ROSIS Center (5x downscale)
OA (%) 98.11 70.97 74.32
Δ (%) - 27.14 - 23.79
EXPERIMENTS
![Page 16: URBAN AREA PRODUCT SIMULATION FOR THE ENMAP HYPERSPECTRAL SENSOR.ppt](https://reader035.vdocuments.us/reader035/viewer/2022070319/5584f5bad8b42a73618b5253/html5/thumbnails/16.jpg)
THEMATIC MAPS
SVM on original HR data(ground truth)
SVM on LR data70.97%
Finer Classification74.32%
![Page 17: URBAN AREA PRODUCT SIMULATION FOR THE ENMAP HYPERSPECTRAL SENSOR.ppt](https://reader035.vdocuments.us/reader035/viewer/2022070319/5584f5bad8b42a73618b5253/html5/thumbnails/17.jpg)
SVM on original HR data(ground truth)
SVM on LR data70.97%
Finer Classification74.32%
THEMATIC MAPS
![Page 18: URBAN AREA PRODUCT SIMULATION FOR THE ENMAP HYPERSPECTRAL SENSOR.ppt](https://reader035.vdocuments.us/reader035/viewer/2022070319/5584f5bad8b42a73618b5253/html5/thumbnails/18.jpg)
EXPERIMENTS
Preliminary conclusions
-- Even slight spatial resolution degradation leads to a significant classification accuracy decrease
-- Sub-pixel information of HSI is helpful to improve classification accuracy
-- Potentialities of hyperspectral data depend on the desired application
![Page 19: URBAN AREA PRODUCT SIMULATION FOR THE ENMAP HYPERSPECTRAL SENSOR.ppt](https://reader035.vdocuments.us/reader035/viewer/2022070319/5584f5bad8b42a73618b5253/html5/thumbnails/19.jpg)
OUTLINE
1) Introduction
2) The EnMap sensor
3) Experimental test
4) Conclusions and perspectives
![Page 20: URBAN AREA PRODUCT SIMULATION FOR THE ENMAP HYPERSPECTRAL SENSOR.ppt](https://reader035.vdocuments.us/reader035/viewer/2022070319/5584f5bad8b42a73618b5253/html5/thumbnails/20.jpg)
CONCLUSIONS
Conclusions
-- Low spatial resolution is a major challenge in urban environment
→ Hard to perform urban monitoring with hyperspectral sensors
-- Additional spectral information useful if properly exploited
→ Need for advanced techniques to study sub-pixel information
Perspectives
- Consider more realistic models (more PSFs, geometric distortions..)
- Investigate lower spatial resolution (comparable to HSI)
- Further investigations of the possibilities offered by sub-pixel methods