technologie-und innovationspark jena spectronet...
TRANSCRIPT
SpectroNet Collaboration Forum Jena 2016
mobile smart
hyperspectral cameras
Technologie-und Innovationspark Jena
XIMEA GmbH , Jürgen Hillmann31.08.20161
SpectroNet Collaboration Forum Jena 2016
What are we talking about?
mobile small, lightweight,
low power consumption,
(battery driven)
smart universal and portable programmable
independent runnable
hyperspectral cameras
single cameras or complete systems
Technologie-und Innovationspark Jena
XIMEA GmbH , Jürgen Hillmann31.08.20162
HSI cameras: area scan sensors
XIMEA GmbH , Jürgen Hillmann3
HSI sensors
mobile smart hyperspectral cameras
31.08.2016
HSI sensor types from imec (used in XIMEA cameras)
XIMEA GmbH , Jürgen Hillmann4
line scan Snapshot Mosaic
‘per-pixel’ design4x4: ~ 470 – 630 nm5x5: ~ 600 – 975 nm
filter layouts
‘wedge’ design100 bands: ~ 600 – 975 nm150 bands: ~ 470 – 900 nm (new)
mobile smart hyperspectral cameras
31.08.2016
HSI sensor types from imec (used in XIMEA cameras)
XIMEA GmbH , Jürgen Hillmann5
line scan Snapshot Mosaic
filter layouts
‘per-pixel’ design4x4: ~ 470 – 630 nm5x5: ~ 600 – 975 nm
‘wedge’ design100 bands: ~ 600 – 975 nm150 bands: ~ 470 – 900 nm (new)
mobile smart hyperspectral cameras
31.08.2016
RAW image interpretation / snapshot mosaic
XIMEA GmbH , Jürgen Hillmann6
2 leaves on a stone
Snapshot mosaic 5X5-NIR, 675-975nm
900 909 892 882 683
809 821 797 784 693
759 772 746 732 708
943 949 935 927 975
861 873 852 840 955
Single 5X5 pattern, wavelength peaks [nm]
Spectrum (Raw-values)
675 nm 975 nm
mobile smart hyperspectral cameras
31.08.2016
Mobile applications
XIMEA GmbH , Jürgen Hillmann7
For the operation of cameras a computer is needed to
• control the camera(s)
• grab images
• data compression if needed
• send and store data
• process and analyze the data
For hyperspectral imaging the computer has to be powerful !
mobile smart hyperspectral cameras
31.08.2016
Mobile HSI UAV applications
XIMEA GmbH , Jürgen Hillmann8
One part of a UAV based hyperspectral solutions is the camera setup:
• (main) HSI camera looking to the ground
• (optional) additional HSI camera looking to the ground (e,g, another wavelength range)
• (optional) additional RGB / mono camera looking to the ground for reference images, optional: 3D reconstruction
• (optional) additional HSI camera or spectrometer to measure the ambient light conditions
mobile smart hyperspectral cameras
31.08.2016
interpolation / sensor fusion
XIMEA GmbH , Jürgen Hillmann9
The spatial resolution in case of a snapshot mosaic sensor is aboutSM 5X5: <= 409 * 216 px SM 4X4: <= 512 * 272 px
The native resolution can be interpolated:
Interpolation can be used to merge images from different snapshot mosaic sensors.
spatial resolution interpolated resolution
mobile smart hyperspectral cameras
31.08.2016
Mobile application (xEC system)
XIMEA GmbH , Jürgen Hillmann11
XIMEA is developing a very compact (HSI) imaging and recording unit for mobile applications, e.g. installable in payload compartment of drones with
• massively parallel computational resources onboard
• storage on fast SD (UHS-II SDHC/SDXC) or M.2 PCIe x 4 SSD (1000-1200 MB/s)
• IMU 9-axis
• interface to a (drone) control unit
• interface to a GPS / wireless connection
LINUX, C/C++ and CUDA compatibility guarantees portability and scalability.
mobile smart hyperspectral cameras
31.08.2016
HW block diagram and interfaces (xEC system)
XIMEA GmbH , Jürgen Hillmann12
mobile smart hyperspectral cameras
31.08.2016
Carrier/Expansion board
SD-A / M.2 SSD
HDMI
Ethernet
IMU
UART UAV
CPU / GPU unit
GPIO, SYNC
I2C, SPI
PWR
SD-B / M.2 SSD
USB3 (1 – 5) PCIe
cameras
spectrometer
WLAN
Mouse / keyboard
other
XIMEA GmbH , Jürgen Hillmann13
Size of the xEC board: approx. 50 * 87 mmSize of the camera head: 25 * 25 mm
Calculation power (TX1 system) ~ 1 TFLOPS
mobile smart hyperspectral cameras
31.08.2016
Mobile application (xEC system)
xEC predecessorxiQ board level camera
Mobile applications
XIMEA GmbH , Jürgen Hillmann14
The system is designed to (e.g.)
• create the corrected hyperspectral imaging cube for the connected xiSpec camerasin realtime
• match spectral signatures against pre-learned signatures
• perform a data self clustering / principal component analyzis (PCA)
• check whether differences against expected results occurs
• perform a multi-pass flight (other directions, different flight altitude for detailed data)
• optional data reduction (store only not expected info, e.g. possible plant diseases fora detailed postprocessing)
mobile smart hyperspectral cameras
31.08.2016
XIMEA GmbH , Jürgen Hillmann15
Thank you for your attention
www.ximea.com, [email protected]
mobile smart hyperspectral cameras
31.08.2016