machine learning and sensor fusion for precision farming · sensor fusionàmachine learning §any...
TRANSCRIPT
![Page 1: Machine Learning and Sensor Fusion for Precision Farming · Sensor FusionàMachine Learning §Any nontrivial machine learning algorithm needs high-quality dataset. This increases](https://reader036.vdocuments.us/reader036/viewer/2022062414/5ee065afad6a402d666b9682/html5/thumbnails/1.jpg)
Machine Learning andSensor Fusion forPrecision Farming
Solmaz Hajmohammadi, Christopher Schardt,Noah Fahlgren, Arash Abbasi, Stefan Paulus
![Page 2: Machine Learning and Sensor Fusion for Precision Farming · Sensor FusionàMachine Learning §Any nontrivial machine learning algorithm needs high-quality dataset. This increases](https://reader036.vdocuments.us/reader036/viewer/2022062414/5ee065afad6a402d666b9682/html5/thumbnails/2.jpg)
Food Insecurity
§Increase in population§2.8 Billion more people to feed by 2050§Increase in cost of labor, fertilizers, …§Decrease in total land§Climate change
![Page 3: Machine Learning and Sensor Fusion for Precision Farming · Sensor FusionàMachine Learning §Any nontrivial machine learning algorithm needs high-quality dataset. This increases](https://reader036.vdocuments.us/reader036/viewer/2022062414/5ee065afad6a402d666b9682/html5/thumbnails/3.jpg)
§ Baseline Projection for people at risk of hunger in 2010,2025 and 2050
![Page 4: Machine Learning and Sensor Fusion for Precision Farming · Sensor FusionàMachine Learning §Any nontrivial machine learning algorithm needs high-quality dataset. This increases](https://reader036.vdocuments.us/reader036/viewer/2022062414/5ee065afad6a402d666b9682/html5/thumbnails/4.jpg)
Answer is…
Harvest Your Field Data
![Page 5: Machine Learning and Sensor Fusion for Precision Farming · Sensor FusionàMachine Learning §Any nontrivial machine learning algorithm needs high-quality dataset. This increases](https://reader036.vdocuments.us/reader036/viewer/2022062414/5ee065afad6a402d666b9682/html5/thumbnails/5.jpg)
Artificial Intelligence (AI):§ The theory and development of computer systems able to
perform tasks that normally require human intelligence.
Machine Learning (ML):§ ML is a type of AI that provides computers with the ability
to learn without being explicitly programmed.
BIG DATA
![Page 6: Machine Learning and Sensor Fusion for Precision Farming · Sensor FusionàMachine Learning §Any nontrivial machine learning algorithm needs high-quality dataset. This increases](https://reader036.vdocuments.us/reader036/viewer/2022062414/5ee065afad6a402d666b9682/html5/thumbnails/6.jpg)
Genetics
SoilIrrigation
Climate…
Increase Yield
![Page 7: Machine Learning and Sensor Fusion for Precision Farming · Sensor FusionàMachine Learning §Any nontrivial machine learning algorithm needs high-quality dataset. This increases](https://reader036.vdocuments.us/reader036/viewer/2022062414/5ee065afad6a402d666b9682/html5/thumbnails/7.jpg)
Hardware Platforms
![Page 8: Machine Learning and Sensor Fusion for Precision Farming · Sensor FusionàMachine Learning §Any nontrivial machine learning algorithm needs high-quality dataset. This increases](https://reader036.vdocuments.us/reader036/viewer/2022062414/5ee065afad6a402d666b9682/html5/thumbnails/8.jpg)
Field Scanalyzer System
§ High Throughput Automated Field Phenotyping System
![Page 9: Machine Learning and Sensor Fusion for Precision Farming · Sensor FusionàMachine Learning §Any nontrivial machine learning algorithm needs high-quality dataset. This increases](https://reader036.vdocuments.us/reader036/viewer/2022062414/5ee065afad6a402d666b9682/html5/thumbnails/9.jpg)
Sensors
![Page 10: Machine Learning and Sensor Fusion for Precision Farming · Sensor FusionàMachine Learning §Any nontrivial machine learning algorithm needs high-quality dataset. This increases](https://reader036.vdocuments.us/reader036/viewer/2022062414/5ee065afad6a402d666b9682/html5/thumbnails/10.jpg)
Color Coded 3D Data from Whole Field
![Page 11: Machine Learning and Sensor Fusion for Precision Farming · Sensor FusionàMachine Learning §Any nontrivial machine learning algorithm needs high-quality dataset. This increases](https://reader036.vdocuments.us/reader036/viewer/2022062414/5ee065afad6a402d666b9682/html5/thumbnails/11.jpg)
Color Coded 3D Plants as They Grow
![Page 12: Machine Learning and Sensor Fusion for Precision Farming · Sensor FusionàMachine Learning §Any nontrivial machine learning algorithm needs high-quality dataset. This increases](https://reader036.vdocuments.us/reader036/viewer/2022062414/5ee065afad6a402d666b9682/html5/thumbnails/12.jpg)
What can Machine Learning do?
§ Autonomous Cars§ Classification§ Object Detection§ Stock Market Analysis§ Game Playing§ Search Engines§ Hand Writing, Speech, Face Recognition§ …
![Page 13: Machine Learning and Sensor Fusion for Precision Farming · Sensor FusionàMachine Learning §Any nontrivial machine learning algorithm needs high-quality dataset. This increases](https://reader036.vdocuments.us/reader036/viewer/2022062414/5ee065afad6a402d666b9682/html5/thumbnails/13.jpg)
What can Machine Learning do?
§ Robot learning how to cook by watching YouTube
![Page 14: Machine Learning and Sensor Fusion for Precision Farming · Sensor FusionàMachine Learning §Any nontrivial machine learning algorithm needs high-quality dataset. This increases](https://reader036.vdocuments.us/reader036/viewer/2022062414/5ee065afad6a402d666b9682/html5/thumbnails/14.jpg)
What can Machine Learning do?
![Page 15: Machine Learning and Sensor Fusion for Precision Farming · Sensor FusionàMachine Learning §Any nontrivial machine learning algorithm needs high-quality dataset. This increases](https://reader036.vdocuments.us/reader036/viewer/2022062414/5ee065afad6a402d666b9682/html5/thumbnails/15.jpg)
LemnaGrid – Machine Learning
SensorTraining Data
NewSensor Data
Labeling(Points of Interest,Diseases, Objects)
Save toDatabase
Data Labeling
CalculateFeatures
Save toDatabase
Features
Image Analysis Configuration
Train and Evaluatean Classification
Algorithm
ClassificationAlgorithm
ClassificationResult
Color, Texture,Keypoints, Shape,
Wavelengths,Vegetation Indices,…
SupportVector
Machine,RandomForest,
Boosted Trees
![Page 16: Machine Learning and Sensor Fusion for Precision Farming · Sensor FusionàMachine Learning §Any nontrivial machine learning algorithm needs high-quality dataset. This increases](https://reader036.vdocuments.us/reader036/viewer/2022062414/5ee065afad6a402d666b9682/html5/thumbnails/16.jpg)
LemnaGrid – Machine Learning
• Easy to use machine learning workflow based on a singleImage Analysis Configuration
• Classification on various sensor data, i.e. RGB,hyperspectral Imaging
![Page 17: Machine Learning and Sensor Fusion for Precision Farming · Sensor FusionàMachine Learning §Any nontrivial machine learning algorithm needs high-quality dataset. This increases](https://reader036.vdocuments.us/reader036/viewer/2022062414/5ee065afad6a402d666b9682/html5/thumbnails/17.jpg)
LemnaGrid – Machine Learning
§ Segmentation of 3D point clouds
Boosted TreeClassification
Detected asa spike
Non-spike
True Spike 0.994 0.0057
True Non-spike 0.0074 0.992
3D Laser Scanner RothamstedResearch
Original resolution (RN = 1, RH = 8)
![Page 18: Machine Learning and Sensor Fusion for Precision Farming · Sensor FusionàMachine Learning §Any nontrivial machine learning algorithm needs high-quality dataset. This increases](https://reader036.vdocuments.us/reader036/viewer/2022062414/5ee065afad6a402d666b9682/html5/thumbnails/18.jpg)
Detecting Plant from Background
Noah Fahlgren, Arash Abbasi
![Page 19: Machine Learning and Sensor Fusion for Precision Farming · Sensor FusionàMachine Learning §Any nontrivial machine learning algorithm needs high-quality dataset. This increases](https://reader036.vdocuments.us/reader036/viewer/2022062414/5ee065afad6a402d666b9682/html5/thumbnails/19.jpg)
Convolutional Nueral Network
§ Learn a feature hierarchy from pixels to classifier§ Each layer extracts features from the output of previous
layer§ Train all layers jointly
Layer 1 Layer 2 … Layer N Classifier
ImagePixels
Plant &Non-Plant
Class
Noah Fahlgren, Arash Abbasi
![Page 20: Machine Learning and Sensor Fusion for Precision Farming · Sensor FusionàMachine Learning §Any nontrivial machine learning algorithm needs high-quality dataset. This increases](https://reader036.vdocuments.us/reader036/viewer/2022062414/5ee065afad6a402d666b9682/html5/thumbnails/20.jpg)
Convolutional Nueral Network
Convolution+ non linearrectifying
Deconvolution+ non linearrectifying
Noah Fahlgren, Arash Abbasi
![Page 21: Machine Learning and Sensor Fusion for Precision Farming · Sensor FusionàMachine Learning §Any nontrivial machine learning algorithm needs high-quality dataset. This increases](https://reader036.vdocuments.us/reader036/viewer/2022062414/5ee065afad6a402d666b9682/html5/thumbnails/21.jpg)
Convolutional Nueral Network
Iterationsè
Noah Fahlgren, Arash Abbasi
![Page 22: Machine Learning and Sensor Fusion for Precision Farming · Sensor FusionàMachine Learning §Any nontrivial machine learning algorithm needs high-quality dataset. This increases](https://reader036.vdocuments.us/reader036/viewer/2022062414/5ee065afad6a402d666b9682/html5/thumbnails/22.jpg)
Sensor Fusionà Machine Learning
§ Any nontrivial machine learning algorithm needs high-quality dataset. This increases the demand for fusingmachines, sensors, and crop models to produce a datasetwith high structural and spatial details.
SensorFusion
RGB
Thermal
Hyperspectral
3D Data
MachineLearning
Algorithms
ClassificationResult
![Page 23: Machine Learning and Sensor Fusion for Precision Farming · Sensor FusionàMachine Learning §Any nontrivial machine learning algorithm needs high-quality dataset. This increases](https://reader036.vdocuments.us/reader036/viewer/2022062414/5ee065afad6a402d666b9682/html5/thumbnails/23.jpg)
Sensor Fusionà Machine Learning
§ Sensor fusion is a process of integrating data collected withdifferent sensors at different spectral, special and temporalscale.
SensorFusion
RGB
Thermal
Hyperspectral
3D Data
MachineLearning
Algorithms
ClassificationResult
![Page 24: Machine Learning and Sensor Fusion for Precision Farming · Sensor FusionàMachine Learning §Any nontrivial machine learning algorithm needs high-quality dataset. This increases](https://reader036.vdocuments.us/reader036/viewer/2022062414/5ee065afad6a402d666b9682/html5/thumbnails/24.jpg)
Sensor Fusionà Machine Learning
§ We produce a dataset with higher order information andknowledge content than could be achieved by assessingeach sensor independently.
SensorFusion
RGB
Thermal
Hyperspectral
3D Data
MachineLearning
Algorithms
ClassificationResult
![Page 25: Machine Learning and Sensor Fusion for Precision Farming · Sensor FusionàMachine Learning §Any nontrivial machine learning algorithm needs high-quality dataset. This increases](https://reader036.vdocuments.us/reader036/viewer/2022062414/5ee065afad6a402d666b9682/html5/thumbnails/25.jpg)
RGB and IR Fusion
RGB IR
Overlaying IR & RGBFused data IR & RGB
![Page 26: Machine Learning and Sensor Fusion for Precision Farming · Sensor FusionàMachine Learning §Any nontrivial machine learning algorithm needs high-quality dataset. This increases](https://reader036.vdocuments.us/reader036/viewer/2022062414/5ee065afad6a402d666b9682/html5/thumbnails/26.jpg)
RGB and IR Fusion
• RGB mask can be used to subtract the background from theplant in IR
• IR data can be used as 4th channel for RGB data and used ina same ML algorithm
Overlaying IR & RGB Fused data IR & RGB
![Page 27: Machine Learning and Sensor Fusion for Precision Farming · Sensor FusionàMachine Learning §Any nontrivial machine learning algorithm needs high-quality dataset. This increases](https://reader036.vdocuments.us/reader036/viewer/2022062414/5ee065afad6a402d666b9682/html5/thumbnails/27.jpg)
3D and RGB Fusion
§ Pixel-level information using RGB and 3D fusion
![Page 28: Machine Learning and Sensor Fusion for Precision Farming · Sensor FusionàMachine Learning §Any nontrivial machine learning algorithm needs high-quality dataset. This increases](https://reader036.vdocuments.us/reader036/viewer/2022062414/5ee065afad6a402d666b9682/html5/thumbnails/28.jpg)
3D and IR Fusion
§ 3D and IR Fusion
![Page 29: Machine Learning and Sensor Fusion for Precision Farming · Sensor FusionàMachine Learning §Any nontrivial machine learning algorithm needs high-quality dataset. This increases](https://reader036.vdocuments.us/reader036/viewer/2022062414/5ee065afad6a402d666b9682/html5/thumbnails/29.jpg)
IR + 3D Fusion from Whole Field
Observe the temperature increase alongthe path from 9am to 2pm
![Page 30: Machine Learning and Sensor Fusion for Precision Farming · Sensor FusionàMachine Learning §Any nontrivial machine learning algorithm needs high-quality dataset. This increases](https://reader036.vdocuments.us/reader036/viewer/2022062414/5ee065afad6a402d666b9682/html5/thumbnails/30.jpg)
Conclusion
§ Increased accuracy in target detection and recognition formachine learning algorithms.
§ Sensor Fusion provides enhanced structural and spatialdetails, and corrects for reflectance complexity andprovides higher level of calibration.
![Page 31: Machine Learning and Sensor Fusion for Precision Farming · Sensor FusionàMachine Learning §Any nontrivial machine learning algorithm needs high-quality dataset. This increases](https://reader036.vdocuments.us/reader036/viewer/2022062414/5ee065afad6a402d666b9682/html5/thumbnails/31.jpg)
Thank you…