machine learning and decision making for sustainability · machine learning and decision making for...
TRANSCRIPT
![Page 1: Machine Learning and Decision Making for Sustainability · Machine Learning and Decision Making for Sustainability Stefano Ermon Department of Computer Science Stanford University](https://reader030.vdocuments.us/reader030/viewer/2022040906/5e7af06294f09f35ad2f08a4/html5/thumbnails/1.jpg)
Machine Learning and Decision
Making for Sustainability
Stefano Ermon
Department of Computer Science
Stanford University
April 12
![Page 2: Machine Learning and Decision Making for Sustainability · Machine Learning and Decision Making for Sustainability Stefano Ermon Department of Computer Science Stanford University](https://reader030.vdocuments.us/reader030/viewer/2022040906/5e7af06294f09f35ad2f08a4/html5/thumbnails/2.jpg)
Overview
2
Technology
Push
Society
Pull
Big Data
Sensing revolution
Artificial Intelligence
Fellow, Woods Institute for the EnvironmentStanford Artificial Intelligence Lab
Computational
Sustainability
![Page 3: Machine Learning and Decision Making for Sustainability · Machine Learning and Decision Making for Sustainability Stefano Ermon Department of Computer Science Stanford University](https://reader030.vdocuments.us/reader030/viewer/2022040906/5e7af06294f09f35ad2f08a4/html5/thumbnails/3.jpg)
ML and Decision Making for Sustainability
Models
Policy
DataAlgorithmic challenges and
opportunities at every step
– Data acquisition and
interpretation
– Model fitting
– Decision making and policy
optimization
3
Vision: sustainability challenges as control problems
![Page 4: Machine Learning and Decision Making for Sustainability · Machine Learning and Decision Making for Sustainability Stefano Ermon Department of Computer Science Stanford University](https://reader030.vdocuments.us/reader030/viewer/2022040906/5e7af06294f09f35ad2f08a4/html5/thumbnails/4.jpg)
Computational Sustainability
Machine Learning
Materials discovery for energy applications
Optimization of energy systems
Poverty traps
Poverty mapping
Large unstructured datasets
natural resources management
Decision making and optimization
Water and weather systems modeling
4
![Page 5: Machine Learning and Decision Making for Sustainability · Machine Learning and Decision Making for Sustainability Stefano Ermon Department of Computer Science Stanford University](https://reader030.vdocuments.us/reader030/viewer/2022040906/5e7af06294f09f35ad2f08a4/html5/thumbnails/5.jpg)
Summary
• Introduction
• Machine Learning for Public Policy
• AI for Sustainable Energy
• Conclusion
5
![Page 6: Machine Learning and Decision Making for Sustainability · Machine Learning and Decision Making for Sustainability Stefano Ermon Department of Computer Science Stanford University](https://reader030.vdocuments.us/reader030/viewer/2022040906/5e7af06294f09f35ad2f08a4/html5/thumbnails/6.jpg)
UN’s Global Goals for Sustainable Development
6
The 2030 Development Agenda (Transforming our world)
1. End extreme poverty2. Fight inequality & injustice
3. Fix climate change
![Page 7: Machine Learning and Decision Making for Sustainability · Machine Learning and Decision Making for Sustainability Stefano Ermon Department of Computer Science Stanford University](https://reader030.vdocuments.us/reader030/viewer/2022040906/5e7af06294f09f35ad2f08a4/html5/thumbnails/7.jpg)
Data scarcity
7
• Expensive to conduct surveys
• Poor spatial and temporal resolution
• Questionable data quality
![Page 8: Machine Learning and Decision Making for Sustainability · Machine Learning and Decision Making for Sustainability Stefano Ermon Department of Computer Science Stanford University](https://reader030.vdocuments.us/reader030/viewer/2022040906/5e7af06294f09f35ad2f08a4/html5/thumbnails/8.jpg)
Satellite imagery is low-cost and globally available
8
Simultaneously becoming cheaper and higher resolution(DigitalGlobe, Planet Labs, Skybox, etc.)
Shipping recordsInventory estimates
Agricultural yieldDeforestation rate
![Page 9: Machine Learning and Decision Making for Sustainability · Machine Learning and Decision Making for Sustainability Stefano Ermon Department of Computer Science Stanford University](https://reader030.vdocuments.us/reader030/viewer/2022040906/5e7af06294f09f35ad2f08a4/html5/thumbnails/9.jpg)
What if…
9
we could infer socioeconomic indicators from large-scale, remotely-sensed data?
![Page 10: Machine Learning and Decision Making for Sustainability · Machine Learning and Decision Making for Sustainability Stefano Ermon Department of Computer Science Stanford University](https://reader030.vdocuments.us/reader030/viewer/2022040906/5e7af06294f09f35ad2f08a4/html5/thumbnails/10.jpg)
Standard supervised learning won’t work
11
- Lots of unlabeled data (images)
- Very little labeled training data (few thousand data points)
- Nontrivial for humans (hard to crowdsource labels)
Poverty, wealth, child mortality, etc.Model
Input Output
![Page 11: Machine Learning and Decision Making for Sustainability · Machine Learning and Decision Making for Sustainability Stefano Ermon Department of Computer Science Stanford University](https://reader030.vdocuments.us/reader030/viewer/2022040906/5e7af06294f09f35ad2f08a4/html5/thumbnails/11.jpg)
Transfer learning overcomes data scarcity
12
Transfer learning: Use knowledge gained from one task to solve a different (but related) task
Train here Perform here
Transfer
![Page 12: Machine Learning and Decision Making for Sustainability · Machine Learning and Decision Making for Sustainability Stefano Ermon Department of Computer Science Stanford University](https://reader030.vdocuments.us/reader030/viewer/2022040906/5e7af06294f09f35ad2f08a4/html5/thumbnails/12.jpg)
Nighttime lights as proxy for economic development
13
![Page 13: Machine Learning and Decision Making for Sustainability · Machine Learning and Decision Making for Sustainability Stefano Ermon Department of Computer Science Stanford University](https://reader030.vdocuments.us/reader030/viewer/2022040906/5e7af06294f09f35ad2f08a4/html5/thumbnails/13.jpg)
Step 1: Predict nighttime light intensities
14
training images sampled from these locations
A. Satellite images C. Poverty measures
Deep learning
model
B. Nighttime light intensities
![Page 14: Machine Learning and Decision Making for Sustainability · Machine Learning and Decision Making for Sustainability Stefano Ermon Department of Computer Science Stanford University](https://reader030.vdocuments.us/reader030/viewer/2022040906/5e7af06294f09f35ad2f08a4/html5/thumbnails/14.jpg)
Training data on the proxy task is plentiful
15
Millions of training images
training images sampled from these locations
Low nightlight intensity
,
High nightlight intensity
,
…
(
(
)
)
Labeled input/output training pairs
![Page 15: Machine Learning and Decision Making for Sustainability · Machine Learning and Decision Making for Sustainability Stefano Ermon Department of Computer Science Stanford University](https://reader030.vdocuments.us/reader030/viewer/2022040906/5e7af06294f09f35ad2f08a4/html5/thumbnails/15.jpg)
Images summarized as low-dimensional feature vectors
16
f1
f2
…
f4096
Inputs: daytime satellite images
{Low, Medium, High}
Outputs: Nighttime light intensities
Convolutional Neural Network
(CNN)
![Page 16: Machine Learning and Decision Making for Sustainability · Machine Learning and Decision Making for Sustainability Stefano Ermon Department of Computer Science Stanford University](https://reader030.vdocuments.us/reader030/viewer/2022040906/5e7af06294f09f35ad2f08a4/html5/thumbnails/16.jpg)
Model learns relevant features automatically
17
Satellite image
Filter activation map
Overlaid image
No supervision beyond nighttime lights - no labeled example of what a road looks like was provided!
f10f1
![Page 17: Machine Learning and Decision Making for Sustainability · Machine Learning and Decision Making for Sustainability Stefano Ermon Department of Computer Science Stanford University](https://reader030.vdocuments.us/reader030/viewer/2022040906/5e7af06294f09f35ad2f08a4/html5/thumbnails/17.jpg)
Transfer Learning
18
f1
f2
…
f4096
Socioeconomic outcomesNonlinear
mapping
Inputs: daytime satellite images
{Low, Medium, High}
Outputs: Nighttime light intensities
Feature Learning
Target task
![Page 18: Machine Learning and Decision Making for Sustainability · Machine Learning and Decision Making for Sustainability Stefano Ermon Department of Computer Science Stanford University](https://reader030.vdocuments.us/reader030/viewer/2022040906/5e7af06294f09f35ad2f08a4/html5/thumbnails/18.jpg)
We can differentiate different levels of poverty
19
2 indicators:• Consumption expenditures
• Household assets
We outperform recent methods based on mobile call record data
Blumenstock et al. (2015) Predicting Poverty and Wealth from Mobile Phone Metadata, Science
Observed consumption ($/cap/day)
Pre
dic
ted
($
/cap
/day
)
![Page 19: Machine Learning and Decision Making for Sustainability · Machine Learning and Decision Making for Sustainability Stefano Ermon Department of Computer Science Stanford University](https://reader030.vdocuments.us/reader030/viewer/2022040906/5e7af06294f09f35ad2f08a4/html5/thumbnails/19.jpg)
Models travels well across borders
20
Models trained in one country perform well in other countries
Can make predictions in countries where no training data exists
![Page 20: Machine Learning and Decision Making for Sustainability · Machine Learning and Decision Making for Sustainability Stefano Ermon Department of Computer Science Stanford University](https://reader030.vdocuments.us/reader030/viewer/2022040906/5e7af06294f09f35ad2f08a4/html5/thumbnails/20.jpg)
Scalable High Resolution Poverty Maps
21
Run the model on about 500,000 images from Uganda:
Scalable and inexpensive approach to generate high resolution maps.
Most up-to-date map
![Page 21: Machine Learning and Decision Making for Sustainability · Machine Learning and Decision Making for Sustainability Stefano Ermon Department of Computer Science Stanford University](https://reader030.vdocuments.us/reader030/viewer/2022040906/5e7af06294f09f35ad2f08a4/html5/thumbnails/21.jpg)
22
![Page 22: Machine Learning and Decision Making for Sustainability · Machine Learning and Decision Making for Sustainability Stefano Ermon Department of Computer Science Stanford University](https://reader030.vdocuments.us/reader030/viewer/2022040906/5e7af06294f09f35ad2f08a4/html5/thumbnails/22.jpg)
Ongoing work
• Describe, model, and predict changes over time
• Incorporate new data sources (phone data, crowdsourcing, etc.)
• Mapping and estimating crop yields
– 1st prize at INFORMS yield prediction challenge
23
Credit: premise.com
![Page 23: Machine Learning and Decision Making for Sustainability · Machine Learning and Decision Making for Sustainability Stefano Ermon Department of Computer Science Stanford University](https://reader030.vdocuments.us/reader030/viewer/2022040906/5e7af06294f09f35ad2f08a4/html5/thumbnails/23.jpg)
Summary
• Introduction
• Machine Learning for Public Policy
• AI for Sustainable Energy
• Conclusion
24
![Page 24: Machine Learning and Decision Making for Sustainability · Machine Learning and Decision Making for Sustainability Stefano Ermon Department of Computer Science Stanford University](https://reader030.vdocuments.us/reader030/viewer/2022040906/5e7af06294f09f35ad2f08a4/html5/thumbnails/24.jpg)
Computational Sustainability
Artificial Intelligence and Machine Learning
Energy Materials discovery
Optimization of energy systems
Poverty traps
Poverty mapping
Large Datasets
natural resources management
Optimization
Groundwater and weather systems
modeling
25
![Page 25: Machine Learning and Decision Making for Sustainability · Machine Learning and Decision Making for Sustainability Stefano Ermon Department of Computer Science Stanford University](https://reader030.vdocuments.us/reader030/viewer/2022040906/5e7af06294f09f35ad2f08a4/html5/thumbnails/25.jpg)
Goal
Accelerate the pace and
reduce the cost of discovery,
and deployment of advanced
material systems
20 years 5 years
26
Very exciting new
research area for
Computer Science and
Big Data techniques
White House Materials Genome Initiative
![Page 26: Machine Learning and Decision Making for Sustainability · Machine Learning and Decision Making for Sustainability Stefano Ermon Department of Computer Science Stanford University](https://reader030.vdocuments.us/reader030/viewer/2022040906/5e7af06294f09f35ad2f08a4/html5/thumbnails/26.jpg)
Vision: AI for materials research
27
Stanford Linear Accelerator
Energy Materials Center at CornellCaltech
Cornell High Energy Synchrotron Source
Experiment
Design
Data
analysis
Domain
Knowledge
High throughput
experiments
Automatic Data Analysis
![Page 27: Machine Learning and Decision Making for Sustainability · Machine Learning and Decision Making for Sustainability Stefano Ermon Department of Computer Science Stanford University](https://reader030.vdocuments.us/reader030/viewer/2022040906/5e7af06294f09f35ad2f08a4/html5/thumbnails/27.jpg)
28
inte
nsi
ty
4 million XANES spectrums collected in a few minutes with 30 nm spatial resolution.
monochromator
Slide courtesy of Apurva Mehta and Yijin Liu, SLAC
![Page 28: Machine Learning and Decision Making for Sustainability · Machine Learning and Decision Making for Sustainability Stefano Ermon Department of Computer Science Stanford University](https://reader030.vdocuments.us/reader030/viewer/2022040906/5e7af06294f09f35ad2f08a4/html5/thumbnails/28.jpg)
29
Pattern Decomposition with Complex
Combinatorial Constraints: Application to Materials Discovery.
[AAAI 2015]
Identify materials
![Page 29: Machine Learning and Decision Making for Sustainability · Machine Learning and Decision Making for Sustainability Stefano Ermon Department of Computer Science Stanford University](https://reader030.vdocuments.us/reader030/viewer/2022040906/5e7af06294f09f35ad2f08a4/html5/thumbnails/29.jpg)
Vision: AI for materials research
30
Stanford Linear Accelerator
Energy Materials Center at CornellCaltech
Cornell High Energy Synchrotron Source
Experiment
Design
Data
analysis
Domain
Knowledge
High throughput
experiments
Improved Data Collection
![Page 30: Machine Learning and Decision Making for Sustainability · Machine Learning and Decision Making for Sustainability Stefano Ermon Department of Computer Science Stanford University](https://reader030.vdocuments.us/reader030/viewer/2022040906/5e7af06294f09f35ad2f08a4/html5/thumbnails/30.jpg)
LCLS tuning at SLAC
31
Linac Coherent Light Source (LCLS) is the world's first X-ray laser. 10 billion times brighter than any other X-ray source before it
Very complex machine, difficult to operate, requires manualtuning (hundreds of hours per year)
Operating cost close to $1,000 per minute – want to make parameter tuning as robust and as quick as possible
![Page 31: Machine Learning and Decision Making for Sustainability · Machine Learning and Decision Making for Sustainability Stefano Ermon Department of Computer Science Stanford University](https://reader030.vdocuments.us/reader030/viewer/2022040906/5e7af06294f09f35ad2f08a4/html5/thumbnails/31.jpg)
Bayesian Optimization for LCLS
Archiving system: records almost 200,000 independent variables once a
second, and goes back several years
32
Sparse Gaussian Processes for
Bayesian Optimization
[under review at UAI-16]
Bayesian optimization:
– Works by seeking promising points
that aren’t already explored
– Sound way to deal with the classic
exploration vs exploitation
tradeoff
![Page 32: Machine Learning and Decision Making for Sustainability · Machine Learning and Decision Making for Sustainability Stefano Ermon Department of Computer Science Stanford University](https://reader030.vdocuments.us/reader030/viewer/2022040906/5e7af06294f09f35ad2f08a4/html5/thumbnails/32.jpg)
Vision: AI for materials research
33
Stanford Linear Accelerator
Energy Materials Center at CornellCaltech
Cornell High Energy Synchrotron Source
Experiment
Design
Data
analysis
Domain
Knowledge
High throughput
experiments
Preliminary work on
dieletric screening via
quantum simulations
![Page 33: Machine Learning and Decision Making for Sustainability · Machine Learning and Decision Making for Sustainability Stefano Ermon Department of Computer Science Stanford University](https://reader030.vdocuments.us/reader030/viewer/2022040906/5e7af06294f09f35ad2f08a4/html5/thumbnails/33.jpg)
Summary
• Introduction
• Machine Learning for Public Policy
• AI for Sustainable Energy
• Conclusion
34
![Page 34: Machine Learning and Decision Making for Sustainability · Machine Learning and Decision Making for Sustainability Stefano Ermon Department of Computer Science Stanford University](https://reader030.vdocuments.us/reader030/viewer/2022040906/5e7af06294f09f35ad2f08a4/html5/thumbnails/34.jpg)
Conclusions
35
• Growing concerns about the threats of Artificial
Intelligence to the future of humanity
• Recent advances in AI also create enormous
opportunities for having deeply beneficial influences
on society (energy, sustainability, …)
• Exciting opportunities for Computer Science research
Computational Sciences
Sustainability
Sciences
Computational
Sustainability