artificial intelligence applications in renewable energy · 2020. 8. 25. · title: artificial...
TRANSCRIPT
![Page 1: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing](https://reader035.vdocuments.us/reader035/viewer/2022071414/610f1e706e91e90629312dcf/html5/thumbnails/1.jpg)
Artificial Intelligence Applications in Renewable Energy
Grant BusterAI in Energy: Advancing New Research ParadigmsAugust 17, 2020
![Page 2: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing](https://reader035.vdocuments.us/reader035/viewer/2022071414/610f1e706e91e90629312dcf/html5/thumbnails/2.jpg)
Messaging + Blue Infographic
Content
NREL | 2
\
SolarWind Water
Geothermal
RenewablePower
Bioenergy
Vehicle Technologies
Hydrogen
Sustainable Transportation
Buildings
Advanced Manufacturing
Government Energy Management
Energy Efficiency
Grid IntegrationHybrid Systems
Energy SystemsIntegration
NREL Science Drives Innovation
![Page 3: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing](https://reader035.vdocuments.us/reader035/viewer/2022071414/610f1e706e91e90629312dcf/html5/thumbnails/3.jpg)
NREL | 3
The National Solar Radiation Database (NSRDB)
![Page 4: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing](https://reader035.vdocuments.us/reader035/viewer/2022071414/610f1e706e91e90629312dcf/html5/thumbnails/4.jpg)
NREL | 4
The Wind Integration National Dataset (WIND Toolkit)
![Page 5: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing](https://reader035.vdocuments.us/reader035/viewer/2022071414/610f1e706e91e90629312dcf/html5/thumbnails/5.jpg)
NREL | 5
Artificial Intelligence (AI) Today
Where are we?
![Page 6: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing](https://reader035.vdocuments.us/reader035/viewer/2022071414/610f1e706e91e90629312dcf/html5/thumbnails/6.jpg)
NREL | 6
Google DeepMind’s AlphaGo
Game of Go:361 possible moves3361 unique board states
https://deepmind.com/research/case-studies/alphago-the-story-so-farhttps://www.youtube.com/watch?v=WXuK6gekU1Y
![Page 7: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing](https://reader035.vdocuments.us/reader035/viewer/2022071414/610f1e706e91e90629312dcf/html5/thumbnails/7.jpg)
NREL | 7
Tesla as a Utility: Autobidder
“Autobidder provides independent power producers … the ability to autonomously monetize battery assets”
https://electrek.co/2020/06/15/tesla-officially-approved-electric-utility-uk-why/https://electrek.co/2020/05/03/tesla-autobidder-new-product-electric-utility/
![Page 8: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing](https://reader035.vdocuments.us/reader035/viewer/2022071414/610f1e706e91e90629312dcf/html5/thumbnails/8.jpg)
AI Applications at NREL
![Page 9: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing](https://reader035.vdocuments.us/reader035/viewer/2022071414/610f1e706e91e90629312dcf/html5/thumbnails/9.jpg)
NREL | 9
Limitations of Mechanistic Cloud Models:
![Page 10: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing](https://reader035.vdocuments.us/reader035/viewer/2022071414/610f1e706e91e90629312dcf/html5/thumbnails/10.jpg)
NREL | 10
Using Theory to Guide Learning:Physics-Guided Neural Networks (phygnn)
𝐿𝐿𝐿𝐿𝐿𝐿𝐿𝐿 = 𝜆𝜆0𝐿𝐿𝐿𝐿𝐿𝐿𝐿𝐿 �𝑌𝑌,𝑌𝑌 + 𝜆𝜆𝑝𝑝𝐿𝐿𝐿𝐿𝐿𝐿𝐿𝐿𝑝𝑝( �𝑌𝑌)
Example neural network loss surfacehttps://www.cs.umd.edu/~tomg/projects/landscapes/
Open source: https://github.com/NREL/phygnn
![Page 11: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing](https://reader035.vdocuments.us/reader035/viewer/2022071414/610f1e706e91e90629312dcf/html5/thumbnails/11.jpg)
NREL | 11
phygnn: reduces error, improves data product
![Page 12: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing](https://reader035.vdocuments.us/reader035/viewer/2022071414/610f1e706e91e90629312dcf/html5/thumbnails/12.jpg)
NREL | 12
Original Data
Improved Data
![Page 13: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing](https://reader035.vdocuments.us/reader035/viewer/2022071414/610f1e706e91e90629312dcf/html5/thumbnails/13.jpg)
What about in the field?
![Page 14: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing](https://reader035.vdocuments.us/reader035/viewer/2022071414/610f1e706e91e90629312dcf/html5/thumbnails/14.jpg)
Geothermal Operational Optimization with Machine Learning
Partnership between:
![Page 15: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing](https://reader035.vdocuments.us/reader035/viewer/2022071414/610f1e706e91e90629312dcf/html5/thumbnails/15.jpg)
NREL | 15
Step 1: Build a Digital Twin
![Page 16: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing](https://reader035.vdocuments.us/reader035/viewer/2022071414/610f1e706e91e90629312dcf/html5/thumbnails/16.jpg)
NREL | 16
Step 2: Hindcast Validation
Steam Delivery Power Generation
![Page 17: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing](https://reader035.vdocuments.us/reader035/viewer/2022071414/610f1e706e91e90629312dcf/html5/thumbnails/17.jpg)
NREL | 17
Step 3: Reinforcement Learning
Action
Reward +Observation
Agent(s)
Environment
![Page 18: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing](https://reader035.vdocuments.us/reader035/viewer/2022071414/610f1e706e91e90629312dcf/html5/thumbnails/18.jpg)
NREL | 18
Reinforcement Learning Experiment #1:
Agent controls:- Line Pressures- Wells
![Page 19: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing](https://reader035.vdocuments.us/reader035/viewer/2022071414/610f1e706e91e90629312dcf/html5/thumbnails/19.jpg)
NREL | 19
Lessons Learned
• Centering the reward at zero is an example of bad reward shaping (at least for this environment)
• The agent learned how to terminate the episode quickly to get the least amount of negative reward
![Page 20: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing](https://reader035.vdocuments.us/reader035/viewer/2022071414/610f1e706e91e90629312dcf/html5/thumbnails/20.jpg)
NREL | 20
Lessons Learned
• Centering the reward at zero is an example of bad reward shaping (at least for this environment)
• The agent learned how to terminate the episode quickly to get the least amount of negative reward
• In other words, the negative reward shaping affected the agent’s will to live!
![Page 21: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing](https://reader035.vdocuments.us/reader035/viewer/2022071414/610f1e706e91e90629312dcf/html5/thumbnails/21.jpg)
NREL | 21
Reinforcement Learning Experiment #2
Agent controls:- Line Pressures- Wells
Improved:- Rewards- Termination
conditions
![Page 22: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing](https://reader035.vdocuments.us/reader035/viewer/2022071414/610f1e706e91e90629312dcf/html5/thumbnails/22.jpg)
NREL | 22
Agent Exploration in Action!
![Page 23: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing](https://reader035.vdocuments.us/reader035/viewer/2022071414/610f1e706e91e90629312dcf/html5/thumbnails/23.jpg)
NREL | 23
Agent Exploration in Action!
![Page 24: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing](https://reader035.vdocuments.us/reader035/viewer/2022071414/610f1e706e91e90629312dcf/html5/thumbnails/24.jpg)
NREL | 24
Agent Exploration in Action!
![Page 25: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing](https://reader035.vdocuments.us/reader035/viewer/2022071414/610f1e706e91e90629312dcf/html5/thumbnails/25.jpg)
NREL | 25
Agent Exploration in Action!
![Page 26: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing](https://reader035.vdocuments.us/reader035/viewer/2022071414/610f1e706e91e90629312dcf/html5/thumbnails/26.jpg)
NREL | 26
Agent Exploration in Action!
![Page 27: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing](https://reader035.vdocuments.us/reader035/viewer/2022071414/610f1e706e91e90629312dcf/html5/thumbnails/27.jpg)
NREL | 27
Agent Exploration in Action!
![Page 28: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing](https://reader035.vdocuments.us/reader035/viewer/2022071414/610f1e706e91e90629312dcf/html5/thumbnails/28.jpg)
NREL | 28
Agent Exploration in Action!
![Page 29: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing](https://reader035.vdocuments.us/reader035/viewer/2022071414/610f1e706e91e90629312dcf/html5/thumbnails/29.jpg)
NREL | 29
Agent Exploration in Action!
![Page 30: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing](https://reader035.vdocuments.us/reader035/viewer/2022071414/610f1e706e91e90629312dcf/html5/thumbnails/30.jpg)
NREL | 30
Agent Exploration in Action!
![Page 31: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing](https://reader035.vdocuments.us/reader035/viewer/2022071414/610f1e706e91e90629312dcf/html5/thumbnails/31.jpg)
NREL | 31
Agent Exploration in Action!
![Page 32: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing](https://reader035.vdocuments.us/reader035/viewer/2022071414/610f1e706e91e90629312dcf/html5/thumbnails/32.jpg)
NREL | 32
Agent Exploration in Action!
![Page 33: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing](https://reader035.vdocuments.us/reader035/viewer/2022071414/610f1e706e91e90629312dcf/html5/thumbnails/33.jpg)
NREL | 33
Agent Exploration in Action!
![Page 34: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing](https://reader035.vdocuments.us/reader035/viewer/2022071414/610f1e706e91e90629312dcf/html5/thumbnails/34.jpg)
www.nrel.gov
Thank you
This work was authored by the National Renewable Energy Laboratory, operated by Alliance for Sustainable Energy, LLC, for the U.S. Department of Energy (DOE) under Contract No. DE-AC36-08GO28308. This material is based upon work supported by the U.S. Department of Energy’s Office of Energy Efficiency and Renewable Energy (EERE) under the Geothermal Technology Office Award Number DE-EE0008766 and the Solar Energy Technologies Office (Systems Integration Subprogram) Contract Number 36598. The views expressed in the article do not necessarily represent the views of the DOE or the U.S. Government. The U.S. Government retains and the publisher, by accepting the article for publication, acknowledges that the U.S. Government retains a nonexclusive, paid-up, irrevocable, worldwide license to publish or reproduce the published form of this work, or allow others to do so, for U.S. Government purposes.
[email protected]://www.linkedin.com/in/grant-buster/
Solar Data Team:Mike Bannister, Aron Habte, Dylan Hettinger, Galen Maclaurin, Michael Rossol, Manajit Sengupta, and Yu Xie
GOOML Team:Andy Blair, Jay Huggins, Ross Ring-Jarvi, Michael Rossol , Paul Siratovich, Nicole Taverna, Jon Weers
NREL/PR-6A20-77593