the modern day blacksmith - university of cambridgegjc29/talks/tcmcurrentresearch... · 2021. 1....

47
Theory of Condensed Matter group The modern day blacksmith Gareth Conduit

Upload: others

Post on 22-Jul-2021

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: The modern day blacksmith - University of Cambridgegjc29/talks/TCMCurrentResearch... · 2021. 1. 10. · The modern day blacksmith Gareth Conduit. Machine learning algorithm to Train

Theory of Condensed Matter group

The modern day blacksmith

Gareth Conduit

Page 2: The modern day blacksmith - University of Cambridgegjc29/talks/TCMCurrentResearch... · 2021. 1. 10. · The modern day blacksmith Gareth Conduit. Machine learning algorithm to Train

Machine learning algorithm to

Train from sparse datasets

Merge simulations, physical laws, and experimental data

Reduce the need for expensive experimental development

Accelerate materials and drugs discovery

Generic with proven applications in materials discovery and drug design

Page 3: The modern day blacksmith - University of Cambridgegjc29/talks/TCMCurrentResearch... · 2021. 1. 10. · The modern day blacksmith Gareth Conduit. Machine learning algorithm to Train

Schematic of a jet engine

Page 4: The modern day blacksmith - University of Cambridgegjc29/talks/TCMCurrentResearch... · 2021. 1. 10. · The modern day blacksmith Gareth Conduit. Machine learning algorithm to Train

Combustor in a jet engine

Page 5: The modern day blacksmith - University of Cambridgegjc29/talks/TCMCurrentResearch... · 2021. 1. 10. · The modern day blacksmith Gareth Conduit. Machine learning algorithm to Train

Direct laser deposition requires new alloys

Page 6: The modern day blacksmith - University of Cambridgegjc29/talks/TCMCurrentResearch... · 2021. 1. 10. · The modern day blacksmith Gareth Conduit. Machine learning algorithm to Train

Black box machine learning for materials design

Composition

Properties

Defects

Fatigue

Welding

Page 7: The modern day blacksmith - University of Cambridgegjc29/talks/TCMCurrentResearch... · 2021. 1. 10. · The modern day blacksmith Gareth Conduit. Machine learning algorithm to Train

Train the neural network

Composition

Properties

Defects

Fatigue

Welding

Page 8: The modern day blacksmith - University of Cambridgegjc29/talks/TCMCurrentResearch... · 2021. 1. 10. · The modern day blacksmith Gareth Conduit. Machine learning algorithm to Train

Neural network for materials design

Composition

Properties

Defects

Fatigue

Welding

Page 9: The modern day blacksmith - University of Cambridgegjc29/talks/TCMCurrentResearch... · 2021. 1. 10. · The modern day blacksmith Gareth Conduit. Machine learning algorithm to Train

One point cannot define a straight line

Composition

De

fect

s

Page 10: The modern day blacksmith - University of Cambridgegjc29/talks/TCMCurrentResearch... · 2021. 1. 10. · The modern day blacksmith Gareth Conduit. Machine learning algorithm to Train

One point cannot define a straight line

Composition

De

fect

s

Page 11: The modern day blacksmith - University of Cambridgegjc29/talks/TCMCurrentResearch... · 2021. 1. 10. · The modern day blacksmith Gareth Conduit. Machine learning algorithm to Train

One point cannot define a straight line

Composition

De

fect

s

Page 12: The modern day blacksmith - University of Cambridgegjc29/talks/TCMCurrentResearch... · 2021. 1. 10. · The modern day blacksmith Gareth Conduit. Machine learning algorithm to Train

Need at least two points to define a straight line

Composition

De

fect

s

Page 13: The modern day blacksmith - University of Cambridgegjc29/talks/TCMCurrentResearch... · 2021. 1. 10. · The modern day blacksmith Gareth Conduit. Machine learning algorithm to Train

Data required for a defects model

Composition and heat treatment space 30 dimensions

Requires 31 points to fit a hyperplane

Just 8 data points available

Page 14: The modern day blacksmith - University of Cambridgegjc29/talks/TCMCurrentResearch... · 2021. 1. 10. · The modern day blacksmith Gareth Conduit. Machine learning algorithm to Train

Neural networks for materials design

Laser Electricity

Page 15: The modern day blacksmith - University of Cambridgegjc29/talks/TCMCurrentResearch... · 2021. 1. 10. · The modern day blacksmith Gareth Conduit. Machine learning algorithm to Train

Insufficient data for processability

Composition

Def

ects

Page 16: The modern day blacksmith - University of Cambridgegjc29/talks/TCMCurrentResearch... · 2021. 1. 10. · The modern day blacksmith Gareth Conduit. Machine learning algorithm to Train

Welding is analogous to direct laser deposition

Composition

Def

ects

Wel

dabi

lity

Composition

Page 17: The modern day blacksmith - University of Cambridgegjc29/talks/TCMCurrentResearch... · 2021. 1. 10. · The modern day blacksmith Gareth Conduit. Machine learning algorithm to Train

Simple processability-welding relationship

Composition

Def

ects

Wel

dabi

lity

CompositionWeldability

Def

ects

Page 18: The modern day blacksmith - University of Cambridgegjc29/talks/TCMCurrentResearch... · 2021. 1. 10. · The modern day blacksmith Gareth Conduit. Machine learning algorithm to Train

Merging properties with the neural network

Def

ects

+

wel

dabi

lity

Composition

Weldability

Def

ects

Wel

dabi

lity

CompositionComposition

Pro

cess

abili

ty

Page 19: The modern day blacksmith - University of Cambridgegjc29/talks/TCMCurrentResearch... · 2021. 1. 10. · The modern day blacksmith Gareth Conduit. Machine learning algorithm to Train

Schematic of a jet engine

Page 20: The modern day blacksmith - University of Cambridgegjc29/talks/TCMCurrentResearch... · 2021. 1. 10. · The modern day blacksmith Gareth Conduit. Machine learning algorithm to Train

Elemental cost < 25 $kg-1

Density < 8500 kgm-3

γ’ content < 25 wt%

Oxidation resistance < 0.3 mgcm-2

Defects < 0.15% defects

Phase stability > 99.0 wt%

γ’ solvus > 1000˚C

Thermal resistance > 0.04 KΩ-1m-3

Yield stress at 900˚C > 200 MPa

Tensile strength at 900˚C > 300 MPa

Tensile elongation at 700˚C > 8%

1000hr stress rupture at 800˚C > 100 MPa

Fatigue life at 500 MPa, 700˚C > 105 cycles

Target properties

Page 21: The modern day blacksmith - University of Cambridgegjc29/talks/TCMCurrentResearch... · 2021. 1. 10. · The modern day blacksmith Gareth Conduit. Machine learning algorithm to Train

Cr 19% Co 4% Mo 4.9% W 1.2% Zr 0.05% Nb 3%

Al 2.9% C 0.04% B 0.01% Ni Expose 0.8 THT 1300ºC

Composition

Page 22: The modern day blacksmith - University of Cambridgegjc29/talks/TCMCurrentResearch... · 2021. 1. 10. · The modern day blacksmith Gareth Conduit. Machine learning algorithm to Train

Microstructure

Probabilistic neural network identification of an alloy for direct laser depositionMaterials & Design 168, 107644 (2019)

Page 23: The modern day blacksmith - University of Cambridgegjc29/talks/TCMCurrentResearch... · 2021. 1. 10. · The modern day blacksmith Gareth Conduit. Machine learning algorithm to Train

Testing the defect density

Designparameter

Probabilistic neural network identification of an alloy for direct laser depositionMaterials & Design 168, 107644 (2019)

Page 24: The modern day blacksmith - University of Cambridgegjc29/talks/TCMCurrentResearch... · 2021. 1. 10. · The modern day blacksmith Gareth Conduit. Machine learning algorithm to Train

Testing the oxidation resistance

Probabilistic neural network identification of an alloy for direct laser depositionMaterials & Design 168, 107644 (2019)

Page 25: The modern day blacksmith - University of Cambridgegjc29/talks/TCMCurrentResearch... · 2021. 1. 10. · The modern day blacksmith Gareth Conduit. Machine learning algorithm to Train

Printing components for an engine

Probabilistic neural network identification of an alloy for direct laser depositionMaterials & Design 168, 107644 (2019)

Page 26: The modern day blacksmith - University of Cambridgegjc29/talks/TCMCurrentResearch... · 2021. 1. 10. · The modern day blacksmith Gareth Conduit. Machine learning algorithm to Train

More materials designed

Nickel andmolybdenum

Steel for welding

Experiment and DFT for batteries

Page 27: The modern day blacksmith - University of Cambridgegjc29/talks/TCMCurrentResearch... · 2021. 1. 10. · The modern day blacksmith Gareth Conduit. Machine learning algorithm to Train

Application to industrial chemicals

Ink formulations

Metal organic framework

Lubricants with molecular dynamics and experiments

Page 28: The modern day blacksmith - University of Cambridgegjc29/talks/TCMCurrentResearch... · 2021. 1. 10. · The modern day blacksmith Gareth Conduit. Machine learning algorithm to Train

Action of a drug

Drug Protein Effect

Page 29: The modern day blacksmith - University of Cambridgegjc29/talks/TCMCurrentResearch... · 2021. 1. 10. · The modern day blacksmith Gareth Conduit. Machine learning algorithm to Train

Novartis dataset to benchmark machine learning

159 kinase proteins, 10000 compounds, data 5% complete

159 proteins

1000

0 co

mpo

unds

Imputation of Assay Bioactivity Data using Deep LearningJournal of Chemical Information and Modeling, 59, 1197 (2019)

Page 30: The modern day blacksmith - University of Cambridgegjc29/talks/TCMCurrentResearch... · 2021. 1. 10. · The modern day blacksmith Gareth Conduit. Machine learning algorithm to Train

Quantitative structure-activity relationships

x3 x1 x1

Molecular weight=183 Da

Imputation of Assay Bioactivity Data using Deep LearningJournal of Chemical Information and Modeling, 59, 1197 (2019)

Page 31: The modern day blacksmith - University of Cambridgegjc29/talks/TCMCurrentResearch... · 2021. 1. 10. · The modern day blacksmith Gareth Conduit. Machine learning algorithm to Train

Quantitative structure-activity relationships

Imputation of Assay Bioactivity Data using Deep LearningJournal of Chemical Information and Modeling, 59, 1197 (2019)

Page 32: The modern day blacksmith - University of Cambridgegjc29/talks/TCMCurrentResearch... · 2021. 1. 10. · The modern day blacksmith Gareth Conduit. Machine learning algorithm to Train

Exploit protein-protein correlations

Imputation of Assay Bioactivity Data using Deep LearningJournal of Chemical Information and Modeling, 59, 1197 (2019)

Page 33: The modern day blacksmith - University of Cambridgegjc29/talks/TCMCurrentResearch... · 2021. 1. 10. · The modern day blacksmith Gareth Conduit. Machine learning algorithm to Train

Comparison of techniques

Page 34: The modern day blacksmith - University of Cambridgegjc29/talks/TCMCurrentResearch... · 2021. 1. 10. · The modern day blacksmith Gareth Conduit. Machine learning algorithm to Train

Predictions have an uncertainty

Act

ivity

Drug 1 Drug 2 Drug 3 Drug 4

Page 35: The modern day blacksmith - University of Cambridgegjc29/talks/TCMCurrentResearch... · 2021. 1. 10. · The modern day blacksmith Gareth Conduit. Machine learning algorithm to Train

Validation data typically within one standard deviation

Act

ivity

Drug 1 Drug 2 Drug 3 Drug 4

Page 36: The modern day blacksmith - University of Cambridgegjc29/talks/TCMCurrentResearch... · 2021. 1. 10. · The modern day blacksmith Gareth Conduit. Machine learning algorithm to Train

R² metric calculated with difference from mean

Act

ivity

Drug 1 Drug 2 Drug 3 Drug 4

Page 37: The modern day blacksmith - University of Cambridgegjc29/talks/TCMCurrentResearch... · 2021. 1. 10. · The modern day blacksmith Gareth Conduit. Machine learning algorithm to Train

Impute 75% of data with smallest uncertainty

Act

ivity

Drug 1 Drug 2 Drug 3 Drug 4

Page 38: The modern day blacksmith - University of Cambridgegjc29/talks/TCMCurrentResearch... · 2021. 1. 10. · The modern day blacksmith Gareth Conduit. Machine learning algorithm to Train

Impute 50% of data with smallest uncertainty

Act

ivity

Drug 1 Drug 2 Drug 3 Drug 4

Page 39: The modern day blacksmith - University of Cambridgegjc29/talks/TCMCurrentResearch... · 2021. 1. 10. · The modern day blacksmith Gareth Conduit. Machine learning algorithm to Train

Impute 25% of data with smallest uncertainty

Act

ivity

Drug 1 Drug 2 Drug 3 Drug 4

Page 40: The modern day blacksmith - University of Cambridgegjc29/talks/TCMCurrentResearch... · 2021. 1. 10. · The modern day blacksmith Gareth Conduit. Machine learning algorithm to Train

Improved performance by exploiting uncertainty

Page 41: The modern day blacksmith - University of Cambridgegjc29/talks/TCMCurrentResearch... · 2021. 1. 10. · The modern day blacksmith Gareth Conduit. Machine learning algorithm to Train

Different drugs can treat the same ailment

Page 42: The modern day blacksmith - University of Cambridgegjc29/talks/TCMCurrentResearch... · 2021. 1. 10. · The modern day blacksmith Gareth Conduit. Machine learning algorithm to Train

Open Source Malaria contest

Page 43: The modern day blacksmith - University of Cambridgegjc29/talks/TCMCurrentResearch... · 2021. 1. 10. · The modern day blacksmith Gareth Conduit. Machine learning algorithm to Train

Focus on compounds with low uncertainty

Page 44: The modern day blacksmith - University of Cambridgegjc29/talks/TCMCurrentResearch... · 2021. 1. 10. · The modern day blacksmith Gareth Conduit. Machine learning algorithm to Train

Open Source Malaria experimental validation

Optibrium & Intellegens

0.647 µM

Page 45: The modern day blacksmith - University of Cambridgegjc29/talks/TCMCurrentResearch... · 2021. 1. 10. · The modern day blacksmith Gareth Conduit. Machine learning algorithm to Train

Open Source Malaria other compounds

Optibrium & Intellegens Davy Guan Exscientia Molomics

0.647 µM >25 µM 10.9 µM >25 µM

Page 46: The modern day blacksmith - University of Cambridgegjc29/talks/TCMCurrentResearch... · 2021. 1. 10. · The modern day blacksmith Gareth Conduit. Machine learning algorithm to Train

Commercialization

Alchemite Analytics platform for materials and chemicals with Intellegens

Machine learning tool embedded into next generation of Optibrium software

Cerella™ released in October 2020

intellegens

Page 47: The modern day blacksmith - University of Cambridgegjc29/talks/TCMCurrentResearch... · 2021. 1. 10. · The modern day blacksmith Gareth Conduit. Machine learning algorithm to Train

Summary

Merge different experimental quantities and computer simulations into a

holistic design tool

Designed and experimentally verified alloy for direct laser deposition

Designed experimentally verified drug in Open Source Malaria competition

Taken to market through startup Intellegens