![Page 1: Learning PDE model reductions/ moment closures of ......Learning PDE model reductions/ moment closures of stochastic reaction-diffusion dynamics NIH 24 October 2019 Eric Mjolsness](https://reader036.vdocuments.us/reader036/viewer/2022062509/60f6b816eae60213786b47bf/html5/thumbnails/1.jpg)
Learning PDE model reductions/moment closures of stochastic
reaction-diffusion dynamics
NIH 24 October 2019
Eric Mjolsness
University of California, Irvine http://emj.ics.uci.edu
![Page 2: Learning PDE model reductions/ moment closures of ......Learning PDE model reductions/ moment closures of stochastic reaction-diffusion dynamics NIH 24 October 2019 Eric Mjolsness](https://reader036.vdocuments.us/reader036/viewer/2022062509/60f6b816eae60213786b47bf/html5/thumbnails/2.jpg)
UCI ICS CCM
Mapping: Model reduction
• Nonspatial: –Graph-Constrained Correlation Dynamics–warmup case for …
• Spatial generalization:–Dynamic Boltzmann distributions
Δt
Δt
ℛ
Ψℛ ≃ ℛΨ
[Johnson, Bartol, Sejnowski, and Mjolsness. Physical Biology 12:4, July 2015]
![Page 3: Learning PDE model reductions/ moment closures of ......Learning PDE model reductions/ moment closures of stochastic reaction-diffusion dynamics NIH 24 October 2019 Eric Mjolsness](https://reader036.vdocuments.us/reader036/viewer/2022062509/60f6b816eae60213786b47bf/html5/thumbnails/3.jpg)
UCI Morphodynamics
E.g.: Synapse CaMKII Signaling Modelinteracting particles with dynamical state information
�3
[Pepke et al., PLoS Comp Bio, 2010]
[Phys Bio 2015] [Johnson PhD thesis 2012]. Original model: [Pepke et al. 2010]
…
![Page 4: Learning PDE model reductions/ moment closures of ......Learning PDE model reductions/ moment closures of stochastic reaction-diffusion dynamics NIH 24 October 2019 Eric Mjolsness](https://reader036.vdocuments.us/reader036/viewer/2022062509/60f6b816eae60213786b47bf/html5/thumbnails/4.jpg)
• Target stoch. dynamics: Chemical master equation• i.e.
• Approximation: Boltzmann/MRF + parameter ODEs
• Error criterion: L1-regularized sum squared error
• Name: Graph-Constrained Correlation Dynamics• “Graph” = assumed MRF structure graph; “Correlations” =
UCI Morphodynamics
GCCD: Target and Approximate Stochastic Dynamics
[Physical Biology 2015]
![Page 5: Learning PDE model reductions/ moment closures of ......Learning PDE model reductions/ moment closures of stochastic reaction-diffusion dynamics NIH 24 October 2019 Eric Mjolsness](https://reader036.vdocuments.us/reader036/viewer/2022062509/60f6b816eae60213786b47bf/html5/thumbnails/5.jpg)
UCI ICS CCM
Mapping: Model reduction
• Nonspatial: –Graph-Constrained Correlation Dynamics–warmup case for …
• Spatial generalization:–Dynamic Boltzmann distributions
Δt
Δt
ℛ
Ψℛ ≃ ℛΨ
[Johnson, Bartol, Sejnowski, and Mjolsness. Physical Biology 12:4, July 2015]
![Page 6: Learning PDE model reductions/ moment closures of ......Learning PDE model reductions/ moment closures of stochastic reaction-diffusion dynamics NIH 24 October 2019 Eric Mjolsness](https://reader036.vdocuments.us/reader036/viewer/2022062509/60f6b816eae60213786b47bf/html5/thumbnails/6.jpg)
… Higher-order calculus!Slides: Oliver Ernst, Salk O. Ernst, T. Bartol, T. Sejnowksi, and E. Mjolsness , J of Chem Phys 149, 034107, July 2018. Also arXiv 1803.01063
·νk(x) = Fk[{νk}Kk=1]
![Page 7: Learning PDE model reductions/ moment closures of ......Learning PDE model reductions/ moment closures of stochastic reaction-diffusion dynamics NIH 24 October 2019 Eric Mjolsness](https://reader036.vdocuments.us/reader036/viewer/2022062509/60f6b816eae60213786b47bf/html5/thumbnails/7.jpg)
�7
O. Ernst, T. Bartol, T. Sejnowksi, and E. Mjolsness , J of Chem Phys 149, 034107, July 2018. Also arXiv 1803.01063
![Page 8: Learning PDE model reductions/ moment closures of ......Learning PDE model reductions/ moment closures of stochastic reaction-diffusion dynamics NIH 24 October 2019 Eric Mjolsness](https://reader036.vdocuments.us/reader036/viewer/2022062509/60f6b816eae60213786b47bf/html5/thumbnails/8.jpg)
�8
O. Ernst, T. Bartol, T. Sejnowksi, and E. Mjolsness , J of Chem Phys 149, 034107, July 2018. Also arXiv 1803.01063
ℛ
![Page 9: Learning PDE model reductions/ moment closures of ......Learning PDE model reductions/ moment closures of stochastic reaction-diffusion dynamics NIH 24 October 2019 Eric Mjolsness](https://reader036.vdocuments.us/reader036/viewer/2022062509/60f6b816eae60213786b47bf/html5/thumbnails/9.jpg)
Adjoint method BMLA-likelearning algorithm
�9[Ernst, Bartol, Sejnowski, Mjolsness, Phys Rev E 99 063315, 2019]
![Page 10: Learning PDE model reductions/ moment closures of ......Learning PDE model reductions/ moment closures of stochastic reaction-diffusion dynamics NIH 24 October 2019 Eric Mjolsness](https://reader036.vdocuments.us/reader036/viewer/2022062509/60f6b816eae60213786b47bf/html5/thumbnails/10.jpg)
�10
![Page 11: Learning PDE model reductions/ moment closures of ......Learning PDE model reductions/ moment closures of stochastic reaction-diffusion dynamics NIH 24 October 2019 Eric Mjolsness](https://reader036.vdocuments.us/reader036/viewer/2022062509/60f6b816eae60213786b47bf/html5/thumbnails/11.jpg)
Benefit of Hidden UnitsNetwork: fratricide + lattice diffusion
MSE of 4th order stats
ℛ
• Learned DBD ODE RHS, without and with hidden units
[Ernst, Bartol, Sejnowski, Mjolsness, Phys Rev E 99 063315, 2019]
![Page 12: Learning PDE model reductions/ moment closures of ......Learning PDE model reductions/ moment closures of stochastic reaction-diffusion dynamics NIH 24 October 2019 Eric Mjolsness](https://reader036.vdocuments.us/reader036/viewer/2022062509/60f6b816eae60213786b47bf/html5/thumbnails/12.jpg)
Rössler Oscillator in 3D• Learned DBD ODE RHS:• Function:
[Ernst, Bartol, Sejnowski, Mjolsness, Phys Rev E 99 063315, 2019]
![Page 13: Learning PDE model reductions/ moment closures of ......Learning PDE model reductions/ moment closures of stochastic reaction-diffusion dynamics NIH 24 October 2019 Eric Mjolsness](https://reader036.vdocuments.us/reader036/viewer/2022062509/60f6b816eae60213786b47bf/html5/thumbnails/13.jpg)
Rössler Oscillator in 3D• Learned Configuration• Learned correlations:
[Ernst, Bartol, Sejnowski, Mjolsness, Phys Rev E 99 063315, 2019]
![Page 14: Learning PDE model reductions/ moment closures of ......Learning PDE model reductions/ moment closures of stochastic reaction-diffusion dynamics NIH 24 October 2019 Eric Mjolsness](https://reader036.vdocuments.us/reader036/viewer/2022062509/60f6b816eae60213786b47bf/html5/thumbnails/14.jpg)
Fields to Structures
• Fields: PDE differential operator dynamics in W
• Dynamical Graph Grammars (DGGs):
• operator addition of reactions, GGs, ODEs;
• but what about PDEs?
• Approximately eliminate fields by:
• Cell complexes in PDE (adaptive) meshing / FEMs, FVMs
Ψ, ℐ
![Page 15: Learning PDE model reductions/ moment closures of ......Learning PDE model reductions/ moment closures of stochastic reaction-diffusion dynamics NIH 24 October 2019 Eric Mjolsness](https://reader036.vdocuments.us/reader036/viewer/2022062509/60f6b816eae60213786b47bf/html5/thumbnails/15.jpg)
MT fiber Stochastic Parametrized Graph Grammar
[EM, Bull. Math Biol. 81:8 Aug 2019+arXiv:1804.11044]
![Page 16: Learning PDE model reductions/ moment closures of ......Learning PDE model reductions/ moment closures of stochastic reaction-diffusion dynamics NIH 24 October 2019 Eric Mjolsness](https://reader036.vdocuments.us/reader036/viewer/2022062509/60f6b816eae60213786b47bf/html5/thumbnails/16.jpg)
[Chakrabortty et al.Current Biology
𝒳
[EM, Bull. Math Biol. 81:8 Aug 2019+arXiv:1804.11044]
MT fiber Stochastic Parametrized Graph Grammar
![Page 17: Learning PDE model reductions/ moment closures of ......Learning PDE model reductions/ moment closures of stochastic reaction-diffusion dynamics NIH 24 October 2019 Eric Mjolsness](https://reader036.vdocuments.us/reader036/viewer/2022062509/60f6b816eae60213786b47bf/html5/thumbnails/17.jpg)
Cajete MT: First Light
Eric Medwedeff, UCI
![Page 18: Learning PDE model reductions/ moment closures of ......Learning PDE model reductions/ moment closures of stochastic reaction-diffusion dynamics NIH 24 October 2019 Eric Mjolsness](https://reader036.vdocuments.us/reader036/viewer/2022062509/60f6b816eae60213786b47bf/html5/thumbnails/18.jpg)
• Baker Campbell Hausdorff theorem • => operator splitting algorithms e.g. Trotter Product Formula …
• Time-ordered product expansions => Stochastic Simulation Algorithm (SSA)– [EMj, Phys Bio 2013]
– weighted SSA (wSSA) possible too
Why operator algebra yields algorithms
ℐ
![Page 19: Learning PDE model reductions/ moment closures of ......Learning PDE model reductions/ moment closures of stochastic reaction-diffusion dynamics NIH 24 October 2019 Eric Mjolsness](https://reader036.vdocuments.us/reader036/viewer/2022062509/60f6b816eae60213786b47bf/html5/thumbnails/19.jpg)
Algebra of Labelled-Graph Rewrite Rules
[ EM, http://arxiv.org/abs/1909.04118]
Ψ
E.g.:
![Page 20: Learning PDE model reductions/ moment closures of ......Learning PDE model reductions/ moment closures of stochastic reaction-diffusion dynamics NIH 24 October 2019 Eric Mjolsness](https://reader036.vdocuments.us/reader036/viewer/2022062509/60f6b816eae60213786b47bf/html5/thumbnails/20.jpg)
Science
Modeling
Mathematics
Computing
!
Analytical Predictions
Numerical Predictions
Dynamics …Analysis …GeometryTopologyLogic…
Biologymolecular
cellulardevelopmentalneuro…
Chemistry …Physics
biophysicsbiomechanics
…
Algorithmsnumerical algos optimization …
Software systemsComputer architecture…
Science
Modeling
Mathematics
Computing
Hierarchy labels Composition Constituent Scale-change Boundary Reduction … Specialization Mutually exclusive Overlapping ….
Processes Objects
Expressions
⋉⊠
“Tchicoma” Architecturefor Mathematical Modeling
• Language meta-hierarchy: (a DAG with edge labels in a tree)
• Mappings therein:
Features: Enables problem-solving
via chaining, theorem-proving Foments abstraction
via commutation Decoupled, yet can be efficient
respecting compositional structure
𝒳,
[EM, Bull. Math Biol. 81:8 Aug 2019+arXiv:1804.11044]
![Page 21: Learning PDE model reductions/ moment closures of ......Learning PDE model reductions/ moment closures of stochastic reaction-diffusion dynamics NIH 24 October 2019 Eric Mjolsness](https://reader036.vdocuments.us/reader036/viewer/2022062509/60f6b816eae60213786b47bf/html5/thumbnails/21.jpg)
Conclusions• Model reduction can be achieved by machine learning, in spatial
stochastic models. Reaction/diffusion examples.• Declarative modeling languages with operator algebra semantics can
support generic model reduction.• Morpho-dynamic spatial structures can be modeled by dynamical graph
grammars with operator semantics. Bio-universal; scalability is in progress. MT examples.
• Model stacks are the key data structure for understanding complex bio systems. • They require model reduction and bio-universal modeling languages (perhaps as above). • They can intersect productively, and could be curated in a proposed conceptual
architecture “Tchicoma”.• “Intelligent Formal Methods for Stacks of Models - InformCosm”
• In these ways, both symbolic and numeric AI can (and should!) be brought to bear on understanding complex biological systems.
![Page 22: Learning PDE model reductions/ moment closures of ......Learning PDE model reductions/ moment closures of stochastic reaction-diffusion dynamics NIH 24 October 2019 Eric Mjolsness](https://reader036.vdocuments.us/reader036/viewer/2022062509/60f6b816eae60213786b47bf/html5/thumbnails/22.jpg)