extending the capability of toughreact simulator using parallel computing
DESCRIPTION
Extending the capability of TOUGHREACT simulator using parallel computing. Application to environmental problems. What is TOUGHREACT ?. Coupled Process in porous media simulator, developed in Lawrence Berkley Lab. . Multi-phase flow + Solute transport + Geochemical reaction. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Extending the capability of TOUGHREACT simulator using parallel computing](https://reader036.vdocuments.us/reader036/viewer/2022081604/568161cc550346895dd1b5d7/html5/thumbnails/1.jpg)
Extending the capability of TOUGHREACT simulator using parallel computing
Application to environmental problems
![Page 2: Extending the capability of TOUGHREACT simulator using parallel computing](https://reader036.vdocuments.us/reader036/viewer/2022081604/568161cc550346895dd1b5d7/html5/thumbnails/2.jpg)
What is TOUGHREACT ?
Multi-phase flow+
Solute transport
+Geochemical reaction
Coupled Process in porous media simulator, developed in Lawrence Berkley Lab.
![Page 3: Extending the capability of TOUGHREACT simulator using parallel computing](https://reader036.vdocuments.us/reader036/viewer/2022081604/568161cc550346895dd1b5d7/html5/thumbnails/3.jpg)
Motivation of the workLab code constraints: • Developed for testing the model
• Running on workstation or laptop
• Numerical model can not scaling ( 8000 discrete grids limited)
Engineering requirements:• Carrying the simulation of site-scale model involved complex
processes
• Improve the speed in numerical solving .
![Page 4: Extending the capability of TOUGHREACT simulator using parallel computing](https://reader036.vdocuments.us/reader036/viewer/2022081604/568161cc550346895dd1b5d7/html5/thumbnails/4.jpg)
Method
• Redevelop the software package using parallel computing schema.
• Domain Decomposition.
• Communication between divided subdomains(MPI)
![Page 5: Extending the capability of TOUGHREACT simulator using parallel computing](https://reader036.vdocuments.us/reader036/viewer/2022081604/568161cc550346895dd1b5d7/html5/thumbnails/5.jpg)
ELEMEA11 1 10.2000E+000.4000E+00 0.1000E+000.5000E+00-.5000E+00A11 2 10.2000E+000.4000E+00 0.3000E+000.5000E+00-.5000E+00A11 3 10.2000E+000.4000E+00 0.5000E+000.5000E+00-.5000E+00A11 4 10.2000E+000.4000E+00 0.7000E+000.5000E+00-.5000E+00CONNEA11 1A11 2 10.1000E+000.1000E+000.1000E+01A11 2A11 3 10.1000E+000.1000E+000.1000E+01A11 3A11 4 10.1000E+000.1000E+000.1000E+01
Multi-level Graph Partition:Metis
Domain Partition
![Page 6: Extending the capability of TOUGHREACT simulator using parallel computing](https://reader036.vdocuments.us/reader036/viewer/2022081604/568161cc550346895dd1b5d7/html5/thumbnails/6.jpg)
Parallel Linear Solver
, 1
, 1, 1 , ,
kkn
p i p i p i pi i
Rx x R x
x
Large Sparse Linear System iterative solvingAztec
![Page 7: Extending the capability of TOUGHREACT simulator using parallel computing](https://reader036.vdocuments.us/reader036/viewer/2022081604/568161cc550346895dd1b5d7/html5/thumbnails/7.jpg)
Module organizationPublic Module
Domain Decomposition
Parallel Matrices Assemble
IO
Parallel Linear solving
Subdomain Communication
Transport GeochemicalFlow
Simulation procedure
EOS-MODULE
Index Transform-
ation
StateUpdate
![Page 8: Extending the capability of TOUGHREACT simulator using parallel computing](https://reader036.vdocuments.us/reader036/viewer/2022081604/568161cc550346895dd1b5d7/html5/thumbnails/8.jpg)
Application: Carbon dioxide sequestration
![Page 9: Extending the capability of TOUGHREACT simulator using parallel computing](https://reader036.vdocuments.us/reader036/viewer/2022081604/568161cc550346895dd1b5d7/html5/thumbnails/9.jpg)
![Page 10: Extending the capability of TOUGHREACT simulator using parallel computing](https://reader036.vdocuments.us/reader036/viewer/2022081604/568161cc550346895dd1b5d7/html5/thumbnails/10.jpg)
Fine grid model:
Total : 37824 grids
![Page 11: Extending the capability of TOUGHREACT simulator using parallel computing](https://reader036.vdocuments.us/reader036/viewer/2022081604/568161cc550346895dd1b5d7/html5/thumbnails/11.jpg)
Mid-term behavior prediction
Serial computing
Parallel Computing
![Page 12: Extending the capability of TOUGHREACT simulator using parallel computing](https://reader036.vdocuments.us/reader036/viewer/2022081604/568161cc550346895dd1b5d7/html5/thumbnails/12.jpg)
Runtime Statistics
Nagaoka Sample Speed UpGrids : 37824 Connection : 102828
Number of Processes
0 20 40 60 80 100 120 140
Speed U
p
0
20
40
60
80
100
120
140
Speed UpIdeal Speed Up
Total Execuation Time for Nagaoka SampleGrids: 37824 Connections: 102828
Number of Processes
0 20 40 60 80 100 120 140
Time (Seconds)
0
1000
2000
3000
4000
5000
6000
7000
Time
![Page 13: Extending the capability of TOUGHREACT simulator using parallel computing](https://reader036.vdocuments.us/reader036/viewer/2022081604/568161cc550346895dd1b5d7/html5/thumbnails/13.jpg)
What we’ve gained from work
• A new software package running on parallel computing facility ( Cluster …)
• Speed up ( 20 X – 40 X in test case )
• Simulation model scaling up ( 100,000 grids have been tested)
![Page 14: Extending the capability of TOUGHREACT simulator using parallel computing](https://reader036.vdocuments.us/reader036/viewer/2022081604/568161cc550346895dd1b5d7/html5/thumbnails/14.jpg)
Thanks for your attention !