04/20/23DBB 1
Integrated Modeling of Wave-Plasma Interactions and Wave Interactions with MHD
• Program and recent results from Center for Simulation of Wave-Plasma Interactions – CSWPI
• Focused Integration Initiatives – toward a comprehensive Fusion Simulation Project
• Program and computational architecture of center for Simulation of Wave Interactions with MHD – SWIM
D. B. Batchelor
Oak Ridge National Laboratory
Workshop on ITER Simulation Beijing
May 15-19, 2006
04/20/23DBB 2
04/20/23DBB 3
A complete simulation of RF/plasma effects requires coupling of several elements, previously studied more or less independently
The focus of our SciDAC project is to integrate these elements to treat the full, nonlinear interactions between them. However, for this talk, we concentrate only on the wave solution and response of the distribution function (blue box).
Antenna model3D launch structurePlasma impedance(RANT3D,TOPICA)
Antenna-edge interactions (sheath models)
Plasma responseFokker-Planck solver(CQL3D, ORBIT-RF)
Wave solversPropagation and heating(PICES, TORIC, AORSA)
Plasma dynamicsTransport, stability, turbulence
( )uxf s ,0
antJ RFP
( ) RFRFs JPuxf ,,,0
( ) ( ) ( ) ( )xBxjxnxT jj ,,,
( )uxf s ,0
04/20/23DBB 4
Objectives of CSWPI: understand heating to ignition, plasma control through localized heat, current and flow drive, < 10-7 sec
J P x,t( ) =e d3vvf1 x,v,t( ) f1 x,v,t( ) =−em
d ′ t E1 ′ x x,v, ′ t ( ), ′ t ( )⋅∂f0∂ ′ v −∞
t
∫∫ ∇ ×∇ ×E +
ω2
c2 E =J P oE +J ant : +boundary conditions
plasma wave current: an integral operator on E
Plasma response is highly non-local solve integral equation, large dense linear system
Quasi-linear – time average distribution function f0 evolves slowly, described by time averaged Boltzmann equation
∂ f0
∂t+ v||b + vd( ) ⋅∇f0 = C f0( ) + Q f0 ,E1( ) + S
flow along field linesradial transport collisional relaxation
quasi-linear RF
particle sources
04/20/23DBB 5
We are advancing two main wave solver codes within our project
• All Orders Spectral Algorithm (AORSA) – 1D, 2D & 3D (Jaeger)
– Spectral in all 3 dimensions– Cartesian/toroidal coordinates
– Includes all cyclotron harmonics– No approximation of small particle gyro radius
compared to wavelength – Produces huge, dense, non-symmetric, indefinite,
complex matrices
• TORIC – 2D (Brambilla/Bonoli/Wright)– Mixed spectral (toroidal, poloidal), finite element
(radial)– Flux coordinates
– Up 2nd cyclotron harmonic– Expanded to 2nd order in – Sparse banded matrices
€
E(x) = En,m ,lei(nx +my+lφ )
n,m,l
∑ , σ →σ (x,y,φ),
€
E(ρ,θ,φ) = Em ,l (ρ)e i(mθ +lφ )∑ , σ →σ (ρ,θ)
Blowup region
Slow ion cyclotron wave
Electrostatic ion Bernstein wave
€
(x, y,φ)
€
(ρ,θ,φ)
04/20/23DBB 6
Details of electromagnetic field structure are compared using two very different codes – TORIC and AORSA2D
TORIC at 240Nr x 255 N
m AORSA at 230N
x x 230 N
y
• Both codes are using the same equilibrium from an Alcator C-Mod discharge with mixture of D-3He-H in (21%-23%-33%) of n
e proportion.
• The previous state of the art was qualitative comparison of integrated quantities such as power deposition profiles
ICW
IBW
FW
04/20/23DBB 7
Calculation of wave fields self-consistently with the plasma distribution requires closed loop coupling of four significant physics models
• High power waves can drive the distribution far from Maxwellian• Significant non-Maxwellian components can be produced by neutral injection or fusion
alpha particlesNon-Maxwellian distributions can:• Affect local damping rate and wavelength• Modify heating and current drive profiles• Change partition of power deposition among plasma species• Affect mode-conversion
CQL3DFokker Planck solver
METSnon-Maxwellian
AORSA2Dwave solver
f0(v||, v, p = 0)
€
t (ψ ,θ p,
r k , f0)
€
E(kx,ky,nφ ) ⇔ E(x,y,φ)
f0(v||, v, p)
Quasilinear operator
04/20/23DBB 8
A conductivity module allowing general plasma distributions has been developed – all orders, all cyclotron harmonics, shared by all wave solvers
where
s =ε s
−iωε 0
= 2πω p
2
ω 2
du||
1− n||u||
μ− lΩ
ω
du⊥U( f ) Sl + e||e|| du|| du⊥u|| u⊥
∂f
∂u||
− u||
∂f
∂u⊥
⎛
⎝⎜⎞
⎠⎟∫∫∫∫l =−∞
∞
∑⎡
⎣⎢⎢
⎤
⎦⎥⎥
⎟⎟⎠
⎞⎜⎜⎝
⎛
∂∂
−∂∂
−∂∂
= ⊥⊥⊥ ||
||||
u
fu
u
fu
n
u
fU
μ
( ) ( ) ( ) ( ) ( )
( ) ( ) ( ) ( ) ( )
( ) ( ) ( ) ( ) ( ) ⎟⎟⎟⎟⎟⎟⎟
⎠
⎞
⎜⎜⎜⎜⎜⎜⎜
⎝
⎛
=
⊥⊥⊥−⊥⊥⊥+⊥
⊥⊥−⊥⊥−⊥⊥−⊥+⊥
⊥⊥+⊥⊥−⊥+⊥⊥+⊥
kJukJkJuukJkJuu
kJkJuukJukJkJu
kJkJuukJkJukJu
lllll
lllll
lllll
l
22||1||1||
1||2
12
112
1||1122
12
2
1
2
12
1
2
1
2
12
1
2
1
2
1
S
For Maxwellians, these 2D velocity space integrals can be expressed analytically in terms of Bessel functions and plasma dispersion function Z. For non-Maxwellians, they must be calculated for every mode in the wave spectrum at each point in space (1010) – R. Dumont, C. Phillips, D. Smithe
Collaboration with Math/CS – accelerated so that evaluation of non-Maxwellian takes only about 4 times as long as evaluation of analytic Bessel/Z functions for Maxwellian
04/20/23DBB 9
Power absorption PRF for non-Maxwellian plasmas
The local power absorption can be expressed as:(McVey, Sund, and Scharer, 1985; M.Brambilla,1988; D. Smithe 1989)
( )
⎭⎬⎫
⎩⎨⎧
⋅⋅= ∑ ⋅−
21
12
210Re2
1
kkk
*k
rkkEWE
,l
i
RF ei
Pωε
( ) ( ) ( )∑ ∫∫∞
∞=
∞
⊥
∞
∞−Ω
− ⋅⎥⎥
⎦
⎤
⎢⎢
⎣
⎡′
−−⋅=
-
SWl
lun-ilp
l fUdudu
e 1CC1 ββω
ωπ
ωμ
ββ
0
||2
12
2
)(1
2||||
2
where Wl is the local energy absorption kernel,
The sums over k1 and k2 can be very costly to evaluate in 2D (4 nested loops) and 3D (six nested loops) with 2D velocity space integrals inside.
Calculation of quasilinear operator is similar
Physics analysis + Code restructuring in collaboration with Math/CS resulted in factor of 100 speedup
04/20/23DBB 10
CQL3D: Bounce-averaged Fokker-Planck Code
Solves for bounce-averaged distribution at torus equatorial plane (P = 0), f0(, v||, v, t)
generalized radial coordinate labeling (non-circular) flux surface
= field line connection length
E = velocity space flux due to toroidal electric field (Ohmic)
RF = = velocity space flux due to full, bounce average, RF Quasi-linear operator (all harmonics, Bessel functions, all wave modes)
coll = full, nonlinear, 2D, relativistic collisional operator
R(f) = Radial diffusion and pinch operator with v dependent coefficients
SNB = Monte Carlo neutral beam source (NFREYA)
L(v) = velocity dependent prompt loss term
€
∂(λ f )
∂t=
∂
∂v⋅ ΓE + ΓRF + Γcoll[ ] + R( f ) + SNB + L
€
tD QL ⋅
∂f
∂v
04/20/23DBB 11
Iteration of AORSA2d and CQL3D for C-mod minority H case [128x128 grid, 256 processors for 3 hrs on Cray XT3 – ORNL]
P(H) = 0.459 MW = 76 %
P(H) = 0.499 MW = 83%
P(H) = 0.518 MW = 86%
P(H) = 0.526 MW = 87%
P(H) = 0.522 MW = 87%
Power absorbed
r
H
D
Power absorbed
r
Power absorbed
r
Power absorbed
r
Power absorbed
r
3 keVr/a = 0.46
u / u_norm
at const. pitch angle
87 keV
u / u_norm
at const. pitch angle
52 keV
u / u_norm
at const. pitch angle
72 keV
u / u_norm
at const. pitch angle
72 keV
u / u_norm
at const. pitch angle
H
D
H
D
H
D
H
D
u_parallel
(r/a = 0.46)
u_parallel
(r/a = 0.46)
u_parallel
(r/a = 0.46)
u_parallel
(r/a = 0.46)
u_parallel
(r/a = 0.46)
(a)
(b)
04/20/23DBB 12
Energetic ion tails measured during ICRH in Alcator C-Mod
•Diagnostic used is a compact neutral particle analyzer (CNPA)
•The spectra from 75keV-~175keV is dominated by fast ion CX w/ DNB Hydrogen. The spectra from ~250-400keV is dominated by Boron CX.
•Using a weighted Maxwellian fit, we get Tion~70keV from our simple model. This corresponds to a RF power of ~5W/cc.
H+ ~0.1% B
Courtesy of Vincent Tang, MIT (APS, 2005)
04/20/23DBB 13
Bounce averaged distribution function for H minority fast wave heating on Alcator C-Mod
• AORSA2D and CQL3D iterated to convergence
• Tail ‘temperature” peaks at ~ 72 keV near r/a = 0.46
• Experimental fit gave ~ 70keV, but may not be comparable because of volume and pitch-angle weighting
04/20/23DBB 14
At 116 MHz, about 95% of the power is absorbed by the deuterium beam in ICRH – NBI on DIII-D
This is in disagreement with the experiment which shows little power absorbed at the 8th harmonic. One possible explanation is that radial diffusion and finite orbit effects are becoming important at the higher frequency
DIII-D shot 122080 (B. Pinsker) at f = 116 MHz (8th harmonic D; non-Maxwellian) and 2% minority H (4th harmonic H, Maxwellian)
8th iterationPRF = 1.6 MW
P(D) = .55 MW = 34.5 %
P(D) = 1.54MW = 96.2 %
P(D) = 1.47 MW = 92.3 %
P(D) = 1.50 MW = 94.6 %
0th iteration PRF = 0
7th iterationPRF = 1.6 MW
1st iterationPRF = 1.6 MW
ee e e
CQL3D: Neutral beam D
8Ω(D) 8Ω(D) 8Ω(D) 8Ω(D)
4Ω(H)
04/20/23DBB 15
ORBIT-RF solves Hamiltonian guiding center drift orbit equations Interaction of resonant ion with wave is modeled as stochastic RF resonant kicks
Monte-Carlo Orbit Solver (ORBIT-RF) and Full Wave Solver (TORIC4)
Allows treatment of finite orbit width effects and radial transport of energetic particles. Stay tuned for next talk by Vincent Chan
l
lill
i
ll
i
ilrf w
KJ
E
Ee
JJ
E
EeJJ
E
EekJE
Bm
lqkkk
& 2)( 121
12
1
2
12
1
2
2
222
⎥⎥⎦
⎤
⎢⎢⎣
⎡
⎭⎬⎫
⎩⎨⎧
⎟⎟⎠
⎞⎜⎜⎝
⎛∂∂
+∂∂
⎟⎟⎠
⎞⎜⎜⎝
⎛+++
Ω=Δ +
+
−−+
+
−−+
+
−⊥−+ μμ
μω
πμ ϑϑϑ
2
)2
1(32 rfsrfrf R μμμ Δ−+Δ=Δ
⎢⎢⎣
⎡Δ
⎥⎥⎦
⎤
⎭⎬⎫
⎩⎨⎧
⎟⎟⎠
⎞⎜⎜⎝
⎛∂∂+
∂∂
⎟⎟⎠
⎞⎜⎜⎝
⎛++=Δ +
+
−−+
+
−−+
+
−− rf
ninn
i
nn
i
nrf
JEE
eJ
JEE
eJJEE
eJ kkk μμμ
μμ ϑϑϑ 1211
2
1
2
1
2
1
2
2 2
04/20/23DBB 16
Wave-Plasma interactions: Summary
• We have begun to explore full-wave phenomena in 2D and 3D with much improved resolution and physics– Mode conversion in 2D on ITER scale devices
– Fast wave heating in 3D
– Effects of non-Maxwellian distribution on waves
• We have achieved self consistent 2D wave solutions with distribution function solutions– Applications to DIII-D, Alcator C-Mod, ITER
• To make feasible the integration of advanced RF models with other disciplines, such as transport or stability, or to carry out extensive studies within RF, careful attention to code speedup and optimation– It’s amazing how much you can optimize
– Our partnership with Computer Science and Applied math has been essential
Support your local applied math and computer science departments
04/20/23DBB 17
The ISOFS subcommittee (2002) recommended that the US undertake a major initiative – Fusion Simulation Project (FSP)
“The purpose is to make a significant advance toward the ultimate objective of fusion simulation – to predict in detail the behavior of any discharge in a toroidal magnetic fusion device on all important time and space scales.”
04/20/23DBB 18
Basic description of plasma is 7D f(x, v, t), evolution determined by non-linear Boltzmann equation + Maxwell’s equations
• High dimensionality• Extreme range of time scales – wall equilibration/electron cyclotron O(1014)• Extreme range of spatial scales – machine radius/electron gyroradius O(104)• Extreme anisotropy – mean free path in magnetic field parallel/perp O(108)• Non-linearity• Sensitivity to geometric details
New physics will have to be incorporated over a long time scaleCannot predict progress in computer hardware, systems, or mathematical algorithm
Fundamental challenges of fusion simulation – can we design the ultimate fusion simulation code starting right now?
∂ f
∂t+ v ⋅∇f + q
m E + v × B[ ] ⋅∇v f = C( f ) + S( f )
convection in space
convection in velocity space
Collisional relaxation toward Maxwellian in velocity space
€
q(x) = d3vf (x,v)∫
€
J(x) = d3vvf (x,v)∫Self -consistent charge and current source densities for Maxwell’s eqs obtained from velocity moments
Particle sources
04/20/23DBB 19
FSP Approach – start simple, pair-wise physics couplings “Focused Integration Initiatives” (FIIs)
• Address one or a few of the fundamental issues for physics integration (wide range of time scales, range of space scales, extreme anisotropy, non-linearity, models of different dimensionality)
• Address problems of immediate programmatic importance
• Test different approaches to computational framework/code integration that might ultimately lead to a basis for complete simulation
Focused Integration Initiative center for Simulation of Wave Interactions with MHD (SWIM)
04/20/23DBB 20
SWIM brings together two mature sub-disciplines of fusion plasma physics, each with a demonstrated code base
Extended MHD – CEMM High power wave-plasma interactions – CSWPI
Why couple these particular two disciplines?
• Macroscopic instabilities can limit plasma performance
• RF waves can mitigate and control instabilities
04/20/23DBB 21
There are several experimentally demonstrated mechanisms by which RF waves can control sawtooth behavior
• Sawteeth can limit plasma performance themselves, or can trigger other instabilities – disruptions, neoclassical tearing modes
• Many physics processes interact – qualitative understanding exists but quantitative verification and prediction is lacking
QuickTime™ and aTIFF (LZW) decompressor
are needed to see this picture.
L.-G. Eriksson et al., PRL 92, 235004 (2004)• ICRF heating can produce “monster” sawteeth – period and amplitude increased
• Likely stabilization mechanism – energetic particle production by RF
• ICRF minority current drive can either increase or decrease period and amplitude
• Likely stabilization/destabilization mechanism – RF modification of current profile
ICRF stabilization on JETSawtooth control on JET with Minority Current Drive on JET
04/20/23DBB 22
It has been demonstrated experimentally that suppression of NTM by RF leads to improvement in confinement
• Empirical scaling of NTM pressure limits in ITER leave no margin in performance
• “Understanding the physics of neoclassical island modes and finding means for their avoidance or for limiting their impact on plasma performance are therefore important issues for reactor tokamks and ITER” – ITER Physics Basis (1999)
R. Prater APS 2003
• Electron cyclotron current drive drives down mode amplitude
• keeps mode rotating (no drop in frequency)
• improves energy confinement
04/20/23DBB 23
SWIM has two sets of physics goals distinguished by the time scale of unstable MHD motion
Fast MHD phenomena – separation of time scales
• Response of plasma to RF much slower than fast MHD motion
• RF drives slow plasma evolution, sets initial conditions for fast MHD event
• Example: sawtooth crash
Slow MHD phenomena – no separation of time scales
• RF affects dynamics of MHD events MHD modifications affect RF drive plasma evolution
• Deals with multi-scale issue of parallel kinetic closure including RF – a new, cutting edge field of research
• Example: Neoclassical Tearing Mode
We are approaching these regimes in two campaigns of architecture development and physics analysis and validation
MHD << HEATING
MHD ~ HEATING
time
time
Te0
Te0
04/20/23DBB 24
Simulation of plasma evolution requires complete model – Integrated Plasma Simulator (IPS)
• Heating and current drive sources
• Particle sources
• Transport
• Magnetic field evolution
MHD << HEATING
MHD ~ HEATING
time
time
Te0
Te0
Integrated Plasma Simulator will allow coupling of virtually any fusion fusion code, not just RF and MHD, and should provide the framework for a full fusion simulation
04/20/23DBB 25
IPS design – Component based architecture, Plasma State component plays a central role, components implemented using existing fusion codes
NUBEAMFRANTICTORICGENRAYAORSA
CQL3DNUBEAM
NCLASS TSCGCNM
TEQTSC
GLF23MMM95
DCONELITENOVA-KPEST-2BALLOON
M3DNIMROD
XPLASMA
04/20/23DBB 26
Overall Project Strategy
• Leverage previous investments to maximum possible extent – Fusion SciDAC projects, predictive TRANSP, NTTC– Computer Science – SciDAC ISICs, Fusion Grid, user interaction system from
LEAD weather prediction system, data management methods from Common Instrument Management Architecture CIMA, authentication technology from myProxy
• Component-oriented architecture (but not formal component system like CCA)
• Design for flexibility and extensibility by abstracting interfaces at a high level – include multiple codes in each component from the beginning
• Start with a strictly file-mediated exchange of data between application components– No changes needed to the application component code; SWIM overall interactions handled by
scripting – Allows isolating of any bugs or problems– Eliminates issues of re-entrancy and overall system state consistency
• Highest end computer systems handled from the start, not as an afterthought– Porting codes to Cray XT3 at ORNL
04/20/23DBB 27
SWIM sample execution model
Simulation Control File(s)Select specific component codes (e.g. TORIC vs AORSA)
Code-specific initialization data
Fusion machine specific data
Simulation control data:
Computer environment settings
Plasma initial conditions
Plasma source and control, time sequences (events)
Simulation ControllerComputer environment initialization
Initialize plasma state
Initialize component
Advance Sequence: [t t+Δt]
Step RF
Step Particle Source
Step Fokker Planck Solver
Solve j||(E)
Step Profiles
Step Magnetics & Equilibrium
Test linear stability
Apply Reduced MHD if unstable
Evaluate Simulation Control finalize, take another step, or adjust and restart current step
RF Component
RF_step:
Get_plasma_state
Convert plasma state to code-specific form and write code-specific initialization data
Launch Implementing code: (i.e. AORSA, TORIC, or GENRAY
Convert code specific output to plasma_state form
Save internal state of component
Write output to plasma_state
Typical component
04/20/23DBB 28
D. B. Batchelor (PI), L. A. Berry, S. P. Hirshman, W. A. Houlberg, E. F. Jaeger, R. Sanchez – ORNL Fusion Energy
D. E. Bernholdt, E. D’Azevedo, W. Elwasif, S. Klasky– ORNL Computer Science and Mathematics
S. C. Jardin, G-Y Fu, D. McCune, J. Chen, L. P Ku, M. Chance, J. Breslau – PPPL
R. Bramley – Indiana University, D. Keyes – Columbia University, D. P. Schissel – General Atomics,
R. W. Harvey – CompX, D. Schnack – SAIC, J. Ramos, P. T. Bonoli, J.C. Wright– MIT
Unfunded participants:
L. Sugiyama – MIT, C. C. Hegna – University of Wisconsin, H. Strauss – New York University, P. Collela – LBNL
H. St. John – General Atomics, G. Bateman, A. Kritz – Lehigh Univ.
Focused Integration Initiative – Center for Simulation of Wave Interactions with MHD (SWIM)
See our fun website at: www.cswim.org
04/20/23DBB 29
Summary
• Our objective is to develop the SWIM architecture such that that the community will adopt the backbone for computational fusion research
• The component-oriented architecture, with a flexible control level, will allow coupling of virtually any fusion code, not just RF and MHD, and should provide the framework for a full fusion simulation
• Addressing ultra-scale computing from the start
• Three physics goals– Unique Integrated Plasma Simulator for comprehensive long-time simulation of
tokamak discharges
– Sawtooth instability stabilization and destabilization
– Neoclassical tearing mode stabilization
04/20/23DBB 30
Backup slides
04/20/23DBB 31
Mode conversion of plasma wavesA beautiful story of science – theory simulation experiment
Ion Bernstein Wave (IBW) conversion in 1D
Plasma waves have an unpleasant habit of changing their character in the middle of a non-uniform plasma – mode conversion
ion cyclotronwave
i o n c y c l o t r o n
w a v e
B e r n s t e i n
w a v e
R e { k }
I m { k }
i o n c y c l o t r o n
r e s o n a n c e
i o n - i o n h y b r i d
r e s o n a n c e
kx
x, ∇ne, ∇B0
• On the right (low magnetic field) the fast wave has long wave length and the IBW has short, imaginary wavelength (evanescent)
• In the center (near the ion-ion hybrid resonance) the modes interact
• On the left (high magnetic field) the fast wave has long wave length, the IBW has short wavelength, which must be resolved, but is well separated from the fast wave.
n|| = S
Fast waveFast wave
04/20/23DBB 32
• This could be important – ICW much better at flow drive than fast wave or IBW.• Could this be used to control transport barriers? – using simulations to design
experiments to find out• Could this work on ITER? – higher resolution simulations may show
Surprise – fast waves can be converted to slow electromagnetic ion-cyclotron waves, as well as the expected Bernstein waves
IBW/ICW
Simulation with TORIC codeQuantitative explanation of PCI measurements on C-mod
04/20/23DBB 33
2D RF simulation gives complete, quantitative picture –understood by comparison with theory, compared in detail with experiment
• Approximate, 1D, analytic theory (F.W. Perkins, 1977)
– Provided valuable paradigms for mode conversion– Indicated several conversions were possible– Did not give quantitative information for real 2D situations
• High-resolution simulations across the full plasma cross section
– Includes arbitrary cyclotron harmonics– Very short wavelength structures – limited by computer
size and speed, not formulation