1icalepcs, october 15-19, 2007, knoxville, tennessee association euratom-cea ph. moreau association...

TORE SUPRATORE SUPRA

Ph. Moreau 1ICALEPCS, October 15-19, 2007, Knoxville, Tennessee

AssociationEuratom-Cea

Association EURATOM-CEADépartement de Recherches sur la Fusion Contrôlée

CEA-Cadarache F-13108 Saint Paul-lez-Durance, FRANCE

IMPROVEMENT OF TORE SUPRA REAL TIME PROCESSING CAPABILITY USING REMOTE PCsIMPROVEMENT OF TORE SUPRA REAL TIME

PROCESSING CAPABILITY USING REMOTE PCs

October 15-19, 2007Knoxville, TN

Ph. Moreau, B. Guillerminet, F. Leroux, D. Molina, N. Ravenel

E-mail: [email protected]



AssociationEuratom-Cea Outline

The Tore Supra tokamak

The Tore Supra Data Acquisition System

Data Acquisition System requirements

New architecture using remote PCs

Conclusion and future work



AssociationEuratom-Cea The Tore Supra Tokamak

Tore Supra is one of the largest superconducting tokamak (1st plasma 1988)

Devoted to long duration, high performance plasma discharge researches

R = 2.42m, a = 0.72m, Ip= 1.5MA, Btor = 4.5T 50 diag. and sub-systems synchronized and operated at the same time RT acquisition and control is essential




Tore Supra Data Acquisition Time Scales

A day of experiments at Tore Supra = Tokamak commissioning, plasma discharges, decommissioning

Continuous acquisitions 24h a day (t ~ 1s)

Plant monitoring ( PLC)

Standard acquisitions (t ~ 1ms)during the entire plasmadischarge. Global analysis ofthe physic of the discharge

Fast acquisitions (t ~ 1µs or less) triggered by plasma events

Essential for studying fast events(plasma deep understanding)

Su

pe

rco

nd

uct

ing

coil

cu

rren

t (k

A)

Pla

sma

curr

ent

(MA

)

Su

pe

rcon

du

cting

coil T

em

p (°C

)

0 5 10 15 200.0

0.4

0.8

1.2

Time (hours)1.6

1.7

1.8

0 1 2 3 540

2

4

6

2 * plasma current (MA)

Plasma density (*10+19 m-3)

Plasma central temperature (keV)

December 4th,2003

Time (min)

-6

-3

0

3

6

372.24 372.28Time (s)

372.20

Magnetic perturbation

Trigger

372.2 372.3 372.4

1

2

3

0Time (s)

Physical analysis

Fre

q (

kHz)

4




Tore Supra DataAcquisition System

Ethernet Gigabit

Timing system

Eth

ern

et10

MB

/s

Eth

ern

et10

MB

/s

Eth

ern

et10

MB

/s

PCs Acquisition(12 units)

Real Time shared memorynetwork (20 nodes)

Interlock syst(based on PLC)

Mutlibus Acquisition (9 units)

VME Acquisition(27 units)

Servers

Dat

a

Database

Dev

elop

.

Rea

l Tim

e

Pro

cess

ing

PCdispatch

Display

Terminals

Compiler

Server

Compiler

Server




Evolution of RequirementsOver the Years

29.95

3.103.12

47.11

7.74

5.60

56.73

7.86

42.43

88.78

11.69

38.65

143.54

13.90

54.31

161.99

13.02

28.46

145.76

18.04

38.90

0

50

100

150

200

250A

mo

un

t o

f d

ata

(Mo

) p

er s

ho

t

2001

2002

2003

2004

2005

2006

2007 Year

Continuous

Post processing

Raw (standard+fast)

1045 shots(*)

Gran total206.9 GB

(*) Until June

2822 shotsGran total560.7 GB






Average row data volume increased by a factor 5 (#channels increases, fastacquisition increases) diag. cannot any more handle data flux

Total amount of data per year increased by a factor 17




Tore Supra Requirements of Fast Data Acquisition

TS

#36933

Example: injection of frozen Deuterium pellets

0 5 100

2

4

6

8

15 Time (s)

Density (*10+19 m-3)

Fast acquisitione- temperature (keV)

Triggers

TS

#37151

10.40 10.44 10.48 10.522.2

2.6

3.0

Time (s)

10’000 points32 channels

Fast acquisitione- temperature (keV)

Delay between triggers

Example: injection of frozen Deuterium pellets

To be considered:

Flow rate (sampling frequency and # channels) Duration of the fast acquisition

Minimum delay between 2 triggers (ttrig)




Flow Rate Requirements for Fast Acquisition

Five diagnostics are on concern by the modifications Specifications depend on diagnostic

Magnetics

ECE

MSE

Reflec. fluctuation

Example of data flow rate variation during a plasma discharge

Reflec. doppler

Data flow rate Acquisitionduration

Delay betweentriggers

6.0 MB/s 0.500 s < 0.5 s

7.0 MB/s 0.500 s < 0.5 s

8.0 MB/s 1.000 s ~ 5 s

4.0 MB/s 1.000 s ~ 1 s

18.0 MB/s 0.200 s < 0.5 s

MAGECEMSEIp (100kA)

0

2

4

6

8

0 5 10 15 20 Time (s)

Dat

a F

low

rat

e (M

B/s

)




Limitations of VMEAcquisition Units

RTserver

Data server + database

Acquisition param(given by user)

Diagnostic(analog data)

ADC Storageboard

Flip flopbuffer

VME bus(1MB/s)

(no DMA)

CPU #2

RTprocessing

Timingboard

Events

CPU #1VME busData extractionData validationStrategy applicationFrame processingPublishing

Frame Buffer

VME crate

Switch

Ethernet 750kB/s

Ethernet Gigabit 70MB/s

(2MB/s)(no DMA)

CPU#2 runs one single task dedicated to RT processing CPU#1 runs several tasks in parallel

Other diagnostics




Limitations of VMEAcquisition Units

1

2

3

4

5

6

7

8

Dat

a F

low

rat

e (M

B/s

)

0

Dia

gn

ost

ic

AD

CB

uff

er

CPU#1 (Power PC166 – 300MHz)

Buffer

Sw

itch

RT

ser

ver

Sto

rag

e

In-Flux8 MB/s

VME bus2 MB/s

(no DMA)

Fra

me

pro

ces

sin

g52

5 k

B/s

Ethernet750 kB/s

Gigabit70 MB/s

Main limitations: ADC buffer size = 2MB Full for fast acquisition longer than 333ms

speed up the VME bus transfer

Acquisition = 125ms 1MB 3.7s to leave the VME crate 30 times longer!

speed up the frame processing and Ethernet connection

Signalpath




Upgrade of VME Capability: Remote PCs

Diagnostic(analog data)

ADC Storageboard

Flip flopbuffer

VME bus(1MB/s)

(no DMA)

CPU #2

RTprocessing

Timingboard

Events

CPU #1VME bus

Frame Buffer

VME crate

Switch

Ethernet 750kB/s

Ethernet Gigabit 70MB/s

Data extractionData validationStrategy applicationFrame processingPublishing

(2MB/s)(no DMA)

DMA transfer implemented in acquisition board driver

(20MB/s)(Driver

modified DMA)

Data extractionData validation

Fast Ethernet 7.0MB/s

Data

RTserver

Data server + Database

Acquisition param(given by user)

Strategy applicationFrame processingPublishing

Remote PCCPU - 3GHz

Linux OS

Monitoring

Other diagnostics

Software in CPU#1 split in independent parts (can be run on different computers)

Network bandwidth between VME crate and switch increased (Fast Ethernet)




Upgrade of VME Capability: Remote PCs

Dia

gn

ost

ic

AD

CB

uff

er

RT

ser

ver

Sto

rag

e

Signalpath

Sw

itch Remote PC

(Intel P-IV 2.8GHzLinux OS)

10

20

30

40

50

60

70D

ata

Flo

w r

ate

(MB

/s)

0

Gigabit70 MB/s

In-Flux8 MB/s

VME bus20 MB/s(DMA)

Dat

a tr

ansf

er60

MB

/s

FastEthernet7 MB/s

Fra

me

Pro

ces

sin

g60

MB

/s

Gigabit70 MB/s

Improvement of performance by a factor ~10 Minor modification of the hardware (cost, human resources) Remote PC is an evolving system vs the VME at Tore Supra A PC is able to deal with 3 VME frame processing tasks Last limit is the Fast Ethernet connection (modification requires new VME CPU major modifications)

CPU#1 (Power PC166 – 300MHz)

Buffer



AssociationEuratom-Cea The Monitoring Interface

Remote PC

# Frameswaiting

# Framessent to

RT server

VME crate

Boardnumber

# packetsreceived byremote PC

# packetssent to

remote PC

# packetwaiting

Java based application for monitoring fast acquisition processes Indicates the status of VME crate processes and remote PC frame builder



AssociationEuratom-Cea Conclusion

Remote PCs = solution to the requirement of fast acquisition atTore Supra while the hardware remains the same.

At present applied routinely on 2 diagnostics (tests on a 3rd one)

Performance increased by a factor 10

A remote PC is able to accommodate 3 diag. using fast acquisition

Monitoring tool for data processing all along its path have been developed

Future developments:Future developments: Integrate advanced RT processing from fast acquisition Integrate advanced RT processing from fast acquisition

Refine analysis of the plasma Refine analysis of the plasma more accurate control more accurate control

Possibility to be more efficient in plasma recovery strategies Possibility to be more efficient in plasma recovery strategies (See poster F. Saint-Laurent)(See poster F. Saint-Laurent)

0.0 0.5 1.0 1.5

5

10

15

20

Acquisition duration (s)0

Dia

gn

ost

ic d

ata

flo

w (

MB

/s)

Acquisition parameters for tTrig 1s

With remote PC

Without remote PC




Thank you for your attention !



AssociationEuratom-Cea Conclusion

Magnetics

ECE

MSE

Reflec. fluctuation

Reflec. doppler

Data flow rate Acquisitionduration

Delay betweentriggers

6.0 MB/s 0.500 s < 0.5 s

7.0 MB/s 0.500 s < 0.5 s

6.0 MB/s 1.000 s ~ 5 s

4.0 MB/s 1.000 s ~ 1 s

18.0 MB/s 0.200 s < 0.5 s

Remote PCs = solution to the requirement of fast acquisition atTore Supra while the hardware remains the same

At present applied routinely on 2 diagnostics (tests on a 3rd one)

A remote PC is able to accommodate 3 diag. using fast acquisition

Monitoring tool for data processing all along its path have been developed

Future developments:Future developments: Integrate advanced RT processing from fast acquisition Integrate advanced RT processing from fast acquisition

Refine analysis of the plasma Refine analysis of the plasma more accurate control more accurate control

Possibility to be more efficient in plasma recovery strategies Possibility to be more efficient in plasma recovery strategies (See poster F. Saint-Laurent)(See poster F. Saint-Laurent)

New DAS




Many diagnostics andsub-systems




0.0 0.5 1.0 1.5

5

10

15

20

Acquisition duration (s)

0

Dia

gn

ost

ic d

ata

flo

w (

MB

/s)

1icalepcs, october 15-19, 2007, knoxville, tennessee association euratom-cea ph. moreau association...

Documents