ODR StatusODR Status

29 July 200829 July 2008

Matt WarrenMatt WarrenValeria Bartsch, Barry Green, Andrzej Miesijuk, Tao Valeria Bartsch, Barry Green, Andrzej Miesijuk, Tao

WuWu

29 Jul 08 Matt Warren & Co. - ODR Starus 2

• ODR is working(!)ODR is working(!)–Receive data on 4x fibre (RX), Receive data on 4x fibre (RX), –Write to disk FAST (250MB)Write to disk FAST (250MB)–Send data up fibre (TX)Send data up fibre (TX)–Controlled from Linux driverControlled from Linux driver

• Future upgrade: Future upgrade: Decode event header from LDADecode event header from LDA–Provides on-line infoProvides on-line info–Can deal with control messages from LDACan deal with control messages from LDA–Allows host to write to disk without processingAllows host to write to disk without processing

Hardware/FirmwareHardware/Firmware

29 Jul 08 Matt Warren & Co. - ODR Starus 3

Software StatusSoftware Status

Progress in the following areas:

• Data transferred from ODR memory -> host memory->to disk (rate 250 MB/s for event fragment 2 kB • Tested sending messages (Tx message to LDA) • Interface to DOOCS and processing messages: DOOCS->ODR receiver ->ODR, ODR receiver-> DOOCS: a) Setting up parameters: ODR Receiver and ODR card b) Passing ODR statistics back to DOOCS c) Passing commands to ODR receiver (start, stop,pause, etc)

ODR receiver: program running on a host machine. Communicate with ODR cards,retrieves the data, sets up ODR card parameters.

29 Jul 08 Matt Warren & Co. - ODR Starus 4

Performance (data to Performance (data to memory)memory)

Simultanious access

0

200

400

600

800

0 1000 2000 3000 4000

Data size [bytes]

Tra

nsf

er r

ate

[MB

/s]

Ch 0

Ch 0&1

Ch 0&1&2

Ch 0&1&2&3

Improvements in performance when accessing more then one channel.The maximum performance achieved for 3-channels access. Adding additionalChannel (4-channel access) does not yield improvement in transfer rate.

29 Jul 08 Matt Warren & Co. - ODR Starus 5

PerformancePerformance

Single channel. Data written to RAID array. Maximum bandwidth for the array: 300 MB/s.Adding active channel has no effect on the rate (remain constant).Best performance for scatter-gather scenario.

0

50

100

150

200

250

300

350

400

0 1000 2000 3000 4000

Data size [bytes]

Ra

te [

MB

/s]

data2mem

data2disk scat-gath

data2disk buf150

data2disk buf130

Top:Data to memoryAll other: data to disk: a) best performance- scatter gather- data copied to up to 80 buffers, then written to disk.

Two lower curves: data to a single memory buffer, then copied to disk.

29 Jul 08 Matt Warren & Co. - ODR Starus 6

ODR VHDL code

Interface to DOOCsInterface to DOOCs

Supervisor

Requester

FIFODup.

DMA FIFO to user buffer

Data BuffData

BuffData BuffDMA data to user buffer(s)

(host memory)

DOOCSTx LDA msg

Two way communication

From DOOCS perspective, everything to right of line is “ODR”

Hardware ODR

DOOCS Interface

29 Jul 08 Matt Warren & Co. - ODR Starus 7

Future DevelopmentFuture Development

• Improve DOOCS GUI.• Add (DOOCS) plots of basic ODR statistics ( on-line).• Create event fragment data base (inside DOOCS ?)• Test connectivity to LDA with the “real” LDA hardware