atca in atlas meeting 16/05/2013 evaluation results of equipment equipment ph-ese-be 1 collaboration...

ATCA in ATLAS meeting16/05/2013

Evaluation results of equipment

PH-ESE-BE

1

Collaboration (PH/ESE)Vincent Bobillier, Matteo Di Cosmo, Stefan Haas, Markus Joos,Sylvain Mico, Francois Vasey and Paschalis Vichoudis

ATCA in ATLAS meeting, CERN, 16 May 2013 - Evaluation of microTCA equipment

> Outline

Outline

Introduction• xTCA Evaluation Project• ESE-BE xTCA Equipment

Tests and procedures for evaluation• Test performed and tools• IPMI Tester

Test examples Power Module NAT DC780

• Test setup • Results discussion

Aspiro and Guardian PSU for MTCA and ATCA• Results discussion

Conclusions• Failures and reparations• Observation/Future work

2

> Outline

3ATCA in ATLAS meeting, CERN, 16 May 2013 - Evaluation of microTCA equipment

Outline







> Introduction\xTCA Evaluation Project

• xTCA evaluation project in PH-ESE group launched in 2011 – Technical evaluation of components for MicroTCA, MTCA.4 and ATCA systems– Technical evaluation of AC/DC converters– Development of tools (H/W and S/W) for the testing of commercial components– Conduct market surveys – Report and share results

• Longer term goal– Try to standardize MicroTCA and ATCA shelves and power supplies

• Many options (backplanes, cooling, RTMs, power supply, …)– Propose acceptance test procedures– Propose a selected set of equipment to the experiments– Provide centralized support for these items


> Introduction\ESE-BE xTCA equipment

MTCA Crates

Vadatech VT892 MTCA.0(12 AMCs, 2 MCHs, 2PMs, 2CUs)

ELMA 043-012 MTCA.4(12 AMCs, 12 RTMs, 2 MCHs, 4PMs, 2CUs)

Schroff MTCA.4 + AC/DC CM100(6 AMCs, 6 RTMs, 1 MCHs)

PMs4xNAT DC780

(792W)Vadatech UTC010

(792W)

MCHsVadatechUTC001

NAT MCH KontronAM4904

AMCs

ELMA Load Board Kontron AM5030 ESD ADIO24 CCT AM31

5

Wiener AC/DC (Prototype, 800W)

Schroff MTCA.4 (12 AMCs, 12 RTMs, 2 MCHs, 4PM)


ATCA Crates

6

Schroff 14-slot 13U

ATCA boards

AC/DC Power Supply

Emerson network power NetSure501 PowerOne Aspiro PowerOne Guardian

> Introduction\ESE-BE xTCA equipment

Kontron AMC Carrier Comtel load boards(including RTM)

Lineage Power CPS

ASIS 14-slot


> Outline


Outline







> Tests and procedures for evaluation\Test performed and tools

• Electrical Evaluation of Power Modules Static Tests

- Load Regulation- Line Regulation

Dynamic Tests- Load transient Response- Ripple and noise

Efficiency and Power Factor Sensor Accuracy and overcurrent protection

Instruments

LeCroy 104Xi LeCroy API015Current probe

Agilent 34970AData Logger

Agilent N3300AElectronic Load


• Electrical Evaluation of AC/DC PSU Static Tests

- Load Regulation- Soak Testing

Dynamic Tests- Load transient Response- Ripple and noise- Inrush Current

Efficiency and Power Factor EMC Tests Sensor Accuracy

Instruments

LeCroy 104Xi LeCroy API015Current probe


Agilent N3300AElectronic Load

9



• Crate Thermal Evaluation Cooling performance

ALB heat distributionALB temp sensors position

Instruments


34901A 20 Channel Multiplexer

Slot 1

Slot 2

Slot 3

Slot 4

Slot 5

Slot 6

0

10

20

30

40

50

60

ΔT1

ΔT3

ΔT1 ΔT2 ΔT3

AMC position

Tem

pera

ture

Del

ta (C

)

On board position

10



Remote LinuxServer

(ipmitool)

Labview GUI MCH

IPMI overLAN

Target FRU

PM

CU

AMC

SSH

FRU address

Ethernet Packets

IPMI Packet

NetFN CMD

MCH IP

DATA

FRU addressIPMI Packet

NetFN CMD

MCH IP

DATA

FRU addressIPMI Packet

NetFN CMD

MCH IP

DATA

FRU address

IPMI Packet

NetFN CMD

DATA

FRU address

NetFN CMD

DATA

FRU address

NetFN CMD

DATA

IPMI CMD LISTIpmitool –I lan –h mch –U admin…

Ipmitool –I lan –h mch –U admin…Ipmitool –I lan –h mch –U admin…

Ipmitool –I lan –h mch –U admin…

11



Functionality Test• Polaris Tester

MicroTCA TesterMCMCMMCEMMCCarrier

AMC Tester

ATCA Tester

MTCA.4 Tester

12

> Tests and procedures for evaluation\IPMI tester


IPMI Sniffer

Useful for test, debug and development purposes. Many I2C Analyzer available but no universal commercial IPMI real-time monitor The solution consists in using a Totalphase i2c Beagle Protocol Analyzer and Wireshark

IPMB_L Sniffing IPMB_0 Sniffing

13

> Tests and procedures for evaluation\IPMI tester


> Outline


Outline







NAT DC780 PM• Standard MicroTCA DC/DC PM • 792 W, Minimum efficiency 95.5%• Support for

- 12 AMCs,- 2 CUs- 2 MCHs

> Test example\PM NAT DC780

Test Setup

- Host: Vadatech VT982 Crate- External AC/DC Power Source (1.5kW)- Auxiliary PM to power Cus and MCH

2 PM DC780 in a Vadatech VT982 crate


NAT DC780 PM• Results discussion: Input Voltage/Line Regulation

NAT DC780

16

PM PCB bottom layer after failure

According to the manufacturer:• The input FET experienced much current causing the rupture of the PM. • A modification of the existing specification will be required (min ≌ -48V)• New HW version soon available to meet the existent specification

DC780 Specs: -60V<Vin<-40V



NAT DC780 PM• Results discussion: Efficiency

17

Efficiency measurement setup

0 100 200 300 400 500 600 700 8000.82

0.84

0.86

0.88

0.9

0.92

0.94

0.96

Output Power [W]

Efficie

ncy

Efficiency measurement

NAT DC780DC780 Specs: 95.5% (min)



NAT DC780 PM• Results discussion and comparison with Vadatech UTC010 and Wiener AC PSU

Test Conditions Measured DC780 SpecsMaximum Power Vi=-48V 730W 780WInput Voltage -48V to -53V -40V to -60VLoad Regulation Full power 8.6% 10%Line Regulation Full load, Vin: -40V to -53V 2mV (max) before failure Not reportedEfficiency Vi = -48V, 1-100% of full power 94% (max) 95.5% (min)Ripple Full power 20mV Not reportedVoltage transient deviation Load step from 25% to 75% of full load ±0.5V Not reported

Test Conditions Measured UTC010 SpecsMaximum Power Vi=-48V 600W 780WInput Voltage -38V to -53V -36V to -75VLoad Regulation Full power 1.2% Not reportedLine Regulation Full load, Vin: -38V to -53V 1.93V Not reported

Minimum load, Vin: -38V to -53V 1.22V Not reported

Efficiency Vi = -48V, 1-100% of full power 93% (max at 300W) 95% (full load)

Ripple Full power 73mV Not reportedMinimum Power 700mV Not reported

Voltage transient deviation Load step from 25% to 75% of full load ±0.4V Not reported

Vadatech UTC010

NAT DC780

TTR ≌ 3d

TTR 13d ≌

18TTR = Time To Reply

Wiener AC/DC PM(Prototype)

Test Conditions Measured Wiener SpecsMaximum Power 800W 800WLoad Regulation 1-100% of full power 3.5% Not reportedEfficiency 1-100% of full power Not possible to measure 93% (min)Power Factor Not possible to measure 0.99Ripple Full power 10mV <10mV Pk-to-PkVoltage transient deviation Load step from 25% to 75% of full load To be done Not reported



AC/DC PSU

19

Aspiro PSU description :

• Up to 4 AC/DC rectifier modules• 1200W per rectifier module• Vout : -48VDC• 8 output channels under breakers (20A)• 1 cooling fan per rectifier module• Front panel control interface• Remote control via USB or Ethernet port• N+1 redundancy system

Guardian PSU description :• Up to 5 AC/DC rectifier modules• 2900W per rectifier module• Vout : -48VDC• 8 output channels under breakers (32A)• 2 cooling fans per rectifier module• Front panel control interface• Remote control via USB or Ethernet port• N+1 redundancy system

> Test example\Aspiro and Guardian PSU for MTCA and ATCA


TESTED Partially TESTED TO BE TESTED

Emerson PSU description :• Up to 5 AC/DC rectifier modules• 2000W per rectifier module• Vout : -48VDC• 10 output channels under breakers (32A)• 1 cooling fans per rectifier module• Front panel control interface• Remote control via USB or Ethernet port• N+1 redundancy system

-48V -48V

20

Test type Test condition measured specified ResultSensor accuracy voltage < 0.15% not specified NA

current < 1% not specified NASoak testing 2 hours @ 75% load voltage fluctuation < 4mV not specified NASW-HW limits voltage 70% load SW limit <0.15% Specified via the GUI pass

current 48V SW limit <1%; HW limit: 26.3A Specified via the GUI passStatic regulation 0 to 100% load output variation < 1.3% ± 1% passDynamic regulation voltage variation 10-90% and 90-10% load 5.6% (worst case) 3% fail

recovery time 10-90% and 90-10% load 14 ms 20 ms passVoltage ripple 90% load 135 mV p-p < 100mV p-p failEMC tests input 90% load within spec EN61000-6-3 pass

output 90% load QP: ok, Avg: 2 dBuV out of spec EN61000-6-4 failInrush current within spec ETS 300 132-1 passEfficiency 40-100% load 95% > 95% passPower factor 40-100% load > 0.99 EN61000-3-2 (0.99 typ.) pass



Aspiro PSU results

0 200 400 600 800 1000 12000

0.10.20.30.40.50.60.70.80.9

1

EfficiencyPower factor

Output power [W]

21

Test type Test condition measured specified ResultSensor accuracy voltage < 0.31% not specified NA

current < 3.33% not specified NASoak testing 14 hours @ 50% load voltage fluctuation < 6mV not specified NASW-HW limits voltage To be performed

current To be performedStatic regulation 0 to 100% load output variation < 1.75% ± 1% passDynamic regulation voltage variation 10-90% and 90-10% load 5.64% (worst case) 5% fail

recovery time 10-90% and 90-10% load 24 ms 20 ms failVoltage ripple At 90% load 152mV pk-pk < 250mV p-p passEMC tests input EN61000-6-3 To be performed

output EN61000-6-4 To be performedInrush current within spec ETS 300 132-1 passEfficiency 0-90% power 94% @ >18% power > 95% typical failPower factor 0-90% load > 0.995 @ >24.64% load >0.995% at >25% load pass

Guardian PSU results



0 2000 4000 6000 8000 10000 120000

0.10.20.30.40.50.60.70.80.9

1

EfficiencyPF

Output Power [W]

> Outline


Outline







NAT PM DC780. Input stage compromised after line regulation tests Repaired under warranty and new HW design

NAT MCH. i2c ports failing. Sent twice for repair under warranty, still waiting for a report Up to now one i2c port not working again

Schroff for Physics Crate. Management Power not available for MCH and first AMC slot. Same problem encountered two years ago on two AMC slots.

Repaired under warrantySchroff for Physics Crate. Backplane connectors wear for excessive mating cycles:

Sent for repair last Christmas. (Backplane replacement)

Further analyses showed a misalignment of the Schroff Backplane which caused the wrap of the ALB connectors. The manufacturer took entirely the responsibility and precautions will be taken. The crate will be shipped soon for expertise.

> Conclusions\Failures and reparations


But also

• Several interoperability problems faced during test• Must be solved in collaboration with the manufactures

• Interoperability not always assured (standards lacks…)• Complete technical specification not always verified or provided by manufacturers• Importance of Support

> Conclusions\Observation

24

Lesson learned and results obtained

• List of written evaluation reports• System architecture knowledge• Cooperation with manufacturers• Detailed test procedure defined• Test setup available

• Load modules• LabView GUI• IPMI monitor

• Full IPMI test suite (Polaris Tester)Availables on the uTCA/ATCA Repository


MicroTCA Equipment evaluation will be kept going • Waiting for new HW releases (NAT, Vadatech and Wiener)

Start AdvancedTCA Evaluation Schroff Crate and ATCA components evaluation Annecy IPMC + Test Carrier ASIS ATCA crate (Vertical airflow)

AC/DC Converters (first results available)

> Conclusions\Future work

ASIS ATCA Crate coming soon


> References

Useful links

• MicroTCA Evaluation Repository https://espace.cern.ch/ph-dep-ESE-BE-uTCAEvaluationProject/default.aspx• ATCA Evaluation Repository https://espace.cern.ch/ph-dep-ESE-BE-ATCAEvaluationProject/SitePages/Home.aspx• PICMG Website http://www.picmg.org/• MicroTCA Short Form Specification http://www.picmg.org/pdf/MicroTCA_Short_Form_Sept_2006.pdf• AMC Short Form Specification http://www.picmg.org/pdf/AMC.0_R2.0_Short_Form.pdf• ATCA Short Form Specification http://www.picmg.org/pdf/PICMG_3_0_Shortform.pdf• IPMI, IPMB Specification http://www.intel.com/content/www/us/en/servers/ipmi/ipmi-specifications.html• Polaris Tester http://www.polarisnetworks.net/atca-test-tool.html• NAT Website http://www.nateurope.com/• Vadatech Website http://www.vadatech.com/


https://espace.cern.ch/ph-dep-ESE-BE-uTCAEvaluationProject/default.aspx

https://espace.cern.ch/ph-dep-ESE-BE-uTCAEvaluationProject/default.aspx

https://espace.cern.ch/ph-dep-ESE-BE-ATCAEvaluationProject/SitePages/Home.aspx

http://www.picmg.org/

http://www.picmg.org/

http://www.picmg.org/pdf/MicroTCA_Short_Form_Sept_2006.pdf



http://www.picmg.org/pdf/AMC.0_R2.0_Short_Form.pdf

http://www.picmg.org/pdf/AMC.0_R2.0_Short_Form.pdf

http://www.picmg.org/pdf/PICMG_3_0_Shortform.pdf

http://www.picmg.org/pdf/PICMG_3_0_Shortform.pdf

http://www.intel.com/content/www/us/en/servers/ipmi/ipmi-specifications.html

http://www.intel.com/content/www/us/en/servers/ipmi/ipmi-specifications.html

http://www.polarisnetworks.net/atca-test-tool.html

http://www.polarisnetworks.net/atca-test-tool.html

http://www.nateurope.com/

http://www.nateurope.com/

http://www.vadatech.com/

http://www.vadatech.com/

>

THANK YOU


atca in atlas meeting 16/05/2013 evaluation results of equipment equipment ph-ese-be 1 collaboration...

Documents

slot atca

atca shelves

pm atca

powerpoint presentation

cus schroff mtca

xtca equipmenttests

w schroff mtca

mchs pms