Download - DMX-3 & 5771 Config
-
8/7/2019 DMX-3 & 5771 Config
1/33
11
DMX-3 & 5771
Aug23, 2005
-
8/7/2019 DMX-3 & 5771 Config
2/33
-
8/7/2019 DMX-3 & 5771 Config
3/33
33
Physical System Layout
Broken from the wheel in, plug and play, model. Aspects of DMX 800 are incorporated. Grow the box as required. This means inter-frame cabling is required.
Base Unit is equipment bay and at least one drive bay.
1A2A 1B 2BSystem
-
8/7/2019 DMX-3 & 5771 Config
4/33
44
DMX-3 Front view
Take note and remember how bays are numbered.
-
8/7/2019 DMX-3 & 5771 Config
5/33
55
System Bay (Front)
Fans
System Midplane
Air Intake(8)1800W Power Supplies
(8)SPS(only 3 shown)
KVM
Server
Card Cage
-
8/7/2019 DMX-3 & 5771 Config
6/3366
System Bay (Rear)
(16) 8-Port Adapters
(2) XCM Boards
(8) Power Supply Cords
(UPS) Uninterruptible Power Supply
(2) (PDP) Power Distribution Panel
(2) (PDU) Power Distribution Unit
(8) (SPS) Standby Power Supplies(only 6 shown)
-
8/7/2019 DMX-3 & 5771 Config
7/3377
Midplane (Front)
Dir1
Pos1
SlotID0
TypeBE
Dir9
Pos17
SlotID8
TypeFE
Dir2
Pos2
SlotID1
TypeBE
Dir10
Pos18
SlotID9
TypeFE
Dir3
Pos3
SlotID2
TypeFE
Dir11
Pos19
SlotIDA
TypeBEorFE
Dir4
Pos4
SlotID3
TypeFE
Dir12
Pos20
SlotIDB
TypeBEorFE
Dir5
Pos5
SlotID4
TypeBEor
FE
Dir13
Pos21
SlotIDC
TypeFE
Dir6
Pos6
SlotID5
TypeBEor
FE
Dir7
Pos7
SlotID6
TypeFE
Dir8
Pos8
SlotID7
TypeFE
Dir16
Pos24
SlotIDF
TypeBE
M0
Pos9
SlotID10
M1
Pos10
SlotID11
M7
Pos16
SlotID17
M6
Pos15
SlotID16
M5
Pos14
SlotID15
M4
Pos13
SlotID14
M3
Pos12
SlotID13
M2
Pos11
SlotID12
Mirrored Memory Pairs
Director Pairs
14
Rev 2.0 9/11/03
15
-
8/7/2019 DMX-3 & 5771 Config
8/3388
Card Cage Front
Each Director has 4 slices
Each Slice has 2 ports
DAs come in pairs
Each DA pair drives 8 DAEs (Primary)
Dirs 5,6,11,12 could be HAs
Memory comes in pairs (Mirrored)
Both cards must be the same size
Available memory sizes are:8GB, 16GB, 32GB, 64GB
-
8/7/2019 DMX-3 & 5771 Config
9/3399
Universal Director
Jtag RS232 Ethernet
DisableInterface
Switch
Boot UpMode
Selection
StatusDisplay ProcessorSelectedDisplay
CPU SelectionSwitch for FBUart, Attn. and
Status Display
A,B,C,DMachineOk LED
MachineCheckError on
A,B,C,D
Attn.Switch
PICFault
LED
FRUBlue
LED
-
8/7/2019 DMX-3 & 5771 Config
10/331010
Cache Configuration Rules: Sym7 vs Sym6
Restrictions 1 and 3 exist on Sym6 to avoid I/O contention
Restrictions 4-5 are new to Sym7 due to mirroring method
Cache Boards are available in 8GB,16Gb, 32GB, 64GB capacities.
Rule Sym 6 Sym 7
1 2 board configs must use same size board 2 board configs must use same size board
2 Largest board no more than twice size of smallest board No restriction on largest vs smallest board
3 Cannot have fewer of the larger board than the smaller board Cannot have fewer of the larger board than the smaller board
Example: (2 x 8GB + 6 x 16GB) OK Example: (2 x 8GB + 6 x 16GB) OK
Example: (4 x 8GB + 4 x 16GB) OK Example: (4 x 8GB + 4 x 16GB) OK
Example: (6 x 8GB + 2 x 16GB) not allowed Example: (6 x 8GB + 2 x 16GB) not allowed
4 Odd no. of total boards allowed Odd no. of total boards not allowed
Example: 3 x 16GB OK Example: 3 x 16GB not allowed
5 Odd no. of individual boards allowed Odd no. of individual boards not allowed
Example: (3 x 16GB + 3 x 8GB) OK Example: (3 x 16GB + 3 x 8GB) not allowed
-
8/7/2019 DMX-3 & 5771 Config
11/331111
Card Cage Rear
B0B1
A0A1
D0D1C0C1
XCM Card
Combination of the
Communications Control Module(CCM) card and EnvironmentalControl Module (ECM) card
Handles communication
switching and card cageenvironmental monitoring
Directors responsible for localenvironmental monitoring
-
8/7/2019 DMX-3 & 5771 Config
12/331212
Drive Bay
1 Pod has 4 X DAEs
1 X DA pair drives 8 DAEsMinimum upgrade granularity @ GA
Drives count 0-E
E
0
Drive 2A 05 A
Drive slots 0, 1, 4, 5, 8, 9, C, D are one power branch.Drive slots 2, 3, 6, 7, A, B, E are the other branch.
Bay DAE Drive
-
8/7/2019 DMX-3 & 5771 Config
13/331313
DAEs Rear View
-
8/7/2019 DMX-3 & 5771 Config
14/331414
Connecting the Daes to Das
16 A0
16 B001 B0
01 A0
16 D0
16 C0
01 D0
01 C0
16 D116 C1
01 D1
01 C1
16 A1
16 B101 B1
01 A1
-
8/7/2019 DMX-3 & 5771 Config
15/33
1515
Note: At GA max of 4 Storage Bays, 8 Storage Bays post-GAMinimum GA Configuration will have 3 DA pairs
Yellow = Dir 1 & 16
Green = Dir 2 & 15
Orange = Dir 5 & 12
Blue = Dir 6 & 11
Connecting Up
FID 94; Symm7 only
-
8/7/2019 DMX-3 & 5771 Config
16/33
1616
PowerVault
Redesign of the power-down process to dump pertinent GlobalMemory information to specified Power Vault drives.
Need a predictable, fast and consistent solution to deal with Cache current method of de-staging Global memory is not scaleable.
Not predictable due to what's happening at the time. Increase in Global Memory sizes (512GB raw) along with stagnant battery
technology meant we could potentially run out of battery time before we hadcompletely de-staged memory.
Symmwin will automatically configure Vault devices. Do not block move or fiddle with Vault devices. Power Vault requirement is 4 unprotected volumes per DA slice.
Must be on primary DAEs which cannot be configured with less than 4 drives. Current Size is 5gb but appear as 0 cyls in bin file.
Power Vault devices are formatted as raw FBA drives and cannot be read using D0commands using Cyl and HD because of this.
Vault Devices are assigned to be the first logical position on a physical drive.
This is the fastest part of the physical drive (Outer Diameter) Insures the highest possible throughput
FID 94; Symm7 only
-
8/7/2019 DMX-3 & 5771 Config
17/33
1717
DAE
LCC
LCC
SPS
DAF1
DAF16
o 4 Vault Drives per DA slice
o 5 GB per Vault drive
To Daisy Chain DAE
PowerVault
-
8/7/2019 DMX-3 & 5771 Config
18/33
1818
Vault Save AllocationExample
PV
DEV
B
Dir
1B
PV
DEV
D
Dir16A
PV
DEV
A
Dir
1A
PV
DEV
D
Dir
1D
PV
DEV
A
Dir
16D
PV
DEV
B
Dir16C
PV
DEV
C
Dir16B
Region 0
Dir 1D
Region ABC
Region DEF
PV
DEV
C
Dir
1C
Dir 1C
Dir 1B
Dir 1ADir 16A
Dir 16B
Dir 16C
Dir 16D
Region
Region UVW
.
.
Each region issaved twice.
This is forredundancy.
You do NOT get acopy of each mirrorimage of memory
-
8/7/2019 DMX-3 & 5771 Config
19/33
1919
Changes to IML
Restore Global Memory from previously successful Vault Save image. This is done in step 14 of the IML
Step 14 also incorporates an extensive Sanity Check of global memory
Error codes that may be seen will reported as ECxx errors
Drive availability Sanity Check Check that all Drives previously in the System are in the same place by comparing
the S/N of the drives since the last successful restore.
Error DD10.01 will be issued if we find the drives in a different slot than before.
At the end of the Restore check that both images of GM match bycalculating the CRCs for the 2 matching Vault regions of memory
Error 3310.00
-
8/7/2019 DMX-3 & 5771 Config
20/33
2020
Vault Implications
System VTOC: the Vault drives will be formatted and a Vault Saveoperation will take place at the end of a successful VTOC.
When a System is taken Offline (DAs) a Vault Save operation will takeplace.
The Front End and RDF can be taken offline and back online without a Vault.
Can not take one DA offline, all or none.
Environmental triggers loss of a sufficient number of Fans
loss of a sufficient number of Vault drives
loss of Battery hold up time meaning we would not be able to Vault if AC Power waslost.
If the system determines theres not enough power to vault it wont come up.
A lack of SPS Battery hold up time will prevent the box from coming online
The box will still complete IML.
The state would remain in Post Restore IML.
-
8/7/2019 DMX-3 & 5771 Config
21/33
2121
Init Screen
Model name DMX3-24 or DMX3-6
Power vault wait time
Raid-S no longer supported
-
8/7/2019 DMX-3 & 5771 Config
22/33
2222
Dir Map tab Changes
-
8/7/2019 DMX-3 & 5771 Config
23/33
2323
DAE
Much like adding disks use the
wizard or type in the letter
-
8/7/2019 DMX-3 & 5771 Config
24/33
2424
Split Screen
Unlike the Hosts tab this one is compulsory
Helps to maintain addressing rules.
-
8/7/2019 DMX-3 & 5771 Config
25/33
2525
Addressing CKD devices
Gives the capability toaddress multiple CU imagesat the same time.
-
8/7/2019 DMX-3 & 5771 Config
26/33
2626
Disks
Add new option as to where you wantto place disks.
Note as you change DAE the colourschange.
Physical view functionality added.
-
8/7/2019 DMX-3 & 5771 Config
27/33
2727
Physical view from Vols Map
-
8/7/2019 DMX-3 & 5771 Config
28/33
2828
Vols Request
128 Vault devices. 16 per DA director. 4 per DA slice.
VCM data base now lives on SFS volumes so the device is samesize as a gatekeeper.
New protection type CDEV (cache only device)VDEV lives in Cache, no longer takes up Physical disk space.
Raid-S no longer supported.
Be Careful traditionally this would be a 9Gb drive Now its double that, remember this when playing with SRDF.
FBA track size Doubled to 64KB
Fewer tracks or slots per GB of user data
Both FBA and CKD will use a 64KB track, so any systemcan mix FBA and CKD devices
FIDs 420,662,663,664; Symm6 & Symm7
-
8/7/2019 DMX-3 & 5771 Config
29/33
2929
SRDF Inter-platform Support
Platform RDF Configuration Level of Support
Symm 4 5267 to 5x71 Migration only
Symm 5 5567 to 5x71 Migration only
5568 to 5671 Full support
5568 to 5771 Full support
Symm 6 5669 to 5x71 none
5670 to 5671 Full support
5670 to 5771 None
5671 to 5x71 Full support
Symm 7 5771 to 5771 Full support
Includes all link types: ESCON, FC, GigE
-
8/7/2019 DMX-3 & 5771 Config
30/33
3030
Numbers
5670 5671 5771
Volumes Supported 8,000 16,000 64,000*
CUs in a box 64 64 250
MF LPARs per slice 64 64 128MF ESCON concurrent I/O 4 8 8
MF Aliases 7 15 255
iSCSI Initiators per Slice 128 128 512
* 32,000 if everything is Raid 7+1
-
8/7/2019 DMX-3 & 5771 Config
31/33
3131
New and Noteworthy
Cable diagnostics Runs automatically during configure and install Symmetrix
Checks out basic cabling connectivity & functionality
Steps CE through a sequence where the DAEs are lit up First vertically thenhorizontally 1 frame at a time.
Provides opportunity to correct any problems before moving on.
Can also be run anytime from menu.
Drive replacement script Drive replacement script has been improved to run mostly unattended.
After testing basic drive functionality CE is released.
Script monitors and will dial home if problems occur.
SCSI code load Planning script and a load script.
Gives CE options on how when and where to load.
Can run in flavors ranging from Big Bang Mode to unattended Super safe mode.
-
8/7/2019 DMX-3 & 5771 Config
32/33
3232
5771 Procedure Wizard changes
Symm 7specificoptions
Starts vaultingprocess prior topower down.New cableoptions
Global sparing notyet available
No offlinechanges
-
8/7/2019 DMX-3 & 5771 Config
33/33
3333