Slide 1
<Insert Picture Here>
Oracle
Slide 2
<Insert Picture Here>
WZT-6508 version B
Sun Fire Nehalem and Westmere Rack-Mount
Servers Architecture and Features
Welcome to the architecture and features module. This module will cover the architecture and feature information about the Sun Fire X2270, X4170, X4270 and X4275 along with the M2 versions of each model, that supports a new processor and features. You will use this information for installation, configuration, administration and troubleshooting of these products.
Slide 3
3
Objectives
• Identify the server models
• Identify the features of the servers
• Explain the architecture of the servers
• List the FRUs and CRUs of each server
Upon completion of this module, you should be able to:
1Identify the server models
2Identify the features of the servers
3Explain the architecture of the servers
4List the FRUs and CRUs of each server
Slide 4
4
Additional Resources
• Sun Microsystems, Inc., Sun Fire X2270 Server Service Manual ,
Revision A, March 2009 Part Number 820-5607-xx.
• Sun Microsystems, Inc., Sun Fire X4170, X4270 and X4275 Servers
Service Manual , Revision A, March 2009 Part Number 820-5830-xx.
• Sun Microsystems, Inc., Sun Fire X4170, X4270 and X4275 Servers
Installation Guide, Revision A, March 2009, Part Number 820-5827-xx.
• Sun Microsystems, Inc., Sun Fire X4170, X4270 and X4275 Servers
Solaris and Linux OS Installation Guide, Revision A, March 2009, Part
Number 820-5828-xx.
• Sun Microsystems, Inc., Sun Fire X4170, X4270 and X4275 Servers
Windows OS Installation Guide, Revision A, March 2009, Part Number
820-5829-xx.
Press PLAY (4) to Continue
The following references provide additional information on the servers and their components.1
Slide 5
5
Additional Resources
• Sun Microsystems, Inc., Sun Fire X2270 M2 Server Service Manual,
Revision A, April 2010, Part Number XXX-XXXX-xx.
• Sun Microsystems, Inc., Sun Fire X4170 M2 Servers Service Manual,
Revision A, April 2010, Part Number 821-0486-xx.
• Sun Microsystems, Inc., Sun Fire X4270 M2 Servers Service Manual,
Revision A, April 2010, Part Number 821-0488-xx
• Sun Microsystems, Inc., Sun Fire X4170 and X4270 M2 Servers
Installation Guide, Revision A, April 2010, Part Number 821-0481-xx
• Sun Microsystems, Inc., Oracle Integrated Lights Out Manager (ILOM)
3.0 Supplement for Sun Fire X4170 M2 and X4270 M2 Servers,
Revision A, April 2010, Part Number 821-0489-xx
• http://panacea.central.sun.com/twiki/bin/view/WebHome
Press PLAY (4) to Continue
The following references provide additional information on the M2 servers and their components 1along
with the links to the TOI presentations that served as the source information for this module.2
Slide 6
6
Which Servers?
Sun Fire X4170 and X4170 M2 Servers
1U
Sun Fire X4270 and X4270 M2 Servers
2U
Sun Fire X4275 and X4275 M2 Servers
2U
Sun Fire X2270 and X2270 M2 Servers
1U
The Sun Fire X2270 and X2270 M2 Servers are 1U form factor high performance rack mount servers. 1The Sun Fire X4170 and X4170 M2 Servers are also 1U form factor high performance rack mount
servers. 2While the Sun Fire X4270 and X4275 Servers along with the M2 models are 2U form factor high
performance rack mount servers. The M2 systems introduced an upgraded version of the Intel processor along with other I/O enhancements. The key physical differences between the server models are the number of adapter slots and the number of disks each support.
Slide 7
PROPERTIES
Allow user to leave interaction: Anytime
Show ‘Next Slide’ Button: Show always
Completion Button Label: Next Slide
The Sun Fire X2270 and X2270 M2 Servers front and rear sides are displayed here. Click on the feature’s hot buttons to view a description of their functionality.
Slide 8
PROPERTIES
Allow user to leave interaction: Anytime
Show ‘Next Slide’ Button: Show always
Completion Button Label: Next Slide
The Sun Fire X4170 and X4170 M2 Servers front and rear sides are displayed here. Click on the feature’s hot buttons to view a description of their functionality.
Slide 9
PROPERTIES
Allow user to leave interaction: Anytime
Show ‘Next Slide’ Button: Show always
Completion Button Label: Next Slide
The Sun Fire X4270 and X4270 M2 Servers front and rear sides are displayed here. Click on the feature’s hot buttons to view a description of their functionality.
Slide 10
PROPERTIES
Allow user to leave interaction: Anytime
Show ‘Next Slide’ Button: Show always
Completion Button Label: Next Slide
The Sun Fire X4275 and X4275 M2 Servers front and rear sides are displayed here. Click on the feature’s hot buttons to view a description of their functionality.
Slide 11
PROPERTIES
Allow user to leave interaction: Anytime
Show ‘Next Slide’ Button: Show always
Completion Button Label: Next Slide
The Sun Fire X2270 and X2270 M2 Servers internal components are displayed here. Click on the feature’s hot buttons to view a description of their functionality.
Slide 12
PROPERTIES
Allow user to leave interaction: Anytime
Show ‘Next Slide’ Button: Show always
Completion Button Label: Next Slide
The Sun Fire X4270, X4275 and their M2 models have their internal components displayed here. With some exceptions, the X4170 and X4170 M2 Servers are also represented. Click on the component’s hot
buttons to view a description of their functionality.
Slide 13
13
Internal Architecture (X2270 and X2270 M2)
Press PLAY (4) to Continue
Intel Xeon
Processors
Nehalem or
Westmere
DDR3
DIMMSlots (6)
DDR3
DIMMSlots (6)
I/O
HUB
(IOH)
QPI QPI
QPI
MemoryChannels (3)
MemoryChannels (3)
Intel
5500
Chipset
The Sun Fire X2270 Server internal architecture centers around the Intel Nehalem-EP CPUs while the Sun Fire X2270 M2 Server uses the Intel Westmere-EP CPUs. In both cases,
1eachCPU has three internal memory channels that supports two DDR3 DIMM slots per
channel. The CPUs are connected to each other with a common I/O interface through its Quick Path Interconnects, that are referred to as the QPIs which replaces Intel’s traditional front-side bus architecture. The QPI that connects the two CPUs together which functions as a memory share path allowing each CPU access to the other CPU’s memory. There are also QPI paths out to the I/O Hub, code named Tylersburg.
2
Slide 14
14
Internal Architecture (X2270 and X2270 M2)
Management10/100 Ethernet
ManagementSerial
video
port 0
port 1
ICH
South
Bridge
ESI
PCIe 2 x2
PCIe2 x16
riser cardconnector
PCIe2
82576EB
SATA x4 SATA x2
FMOD (2)
SATA
disks
or SSDs (4)
PCI 32 bit 33Hhz
USB
USB
LPC
USB (internal)
USB (front panel)
USB (front panel)
USB (rear panel)
USB (rear panel)
SP (optional)
Without SP Board:
No network mgmt port support.
Serial mgmt port support by
SuperIO chip
No graphics support
Fan and LED support by BIOS
Press PLAY (4) to Continue
Intel Xeon
Processors
Nehalem or
Westmere
DDR3
DIMMSlots (6)
DDR3
DIMMSlots (6)
I/O
HUB
(IOH)
QPI QPI
QPI
MemoryChannels (3)
MemoryChannels (3)
Intel
5500
Chipset
10/100/1000 Base-T
Intel
Kawela
The IOH performs a QPI to PCIe bridge function, as well as, provides an ESI connection to the ICH SouthBridge chip which supports an optional PCIe generation 2 16-lane board. The IOH supports one Intel Kawela Dual Port Ethernet controller by providing two PCIe2 lanes to the controller. Its PCIe2 interconnect configuration depends on the server, so it will be discussed in detail later in this presentation. Note that the non-M2 servers support a Zoar Dual Port Ethernet controller. 1The ICH SouthBridge chip also supports five USB buses, six SATA buses, two FMOD slots and four
interfaces to the service processor board: a PCI bus, two USB buses and an LPC bus. 2If an SP board is installed, the serial and network management ports are controlled by the SP board,
graphics support is available, fan and LED support is performed by the SP board and the side-band connection to the Kawela chip is enabled.
3If an SP board is not installed, there is no network
management support, no graphics support, the serial port is supported by the SuperIO chip and the LEDs and fans are controlled by BIOS.
4For more component specifications review the Specification Table
attachment file.
Slide 15
15
Internal Architecture (X4x7x and X4x7x M2)
Intel Xeon
Processors
Nehalem or
Westmere
Press PLAY (4) to Continue
DDR3
DIMMSlots (9)
QPI
MemoryChannels (3)
MemoryChannels (3)
DDR3
DIMMSlots (9)
I/O
HUB
(IOH)
QPI QPI
Intel
5520
Chipset
ICH
South
Bridge
ESI
PCIe 2 X2
PCIe 2 x2
port 0 /1
Riser Card
Connectors
(3)
port 2 /3
82576EB
10/100/1000 Base-T
Intel
Kawela
Intel
Kawela
The Sun Fire X4170, X4270 and X4275 server internal architectures, along with their M2 models, are similar to each other. The X4170, X4270 and X4275 servers support Nehalem-EP CPUs while the M2 models support Westmere-EP CPUs.
1Each CPU has three internal memory channels that supports three
DIMM slots per channel. The DIMM types supported are DDR3. The CPUs are connected to each other and to the I/O Hub through Quick Path Interconnects, that are referred to as the QPIs, which replaces Intel’s traditional front-side bus in this architecture. 2The IOH performs a QPI to PCIe bridge function, as well as, provides 32 PCIe generation 2 lanes to the
ICH SouthBridge chip which supports three riser card connectors. The IOH supports two Intel Kawela Dual Port Ethernet controllers by providing two PCIe generation 2 lanes to each of the controllers. Its PCIe interconnect configuration depends on the server, so it will be discussed in detail later in this presentation.
3
Slide 16
16
Internal Architecture (X4x7x and X4x7x M2)
SATA Devices
(for X4170)DDR3
DIMMSlots (9)
Intel Xeon
Processors
Nehalem or
Westmere
QPI
MemoryChannels (3)
MemoryChannels (3)
DDR3
DIMMSlots (9)
I/O
HUB
(IOH)
QPI QPI
ICH
South
Bridge
ESI
PCIe 2 X2
PCIe 2 x2
port 0 /1
Riser Card
Connectors
(3)
port 2 /3
82576EB
CD /DVD
(2) FMODs
USB to SATA
Management10/100 Base-T
ManagementSerial
video
Press PLAY (4) to Continue
SP
PCI 32 bit 33Hhz
USB
USB
LPC
USB (internal)
USB (front panel)
USB (front panel)
USB (rear panel)
USB (rear panel)
Not supported
on the
X4275 and
X4275 M2
Intel
5520
Chipset
10/100/1000 Base-T
NOTE: The FMODs are
supported on the M2 and
the X2270 servers.
Intel
Kawela
Intel
Kawela
The ICH SouthBridge chip also supports five USB buses dedicated to two front panel, two rear panel and one internal connection.
1Notice that the X4275 and X4275 M2 servers have no USB connectors on the
front panel. The ICH is connected to the service processor or SP through a PCI 32 bit 33Mhz bus, two USB buses and a Low Pin Count bus referred to as LPC.
2The ICH also supports two other USB buses
that are used to connect to two FMOD connectors and a CD/DVD drive, after converting the USB buses to IDE and SATA buses, respectively.
3Note, the FMODs are supported on the M2 and the X2270 servers.
The other servers support compact flash cards. 4The disk configuration will be discussed in detail later in
this presentation. 5The SP function is incorporated on the motherboard and its ILOM application can be accessed through a
serial or network management port. The SP also has a side-band connection to both Kawela chips and the video port can be used to support a console monitor.
6For more component specifications review the
Specification Table attachment file.
Slide 17
17
I/O Architecture (X4x7x and X4x7x M2)
SATA
ICH
South
Bridge
6
SATA
HDDs
or
SSDs
PCIe2
HBA
OR
8 SAS/SATA HDDs or 8 SATA SSDs
PCIe2
HUB
PCIe2
Slots
PCIe2
Lanes
0 1 2
x16 x8 x8
X4170 and X4170 M2
PCIe2
Slots5
PCIe2
HUB
PCIe2
Slots
PCIe2
Lanes
0 1 2
x8 x8 x8
3 4
X4270 and X4270 M2
16 SAS/SATA HDDs or 12 SATA SSDs
PCIe2
HBA
SAS
Expander
X4275 and X4275 M2
PCIe2
HUB
PCIe2
Slots
PCIe2
Lanes
0 1 2
x8 x8 x8
PCIe2
Slots3 4 5
12 SAS/SATA HDDs or 12 SATA SSDs
PCIe2
HBA
SAS
Expander
Press PLAY (4) to Continue
Intel
5520
Chipset
Intel
5520
Chipset
Intel
5520
Chipset
risers
risers risers
The IOH supports 3 PCIe2 connectors. On the X4170 and X4170 M2, PCIe2 slot 0 support a 16-lane board while the other two PCIe2 slots support 8-lane boards all through riser boards. On the X4270, X4275 and their M2 models, there are PCIe2 slot pairs supported by a riser card per pair. PCIe2 slots 0 and 3 are supported directly from the CPUs while PCIe2 slots 1 and 4 and PCIe2 slots 2 and 5 are supported through PCIe2 switching off their respective riser cards. 1The X4170 and X4170 M2 servers support two different disk configurations depending on whether you
use a PCIe2 HBA or not. Without a PCIe2 HBA, you can connect up to six 2.5 inch SATA HDDs or SSDs directly off the ICH SouthBridge SATA interface.
2With a PCIe2 HBA installed in slot 0, you can support
up to eight 2.5 inch SAS or SATA drives. 3The X4270 and X4270 M2 servers support its disk configuration from a PCIe2 HBA that can be installed
in PCIe2 slots 0, 3, 2, or 5. The HBA will support 16 2.5 inch SAS or SATA HDDs or 12 SATA SSDs. 4The
X4275 and X4275 M2 servers also support its disk configuration from a PCIe2 HBA that can be installed on PCIe2 slots 0, 3, 2, or 5. The HBA will support 12 3.5 inch SAS or SATA HDDs or SSDs.
5Note, the
middle PCIe2 HBA slots cannot support these configurations due to physical constraints.6
Slide 18
18
Software Supported
The OS Software supported on these servers are:
• Oracle Enterprise Linux (OEL) 5.4
• Oracle Virtual Machine 2.2.1
• Oracle Solaris 10 X86 (S10 10/09)
• Windows 2008 SP2 (standard/enterprise/dc) 32bit
• Windows 2008 R2 (standard/enterprise/dc)
• RHEL5 Update 4 64-bit AS
• SuSE Linux Enterprise Server (SLES) 11
• SuSE Linux Enterprise Server (SLES) 10 64-bit (SP3)
• VmWare 4.0 U1 ESX / ESXi
Press PLAY (4) to Continue
There are multiple OSes supported by these servers. 1All the major OSes are represented: Oracle Linux,
Oracle Solaris, Windows, Red Hat Linux, SuSE Linux and VmWare.2
Slide 19
19
Firmware Supported
The firmware supported on these servers are:
• ILOM 3.0.9.x - Upgraded using ILOM
• BIOS - Upgraded using ILOM
• CPLD - Upgrade using cpld_update and cpld2_update
• Adaptec HBAs - Upgraded using the Adaptec Flash Utility
• LSI HBAs - Upgraded using the SASFlash Utility
• LSI SAS Expander - Upgraded using the SASFlash Utility
• NICs - Upgrade procedure in product notes
Press PLAY (4) to Continue
Here we going to list the key field upgradeable firmware images. 1BIOS and ILOM are a packaged image
that can be downloaded and installed by ILOM. 2The Complex Programmable Logic Device or CPLD may
also need to be field upgraded using the cpld_update and the cpld2_update scripts. The upgrade procedures for
3the HBAs will use either the Adaptec Flash or the SASFlash utility depending on the HBA
type. 4The SASFlash can also be used to upgrade the LSI SAS Expander chips. The network interface
controllers 5or NICs upgrade procedures will also be supplied separately in the product notes.
6
Slide 20
20
PCIe2 HBAs Supported
Press PLAY (4) to Continue
Sun SAS RAID HBA• Internal (SGX-SAS6-INT-Z)
• Code named Erie
• RAID 0,1, 10
Sun SAS RAID HBA• External (SGX-SAS6-R-INT-Z)
• Code named Niwot
• RAID 0, 1, 5, 6, 00, 10, 50, and 60 with battery backup
RAID Management Software: Sun StorageTek RAID Manager Software/ASM (Configuration and Monitoring)
for Solaris, Linux and Windows, LSI MSM (Windows, Linux), RAIDCTL
(Solaris) and CFGGEN (DOS)
Firmware update utilities: Sun StorageTek RAID Manager Software/ASM (Windows, Linux and Solaris),
ARConf CLI (Windows, Linux and Solaris), SASFlash (DOS), SASFlash
(Windows, Linux), and RAIDCtl (Solaris)
The PCIe2 HBAs supported at release of these servers are listed here. 1The presentation will now stop to allow
you to view these items.
Slide 21
21
Determine the FRU Inventory
Press PLAY (4) to Continue
Displaying FRU inventory from ILOM root account:-> show /SYS/<target>
Displaying FRU inventory from ILOM sunservice account:-> prtfru
NOTE: For a list of FRUs select the FRU Lists attachment file, but for a
current list access the Sun System Handbook at:
http://sunsolve.sun.com/handbook_pub/validateUser.do?target=index
ILOM under the root account can display 1the current FRU inventory by executing the show command.
2ILOM
under the sunservice account has the prtfru command that displays similar FRU inventory. Within the Configuration and Administration module of this course, we will cover the procedures to access ILOM and use these types of commands.
3Note, for a list of FRUs select the FRU Lists attachment file, but for a
current list access the Sun System Handbook at the website listed.4
Slide 22
PROPERTIES
On passing, 'Finish' button: Goes to Next Slide
On failing, 'Finish' button: Goes to Next Slide
Allow user to leave quiz: At any time
User may view slides after quiz: At any time
User may attempt quiz: Unlimited times
Slide 23
23
Summary
• Identify the server models
• Identify the features of the servers
• Explain the architecture of the servers
• List the FRUs and CRUs of each server
Now that you can completed this module, you should be able 1to identify the servers and their features,
explain their architecture and list their FRUs and CRUs. This completes this module.
Slide 24
24
Oracle is the Information Company
Slide 25
25
Oracle