Chapter 2
Presented by:
Anupam Mittal
Storage Systems Environment: Components of a Storage System Environment
Storage System Environment - 2
Upon completion of this chapter, you will be able to:
List components of storage system environment◦ Host, connectivity and storage
List physical and logical components of hosts Describe key connectivity options Describe the physical disk structure Discuss factors affecting disk drive
performance
Storage System Environment - 3
Upon completion of this lesson, you will be able to:
Describe the three components of storage system environment◦ Host, Connectivity and Storage
Detail Host physical and logical components Describe interface protocol
◦ PCI, IDE/ATA and SCSI Describe storage options
◦ Tape, optical and disk drives
Storage System Environment - 4
Applications runs on hosts Hosts can range from
simple laptops to complex server clusters
Physical components of host◦ CPU◦ Storage
Disk device and internal memory
◦ I/O device Host to host communications
Network Interface Card (NIC) Host to storage device
communications Host Bus Adapter (HBA)
Storage System Environment - 5
LaptopServer
Mainframe
Group of Servers
LAN
Components of a Host - 6
Speed
Slow
Fast
CostHighLow
TapeOptical
disk
Magnetic disk
RAM
L2 cache L1 cache
CPU registers
Human interface◦ Keyboard◦ Mouse◦ Monitor
Computer-computer interface◦ Network Interface Card (NIC)
Computer-peripheral interface◦ USB (Universal Serial Bus) port◦ Host Bus Adapter (HBA)
Components of a Host - 7
Components of a Host - 8
Host
Apps
Volume Management
DBMS Mgmt Utilities
File System
Multi-pathing Software
Device Drivers
HBA HBA HBA
Operating System
Application ◦ Interface between user and the host ◦ Three-tiered architecture
Application UI, computing logic and underlying databases◦ Application data access can be classifies as:
Block-level access: Data stored and retrieved in blocks, specifying the LBA
File-level access: Data stored and retrieved by specifying the name and path of files
Operating system◦ Resides between the applications and the hardware◦ Controls the environment
Storage System Environment - 9
Responsible for creating and controlling host level logical storage◦ Physical view of storage is
converted to a logical view by mapping
◦ Logical data blocks are mapped to physical data blocks
Usually offered as part of the operating system or as third party host software
LVM Components:◦ Physical Volumes◦ Volume Groups◦ Logical Volumes
Storage System Environment - 10
Physical Storage
Logical Storage
LVM
One or more Physical Volumes form a Volume Group
LVM manages Volume Groups as a single entity
Physical Volumes can be added and removed from a Volume Group as necessary
Physical Volumes are typically divided into contiguous equal-sized disk blocks
A host will always have at least one disk group for the Operating System◦ Application and Operating
System data maintained in separate volume groups
Storage System Environment - 11
Logical Disk Block
Volume Group
Physical Disk Block
Physical Volume 1 Physical Volume 2 Physical Volume 3
Logical Volume
Logical Volume
Storage System Environment - 12
Partitioning Concatenation
Logical Volume
Physical Volume
Servers
Device Drivers◦ Enables operating system to recognize the device ◦ Provides API to access and control devices◦ Hardware dependent and operating system
specific File System
◦ File is a collection of related records or data stored as a unit
◦ File system is hierarchical structure of files Examples: FAT 32, NTFS, UNIX FS and EXT2/3
Storage System Environment - 13
UNIX (UFS) File type and permissions Number of links Owner and group IDs Number of bytes in the
file Last file access Last file modification
Windows (NTFS) Time stamp and link
count File name Access rights File data Index information Volume information
Components of a Host - 14
Improves data integrity and system restart time over non-journaling file systems
Uses a separate area called a log or journal◦ May hold all data to be written◦ May hold only metadata
Disadvantage - slower than other file systems◦ Each file system update requires at least 1 extra
write – to the log
Components of a Host - 15
Storage System Environment - 16
1 2 3
456
Consisting of Mapped by LVM to
Teacher (User)Course File(s) File System Files
File System Blocks
LVM Logical Extents
Disk Physical ExtentsDisk Sectors
Configures/Manages
Residing in
Reside in Mapped by a file system to
Managed by disk storage subsystem
Key points covered in this module: Hosts typically have:
◦ Hardware: CPU, memory, buses, disks, ports, and interfaces
◦ Software: applications, operating systems, file systems, device drivers, volume managers
Journaling enables: ◦ very fast file system checks in the event of system
crash ◦ provides better integrity for file system structure
HBAs are used to connect hosts to storage devices
Components of a Host - 17
Interconnection between hosts or between a host and any storage devices
Physical Components of Connectivity are:◦ Bus, port and cable
Storage System Environment - 18
CPU HBA
Port
CableBUS
Disk
Connectivity - 19
Serial
Serial Bi-directional
Parallel
System Bus – connects CPU to Memory Local (I/O) Bus – carries data to/from
peripheral devices Bus width measured in bits Bus speed measured in MHz Throughput measured in MB/S
Connectivity - 20
Protocol = a defined format for communication between sending and receiving devices
◦ Tightly connected entities such as central processor to RAM, or storage buffers to controllers (example PCI)
◦ Directly attached entities connected at moderate distances such as host to storage (example IDE/ATA)
◦ Network connected entities such as networked hosts, NAS or SAN (example SCSI or FC)
Storage System Environment - 21
Tightly ConnectedEntities
DirectlyAttachedEntities
Network Connected
Entities
Connectivity - 22
Host
Apps
Operating System
PCI
SCSI or IDE/ATA Device Drivers
PCI is used for local bus system within a computer
It is an interconnection between microprocessor and attached devices
Has Plug and Play functionality PCI is 32/64 bit Throughput is 133 MB/sec PCI Express
◦ Enhanced version of PCI bus with higher throughput and clock speed V1: 250MB/s V2: 500 MB/s V3: 1 GB/s
Storage System Environment - 23
Integrated Device Electronics (IDE) / Advanced Technology Attachment (ATA)◦ Most popular interface used with modern hard disks◦ Good performance at low cost◦ Inexpensive storage interconnect◦ Used for internal connectivity
Serial Advanced Technology Attachment (SATA)◦ Serial version of the IDE /ATA specification ◦ Hot-pluggable◦ Enhanced version of bus provides upto 6Gb/s
(revision 3.0)
Storage System Environment - 24
Parallel SCSI (Small computer system interface)◦ Most popular hard disk interface for servers◦ Supports Plug and Play◦ Higher cost than IDE/ATA◦ Supports multiple simultaneous data access
◦ Used primarily in “higher end” environments ◦ SCSI Ultra provides data transfer speeds of 320
MB/s Serial SCSI
◦ Supports data transfer rate of 3 Gb/s (SAS 300)
Storage System Environment - 25
Most popular hard disk interface for servers Higher cost than IDE/ATA Supports multiple simultaneous data access Currently both parallel and serial forms Used primarily in “higher end”
environments
Connectivity - 26
Connectivity - 27
Target
Initiator
Connectivity - 28
Target ID
Initiator ID
LUNs
Initiator ID - a number from 0 to 15 with the most common value being 7.
Target ID - a number from 0 to 15 LUN - a number that specifies a device
addressable through a target.
Connectivity - 29
Initiator ID Target ID LUN
Host Addressing◦ Controller◦ Target◦ LUN
Connectivity - 30
c0 – Controller/Initiator/HBA
PeripheralController
t0
Target
LUNs
d0 d1 d2
c0 t0 d0
Pros:◦ Fast transfer speeds, up to
320 megabytes per second
◦ Reliable, durable components
◦ Can connect many devices with a single bus, more than just HDs
◦ SCSI host cards can be put in almost any system
◦ Full backwards compatibility
Cons:◦ Configuration and setup
specific to one computer◦ Unlike IDE, few BIOS
support the standard◦ Overwhelming number of
variations in the standard, hardware, and connectors
◦ No common software interfaces and protocol
Connectivity - 31
Connectivity - 32
Feature IDE/ATA SCSI
Connectivity Market Internal Storage Internal and External Storage
Speed (MB/sec) 100/133/150 320
Hot Pluggable No Yes
Expandability Easier to set up Very good but veryexpensive to set up
Cost/Performance Good High cost/Fasttransfer speed
Connectivity - 33
Bus
Disk
Cable
Host
Port
Port
HBA
CPU
Connectivity - 34
Fibre Channel
Storage Arrays
Host
AppsDBMS Mgmt Utils
File System
LVM
Multipathing Software
Device Drivers
HBA HBA HBA
SCSI◦ Limited distance◦ Limited device count◦ Usually limited to single initiator◦ Single-ported drives
Fibre Channel◦ Greater distance◦ High device count in SANs◦ Multiple initiators◦ Dual-ported drives
Connectivity - 35
iSCSI◦ Transport is over an IP network◦ SCSI Commands are exchanged over an IP
network Fibre Channel over Ethernet
◦ Tunnels fibre channel commands over IP
Connectivity - 36
Connectivity - 37
Switches Storage
Hosts
Magnetic Tape◦ Low cost solution for long term data storage◦ Limitations
Sequential data access, Single application access at a time, Physical wear and tear and Storage/retrieval overheads
Optical Disks◦ Popularly used as distribution medium in small, single-
user computing environments◦ Write once and read many (WORM): CD-ROM, DVD-ROM◦ Limited in capacity and speed
Disk Drive◦ Most popular storage medium with large storage capacity◦ Random read/write access
Ideal for performance intensive online application
Storage System Environment - 38
Key points covered in this lesson: Host components
◦ Physical and Logical Connectivity options
◦ PCI, IDE/ATA, SCSI Storage options
◦ Tape, optical and disk drive
Storage System Environment - 39
Disk drive components, Disk Drive Performance
Storage System Environment - 40
Upon completion of this lesson, you will be able to:
List and discuss various disk drive components◦ Platter, spindle, read/write head and actuator arm
assembly Discuss disk drive geometry Describe CHS and LBA addressing scheme Disk drive performance
◦ Seek time, rotational latency and transfer rate Law’s governing disk drive performance Enterprise flash drive
Storage System Environment - 41
Storage System Environment - 42
Interface
Controller
Power Connector
HDA
Physical Disks - 43
0011010011101010101000110100111010101010
10110101011010101010
01010100111010101010
Physical Disks - 44
Spindle
Platters
Physical Disks - 45
Physical Disks - 46
Actuator
Spindle
Physical Disks - 47
Actuator
R/W Head
R/W Head
Physical Disks - 48
Bottom View of Disk Drive
HDA
Controller
Interface
Power Connector
Physical Disks - 49
Sector
Track
Platter
Physical Disks - 50
Platter Without Zones
Sector
Track
Platter With Zones
Physical Disks - 51
Cylinder
Tracks, Cylinders and Sectors
Physical Disks - 52
Physical Address = CHS Logical Block Address = Block #
Sector
CylinderHead
Block 0
Block 16
Block 32
Block 48
Block 8
(lower surface)
Physical Disks - 53
A
Concatenation -
One Logical Volume
Partitioning -
Multiple Logical Volumes
ABC
D
Key points covered in this lesson: Physical drives are made up of:
◦ HDA Platters connected via a spindle Read/write heads which are positioned by an actuator
◦ Controller Controls power, communication, positioning, and
optimization Data is structured on a drive using tracks,
sectors, and cylinders The geometry of a disk impacts how data is
recorded on a platter
Physical Disks - 54
Disk Drive Performance Logical Components
Storage System Environment - 55
Upon completion of this lesson, you will be able to:
Describe the factors that impact the performance of a drive
Describe how drive reliability is measured
Physical Disks - 56
Seek time is the time for read/write heads to move between tracks
Seek time specifications include:◦ Full stroke◦ Average◦ Track-to-track
Physical Disks - 57
Physical Disks - 58
Physical Disks - 59
Request 1
Request 2
Request 3
Request 4
1234
Request 1
Request 2
Request 3
Request 4
1324
Without Command Queuing
With Command Queuing
1
2
34
1
2
34
Physical Disks - 60
InterfaceInterface BufferBufferHBAHBA
Disk Drive
Internal transfer rate measured here
External transfer rate measured here
Mean Time Between Failure Amount of time that one can anticipate a
device to work before an incapacitating malfunction occurs◦ Based on averages◦ Measured in hours
Determined by artificially aging the product
Physical Disks - 61
Consider a disk I/O system in which an I/O request arrives at a rate of 100 I/Os per second. The service time, RS, is 4 ms. ◦ Utilization of I/O controller (U=a × Rs) ◦ Total response time (R=Rs /1-U)
Calculate the same with service time is doubled
Storage System Environment - 63
0% 100%Utilization
Knee of curve: disks at
about 70% utilization
Low Queue Size
70%
Conventional disk drive Mechanical Delay associated
with conventional drive◦ Seek time ◦ Rotational latency
More power consumption due to mechanical operations
Low Mean Time Between Failure
Enterprise flash drive Highest possible throughput
per drive◦ No Spinning magnetic media◦ No Mechanical movement
which causes seek and latency
◦ Solid State enables consistent I/O performance
Very low latency per I/O Energy efficient storage
design◦ Lower power requirement per
GB of storage◦ Lower power requirement per
IOPS
Storage System Environment - 64
Drive is based on Flash Solid State memory technology◦ High performance and low latency ◦ Non volatile memory◦ Uses single layer cell (SLC) or Multi Level cell (MLC)
to store data Enterprise Flash Drives use a 4Gb FC interface
Storage System Environment - 65
Faster performance◦ Up to 30 times greater
IOPS (benchmarked)◦ Typical applications: 8 –
12X◦ Less than 1 millisecond
service time More energy efficient
◦ 38 percent less per terabyte
◦ 98 percent less per IO Better reliability
◦ No moving parts◦ Faster RAID rebuilds
Storage System Environment - 66
IO per secondR
esp
on
se T
ime
1 Flash drive
1@15K FibreChannel drive
10@15K Fibre Channeldrives
30@15KFibre
Channel drives
Position Enterprise Flash Drives as the high-performance option in demanding environments◦Low latency applications, also known as “Tier-0”
applications Standard form-factor and capacity design allows
for easier integration High performance, low power for a “Green”
initiative Target Customer/Market Segments:
◦ High performance solutions coupled with low power◦ Specifically target Oracle database customers initially◦ Financial trading◦ OLTP databases
Storage System Environment - 67
Key points covered in this lesson: Disk drive components and geometry Disk drive addressing scheme Disk drive performance Convention drive Vs Enterprise Flash Drives Enterprise Flash Drives for high
performance and low power storage solution
Storage System Environment - 68
Key points covered in this chapter: Storage system environment components:
◦ Host, connectivity and storage Physical disk structure and addressing Factors affecting disk performance Flash drives benefits
Storage System Environment - 71
What are some examples of hosts? What are the physical and logical
components of a host? What are the common connectivity
protocols used in computing environments? What is the difference between seek time
and rotational latency? What is the difference between internal and
external data transfer rates?
Storage System Environment - 72