cbsi 2011 0615 hp storage newlogo

8/6/2019 Cbsi 2011 0615 Hp Storage Newlogo

http://slidepdf.com/reader/full/cbsi-2011-0615-hp-storage-newlogo 1/57

1

www.hp.com



Top 10 Considerations for Maximized

Storage Security, Performance, andScalability

Welcome



Storage is not

an afterthought.

Storage is thought.



• The cloud is storage• Google is storage• Amazon is storage• YouTube is storage

What is storage?



• 490 million unique visitors• 2.9 billion hours spent on the site each month

24 hours of videouploaded each minute

YouTube is storage



• The cloud is storage• Google is storage• Amazon is storage• YouTube is storage• Facebook is storage

What is storage?



• The cloud is storage• Google is storage• Amazon is storage• YouTube is storage• Facebook is storage• Twitter is not storage

Twitter is flow

• eBay is not storage eBay is transactions

What is storage?



• 600 million users• Each user shares 90 items of content per month• 9.3 billion hours spent on the site each month• 50 billion photos• Hundreds of millions of requests per second• 130 terabytes of logs each day

2 trillion objects cached

Facebook is storage

SOURCE: Robert Johnson,

Facebook Director of Engineering



• A megabyte? A gigabyte? A terabyte?• What about a petabyte? Or an exabyte?• What the @&#% is an exabyte?• 1 quintillion bytes• 1 billion billion bytes (that’s 1B x 1B bytes!)• What does that even mean?

How much storage do we really need?



• Eight bits• One character• If data were money, what

would it buy you?• Let’s say each byte is

worth a penny

One byte0 1 0 0 0 0 0 1



• 140 characters(or 140 bytes)

One “tweet”

Let’s say a tweet is worth

140 pennies ($1.40)

Image courtesy CBS News



• 1,000 bytes• A few paragraphs of text

One kilobyte

Let’s say a kilobyte is worth1,000 pennies ($10)

Image courtesy Subway



Data multipliers

• For those curious, I went a bit nuts checking if bytemultipliers were 1024x the previous level or 1000x.

• Every source I found, including Google’s Chief Economist, Hal Varian, said it was 1000x.

• Hard drives makers, however, often like to use the1024x multiplier

• Which brings us to megabytes…



• 1,000 kilobytes• A photograph or about

30 seconds of an MP3

One megabyte

Let’s say a megabyte is worth1M pennies ($10,000)

MP3 image courtesy ZDNet

1998 Toyota Camry image courtesy eBay MotorsHandsome dude in shades image courtesy your esteemed speaker



Fundamental transition in data use

First Last Phone Street City State ZIP

Item # Name Desc Dept QTY Cost Price

From field-based data

Even as the per-terabyte price forstorage has been dropping

regularly over the past few years,

the demand for more and morecapacity has been increasing at a

ferocious pace. More powerfulprocessors, larger addressable

RAM address spaces, andvirtualized and parallel systems

have wildly expanded the scope ofwhat’s possible for many of the

most ambitious enterprise-level ITand research projects.

And text-based data to…



Unstructured media is the new dataWeb Pages Reports Photographs Digital Books Music and audio

Videos Television Movies

George Clinton image courtesy CBS News

How to Train Your Dragon courtesy ParamountOther images courtesy CBS Interactive and that speaker guy



Field data vs. media data

• This webcast will require about 200MB of storage

• Typical name and address record is 128 bytes

First

Last

Phone

Street

City

State

ZIP

One of these1.5 million

of these

vs.



Field data vs. media data

Media type Storage required Approx. # address records

Address record 128 bytes 1

Facebook photo 1MB 7,000

MP3 track 3.5 MB 27,000

This webcast 200 MB 1.5 million

DVD movie 4 GB 31 million

Blu-ray movie 20 GB 156 million

In the storage space required for one Blu-ray movie,

you could store name and address datafor every working American



• 1,000 megabytes• A TV show episode

One gigabyte

Let’s say a gigabyte is worth 1billion pennies ($10 million)

Hawaii Five-O courtesy CBS

Maryland estate image courtesy Zillow.com



Media vs. text

• Each second of HD video requires more than 2,000

times more data storage than a page of text



• 1,000 gigabytes

• About 120 DVDsor about 20 Blu-rays

One terabyte

Let’s say a terabyte is worth1 trillion pennies ($10 billion)1/5 Bill Gatesnet worth is $10B



Prediction from 1981

Creative Computing magazine

December 1981, page 6

“The cost for 128 kilobytes will fall belowU$100 in the near future.”

$781,250Disclosure: I was a contributing editor

for Creative Computing at that time.

At that rate, one terabytewould have cost



“Put it there”

Image and song title courtesy Paul McCartney Digital Library

• Paul McCartney DigitalLibrary

• Digitizing all images,recordings, music,concerts, videos

• Millions of old tapesstored under hisrecording studio

• Saving this great

resource in digital form



• 1,000 terabytes

• About 20,000 Blu-rays

One petabyte

Let’s say a petabyte is worth

1 quadrillion pennies ($10 trillion)

LoC image courtesy of VisitingDC.com

Maps courtesy CBS News

The Library of Congress hascollected about 235 terabytes

of data. A petabyte is 4x that.

$10 trillionis the entire

GDP of China

and Japan…combined



• 1,000 petabytes

One exabyte

Let’s say an exabyte is worth

1 quintillion pennies ($10 quadrillion)

Book stack image courtesy Flickr user 0olong

$10 quadrillionis 167 times

the totalworld GDP

An exabyte can hold about5x all the printed material

in the world.



We started with one byte, one character, one penny

Name Bytes

Byte 1Kilobyte 1,000

Megabyte 1,000,00

Gigabyte 1,000,000,000

Terabyte 1,000,000,000,000

Petabyte 1,000,000,000,000,000

Exabyte 1,000,000,000,000,000,000

Zettabyte 1,000,000,000,000,000,000,000

Yottabyte 1,000,000,000,000,000,000,000,000

167x

If data were money



How much storage do we need?

• Enterprises stored more than 7 exabytes of new data

on disk drives in 2010

• Consumers stored more than 6 exabytes on PCs andlaptops.

If all words ever spoken by humans weredigitized into text, they'd consume 5 exabytes,

only one exabyte less than what

consumers generate each year.

SOURCES:McKinsey Global Institute

How much information, UC Berkeley, Peter Lyman and Hal Varian



TIPS FOR IMPLEMENTING STORAGE

HANDS-ON

Image courtesy Google’s containerized data center,

Located somewhere in space, somewhere in time



Valuable career opportunity

• U.S. has analytics and informatics staffing shortfall

• Shortage of 140,000 to 190,000 people with deepanalytical skills

• Shortage of 1.5 million managers and analysts toanalyze big data and make decisions based on their

findings

• Learn analytics, statistics, mathematics, decisionanalysis, and data mining

SOURCE: McKinsey Global Institute



Storage is an economic resource

• Storage is not just about the tech

• It is a resource that needs to be managed

• It's a result of a manufacturing process

• It's used as feed into a manufacturing process

• Think of it as another economic raw material• Like oil and corn, it needs to be stored, moved, mixed,

processed, distributed, grown, and cleaned.



• Scale across many machines

• Rather than breaking code into modulesas a way of scaling, scale horizontally• There are only so many modules

• Be flexible, move fast• Change incrementally

• Measure everything• Remember that 130TB of daily logs?

• Use small, independent teams• Give control to those who are

responsible

How to scale, according to Facebook

SOURCE: Robert Johnson,Facebook Director of Engineering

Prineville Data Center image courtesy Facebook



• Storage• Content and data import• Processing and analysis• Indexing

• Retrieval• Query parsing• Matching against the stored data• Presentation

Don’t forget that higher -level apps are needed



Facebook’s three tiers of servers

SOURCE: Robert Johnson,




New storage demands among consumers

• In 2010, more than 4 billion people used mobile phones

• 480 million people have smartphones – Growing at 20% per year

• If the average low-end smartphone has 8GB storage – That’s 3.85 exabytes across all smartphones

– Next year, add another 768 petabytes

• Much of this will need to be mirrored in the cloud

• There’s a sobering preview of data center demand!

SOURCES:McKinsey Global Institute

Wolfram Alpha



How to be fully storage buzzword compliant

• DAS: Direct-Attached storage

What we’dnormally call

“the drives”

Image courtesy Flickr user S-a-S





• NAS: Network-Attached Storage – Old-school term: file server

– Connected via TCP/IP to network

– Often FreeNAS on an old PC

– Now, “appliances” available that make file storage plug-n-go

O i



David’s home office NAS cluster

20TB

Media& fileserverNAS

20TBMediabackupserverNAS

Videosync

DroboBackup

NAS

All other files sync PCsand

laptops

PCsand

laptops

PCsand

laptops

PCsand

laptops

PCsand

laptops

All files sync

Cloud BackupService

CloudExchange

Server

Email

On premiseOff-site





• NAS: Network-Attached Storage

• SAN: Storage Area network – Enterprise storage solution

– An array of storage devices live on their own network

– That network often acts as a NAS






• SAN: Storage Area network

• SCSI: Small Computer System Interface – Back in the olden days, how drives

attached to Macs

– Parallel interface to drives

– SCSI is also a set of commandsand interfaces still in use today

– Multi-drop (multiple devices chain)







• SCSI: Small Computer System Interface

• SAS: Serial-Attached “Scuzzy” – Point-to-point serial connection instead of parallel

– Single connection only

– Variety of different connector types







• SCSI: Small Computer System Interface

• SAS: Serial-Attached “Scuzzy”• iSCSI: SCSI over Internet protocol – Allows for very long-distance connections over IP

– Core component of many SANs



Network-attached storage and clustering

VM1 withclustering

aware OS

VM2 withclustering

aware OS

LUNs

Clusteringaware app

iSCSIInitiator

iSCSIServer

Network

VHD

VHD

VHD

Clusteringaware app

iSCSIInitiator

Best with clustering-aware application

This could be a fullFibre Channel SAN



Consolidated, integrated, converged infrastructure

• Allows all resources to be shared

• Resources can be shared, used as needed

• Resources dynamically reallocated – Storage

– Networking bandwidth – Applications

– Even power and cooling

• Silos become pools



Final thought

Robert Johnson,


“Seeing something you created be usedby half a billion people is awe inspiring

and humbling.”



Final thought

Robert Johnson,


“Seeing something you created be usedby half a billion people is awe inspiring

and humbling.

Seeing it break is even more humbling.”



Please submit your questions in the field provided atthe bottom of your player console

Questions and Answers



The Top 10 Considerations for

Maximized Storage Security,Performance, and Scalability

Thank you



www.hp.com

cbsi 2011 0615 hp storage newlogo

Documents