101 ab 1445-1515

40
© Copyright 2012 EMC Corporation. All rights reserved.

Upload: chiou-nan-chen

Post on 18-Nov-2014

372 views

Category:

Documents


3 download

DESCRIPTION

 

TRANSCRIPT

© Copyright 2012 EMC Corporation. All rights reserved.

© Copyright 2012 EMC Corporation. All rights reserved.

ACCELERATE SUCCESS IN THE NEW WORLD OF

BIG DATA EMC Isilon Scale-Out Storage

© Copyright 2012 EMC Corporation. All rights reserved.

大資料的定義

AWS(亞馬遜網路服務):任何超過了一台電腦處理能力的龐大資料量。

– 大資料是最大的宣傳技術、是最時髦的技術,當這種現象出現時,定義就變得很混亂。

– 三大挑戰:大資料使用的三個術語都含有字母“V”:volume(數據量大),velocity(數據增長速度快)和variety(數據種類繁多).

– 第四個V:vendor

大資料不是關於如何定義,最重要的是如何使用 – 最大的挑戰在於哪些技術能更好的使用資料

– 大數據的應用情況如何

– 不是IT部門發現大資料,而是業務部門。

© Copyright 2012 EMC Corporation. All rights reserved.

大資料處理特點

它能處理幾乎各種類型的海量資料,無論是微博、文章、電子郵件、文檔、音訊、視頻,還是其它形態的資料。

它工作的速度非常快速:實際上幾乎即時。

它具有普及性:因為它所用的都是最普通低成本的硬件

事實上大資料處理並非一項新的技術,它僅僅是小部分技術的一個術語簡稱。其中的某些技術已經與我們生活了數度春秋,然而時間推移到2012年,其中更小的部分技術就讓大資料一下子火了起來。

© Copyright 2012 EMC Corporation. All rights reserved.

Sources: “How Much Information?” Peter Lyman and Hal Varian, UC Berkeley,. 2011 IDC Digital Universe Study.

IN 2000 THE WORLD GENERATED

TWO EXABYTES OF NEW INFORMATION

© Copyright 2012 EMC Corporation. All rights reserved.

Sources: “How Much Information?” Peter Lyman and Hal Varian, UC Berkeley,. 2011 IDC Digital Universe Study.

IN 2000 THE WORLD GENERATED

TWO EXABYTES OF NEW INFORMATION

EVERY DAY

© Copyright 2012 EMC Corporation. All rights reserved.

In 2012, 80% Of New Storage

Capacity Installed Will Be For

FILE-BASED DATA

Source: IDC, 2011

© Copyright 2012 EMC Corporation. All rights reserved.

Big Data World…Requirements

OPERATIONAL SIMPLICITY

HIGH EFFICIENCY

HIGH PERFORMANCE

MASSIVE SCALE

Big Data

© Copyright 2012 EMC Corporation. All rights reserved.

Enterprise IT World…Requirements

PREDICTABLE PERFORMANCE

INTEROPERABILITY DATA

PROTECTION

DATA SECURITY

Enterprise IT

© Copyright 2012 EMC Corporation. All rights reserved.

These Two Worlds are Converging

Enterprise IT

Big Data

Scale-Out IT

© Copyright 2012 EMC Corporation. All rights reserved.

Typical Scale-Out IT Applications

VIRTUALIZED EVERYTHING

LARGE-SCALE ANALYTICS

HIGH PERFORMANCE

ARCHIVES

MASSIVE HOME DIRECTORIES

Scale-Out IT

© Copyright 2012 EMC Corporation. All rights reserved.

All Data Faster Answers Elastic & Scalable 1

The Journey To Big Data

Big Data Infrastructure Technology Focus

Analytics Engines

Cloud Infrastructure

Analytic Engines

© Copyright 2012 EMC Corporation. All rights reserved.

All Data Faster Answers Elastic & Scalable 1

The Journey To Big Data

2 Data Science Collaboration Self-Service

Agile Analytics People & Productivity Focus

Analytic Productivity Platform

Agile Process & Tools

Big Data Infrastructure Technology Focus

Analytics Engines

Cloud Infrastructure

Analytic Engines

© Copyright 2012 EMC Corporation. All rights reserved.

All Data Faster Answers Elastic & Scalable 1

The Journey To Big Data

2 Data Science Collaboration Self-Service

Agile Analytics People & Productivity Focus

Analytic Productivity Platform

Agile Process & Tools

Big Data Infrastructure Technology Focus

Analytics Engines

Cloud Infrastructure

Analytic Engines

© Copyright 2012 EMC Corporation. All rights reserved.

Old Analytic Processes

Administrator Bottleneck

Opaque, No Collaboration

Reactive, Unresponsive

© Copyright 2012 EMC Corporation. All rights reserved.

Shouldn’t Collaboration Work More Like Facebook ? (purchased 28P isilon)

© Copyright 2012 EMC Corporation. All rights reserved.

Facebook資料分析(一)

© Copyright 2012 EMC Corporation. All rights reserved.

Facebook資料分析(二)

© Copyright 2012 EMC Corporation. All rights reserved.

Facebook数据分析(三)

© Copyright 2012 EMC Corporation. All rights reserved.

Iterative, Agile

Self-Service

Transparent, Real Time Collaboration

New Analytic Processes Are Different

© Copyright 2012 EMC Corporation. All rights reserved.

The Organization Must Evolve From This…

Line Of Business User

Business

I.T. Department

Database Administrator

Business Intelligence Analyst

© Copyright 2012 EMC Corporation. All rights reserved.

To A Data Science Team

Line Of Business User

Data Platform Administrator

Business Intelligence Analysts

Data Scientists

© Copyright 2012 EMC Corporation. All rights reserved.

All Data Faster Answers Elastic & Scalable 1

The Journey To Big Data

2 Data Science Collaboration Self-Service

Agile Analytics People & Productivity Focus

Analytic Productivity Platform

Agile Process & Tools

3 Real Time Decisions New Applications Data Monetization

Predictive Enterprise Application Focus

Big Data Enabled Apps

Big Data Infrastructure Technology Focus

Analytics Engines

Cloud Infrastructure

Analytic Engines

© Copyright 2012 EMC Corporation. All rights reserved.

Predictive. Embedded.

© Copyright 2012 EMC Corporation. All rights reserved.

All Data Faster Answers Elastic & Scalable 1

The Big Data Stack

2 Data Science Collaboration Self-Service

Agile Analytics People & Productivity Focus

3 Real Time Decisions New Applications Data Monetization

Predictive Enterprise Application Focus

Big Data Infrastructure Technology Focus

Self-Service(互動,共用式) Iterative, Agile Transparent, Real-time Collaboration

Predictions Built-In Data At The Point Of Decision Scale Big Data Insights (即時展現)

Analytic Productivity Platform

Agile Process & Tools

Big Data Enabled Apps

Analytics Engines

Cloud Infrastructure

Analytic Engines Structured & Unstructured Data Analyze Petabytes Of Current Data Virtual, Scale Out Architecture 易擴展(容量,性能),易管理,安全 提供多種資料介面方式

© Copyright 2012 EMC Corporation. All rights reserved.

Your Approach To Enterprise Storage Must Change

Big Data Apps Require Big Data Storage

Storage Islands

More Capacity, More Admins

Performance Optimization “Whack-A-Mole”

One Storage Pool To 10+PB

More Capacity, Same Admins

Linear Performance Scalability

Scale Up, Manual Scale Out, Automated

© Copyright 2012 EMC Corporation. All rights reserved.

EMC Isilon Scale-Out Storage

© Copyright 2012 EMC Corporation. All rights reserved.

The EMC Isilon Advantage For The World Of Big Data

Scales To Over 15 PB In A Single File System

Single File System, Single Volume, Global Namespace

>80% Storage Utilization & Automated Storage Tiering

1.6 Million CIFS File Operations Per Second

© Copyright 2012 EMC Corporation. All rights reserved.

The EMC Isilon Advantage For The World Of Enterprise IT

Support For Industry-standard Protocols: NFS, SMB, HTTP, FTP And iSCSI;

World’s Only Scale-out Storage System With Native Hadoop HDFS Support

N+1 Through N+4 Redundancy; Efficient Snapshot Data Back-up and Restore; Rapid Data Replication for Disaster Recovery Protection

WORM Data Retention, RBAC, Authentication Zones

>100GB/second Throughput

© Copyright 2012 EMC Corporation. All rights reserved.

OneFS Scale-Out Operating System

EMC Isilon Core Innovation

© Copyright 2012 EMC Corporation. All rights reserved.

Linear Scaling Of Performance And Capacity

The Isilon Hardware Family Perf

orm

ance

Capacity

S-Series

PERFORMANCE

X-Series

FLEXIBILITY

NL-Series

CAPACITY

© Copyright 2012 EMC Corporation. All rights reserved.

Best-Of-Breed Capabilities For The Needs Of Scale-Out IT

Introducing OneFS “Mavericks”

PERFORMANCE

INTEROPERABILITY

DATA PROTECTION

DATA SECURITY

PERFORMANCE

MASSIVE SCALE

EFFICIENCY

OPERATIONAL SIMPLICITY

OneFS “Mavericks”

© Copyright 2012 EMC Corporation. All rights reserved.

Increase Productivity & Unlock New Opportunities

OneFS “Mavericks” Performance

50% Less Latency

724MB/s Single Stream

1.6M IO/s World’s Fastest NAS

106GB/s Concurrent

Big Data Performance

Throughput

Enterprise IT Performance

Random/IO Intensive

© Copyright 2012 EMC Corporation. All rights reserved.

New Snapshot Restore

Lower Risk For Business Critical Data

OneFS “Mavericks” Data Protection

Fast

Efficient

Simple

© Copyright 2012 EMC Corporation. All rights reserved.

Lower Risk For Business Critical Data

OneFS “Mavericks” Data Protection

New York London New One-Click Failover/Failback

Full SnapshotIQ™ Integration Identifies Changes

Improved RPO/RTO

For Business Continuance

Multi-Threaded, Multi-Node Scale-Out Replication

© Copyright 2012 EMC Corporation. All rights reserved.

Secure Separation

New Roles-Based Administration

Administration & Data Access Separated

Meets Enterprise Governance & Compliance Requirements

OneFS “Mavericks” Security

Secure Compliance

New Compliance SmartLock™

SEC 17a-4 Regulation

Secure Isolation

New Authentication Zones Legal

IT

Accounting

Marketing

Accounting Legal

IT Marketing

© Copyright 2012 EMC Corporation. All rights reserved.

Scale-Out NAS For Virtualization. Simplified Management.

OneFS “Mavericks” Application Integration

CIFS NFS

FTP HTTP

HDFS (Hadoop)

VAAI VASA

OneFS API

VAAI – Vstorage APIs For Array Integration

VASA – Vsphere APIs For Storage Awareness

Virtual Server Writeable Clones

Latency Improvements

New Levels of VMware integration

Simple

Platform OneFS REST API

Simplifies Management And Integration

3rd-Party Application Integration For Unique Value Proposition

Flexible

38 © Copyright 2012 EMC Corporation. All rights reserved.

For More Information Web: www.isilon.com/onefs-directions

Email: [email protected]

Blog: www.isilon.com/blog

Web: www.emc.com/bigdata

© Copyright 2012 EMC Corporation. All rights reserved.

THANK YOU!