Download - Is It Time to Go Global with Cloud Performance Management?

.

Mission Statement

1. federated clouds = diversification2. many DCs and/or cloud providers

3. we care mostly about performance4. practical solutions are needed

Marat Zhanikeev -- [email protected] Is It Time to Go Global with Cloud Performance Management? -- http://tinyurl.com/marat140328 2/30...

2/30

.

Example: BizStore


3/30

.

BizStore: One DC is Not Enough

• rememberJune 2013?• most services today use vertical intergration -- no diversity

• Hitachi does not share DCs with NEC

• regional diversity of one provider is bad◦ how many Amazon DCs in Japan?

.(the only possible) Solution..

.

... is to sign contracts with multiple DCs and manage on

client side◦ to be officially presented/released in April 01

01 myself+0 "High Availability Cloud Storage ... Social Graph ... Smart Distribution" NS研 (April 2014)


4/30

.

BizStore: One DC is Not Enough

Kansai

DC1

Okinawa Locations

Data Centers

DC2

Kyushu

Osaka Office DC1

DC1 DC2 Naha Office

Network distance

Network distance

storage network

Employee A …. Content / Social Metadata High Availability Data Store DC1 DC2 ….

DC1 DC2 Business trip

Store APIs

Proposed Software


5/30

.

BizStore: Store Diversification

• in software: not a priority list -- optimization engine!• realtime performance monitoring, read/write optimization, etc.

• sub-file data unit -- chunks

SSD Growing network

distance User

HDD DC1 DC2 …

Network


6/30

.

BizStore: Socially Aware Store• content relevance based on

social graph• relevance is a distribution• individual redundancy based on distribution

• other link types: same time, location,filetype, ...

• link strengh != 1Descending

order

Relevance

Distribution

Redundancy (user setting)

Physical limit of redundancy

End of content

There is a link

When a file is …

Between Created Viewed Edited Deleted


7/30

.

Example: Cloud Streaming


8/30

.

Cloud Streaming: Fixing Problems

Traditionalstreaming

P2Pstreaming

Cloud streaming

Adaptivestreaming

• Congestion(Flash Crowds)

• Unreliable throughput

• Unreliable sources

• Unreliable throughput

• Congestion

Fixed Fixed

Fixed

Fixed


9/30

.

Cloud Streaming: Design

VMpopulation

CurrentSources

ServiceProvider

(SP)

Tracker

ServiceProvider

(SP)

Parentpeers

P2Pstreaming

Cloudstreaming

ClientClient

02 myself+0 "Multi-Source Stream Aggregation in the Cloud" Wiley Book on ACDN, Chapter 10 (2014)


10/30

.

Practical Solutions for FederatedClouds


11/30

.

A Shortlist of (S)olutions

1. S1: Nextgen traffic processors at DCs

2. S2: QoS Context and Performance Visualization at DCs

3. S3: Performance Modeling for Federated Clouds

4. S4: Client Side Traffic Boostings5. .... definitely not a complete list


12/30

.

Solution (S) 1:Nextgen Traffic Processors at DCs(work in progress)


13/30

.

S1: Multicore Packet Capture

Global Networks

Data Center Internals

Gateway Switch

Capture Manager

CPU CPU CPU

CPU CPU CPU

… Storage

Mirror

• multicore is the key

• multicore !=traditional parallel processing03

• on-demand capture, DPI,heterogeneous tasks 04

03 myself+0 "...Multicore Capture in Data Center Forensics" ACM AISACCS-SFCS (June 2014)

04 myself+0 "A Lock-Free Shared Memory Design for ... Multicore Packet Traffic Capture" IJNM (in print)


14/30

.

S1: Multicore Hates Memory Locks• lockfree design 04 : no messages, no memory locks

PF_RING

PF_RING

TimeManager

Shared Memory

Capture

Capture

…

Core 1

Core 2

Core 3

….

Core X Manager

PF_ RING

Shared memory

One thread

Create

Fork

Lifespan Stale check

Process/wrap Wrap wait

Doub

le-L

inke

d Li

st (D

LL)

Assign

04 myself+0 "A Lock-Free Shared Memory Design for ... Multicore Packet Traffic Capture" IJNM (in print)


15/30

.

Solution (S) 2: DC Performance APIs


16/30

.

S2: E2E QoS, M2M Patterns

Meter Merger

Per flow statistics

Analyzer

History,state

Profiler

UDP

Users

Clients

Probe Analysis machine

Web application

• clean slate: captureQoS context 05

• visualize usercommunities

• export via APIs to usersand/or service providers

05 myself+0 "A holistic community-based architecture for measuring E2E QoS at data centres" IJCSE (in print)


17/30

.

S2: Has to be a Clean Slate

ProbeRouter

Data center infrastructure

source IP

timestamp Key Key DLL0 #01 #02 #03 1 #042 #05 #06….….2^24 #07

source portdest IP

dest port

protocolpacket size

CRC24

Packet Hash table

#01

DLL#05#04

#02#03#07

Exportover UDP

Byte048

12162024…

0 (bits) 32

Source port Dest port

Source IPDestination IP

* psize pspace

Start time (s)Start time (us)

* psize pspace1 11

Data unit

psize:Packet size

pspace:Packet space

(us)

#06

Exportvia

a file

UDP RX

Buffer (5s)

Byte048

12162024…

0 (bits) 32

Source port Dest port

Source IPDestination IP

D psize pspace

Start time (s)Start time (us)

D psize pspace1 11

Data unit

D:Direction(0 or 1)

Merger

Find flow fromopposite direction

Analyzer

History

State

Read and update

Ring buffer of data units per IP on internal networks

Statistic MeaningMinOWD Global minimum OWDMaxBatch Max byte count of a

packet burstBulks Throughputs in flows

Per source-dest pair

• has to be a clean slate!• cisco, ntop, sflow are notfeasible

• QoS context is somethingnew

• (figure is vector, so, zoom in!)


18/30

.

S2: But Payoff is Great!

0 6400 12800 19200Batch size (bytes)

0

800

1600

2400

3200

4000O

WD

(ms)

+ T

X tim

e (x

0.1m

s)


19/30

.

Solution (S) 3: Cloud Weather System(work in progress)


20/30

.

S3: Cloud Weather System

(high/low)Pressure

front

Typhoon

Drought

Goodweather

Badweather

• continents: user, services 07

• water: network• weather, clouds, etc.: changes inperformance

• droughts: insufficiency ofinfrastructure, users do not get enoughcapacity

• typhoons: basically, Flash Crowds inservices, going viral, ...

• forecasting: possible with enoughperformance monitoring, similar to stockmarket

07 myself+0 "Cloud Weather System as a Futuristic Performance Model" IEICE総合大会 (March 2013)


21/30

.

Solution (S) 4: Mobile ThroughputBoosters


22/30

.

S4: Mobile Throughput Booster

• so far, only possible in wireless -- WiFi Direct

Single Connection Multipath

Singular Connectivity

Traditional Applications

Traditional Multipath

Multiple Connectivity

No known cases (wasted potential)

Group Communication 3G/LTE/* + WiFi Direct THIS PROPOSAL


23/30

.

S4: Group Resource Pooling

Remote connectivity Local Connectivity

Content Provider

Main Client

Delegated Client

Delegated Client

3G/LTE/* Access 3G/LTE/*

Access


24/30

.

S4: Converged Wireless Campus

Student

Develop, make secure

APP + CODE

Campus

Another Student

APP + CODE

APP + CODE

1

2 2 Distribute

3 Meet and delegate

API Tokens

API Tokens

Distribute

Pass at delegation

University 4


25/30

.

Solution (S) 5: Over-the-NetworkIndexing


26/30

.

S5: Indexing in Clouds

Data

Indexer

Index

Network

Traditional Client

Data

Indexer

Index Read, Write

Stringex Client

The


27/30

.

S5: Over-the-Network Optimization• in short: throughput-centric network storage optimization 08

Stringex

Index

Stringex Client

The

Sync Engine

Optimization

Local Cache

Check 1 2

Use

08 myself+0 "A New Practical Design for Browsable Over-the-Network Indexing" ISEEE (April 2014)


28/30

.

S5: Performance

3.15 3.85 4.55 5.25 5.95 6.65Index Size (log)

2.55

2.65

2.75

2.85

2.95

3.05

3.15

3.25

Thro

ughp

ut (l

og o

f byt

es/d

oc)

Lucene

Stringex


29/30

.

That’s all, thank you ...


30/30

.

[01] myself+0 (April 2014)High Availability Cloud Storage ... Social Graph ... Smart DistributionNS研

[02] myself+0 (2014)Multi-Source Stream Aggregation in the CloudWiley Book on ACDN, Chapter 10

[03] myself+0 (June 2014)...Multicore Capture in Data Center ForensicsACM AISACCS-SFCS

[04] myself+0 (in print)A Lock-Free Shared Memory Design for ... Multicore Packet Traffic CaptureIJNM

[05] myself+0 (in print)A holistic community-based architecture for measuring E2E QoS at data centresIJCSE

[06] myself+0 (May 2014)Marat Zhanikeev -- [email protected] Is It Time to Go Global with Cloud Performance Management? -- http://tinyurl.com/marat140328 30/30

...

30/30

.

Towards a Practical Method for Interactive Traffic Visualizations in Data CentersSC研

[07] myself+0 (March 2013)Cloud Weather System as a Futuristic Performance ModelIEICE総合大会

[08] myself+0 (April 2014)A New Practical Design for Browsable Over-the-Network IndexingISEEE


30/30

Download - Is It Time to Go Global with Cloud Performance Management?

Top Related