e2dc workshop 2013 kolias to present final

7/21/2019 E2DC Workshop 2013 Kolias to Present Final

1/29

Christos Kolias, Sr. Research Scientist

Network Architecture, Orange Silicon Valley

E2DC WorkshopACM e-Energy 2013

May 21, 2013 Berkeley, CA, USA

SDN & NFV for energy-efficientclouds

(from the smart grid to the smart shirt)


2/29

2Orange Silicon Valley


3/29


Trends, Challenges & Facts

Energy-Efficient Clouds (E2C)

Software-Defined Networking (SDN)

Network Functions Virtualization (NFV)

Next-generation Data Center

Conclusion

Menu


4/29

4

Orange, a worldwide presence

Orange Silicon Valley (OSV), a wholly

owned subsidiary of the Orange-FranceTelecom Group, is the Silicon Valleypresence of Orange

Internet, Fixed, Mobile, TV provider

Orangeis one of the major telcos, in 5continents, 32countries, 226 millioncustomers, 6 million businesscustomers

180,000employees and ~$ 57 b

revenues in 2012

Founding member of ETSI NFV. Memberof Open Networking Foundation (ONF)

Orange Silicon Valley


5/29

55

Trends

Deluge of data: Big Data & Big Data

Centers; small but many transactions

Mobility, explosion of devices and

traffic (video)

Cloud services Convergence of computing, storage

and networks

New virtualization technologies that

abstract underlying hardware

yielding elasticity, scalability and

automation

Software-defined networking

Energy efficiency

Cost-cutting in IT

Challenges

Data-intensive applications (hadoop)

Real-time processing, fast response

Storing/archiving huge amounts of

data

High availability

Ubiquitous connectivity

How to move network resources where

& when needed

Aging legacy data centers

Trends & Challenges



6/29


Factoids

Avg. power consumption per DC isequivalent to 25k households, in termsof CO2 emissions

DCs consume 2% of US total power;$2B/monthdoubles every 4-5 yrs

source: DCD Intelligence

63%

17%

Global Data Center power demand

Power costs for the data center equipment over its useful life toexceed the cost of the original capital investment

Data Center annual growth: 20%

Unprecedented surge in energyrequirements

Electricity costs is the dominantoperating expense

Amazons data centers energy-related costs>40% of total costs

source: DCD Intelligence

Data Center real estate

: outsourced


7/297Orange Silicon Valley

source: IDC

Worldwide IT Spending on Servers, Power,

Cooling and Management Administration

source: Info-tech Research Group

Typical Data Center Energy Consumption

PUE= 1/0.36 = 2.77

Data Center power use

source: Intel

Power allocation in the Data Center



Lessons from Energy-Efficient Technologies Eco-friendly energy generation: solar, wind, waves

Energy saving: insulation & Energy monitoring

Smart Grids

Data Center Low-power CPUs

Efficient power supplies Cooling

What about the Network Energy-Efficient Ethernet (EEE, 802.3az)

Power saving: virtualization Bandwidth monitoring

Smart Networks & Clouds

PUE most common metric for EE in data centers Avg data center PUE in US is ~ 1.8, higher elsewhere

Google is 1.12, FB 1.07 (using solar for the office space)

The Green Effect



Energy-Efficient Clouds

Energy efficiency: E2 = % of total energy required to support

useful traffic carried by a network

Energy efficiency involves all system components

Hardware (servers, networking)

Software (protocols, applications)

Physical (cooling, power generation, power minimization)

Energy-aware data centers/networks and applications

Virtualization (compute, storage, network) is key aspect in E2DC

Energy control policies required in addition to QoS/traffic, security policies Energy aware apps: can adjust their (idleness in ) workloads for power

management

Need to ensure a balance between energy efficiency and

performance



Energy-saving techniques

Power-aware computing (CPU, disks, communication devices/links)

Clock gating: slowing down CPU clock speeds

Power gating: powering off parts of the chips (if idle) Energy analyzer and optimizer

Energy-aware resource management, scheduling and provisioning

Partition workloads (load balancing)

Move peak loads in the cloud as to maximize performance

Scheduling tasks for multiprocessors

Consolidation (equipment, data centers, data, applications)

Even when run at low utilization servers consume up to 70% power

Less redundancy required

Wireless Networks are ripe for energy savings Even when idle, typical base station may use 70-80% of its power

Savings of the order of 20% can be achieved in server and

network energy consumption, Data Centre Energy Forecast

Such savings can bring additional 30% saving in cooling needs


12/2912

People want to control their own network


Software-Defined Networking (SDN)

SDN supports the abstraction of the control plane

from the data plane

Users can define (their) traffic flows and decide how

these are treated in the network

Supports programmability for hardware


13/2913source:ONFOrange Silicon Valley

Why SDN

Todays boxesare closed & proprietary

I want to add a new service/capability but my equipment (h/w & s/w) has

to support ithard and risky to innovate

No elasticity. Too much complexity.

Challenges from mobile growth to big data and cloud computing

Poor resource utilization

Create an abstraction thatyields a logical view of thenetwork (topology & resources)

Network programmability Open APIs


14/2914

Protocol for an SDN, standardized by ONF

Built around the concept of traffic flows

identify flows (matching, statistics)

dynamically manage flows (action)

Firmware. Vendor-enabled. Main components:

flow table: incoming packets header matched against flow entry,take action (e.g. send to port 5 or block it, etc)-resides in switch

controller:

- software (e.g., residing outside switch/router)

- decides on actions, inserts flow entries, programmable

protocol (for controller-switch communication, secure)

Classical

Architecture

ControlPlane

Data

Plane

Switch/Router

Proprietary

Bus

OpenFlow

Protocol

Control

Plane

Data

Plane

Switch/Router

Control

Plane

Data

Plane

Switch/Router

Controller

open i/f

OpenFlow

in_port MAC_src MAC_dst IP_src IP_dst Action Stats

4 * 00:1f.. 1.2.3.4 5.6.7.8 port 5 & 6 1000

20 * * * 2.3.4.5 drop 4

12 * * * * controller 235

1 7e:4b.. 5a:2c.. 6.7.8.1 * port 1 37

8 6b:11.. 01:ab.. 8.7.6.5 4.3.2.1 all ports 89Orange Silicon Valley



OpenFlow Network

Controller

PC

OpenFlowAccess Point

Server room

OpenFlow-enabledCommercial Switch

Flow

Table

SecureChannel

NormalSoftware

Normal

Datapath

OpenFlowswitch

OpenFlowswitch

Add/delete flow entry Encapsulated packets

Controller discovery

OpenFlowswitch

OpenFlowswitch

OpenFlowswitch

flow_A

flow_B

OF allows to monitor the network and takeinstant action (programmatically)



Programmable platform brings agility & elasticity into network

Allows for optimization & customization: Build Your OwnRouter, Firewall, Load Balancer, DPI, WAN Accelerator

Supports intelligent management of traffic flows

Enabler for network virtualization. Great tool for cloud

management. Deploy new, on-demand, tailored services & apps

Resource discovery and monitoring

Unified method for traffic engineering, network management Great tool for (live) VM migration across network boundaries

It is all about empowering the administrator/operator, user

More choices, more control

Define your own rules/policies

Benefits of SDN


17/2917

Elastic Capacity: Bandwidth-on-Demand (BoD)

Dealing with traffic spikes

Dynamic Bandwidth allocation/scheduling

who gets what, when & for how long

choose level of granularity

automation, calendaring

Resource optimization

pooled capacity

bundling (aggregation)/unbundling as needed

Coupling capacity with time-varying traffic demand

Active monitoring and real-time response

set up thresholds

programmable alerts

Physical Layer: single radio channel, optical wavelength (or a

band)

Bandwidth Management


kbps



Overprovisioned networks, with extra capacity

Network is often underutilized (but designed to

handle peaks/failures)

Dynamically adjust network elements tosave energy

Activate/deactivate devices, cards, ports on a need-basis

Software-controlled, e.g.: program capacity depending on energy-saving needs/modes

Todays devices are not energy-proportional

Fans, chips, interfaces waste power at low-loads

Software components/features not always needed

Elastic Tree: prototype testbed using OpenFlow

Benefits: less power consumption, cooling, less hardware failures,

improved redundancy

Power Management



Network Functions Virtualisation is about implementing networkfunctions in software - that run today on proprietary hardware -leveraging (high volume) standard servers and IT virtualization

Advances in virtualization & server technologies have propelled theimportance and use of software in many applications and fields

Facilitates innovation towards new network functions and servicesthat are only practical in a pure software network environment

Gives rise to the virtual (network) appliance (VA)

Automation of management and configuration of functionsimportant for NFV to scale

SDN can be a significant enabler for NFV

NFV aims to ultimately transform the way network operatorsarchitect and operate their networksthough change will beincremental

Network Functions Virtualisation (NFV)


20/2920

Network Functions Virtualisation: Vision

Classical Network Appliance

Approach

BRAS

FirewallDPI

CDN

Tester/QoE

monitor

WAN

AccelerationMessage

Router

Radio/Fixed Access

Network Nodes

Carrier

Grade NAT

Session Border

Controller

PE RouterSGSN/GGSN

Fragmented non-commodity hardware.

Physical install per appliance per site.

Hardware development large barrier to entry for

new vendors, constraining innovation & competition.

Network Functions

Virtualisation Approach

High volume Ethernet switches

High volume standard servers

High volume standard storage

Orchestrated,

automatic & remote install.

Competitive&

Innovative

OpenEcosyst

em

IndependentSoftware Vendors

EPC



21/2921

Recent tests have demonstrated network

functions can operate at the level of several

millions of packets per sec, per CPU core

Demonstrates that servers have sufficient

processing performance to cost-effectively

virtualise network appliances

Why we believe NFV is the future for Networks

The hypervisor need not be a bottleneck The OS need not be a bottleneck

Reduced CapEx/OpEx; consolidation of devices (ease of management)

dramatic energy savings

Faster time-to-market

In November 2012 we formed the NFV ISG under ETSI

More than 100 members, more than 20 operators

Goal: deliver requirements and framework for NFV

[source=BT]



22/2922

Virtual Data Center (VDC): using virtualization technologies and

cloud solutions to emulate your racks in a highly efficient,

optimized environment

Make physically dispersed hw/sw operate logically as one DC

Virtual servers, virtual storage, virtual networking

Multi-tenancy

DR/BC: ability to redeploy fast (e.g., Japan earthquake)

Cloud-wide management system: allocation, management &

orchestration of resources. Virtual Data Centers (VDC) will be the

basis of the new cloud.

SDN can fundamentally change the way we design and build data

centers Deeply programmable and virtualized

Applications/services awareness

Resource optimization (compute, storage, compute). Enhanced policy

(routing, TE, security) management

VDC: the new norm for the Cloud


Software-Defined Virtual Data Centers will be the basis

of the New E2 Cloud


23/2923

The Future Cloud Architecture

Ideally, the user should be able to specify his application demands (broadcast election video coverage for 12 hours and 50m

subscribers) and the cloud should broker the specific resource needs (capacity, storage, bandwidth, etc)

SDNController

Cloud

Maestro

SDN API

Network

Virtualization

Cloud

Broker

Smart Cloud

I want a

cloud

Cloud

Cloud Management Plane

Cloud API

Server

Virtualization

Storage

Virtualization

Cloud App

Cloud API Cloud API

Cloud AppCloud App

Network Virtualization Plane




The Next Generation Data Center

Green (energy star equipment), self-contained

100% virtualized

Intelligently controlled

Automation

Optimized, efficient

Extremely modularized

Consolidation, VDC

Application-aware networking

Facebook builds its 4th data center, super-energy efficient, $1.5B,

1.4m f2, in Iowa. IO gets a $260 credit line

source: Cisco


25/29

25

Energy efficiency very important

Activity scheduling for energy saving; power control

Flexible, smart devices/objects

Applications

Home automation: programmable HVAC, appliances, smart LEDs

M2M Sensors: from temp gauges to sprinklers

Wearable technologies (dress smart: glasses, shoes, shirts, watches)

Enablers: software, mobile devices, sensor networks, wireless

networks, cloud computing, geo-location

Software-Defined Environment

eg, re-programmable & reconfigurable SDBs)

Smart Cities

Internet of Things (IoT)



26/29

26

GreenTouch: consortium of ICT stakeholders (industry, government,

academia, research)launched in 2010, funded by >50 companies

Mission: deliver the architecture, specifications and technologies

needed to increase energy efficiency by a factor of 1000 compared to

2010 levels

Objectives & benefits

Reinvention of todays telecommunications networks; design new

architectures, communication protocols, etc.

Demonstrate those key components for making network more E2

Make network & internet sustainable

Applicable to both wired & wireless/mobile networks; mobile networks can

benefit the most

Effectively cut carbon emissions of ICT networks by more than 250m tons a

year

Prediction: energy consumption in overall networks can be reduced by

90% by 2020!

GreenTouch



27/29

27

SDN brings automation, orchestration, optimization, scale,

programmability and customization to the network

NFV brings server virtualization, commoditization in the (service

provider) network

Dedicated hardware gives way to the virtual network appliance

Both SDN & NFV can be huge energy savers

It is the power of software

Make your network more intelligent. Smart devices & apps* need

smart networks!

Smart means with low carbon footprint

Key Takeaways


*app= application or appliance

(but be aware of bugs and hackers!)


28/29

28

SDN is like a buffet !

NFV is like

You need soda to digest afterall


single hardware,

many services

mix & match

centralized

control

customization

self-provisioning

automation

elastic

customization


29/29

[email protected]

thank you& bon appetit !

e2dc workshop 2013 kolias to present final

Documents