Central Office Re-architectedas a Datacenter (CORD)
Larry PetersonOpen Networking Lab(In collaboration with AT&T)
Mission – To bring openness and innovation to the Internet and Cloud
History – A non-profit corporation, spun out of Stanford to catalyze SDN Parallel organization to the Open Networking Foundation (ONF)
Team – 25 Engineers + Visiting Engineers + Student Interns
Partners – AT&T, NTT, SKT NEC, Ericsson, Huawei, Cisco, Fujitsu, Intel, Ciena
Projects – Open Network Operating System (ONOS) & OpenCloud (XOS)
Open Networking Lab
Large number of big facilities
AT&T alone operates 4-5k Central Offices
Evolved over the past 40-50 years
Not architected as a single coherent facility
Source of huge CAPEX/OPEX costs
Especially when compared to OTT cloud providers
Telco Central Office
Terminates subscriber connections10-100k per Central Office
Terminates metro networks and enterprise linksSONET and Carrier Ethernet
Connects to backbone networksOptical and transport termination
Connects cellular networksBackhaul termination, S-GW, P-GW, MME,…
Provides range of servicesVoice, Video, Data
Inside a Central Office
GP
ON
(Acc
ess)
RO
AD
M(C
ore)
Commodity Servers, Switches, and Storage
Central Office Re-architected as a Datacenter
PONOLT MACs
Cloud Management and Service Orchestration
Leaf-SpineFabric
SDN NFV
Cloudabout best practices in scaling functionality
about treating the network’s data plane as a programmable function
about treating the network’s control plane
as a programmable function
Converging Threads
Reduce CAPEX with virtualized commodity hardware
Reduce OPEX with automated service orchestration
Accelerate time-to-market for new services
Add value to existing OTT cloud services
Leverage SDN, NFV and modern datacenter technologies and best practices
Value Proposition
Source of technology to reduce CAPEX/OPEXe.g., virtual machines, virtual networks, elastic scaling
Source of services to offer subscribersGlobal Cloud Servicese.g., CDN, NoSQL DB, Analytics, Internet-of-Things
Control Plane Servicese.g., VPN, Q-in-Q Termination, MPLS Tunneling
Data Plane Servicese.g., Parental Control, NAT, WAN Acceleration
SDN x NFV x Cloud
Residence/Enterprise Central Office
CPE ONU OLT ETH AGG BNG
Devices We Want to Virtualize
Acronyms• CPE – Customer Premises Equipment• OLT – Optical Line Termination • BNG – Broadband Network Gateway
BackboneCore
DataCenter
Residence/Enterprise Central Office
CPE ONU OLT ETH AGG BNG
Devices We Want to Virtualize
BackboneCore
NATDHCPVoIPFirewallParental Control…
DataCenter
Residence/Enterprise Central Office
CPE ONU OLT ETH AGG BNG
Devices We Want to Virtualize
BackboneCore
AuthorizationPhysical Connect Point…
DataCenter
Residence/Enterprise Central Office
CPE ONU OLT ETH AGG BNG
Devices We Want to Virtualize
BackboneCore
QoSVPNGRE TunnelingMPLS TunnelingQ-in-Q Termination…
DataCenter
TLA vTLA = Merchant Silicon+ SDN Control Function (App running on ONOS)+ NFV Data Function (Network-Function-as-a-Service)
TLA = Three Letter Acronym
Virtualization Process – Generic
CPE vCPE= White-box Switch in the home+ N/A+ vCPE-as-a-Service (Container-per-Subscriber)
OLT vOLT= GPON Interface Card in the Central Office+ vOLT-as-a-Service (App running on ONOS)+ N/A
BNG vBNG= White-box Switching Fabric in the Central Office+ vBNG-as-a-Service (App running on ONOS)+ N/A
Virtualization Process – Specific
Residence/Enterprise Central Office
CPE ONU OLT ETH AGG BNG
Before
Acronyms• CPE – Customer Premises Equipment• OLT – Optical Line Termination • BNG – Broadband Network Gateway
BackboneCore
DataCenter
Residence/Enterprise Central Office
ONU
vOLT + vCPE + vBNG + CDN
BackboneCore
vOLT-as-a-Service
vCPE-as-a-Service
CDN-as-a-Service
vBNG-as-a-Service
DataCenter
GP
ON
Commodity Servers, Switches, and Storage
Target Architecture
PONOLT MACs
XOS (Service Orchestration) + OVX (Virtual Networks) + ONOS (Control Apps)
Control Plane Services(vOLT-as-a-Service + vBNG-as-a-Service)
Data Plane Services(vCPE-as-a-Service)
Cloud Services(CDN-as-a-Service) R
OA
DM
Service Instances(VMs, Devices)
Service ControllerLogically centralized interfaceto network-wide functionality
Many points of implementationdistributed across the network.
(Multi-Tenant)
Everything-as-a-Service (XaaS)
Service Instances(VMs, Devices)
vBNG ControllerLogically centralized interfaceto network-wide functionality.
Many points of implementationdistributed across the network.
OpenFlow
OpenFlow Switches
(Tenant = Routable Subnet)
Internet-as-a-Service
Service Instances(VMs, Devices)
vOLT ControllerLogically centralized interfaceto network-wide functionality.
Many points of implementationdistributed across the network.
OpenFlow
OpenFlow Switches
(Tenant = Subscriber VLAN)
Access-as-a-Service
NB Core API
Distributed Core(state management, notifications, high-availability & scale-out)
SB Core API
Protocols
Adapters
Protocols
Adapters
Protocols
Adapters
Protocols
Adapters
AppsApps
ONOS – An Open Network OS
vOLT & vBNG
Service Instances(VMs, Devices)
vCPE ControllerLogically centralized interfaceto network-wide functionality.
Many points of implementationdistributed across the network.
Dockerfile
Per-Subscriber Linux Container(with select bundle)
…
(Tenant = Subscriber Bundle)
Subscriber-as-a-Service
Service Instances(VMs, Devices)
CDN ControllerLogically centralized interfaceto network-wide functionality.
Many points of implementationdistributed across the network.
Proprietary
Caches
(Tenant = Content Provider)
CDN-as-a-Service
Service Instances(VMs, Devices)
OpenStackLogically centralized interfaceto network-wide functionality.
Many points of implementationdistributed across the network.
Open Source
VMs
(Tenant = Slice)
Infrastructure-as-a-Service
Service Instances(VMs, Devices)
OVX ControllerLogically centralized interfaceto network-wide functionality.
Many points of implementationdistributed across the network.
OpenFlow
OpenFlow Switches
(Tenant = Virtual Network)
VN-as-a-Service
VM
OpenVirteX – A Network Hypervisor that supports Topology, Address Space, and
Control Isolation
Network OS Network OS Network OS
Physical Network
OpenVirteX (OVX)
Service 1Controller
Service 2Controller
Service 3Controller
Service NController
Service 4Controller . . .
XOS
XOS – XaaS Operating System
XOS
Data Model
Service 1Controller
Service 2Controller
Service 3Controller
Service NController
Service 4Controller
. . .
TenantView
Controller Framework
DeveloperView
OperatorView. . .
(REST API, xoslib)
XOS – XaaS Operating System
XOS
Data Model
vOLTController
vCPEController
vBNGController
OpenStackController
CDNController
. . .
SubscriberView
Controller Framework
DeveloperView
CORDView. . .
(REST API, xoslib)
XOS – XaaS Operating System
Defines Service as a first class objectService = ({Slice,…}, Controller)
Flexible control over operational parametersSlice = ({VM,…}, {VN,…})
VM = (Placement, Image, Resources)
VN = (Topology, NetworkOS, Resources)
Controller = (URL, Credentials, Plugin)
Service Composition and TenancyTenant = (ServiceTenant , ServiceProvider , Connect)
Connect = Public | Private | Interconnect | Management
XOS Data Model
Reduce CAPEX with virtualized commodity hardware
Reduce OPEX with automated service orchestration
Accelerate time-to-market for new services
Add value to existing OTT cloud services
Leverage SDN, NFV and modern datacenter technologies and best practices
Value Proposition
VMVM
VM
VMVM
VMVMVM
VMVM
VM
Service1 Service2
VMVM
VMVM
VM
VMVM
VMVM
VM
VM
VMVM
Logically compose services to achievedesired functional/security behavior
Map onto physical infrastructure tomeet performance requirements
VM
Service CompositionService 3 = Service 1 Service2
AmazonAWS
GoogleCloud
Platform
…Commodity
Clouds
OperatorData Centers
BackbonePoPs
CentralOffices
Subscribers(Enterprises)
Nintendo Wii
Multi-Tier Carrier Cloud
Syndicate = CDN Object Store NoSQL DB
Scalable Read Bandwidth(Akamai HyperCache & RequestRouter)
Data Durability(S3, Glacier, DropBox, Box, Swift)
Data Consistency(Google App Engine)
Value-Add Storage Service
Operational Example
AmazonAWS
GoogleCloud
Platform
…
CommodityClouds
OperatorData Centers
BackbonePoPs
CentralOffices
Subscribers(Enterprises)
Nintendo Wii
HPC
HPC
HPC
HPC
HPC
HPC
HPC
HPC
HPC
HPC
HPC
HPC
HPC
HPC
HPC
HPC
HPC
HPC
HPCS3
S3
S3
S3
S3
RR
RR
RR
RR
MS
MS
MS
MS
MS
Value-Added Storage Service
OpenCloud: An Operational Cloud
portal.opencloud.us
guide.opencloud.us
XOS: An Open Source Project
github.com/open-cloud/xos
ONOS: An Open Source Project + Community
onosproject.org
Syndicate: A Research Project (also open source)syndicatedrive.com
More Information