•

•

•

•

•

•

•

•

•

•

Edge Cluster in ONF-Connect Conference

Internet

Central Cluster in ONF Menlo Park

Quantity Category Brand Model Part

Edge Cluster

Standard setup

3 64-bit x86 server / / Haswell X86 microarchitecture or better

1G intf and 10G intf

4 Openflow switch EdgeCore AS6712-32X

1 L2 Management Switch D-Link DGS-1510-28X Support both 1G and 10G

1 Cabling (data plane, fiber) Robofiber QSFP-40G-03C

6 Cabling (management, copper)

/ CAT6, 3M

Central Cluster

3 64-bit x86 server / Haswell X86 microarchitecture or better

1 L2 Management Switch D-Link DGS-1510-28X

3 Cabling (management, copper)

/ CAT6, 3M

●○

●○

●○

NAT container

Redis container

BBUcontainer

Fabric

Fabric

Fabric

Fabric

Central Cluster

COMAC Fabric

Edge1

K8S K8SK8S

Edge2 Edge3 VPNRRU

Enodeb

ON

OS

Fab

ric

ON

OS

Slic

ing

XO

S

Pro

met

heu

s/G

rafa

na

COMAC Management Network & Virtual COMAC 3GPP CP Network

SRIOV SRIOVSRIOV

Virtual COMAC 3GPP UP Network Running on Fabric

CD

N-L

oca

l

SPG

W-U

L2 Management Network

Calico Calico Calico

Central 1

K8SK8S

COMAC Management Network & Virtual COMAC 3GPP CP Network

Calico

Calico

Central 2

VPNMM

E

HSS

SPG

W-C

Router

RA

N-C

U

Central 3

K8S

Calico

CD

N-R

emo

te

HSS

DB

Fabric

Fabric

FabricCOMAC Fabric

L2 Management NetworkFabric

Edge Cluster

● ://wiki.opencord.org/display/CORD/Trellis+Underlay+Fabric

●

Step2: Install OF-DPA package

●○ 32 ports are running in 1x40G mode. ○ Modify /etc/accton/ofdpa.conf to break out 1x40G into 4x10G.

●○

https://gerrit.opencord.org/gitweb?p=pod-configs.git;a=blob;f=tosca-configs/mcord/mcord-local-cluster-fabric-accelleran.yaml;h=ae4c812ebbb6e08a7e9a75c2640282898ace3b46;hb=refs/heads/master

○

● subnet: 119.0.0./24RRU← → SPGWU containerNode← →Node

● & Node subnet: 116.0.0./24 RRU← → BBU container

● Subnet: 13.1.1./24SPGWU ← → CDN or Internet GW.

Node

Calico

Calico

1G 10G

Node

Calico

Calico

1G 10G

Node

Calico

Calico

1G 10G

Internet

•

•

•

•

•

#OpenCORD

• Most popular open-source container-orchestration system• Just define your application as K8S resources like Deployment,

ConfigMap, Service, and so on• Helps automating deployment, management, and scaling

your-app.sh

kubectl create-f your_app.yaml

config.conf

kubectl scale--replicas=3 your-app.sh your-app.sh

your-app.sh

configmap.yml

your-app.sh

deployment.yml

Helm Charts• Collection of files that describes related set of K8S resources• Stored locally of fetched from remote chart repository

Helm• Renders Helm Charts and requests deployment to K8S• Composed of Tiller server and Helm client tool

Helm repo

deployment.yaml

Tillerhelm install your-app

••••••

•••

••••

https://github.com/opencord/helm-charts

#OpenCORD

hss mme spgwc

spgwu

DB

onos

fabric

cu

data plane switch

DB mme spgwuVF2 VF3

control plane switch

eth0eth0eth0

eth1

onos cu

hss spgwc cdn-local

cdn-remote

VF1

spgwu

eth0•••

•••

eth1(PF)

VF1 VF2

sriov-plugin

cassandra-0

cassandra-2

cassandra-1

hss

mme-apps6a-apps11-app

s1ap-app

spgwc

spgwu

db-sync bootstrap

•

•

•

•

•

•

•

••

•

•••

••

MME App in Container

Python Flask Server in Host

machine

Linux Server

IPC BrowserREST API

The click on the IMSI gives the various parameters of the UE context.

•

•

•

•

•

--

XOS Core & Synchronizers

KafkaLogHandler

VOLTHA

KafkaLogHandler

Event_bus

ONOS

Filebeat sidecar

Kafka-onos app

Kafka Topic Exporter Prometheus Grafana

Monitoring

Logstash Elasticsearch Kibana

LoggingKafka

xos.log.* topic

voltha.log topic

onos.log topic

voltha.kpis topic

onos.kpis topic

...

---

----

--

EdgeCentral

-

Central1

Edge1 Edge2 Edge3

Central2

cAdvisor

Node Exporter

Kube-state-metrics

cAdvisor

Node Exporter

nem-monitoring

Prometheus Grafana

cAdv

isor

Nod

e E

xpor

ter

Kub

e-st

ate-

met

rics

cAdv

isor

Nod

e E

xpor

ter

cAdv

isor

Nod

e E

xpor

ter

-

---

-

•

•

•

•

•

••

••

•••

••

Hardware

XOS

ONOS Kubernetes

Trellis SD-RAN

OMEC-UP OMEC-CP CDN Prome-theus

Subs.Monitor Grafana

Helm

CDN

Edge Cluster Central Cluster

CDN-RemoteCDN-Local

Pull video streams from CDN-Remote Include multiple video files

Include cached video files

Stream cached & remote videos

Manage video streams

Transmit video streams

Edge Cluster Central Cluster

CDN-RemoteCDN-Local

Pull video streams from CDN-Remote Include multiple video files

Include cached video files

Stream cached & remote videos

Manage video streams

Transmit video streams

This is fully “Open-Source CDN”

Video archiveMedia server

CDN-RemoteCDN-Local

Video files

(1) Video archive contains video files

(2) Video archive sends videos to media server (RTMP)

(3) Media server transmitsvideo streams (RTMP)

CDN server (4) CDN server gets video stream from Media

server (RTMP)

(5) CDN server starts streaming service

(6) UE requests and then receives video streaming

through OMEC/RAN

Edge Cluster Central Cluster

Video archiveMedia server

CDN-RemoteCDN-Local

Video files

CDN server

Cached videos

(1) CDN server includes cached video files

(2) CDN server startsstreaming service

(3) UE requests and then receives video streaming through OMEC/RAN

Edge Cluster Central Cluster

Video archiveMedia server

CDN-RemoteCDN-Local

Video files

CDN server

Cached videos

Edge Cluster Central Cluster

NGINX

Ant media

ffMPEGContainerized open-source Web server

Containerized open-source media server

Containerized open-source ffMPEG Apps + video files

Video archiveMedia server

Video files

CDN server

Cached videos

Edge Cluster Central Cluster

NGINX

Ant media

ffMPEG

CDN-RemoteCDN-Local

Helm chart #1: CDN-Local Helm chart #2: CDN-Remote

••••

•

Hardware

XOS

ONOS Kubernetes

Trellis SD-RAN

OMEC-UP OMEC-CP CDN Prome-theus

Subs.Monitor Grafana

Helm

XOS

TOSCA files XOS Synchronizer ONOS-F/R

Profile definition

Fabric definition

UE definition

RAN slice definition

XOS-TOSCA

XOS services

Service chain

Configuration UI

Monitoring

Configuration

Fabric monitoring

Fabric configuration

RAN monitoring

RAN configuration

Profile file XOS Synchronizer ONOS-F/R

ONOS apps

Service definitions

Service dependencies

XOS-TOSCA

(1) Send profile TOSCA file to XOS

XOS services

(2) Define services

Service chain

Configuration UI

(3) Draw service chain on dashboard

(4) Make UI for configuration

(5) Onboard synchronizers for services: {ONOS-Fabric, ONOS-RAN}-Synchronizer

(6) ONOS monitoring

Fabric file XOS Synchronizer ONOS-Fabric

Node configuration

Switch configuration

Port configuration

XOS-TOSCA

(1) Send Fabric TOSCA file to XOS (2) Save config values

XOS services

Monitoring

Configuration

(3) Send config values

Fabric monitoring

Fabric configuration

(4) Ask fabric configuration

(5) Fabric monitoring(6) ONOS monitoring

Configuration UI(7) W/O TOSCA, admin can configure manually through UI

RAN File XOS Synchronizer ONOS-RAN

UE configuration

eNB configuration

Slice configuration

XOS-TOSCA

(1) Send Fabric TOSCA file to XOS (2) Save config values

XOS services

Monitoring

Configuration

(3) Send config values

RAN monitoring

RAN configuration

(4) Ask RAN configuration

(5) RAN monitoring(6) ONOS monitoring

Configuration UI(7) W/O TOSCA, admin can configure manually through UI