White Boxes for the BNG Use Case

Carsten Michel, Senior Expert NGN, Deutsche TelekomWinnie Lin, Senior R&D Director, Delta Electronics

NETWORKING

DT Access 4.0 Mission StatementNETWORKING

“We develop a cost-efficient, lean-to-operate and scalable access platform to deliver Gigabit products”

What is Access 4.0/A4?NETWORKINGSCOPE OF ACCESS 4.0

• Extensive D2C (Design-To-Cost) project for FTTH/B• Everything monitored in a comprehensive Cost Model• Design and engineering using bare metal / OCP hardware, lots of

open-source software as well as merchant silicon• Application of data center principles, leaf/spine fabric, CI/CD, …• Clean IT architecture (Las Vegas principle)

OBJECTIVES OF ACCESS 4.0• Save CapEx and OpEx• Reduce vendor lock; bring in new players• Drive automation• Time-to-Market for services (keep business logic SW in house)• Increase flexibility for capacity mgmt, change-over, migration, …

BNG in a Nutshell

• Broadband Network Gateway (BNG) is an edge device of the IP network

• BNG aggregates user sessions, e.g. PPP sessions, from the access network

• Responsible for authentication, authorization and accounting enforcement

• Manages subscribers IP addresses

• Forwards packet to the IP core network

NETWORKING

BNG on Whitebox Switches

Motivation• Lot of work has been done for data center environment which addresses key points like openness,

automation, programmability• Not very well suited for subscriber edge functionality

Technical Requirement• Termination of Q-in-Q tagged Ethernet frames (S-VLAN, C-VLAN)• Termination of PPPoE session (including LCP, IPCP, IPv6CP)• Authentication, Authorization and Accounting (RADIUS) (control plane only)• Subscriber IP address management (control plane only)• Customer specific IP packet filter, for instance anti-spoofing filters• Hierarchical (aka per subscriber) Quality of Service for various services (e.g. VoIP, IPTV, etc.)• Multicast Replication• Termination of L2TP tunnel for wholesale• Subscriber-aware counting and statistics for both operation as well as billing

NETWORKING

ACCESS 4.0 Core Beliefs and DriversNETWORKING

HomogeneitySame Platforms for

a few Use-Cases for Single or

Multiple Operators

ManageabilityHelp Reducing

Operational Team’s

Efforts in Installation and

Maintenance

FlexibilityModular Design

for Various Application and

Operator

Efficiency

Space, Power, MTBF, Life-

cycle and etc.

Same ASIC withSPINE and LEAF Configurations

Standardizationwith 2RU Chassis, Same PSU and

Fan-Tray, 80mm Fan-tray for longer MTBF; BMC Supported

Modular CPU Boardwith Compatibility of CPU options

and System Memory/Storage

Compact Designwith High Power Efficiency

and Longer Life-Cycle

New Hardware Design - ConsiderationsNETWORKING

AGCVA48S4*SFP+, 48*SFP28 and 10*QSFP28

AGCX422S22*QSFP28 and 4*QSFP-DD

DNXQumran 2C (2.4Tbps)HQoS TM, Scalability, Deep Buffer, Programmability

Xeon D1500/D1600High Performance with QAT

Ex. TCAMKBP for Larger Table (IPv4/IPv6), ACLs and Statistics

SyncE/1588v2*ToD, BITS, 1PPS, 10MHz and etc.*Time Synchronization supported on all ingress and egress ports

On-Chip Buffer4GB HBM for Elastic Pipeline

StatisticsTAP as Optional Module

What’s inside? HLD - Leaf Platform

•DNX Qumran 2C(2.4Tbps, ILKN and OTN Supported)

•Choose between KBP (TCAM) orTAP (Statistics)

•SFP+ and SFP28 for smaller accessinterfaces

•Time Synchronization (1588v2)

•BMC/OpenBMC Support

NETWORKINGCPU 150pin Connector

1588,SyncE Circuit

BroadcomDNX Qumran 2C

PM25

PM25 PCIeBroadSync

LPC

BMCAST2520

CPLD

I2C

I2C

Flash

Flash

DDR4

I210

PCIe x1

NCSI

UART

MGMT

USB

PCIex4

10G KRx4

10G Serdes

25G Serdes

25GSerdes

KBPor

TAP

48 x SFP28 25G 10 x QSFP28 100G4 x SFP+ 10G

Statistic4 x 50G

Search 8 x 50G

MGMTConsole

USB

Mux

UART

Mux

BCM82758

SFI

1pps_outBITS

What’s inside? Inside of LEAF Platform

Modular CPU Board

Broadcom ASICand T-CAM

BMC

Timing Injection Interface

4*SFP+

Management Port and Console

Oscillator

NETWORKING

What’s inside? HLD - Spine Platform

•DNX Qumran 2C(2.4Tbps, ILKN and OTN Supported)

•Non-KBP/TAP Design

•QSFP28 and QSFP-DD for larger backbone interfaces

•Time Synchronization (1588v2)

•BMC/OpenBMC Support

NETWORKINGCPU 150pin Connector

14 x QSFP28 100G

1588,SyncE Circuit

BroadcomDNX Qumran 2C

PM25 / PM50

PM25 PCIeBroadSync

LPC

BMCAST2520

CPLD

I2C

I2C

Flash

Flash

DDR4

I210

PCIe x1

NCSI

UART

MGMT

USB

PCIex4

10G KRx4

10G Serdes 25G

Serdes

50GSerdes

4 x QSFP-DD 400G4 x SFP+ 10GMGMTConsole

Mux

UART

BCM82758

1pps_outBITS

25G Serdes

8 x QSFP28 100G

What’s inside? Inside of SPINE Platform

DRAM-Module

400G Connectivity

Timing Injection Interface

22*QSFP28

Mounting Post of Sliding Rail

SSD Storage

NETWORKING

What’s inside? HLD - CPU Module

• Modular CPU Board Design

• Upgradable CPU Module

• Dual FLASH for BIOS Backup

• Upgradable RAM Module

• Dual Storage (SATA3 and PCIe) forSwitch OS Backup

• TPM supported

NETWORKING

Bo

ard

to B

oa

rd C

on

ne

ctor

Intel Xeon Processor D-1500Product FamilySO-DIMM DDR4

PCIe Gen3 X4

SATA Gen3

M.2 PCIe Gen3 2280 SSD

M.2 SATA3 2242 SSD

TPM

Flash

SPI

SPI

J-Tag chain

UARTUART

LPC/eSPI

PCIe Gen1 X1

PCIe Gen3 X4PCIe Gen3 X2PCIe Gen3 X1PCIe Gen3 X1

10G KR10G KR

USB 3.0

1PPS

I2C I2C

PCIe Clock

TMP

Misc.

I2C

12V & 3V3

POWER MONITOR

BackupFlash

Flash

Improving Operation Efficiency

•Design is intended to be compatible with any optical transceivers

•Standard chassis for Central Office requirements

•ETSI* and NEBS* compliant(*in-progress)

NETWORKING

•80mm fan-tray to extend switch life cycle

•Modular design of fan-tray for easy maintenance

•High efficiency PSU, achieving 98%+ efficiency

•AC/DC and OCP PTM (Pass-Through Module) Compatible

How Do We Proceed• We are seeking for active feedback from the

community

• Feedback on the proposed design• Interest in having / using such a box?• Interest in collaborating?

• In case of common interest, DT and Delta plan tocontribute specification of BNG-capable switch design to OCP

To be OCP Accepted(in-progress)

NETWORKING