sonicdevelopment and deployment at alibaba · •alibaba has became a key contributor to...
TRANSCRIPT
![Page 1: SONiCDevelopment and Deployment at Alibaba · •Alibaba has became a key contributor to SONiCcommunity •Tremendous progress of developing and deploying NOS at Alibaba •Future](https://reader030.vdocuments.us/reader030/viewer/2022040606/5eb404a6b39b75130106ed0e/html5/thumbnails/1.jpg)
![Page 2: SONiCDevelopment and Deployment at Alibaba · •Alibaba has became a key contributor to SONiCcommunity •Tremendous progress of developing and deploying NOS at Alibaba •Future](https://reader030.vdocuments.us/reader030/viewer/2022040606/5eb404a6b39b75130106ed0e/html5/thumbnails/2.jpg)
S O N i C D e v e l o p m e n t a n d D e p l o y m e n t a t A l i b a b aHaiyong WangSenior DirectorAlibaba Group
![Page 3: SONiCDevelopment and Deployment at Alibaba · •Alibaba has became a key contributor to SONiCcommunity •Tremendous progress of developing and deploying NOS at Alibaba •Future](https://reader030.vdocuments.us/reader030/viewer/2022040606/5eb404a6b39b75130106ed0e/html5/thumbnails/3.jpg)
Search Engine AD Engine
Business Platform
Software
Infrastructure
Security
Productivity
Computing platform
TMall Taobao AliExpress Data AdsCloud
Computing
Digital Media
Entertainment CainiaoAnt
Financial
ML, Speech, NLP, Image & Video
Container/VirtualizationScheduling
Modular / Customization
High throughput Low latency
Intelligent
Cloud / Heterogeneous Anti-fraud
Privacy
Algorithm component / Deep learning framework / Visualization
EDAS / MQ / ARMS
Graph / Stream / Batch
Operation System Database Storage Middleware
Server NetworkData Center Operation
Data platform Algorithm platform
Green Available Scalable
OneID / OneData / OneService / GProfile
Alibaba Technology Stack
![Page 4: SONiCDevelopment and Deployment at Alibaba · •Alibaba has became a key contributor to SONiCcommunity •Tremendous progress of developing and deploying NOS at Alibaba •Future](https://reader030.vdocuments.us/reader030/viewer/2022040606/5eb404a6b39b75130106ed0e/html5/thumbnails/4.jpg)
Alibaba Network OSAlibaba Network Management and Monitoring Services
Switch Hardware
DB
L2/L3 Monitoring Management
System Process
Hardware Abstraction
![Page 5: SONiCDevelopment and Deployment at Alibaba · •Alibaba has became a key contributor to SONiCcommunity •Tremendous progress of developing and deploying NOS at Alibaba •Future](https://reader030.vdocuments.us/reader030/viewer/2022040606/5eb404a6b39b75130106ed0e/html5/thumbnails/5.jpg)
SONiC
• Focus on hyper-scale datacenters• Open source and vibrant community• Wide support from ODMs and ASIC vendors• Linux software and integration
![Page 6: SONiCDevelopment and Deployment at Alibaba · •Alibaba has became a key contributor to SONiCcommunity •Tremendous progress of developing and deploying NOS at Alibaba •Future](https://reader030.vdocuments.us/reader030/viewer/2022040606/5eb404a6b39b75130106ed0e/html5/thumbnails/6.jpg)
Community Participation
• Announce joining SONiC@OCP community at ONS 2017• Expand ODM and ASIC vendor SONiC@OCP support• Lead SONiC adoption in China• Major contributor to SONiC
![Page 7: SONiCDevelopment and Deployment at Alibaba · •Alibaba has became a key contributor to SONiCcommunity •Tremendous progress of developing and deploying NOS at Alibaba •Future](https://reader030.vdocuments.us/reader030/viewer/2022040606/5eb404a6b39b75130106ed0e/html5/thumbnails/7.jpg)
Feature Contribution
![Page 8: SONiCDevelopment and Deployment at Alibaba · •Alibaba has became a key contributor to SONiCcommunity •Tremendous progress of developing and deploying NOS at Alibaba •Future](https://reader030.vdocuments.us/reader030/viewer/2022040606/5eb404a6b39b75130106ed0e/html5/thumbnails/8.jpg)
Alibaba Network OS
![Page 9: SONiCDevelopment and Deployment at Alibaba · •Alibaba has became a key contributor to SONiCcommunity •Tremendous progress of developing and deploying NOS at Alibaba •Future](https://reader030.vdocuments.us/reader030/viewer/2022040606/5eb404a6b39b75130106ed0e/html5/thumbnails/9.jpg)
Support dual uplinks
Server
Switch A Switch B
Server
Switch A Switch B
![Page 10: SONiCDevelopment and Deployment at Alibaba · •Alibaba has became a key contributor to SONiCcommunity •Tremendous progress of developing and deploying NOS at Alibaba •Future](https://reader030.vdocuments.us/reader030/viewer/2022040606/5eb404a6b39b75130106ed0e/html5/thumbnails/10.jpg)
BGP Enhancements
• Announce low priority routes for graceful device restart• RFC7911 enhancement to support multipath advertisement• Enable ECMP member de-active on data plane before route removal• Replace periodic timer with event trigger for faster response and
lower CPU
![Page 11: SONiCDevelopment and Deployment at Alibaba · •Alibaba has became a key contributor to SONiCcommunity •Tremendous progress of developing and deploying NOS at Alibaba •Future](https://reader030.vdocuments.us/reader030/viewer/2022040606/5eb404a6b39b75130106ed0e/html5/thumbnails/11.jpg)
Networking Telemetry
Networking data collectors
Networking data analytics
UI
Switch
Troubleshooting Monitoring/Alert
CLI SNMP Syslog Mirror INT gRPC
![Page 12: SONiCDevelopment and Deployment at Alibaba · •Alibaba has became a key contributor to SONiCcommunity •Tremendous progress of developing and deploying NOS at Alibaba •Future](https://reader030.vdocuments.us/reader030/viewer/2022040606/5eb404a6b39b75130106ed0e/html5/thumbnails/12.jpg)
Telemetry via gRPC
Efficient collection stack
Change only mode
Push instead of poll
![Page 13: SONiCDevelopment and Deployment at Alibaba · •Alibaba has became a key contributor to SONiCcommunity •Tremendous progress of developing and deploying NOS at Alibaba •Future](https://reader030.vdocuments.us/reader030/viewer/2022040606/5eb404a6b39b75130106ed0e/html5/thumbnails/13.jpg)
gRPC Architecture
Virtual DB paths
SONiC Redis DB
gRPC Get andSubscribe (poll and stream)
SONiC System Telemetry gRPC service
SONiC Redis DB
SONiC Redis DB DB Client
Non-DB Client
Platform data
Proc data
ASIC data(non-SAI )
gRPC Dial-in Server (gNMI server)
gRPC Dial-out Client ( gNMIDiaout Publish service)
System Telemetry data Collectors
gRPC Publish (periodic and stream)
![Page 14: SONiCDevelopment and Deployment at Alibaba · •Alibaba has became a key contributor to SONiCcommunity •Tremendous progress of developing and deploying NOS at Alibaba •Future](https://reader030.vdocuments.us/reader030/viewer/2022040606/5eb404a6b39b75130106ed0e/html5/thumbnails/14.jpg)
gRPC Performance
![Page 15: SONiCDevelopment and Deployment at Alibaba · •Alibaba has became a key contributor to SONiCcommunity •Tremendous progress of developing and deploying NOS at Alibaba •Future](https://reader030.vdocuments.us/reader030/viewer/2022040606/5eb404a6b39b75130106ed0e/html5/thumbnails/15.jpg)
Quagga/FRR Data
Ali CLI
TACACS+ Linux CMD APP CMD
Authorization
CFG DB APP DB Counter DB
Config/ShowShow
socket
APP Data
ShowConfig
Unified CLI for Operation
![Page 16: SONiCDevelopment and Deployment at Alibaba · •Alibaba has became a key contributor to SONiCcommunity •Tremendous progress of developing and deploying NOS at Alibaba •Future](https://reader030.vdocuments.us/reader030/viewer/2022040606/5eb404a6b39b75130106ed0e/html5/thumbnails/16.jpg)
Get Ready for Production
• Feature development and customization• Testing
• Automate regression with Robot framework• Add test topology to align with Alibaba network architecture
• Operation• Integrate with network management and monitoring systems• Customized zero touch provision• Unified CLI for network operation team
![Page 17: SONiCDevelopment and Deployment at Alibaba · •Alibaba has became a key contributor to SONiCcommunity •Tremendous progress of developing and deploying NOS at Alibaba •Future](https://reader030.vdocuments.us/reader030/viewer/2022040606/5eb404a6b39b75130106ed0e/html5/thumbnails/17.jpg)
Alibaba Data Center Network Deployment
���
POD
��� ��� ��� ���
POD
��� ��� ���
��� ��� ��� ��� ��� ��� ��� ���
![Page 18: SONiCDevelopment and Deployment at Alibaba · •Alibaba has became a key contributor to SONiCcommunity •Tremendous progress of developing and deploying NOS at Alibaba •Future](https://reader030.vdocuments.us/reader030/viewer/2022040606/5eb404a6b39b75130106ed0e/html5/thumbnails/18.jpg)
Challenges
• Multi-vendor hardware troubleshooting• Interoperability of INT metadata across multi-vendor devices
![Page 19: SONiCDevelopment and Deployment at Alibaba · •Alibaba has became a key contributor to SONiCcommunity •Tremendous progress of developing and deploying NOS at Alibaba •Future](https://reader030.vdocuments.us/reader030/viewer/2022040606/5eb404a6b39b75130106ed0e/html5/thumbnails/19.jpg)
Summary
• Alibaba has became a key contributor to SONiC community• Tremendous progress of developing and deploying NOS at Alibaba• Future work
• 10X deployment scale• Expand to more device roles• Programmable network
![Page 20: SONiCDevelopment and Deployment at Alibaba · •Alibaba has became a key contributor to SONiCcommunity •Tremendous progress of developing and deploying NOS at Alibaba •Future](https://reader030.vdocuments.us/reader030/viewer/2022040606/5eb404a6b39b75130106ed0e/html5/thumbnails/20.jpg)