Xiaowei JiangDirectorAlibaba Infrastructure ServiceAlibaba Group

6/1/2017

Alibaba Today

Hangzhou

Beijing

Taipei

Hong Kong

Sydney

Mumbai

Milan

Paris

London

NYC

DCSan Mateo

Seattle

~ 50,000 employers, offices all over the world

The 11.11 Global Shopping Festival

2015 2016

GMV (USD in Billions) 14.3 17.8

Transactions (Peak Value) 140K/s 175K/s

Payments (Peak Value) 85.9K/s 120K/s

Unveiling the Miracle of 11.11

OnlineandMobileCommercePlatform

$BUYERSSELLERS

Marketing

Financing&PaymentSolution

ProfessionalServiceProviders

DigitalEntertainment

Logistics

MobileBrowser

Location-Based

AutoNavi

SocialMedia

Weibo

Alibaba Global Infrastructure

14International DCs

530+CDN nodes

Alibaba Datacenters

Alibaba Server R&DODM

Components

Silicon

Memory

CPUHDD

SSD

Era of Post Moore’s LawHardware software co-designed datacenter

Compute

Deep customization

Heterogeneous computing for emerging workload

Storage

In-house SSDs

NVMoF, NVDIMM

Networking

Network acceleration

Server

In-house server designs

Immersion cooling

Compute Deep Customization

Customized x86 CPUs

Optimized for Alibaba’s workload

Alibench as perf metrics

Higher perf/watt than roadmap x86

Deployed at scaleALIBDWSKU HSWSKU IVBSKU

PERFORMANCE/WATT

Heterogeneous Computing

Deep Learning with GPU

Item classification

Shot and buy

Item prediction

Anti-ponography

Item quality control

Image search

Tag recognition

Voice recognition

Heterogeneous Computing

Pushing GPU power onto the cloud

Fully optimized for deep learning

Aliyun EC2 instances GA1 + GN4

C

AliFlash

Alibaba’s in-house SSD

Hardware software co-designed

Alibaba exclusive performance and functional features

A number of form factors

Reduced TCO

Deployed at scale

AliFlash

AliFlash PCIe v1.0

Host-based

PCIe interface

Low latency

High IOPS

11-25W

AliFlash

AliFlash NVMe v.10

Device-based

NVMe support

PCIe or U.2 interface

SPDK enabled

7-25W

AliFlash

AliFlash SATA v.10

SATA interface

Low cost

High density

For read-intensive workload

4-5W

AliFlash

AliFlash M.2 v.10

M.2 interface

SATA protocol

Low cost

For system drive

3W

Server Immersion Cooling

Air Cooling

Tf

Tcase

PROCESSOR

Immersion cooling

Boundary condition

Air cooling

35°C @ 1500m，1U server

Immersion cooling

fluid boils at 56°C

Server Immersion Cooling

Server Immersion CoolingThe layout of the chip is no longer limited

AirCooling

Airduct

Immersioncooling

AirCooling

Immersioncooling

Fans, heat sinks, air duct required

A lot of space waster

No heat sinks and fans

Compatibility cross generations

Q&A