ai hardware infrastructure at facebook · workplace. facebook. instagram. 10 year roadmap. 3 yrs. 5...

A I H A R D W A R E I N F R A S T R U C T U R E A T F A C E B O O K

Xiaodong WangKevin Lee

Today’s AI HardwareInfrastructure

What’s NextNew HardwareAnnouncement

4

AI Research AI InfrastructureApplied Machine Learning

5

Artificial Intelligence

Machine Learning

Deep Learning

Program that can sense, reason, act, and adapt like humans

Program that can perform actions without explicitly being programmed

Subset of machine learning in which multilayered neural networks learn

6

7

Services and Use Cases

Face taggingNews Feed

Search Translation Ads

8

Connectivity

AI

VR / AR

Express Wi-FiTelco Infra

Terrestrial SolutionsSatellites

DronesFree BasicsLasers

Language PlanningVision Reasoning

AR Tech

Touch

Standalone

RiftMobile VRBCI

Social VR

TECHNOLOGIESPRODUCTSECOSYSTEMS

Messenger

WhatsApp

Video

Search

Groups

Workplace

Facebook

Instagram

1 0 Y E A R R O A D M A P

3 YRS

5 YRS

10 YRS

2017

9

Why Now?

ComputeDataResearch

10

FBLearner Feature Store

FBLearner Flow

FBLearner Predictor

Frameworks& Infrastructure

Internal Platforms & Toolkits

11

How Are We Leveraging Machine Learning at FB?

Data Features Training Evaluation Inference

FBLearnerFeature Store

FBLearnerFlow

FBLearnerPredictor

Bryce Canyon Big Basin Tioga Pass Twin Lakes

12

2012Experimentation

2013HP SL270s G8

2015Big Sur

2016Big Basin Pascal

2018Announcing Today

Today’s AI HardwareInfrastructure

AnnouncingBig Basin Volta

What’s Next

14

Big Basin Volta at OCP 2018

15

Big Basin Volta at OCP 2018

• Paired with OCP Tioga Pass platform• Increased GPU performance• Improved airflow and serviceability Heat sink

Enlarged handles

16

Computer Vision at FB

17

1-V100 2-V100 4-V100 8-V100

FP-32

Computer Vision Performance

Multi-GPU speedup

18

1-V100 2-V100 4-V100 8-V100

FP-32 FP-16 TensorCore

High-bandwidth FP-16 TensorCore

Computer Vision Performance

19

Machine Translation

Better Translation Quality

Phrase-based statistical approach Neural network approach

Today’s AI HardwareInfrastructure

AnnouncingBig Basin Volta

What’s Next

Consolidated Hardware

Design

Max Operating Efficiency

Vendor Agnostic Platform

Disaggregated Design

Please join us Wednesday at 11:30am for Big Basin Volta workshop!