Greg BrunoVP of Engineering

How PayPal Installs 300 Nodes in 14 Minutes …In 14 Minutes

Stacki Positioning

Stacki @ PayPal

Ambari HDPHealth Detection

Integration

IPMI/iLOOS Disk Network DHCP / DNS /TFTP

Ansible

- Disk Array Controller Configuration- Disk Partitioning Configuration

“Stacki + Ansible = Happiness. :D” – Stacki mailing list 8/11/15

Hadoop @ PayPal

12 x 2TB SATA data drives

48 nodes each rack

1GBE-10GBE NICs

24 x 900GB 6G SAS 10K data drives

24 nodes each rack

10GBE NIC

8 x 4TB NR-SAS data drives

10 GBE NIC

Bay Area

Salt Lake City

Las Vegas

DATACENTERS

• 3,000 nodes and growing• 60+ initial server racks• Heterogeneous HW

across multiple DCs

Data Science Infrastructure Footprint

48 nodes each rack

Quick, Early Success

14 Minutes*To Fully Provision 6 Racks of Bare Metal (288 Servers)

Includes wiping alldisks then fullypartitioning & formatting ~3500 drives

And Now…

Upgrades all firmware automatically

Executes Ansible scripts on all hosts

Hadoop packages installed

* Versus hours with other hyperscale management tools, or days to weeks with traditional tools and processes