paddy power betfair percona and mysql power betfair percona...the openstack private cloud was...

15
Paddy Power Betfair Percona and MySQL Shane Murray & Andrew Cook PADDY POWER BETFAIR

Upload: others

Post on 30-May-2020

12 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Paddy Power Betfair Percona and MySQL Power Betfair Percona...The OpenStack private cloud was initially built for stateless immutable applications ... Disaster Recovery Workflow –recover

Paddy Power BetfairPercona and MySQL

Shane Murray & Andrew Cook

PADDY POWER BETFAIR

Page 2: Paddy Power Betfair Percona and MySQL Power Betfair Percona...The OpenStack private cloud was initially built for stateless immutable applications ... Disaster Recovery Workflow –recover

Who We Are

Paddy Power Betfair is a leading international

sports betting and gaming operator

FTSE100, Market Cap ~£7Bn

We operate five leading brands; Paddy Power, Betfair,

Sportsbet, FanDuel, TVG

Page 3: Paddy Power Betfair Percona and MySQL Power Betfair Percona...The OpenStack private cloud was initially built for stateless immutable applications ... Disaster Recovery Workflow –recover

Our mission is to bring excitement to life for every single one

Over five million customers worldwide

We employ over 7000 people globally

Who We Are

Page 4: Paddy Power Betfair Percona and MySQL Power Betfair Percona...The OpenStack private cloud was initially built for stateless immutable applications ... Disaster Recovery Workflow –recover

Paddy Power Betfair & MySQL

In 2014 Betfair (pre

Merger with Paddy

Power) embarked on a

strategic decision to

increase the usage of

Open Source solutions

The primary Open

Source database of

choice was MySQL

When development teams

requested new data stores, we

asked them to consider MySQL as

an option

In 2014 there was a modest

MySQL footprint within the

Betfair database estate compared

to other Database vendors

Page 5: Paddy Power Betfair Percona and MySQL Power Betfair Percona...The OpenStack private cloud was initially built for stateless immutable applications ... Disaster Recovery Workflow –recover

MySQL adoption Challenges

Lack of MySQL skills within the DBA and Development

teams

No automated Release

Framework

No 3rd Party Support in

place

Architectural and best practice

immaturity

Concerns around

performance, functionality and scaling

Betfair sought a support and consultancy contract with Percona to help with the transition towards the

adoption of MySQL as the de-facto Open Source Database technology for applications

Page 6: Paddy Power Betfair Percona and MySQL Power Betfair Percona...The OpenStack private cloud was initially built for stateless immutable applications ... Disaster Recovery Workflow –recover

MySQL adoption Challenges

& Percona

MySQL DBA and Developer training

Migration of CE MySQL instances to use Percona

Consultancy on building new applications on MySQL

Adoption of XtraBackup

Testing of alternative High Availability solutions

Page 7: Paddy Power Betfair Percona and MySQL Power Betfair Percona...The OpenStack private cloud was initially built for stateless immutable applications ... Disaster Recovery Workflow –recover

Merger of Paddy Power and Betfair

In February 2016 Paddy Power

and Betfair merged to become

Paddy Power Betfair

+

Infrastructure Teams formulated a plan to merge our operations and

adopt each others best practices

MySQL estate at Paddy Power was fairly large, running CE edition in

multi master configurations and some older versions (5.1)

A single MySQL solution for both brands hosted on the new PPB

Private Cloud was agreed as the strategic direction

Page 8: Paddy Power Betfair Percona and MySQL Power Betfair Percona...The OpenStack private cloud was initially built for stateless immutable applications ... Disaster Recovery Workflow –recover

PPB Requirements

Fully automated provisioning of MySQL database systems

Always-On, Highly Available, Disaster Proof architecture

Minimal downtime for Patching

Time to Market (TTM)

Free up staff for more valuable work

Page 9: Paddy Power Betfair Percona and MySQL Power Betfair Percona...The OpenStack private cloud was initially built for stateless immutable applications ... Disaster Recovery Workflow –recover

Technology Choices

PPB DBA Team met with Percona to discuss how we could host MySQL on our OpenStack private cloud, which

spans two datacenters in an Active-Active configuration

The OpenStack private cloud was initially built for stateless immutable applications

A number of designs and technology choices for high availability and load balancing were discussed and tested

A solution was designed by the PPB DBA Team and ratified by Percona based on Percona’s XtraDB Cluster

Page 10: Paddy Power Betfair Percona and MySQL Power Betfair Percona...The OpenStack private cloud was initially built for stateless immutable applications ... Disaster Recovery Workflow –recover

The Solution…

Asymmetric XtraDB Cluster spanning dual data centers

Full Automation

Fully supported architecture with Percona Support

Disaster Recovery Workflow – recover all instances within 10 mins

Page 11: Paddy Power Betfair Percona and MySQL Power Betfair Percona...The OpenStack private cloud was initially built for stateless immutable applications ... Disaster Recovery Workflow –recover

Percona Tools and services at PPB

Percona XtraDB Cluster

Percona Toolkit (pt-online-schema-change)

Percona PMM monitoring with Grafana dashboards

Percona XtraBackup

Percona Enterprise support with 30 mins SLA

Page 12: Paddy Power Betfair Percona and MySQL Power Betfair Percona...The OpenStack private cloud was initially built for stateless immutable applications ... Disaster Recovery Workflow –recover

In Summary

+

Full MySQL & XtraDB

Automation

Highly resilient and

DR proof architecture

TTM reduction

Better utilization of

team resources

Page 13: Paddy Power Betfair Percona and MySQL Power Betfair Percona...The OpenStack private cloud was initially built for stateless immutable applications ... Disaster Recovery Workflow –recover

PPB DBaaS - Want to Learn More?

To understand how PPB built and operates our MySQL platform on

Openstack please attend the cloud track discussion later today:

Building MySQL DBaaS on OpenStack with XtraDB Clusteri

Page 14: Paddy Power Betfair Percona and MySQL Power Betfair Percona...The OpenStack private cloud was initially built for stateless immutable applications ... Disaster Recovery Workflow –recover

Thank You!

Page 15: Paddy Power Betfair Percona and MySQL Power Betfair Percona...The OpenStack private cloud was initially built for stateless immutable applications ... Disaster Recovery Workflow –recover

15

Rate My Session