check mk high availability · pacemaker corosync drbd corosync / heartbeat pacemaker primary...

59

Upload: others

Post on 18-Aug-2020

24 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &
Page 2: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

Innovative technologies. Impeccable services. Marius Pana | @mariuspana

Page 3: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

Check_MK High Availability

Check_MK Conference #4 2.-4.5.2018

Page 4: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

IT MONITORING IS IMPORTANT

-insight and visibility into the infrastructure and applications -we instantly feel it when the systems are down

-we know this when we no longer have monitoring data available -and because IT monitoring is important, HA has become a common practice

-in some situations it is business critical (no visibility into customers systems considered critical)

Page 5: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

IT MONITORING IS IMPORTANT

-insight and visibility into the infrastructure and applications -we instantly feel it when the systems are down

-we know this when we no longer have monitoring data available -and because IT monitoring is important, HA has become a common practice

-in some situations it is business critical (no visibility into customers systems considered critical)

Check_MK is important

Page 6: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

IT MONITORING IS IMPORTANT

-insight and visibility into the infrastructure and applications -we instantly feel it when the systems are down

-we know this when we no longer have monitoring data available -and because IT monitoring is important, HA has become a common practice

-in some situations it is business critical (no visibility into customers systems considered critical)

insight and visibility

Check_MK is important

Page 7: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

IT MONITORING IS IMPORTANT

-insight and visibility into the infrastructure and applications -we instantly feel it when the systems are down

-we know this when we no longer have monitoring data available -and because IT monitoring is important, HA has become a common practice

-in some situations it is business critical (no visibility into customers systems considered critical)

insight and visibility

fault management

Check_MK is important

Page 8: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

IT MONITORING IS IMPORTANT

-insight and visibility into the infrastructure and applications -we instantly feel it when the systems are down

-we know this when we no longer have monitoring data available -and because IT monitoring is important, HA has become a common practice

-in some situations it is business critical (no visibility into customers systems considered critical)

insight and visibility

fault management

business continuity

Check_MK is important

Page 9: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

terminology

Page 10: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

terminology

business continuity

Page 11: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

terminology

fault tolerance (ft)

handle hw/sw fault(s)

business continuity

Page 12: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

terminology continuous availability (ca)

fault tolerance (ft)

no downtime

handle hw/sw fault(s)

business continuity

Page 13: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

terminology continuous availability (ca)

high availability (ha)fault tolerance (ft)

no downtime

handle hw/sw fault(s) limited downtime

business continuity

Page 14: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

Availability % Downtime per year Downtime per month Downtime per week Downtime per day90% ("one nine") 36.5 days 72 hours 16.8 hours 2.4 hours

95% ("one and a half nines") 18.25 days 36 hours 8.4 hours 1.2 hours97 % 10.96 days 21.6 hours 5.04 hours 43.2 minutes98 % 7.30 days 14.4 hours 3.36 hours 28.8 minutes

99% ("two nines") 3.65 days 7.20 hours 1.68 hours 14.4 minutes99.5% ("two and a half nines") 1.83 days 3.60 hours 50.4 minutes 7.2 minutes

99,8 % 17.52 hours 86.23 minutes 20.16 minutes 2.88 minutes99.9% ("three nines") 8.76 hours 43.8 minutes 10.1 minutes 1.44 minutes

99.95% ("three and a half nines") 4.38 hours 21.56 minutes 5.04 minutes 43.2 seconds99.99% ("four nines") 52.56 minutes 4.38 minutes 1.01 minutes 8.64 seconds

99.995% ("four and a half nines") 26.28 minutes 2.16 minutes 30.24 seconds 4.32 seconds

99.999% ("five nines") 5.26 minutes 25.9 seconds 6.05 seconds 864.3 milliseconds

99.9999% ("six nines") 31.5 seconds 2.59 seconds 604.8 milliseconds 86.4 milliseconds99.99999% ("seven nines") 3.15 seconds 262.97 milliseconds 60.48 milliseconds 8.64 milliseconds

99.999999% ("eight nines") 315.569 milliseconds 26.297 milliseconds 6.048 milliseconds 0.864 milliseconds

99.9999999% ("nine nines") 31.5569 milliseconds 2.6297 milliseconds 0.6048 milliseconds 0.0864 milliseconds

Page 15: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

ha options

Page 16: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

ha options

Virtualisation

Page 17: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

ha options

DYI Clusters

Virtualisation

Page 18: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

ha options

Check_MK Appliance DYI Clusters

Virtualisation

Page 19: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

ha options

Backup / Restore

Check_MK Appliance DYI Clusters

Virtualisation

Page 20: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

ha options

Backup / Restore

Other Solutions

Check_MK Appliance DYI Clusters

Virtualisation

Page 21: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

virtualisation

Page 22: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

virtualisation quick and easy

Page 23: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

virtualisation no special config

Page 24: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

virtualisation

Page 25: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

virtualisation

Page 26: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

virtualisation

OS/AppOS/App OS/App OS/App

Page 27: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

virtualisation

OS/AppOS/App OS/App OS/App

OS/App OS/App

Page 28: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

dyi clusters

Page 29: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

dyi clusters

requires specialised know-how

Page 30: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

dyi clusters

specialised tools

Page 31: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

dyi clusters

specialised procedures

Page 32: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

dyi clusterspacemaker corosync DRBD

Page 33: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

dyi clusterspacemaker corosync DRBD

Resource ResourceResource Resource

Page 34: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

dyi clusterspacemaker corosync DRBD

CoroSync / Heartbeat

Pacemaker

Primary Secondary

ext4

app

IP

Messaging

Resource mgr

DRBD

resource

resource

resource

Page 35: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

backup & restore

Page 36: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

backup & restore

seriously?

Page 37: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

backup & restore

yes!

Page 38: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

backup & restore

SLA of 99,95%

Page 39: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

backup & restore

4.38 hours downtime per year

Page 40: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

backup & restore

RTO - restore time (allowed downtime)

Page 41: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

backup & restore

RPO - how much data can I lose?

Page 42: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

backup & restore

Page 43: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

other solutions

Page 44: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

other solutions

can you handle a relaxed HA level?

Page 45: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

other solutions

how much do you want to tune and tweak?

Page 46: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

other solutions

zfs

Page 47: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

other solutions

zfs rsync

Page 48: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

other solutions

zfs rsync DRBD

Page 49: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

other solutions

zfs rsync DRBD Containers

Page 50: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

check_mk appliance

Page 51: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

check_mk appliance

completely managed solution 2 node active/passive cluster

Page 52: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

check_mk appliance

easy to use GUI standardised

DRBD

completely managed solution 2 node active/passive cluster

Pacemaker CoroSync

Page 53: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

closing thoughts

Page 54: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

whats the best approach?

closing thoughts

Page 55: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

closing thoughts

simple is almost always better

Page 56: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

closing thoughts

what is your acceptable HA level?

Page 57: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

closing thoughts

network architecture is important

Page 58: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

closing thoughts

Page 59: Check MK High Availability · pacemaker corosync DRBD CoroSync / Heartbeat Pacemaker Primary Secondary ext4 app IP Messaging Resource mgr DRBD resource resource resource. backup &

Spearhead Systems S.R.L. 64th I.P. Pavlov Street, Sector 1

Bucuresti, ROMANIA Phone: +40 21 322 5757 http://spearhead.systems

Thank You