next generation postgres high availability · postgres-bdr3 advanced clustering & scaling...

https://www.2ndQuadrant.com

2ndQuadrantPostgreSQL Solutions for the Enterprise

Postgres-BDR3 Advanced Clustering & Scaling

Next GenerationPostgres

High AvailabilitySimon Riggs

December 2019




High Availability/ Disaster Recovery

(Feature set in 2004)




High Availability/ Disaster Recovery

● Point in Time Recovery (2004)

● Continuous Recovery → Replication (2006/7)

● Physical Streaming Replication (2010)● Hot Standby (2010)

● Synchronous Replication (2011)




Maintenance Task Availability

● Online Backup (2004)

● CREATE INDEX CONCURRENTLY (2006)

● AutoVACUUM cancelled by user DDL (2009)

● DROP INDEX CONCURRENTLY (2012)

● Data Checksums (2013)




Data Availability

● ALTER TABLE VALIDATE CONSTRAINT (2011)

● ALTER TABLE lock reductions (2014-15)

● ALTER TABLE ADD PARTITION (2019)




Sources of Loss of Availability

● Server Uptime● Maintenance Tasks● Software Upgrade● Schema Change● Denial of Service● Human Factors






● AlwaysOn○ Sub-second failover

● Performance/Durability Options○ BDR adds 4 new

replication modes





● Server Uptime● Maintenance

Tasks● Software Upgrade● Schema Change● Denial of Service● Human Factors

● Migration● Major Version Upgrade● Post-migration Backfeed● Hitless reload

○ Restart BDR withoutrestarting Postgres







● Fully Automatic cluster-level DDL, with fine-grained locking

● Adding Indexes● Changing datatypes● Dropping Partitions

● Adding Tables

● Adding columns● Adding constraints







● Security● Configurable Timeouts● WAL Pacing● User Resource Controls







● User Education○ Talks, Books, Docs, Training

● Configuration Management○ TPAexec

● Responsive Support○ 2ndQuadrant Platinum Support




Kubernetes

● System-level failure detection using RAFT● Configuration Management

● Moving everything internally to Kubernetes● Developing BDR operators (1Q2020)

○ Using previously developedTrusted Postgres Architecture (TPA)

● Ready to deliver, migrate and support○ 2ndQuadrant is registered KCSP




PostgreSQL and Open Source

● Further extensive contributions to PostgreSQL core○ CREATE UNIQUE INDEX NOT VALID○ Config Change Outage Domino○ Disk Space Outage Domino

● PgLogical3 Community Edition 1Q2020

● BDR3 Community Edition 2021




Roadmap● PgLogical Streaming

○ [Kafka, RabbitMQ], Oracle○ More sources/targets

● BDR AlwaysOn○ Concurrency of Large Transactions (COLT)○ Parallel Apply

● AutoScale○ Elastically scalable OLTP Clustering○ Massively Parallel BI/Reporting




● AutoScale○ Elastically scalable cluster of 2+ Groups○ Optional Read/Write Coordinator Groups(s)○ Optional Disaster Recovery site

AutoScaleMassively Parallel Database & Elastic Scaling

...




Website https://www.2ndquadrant.com/Blog https://blog.2ndquadrant.com/ Email [email protected]

2ndQuadrantPostgreSQL Solutions

https://www.2ndquadrant.com/

https://blog.2ndquadrant.com/

mailto:[email protected]

next generation postgres high availability · postgres-bdr3 advanced clustering & scaling...

Documents