october 2013 nyc meetup
DESCRIPTION
These slides were used as part of an interactive talk/demo in New York. The video fills in the gaps: https://www.youtube.com/watch?v=cO197XEkcVo. Abstract: The move from scale-up to scale-out architectures has challenged developers to re-think database design. It's been a great forcing function, resulting in a number of systems that combine traditional database functionality with modern scaling capability. What is sometimes lost in that discussion, however, is how difficult it is to manage a distributed system. In this talk I'll introduce you to the newly released NuoDB 2.0, a NewSQL database that can be distributed across data centers, and demonstrate why the user experience should be considered part of the criteria for judging scale.TRANSCRIPT
Copyright © 2013 NuoDB
Keeping Pace with a Distributed Database
!Seth Proctor
CTO
Copyright © 2013 NuoDB !2
Copyright © 2013 NuoDB
NuoDB is a Distributed Database
!3
Copyright © 2013 NuoDB
Simple; Composable
!4
Copyright © 2013 NuoDB
Peers play one of two roles
!5
Host 1
Transaction Engine
Host 2
Storage Manager
SQL Clients
Durable Store (KV)
Copyright © 2013 NuoDB
Scaled independently
!6
Host 1
Transaction Engine
Host 2
Storage Manager
Host 3
Transaction Engine
Host 4
Transaction Engine
Host 5
Storage Manager
Copyright © 2013 NuoDB
On-demand
!7
Copyright © 2013 NuoDB
Adjust transactional throughput‣ Add, move or remove TEs to ‣ Adjust for demand
‣ Migrate or upgrade active databases
‣ Re-adjust resources
!8
Copyright © 2013 NuoDB
Add durability points
!9
TE (Running)
TE (Running)
SM (Running)
SM (Syncing)
Archive Archive
TE (Running)
TE (Running)
SM (Running)
SM (Running)
Archive Archive
Active Database: add SM
Active Database: redundant archives
TE (Running)
TE (Running)
SM (Running)
Archive
Active Database: one SM running
Copyright © 2013 NuoDB
React to failure
!10
TE (Running)
TE (Joining)
SM (Running)
Archive
Active Database: add TE
TE (Running) TE (Fails)
SM (Running)
Archive
Active Database: one TE fails
TE (Running)
TE (Running)
SM (Running)
Archive
Active Database: two TEs
Copyright © 2013 NuoDB
Multi-tenant; Managed
!11
Copyright © 2013 NuoDB
Installation == Provisioning
!12
‣ Every host has a management agent ‣ Makes the host available
‣ Keeps track of local activity
‣ Some are “Connection Brokers” ‣ Load-balancer for SQL clients
‣ Single management point
Copyright © 2013 NuoDB
Independent databases
!13
Host 1 Host 2 Host 3 Host 6
EBS
Host 5
TE SM SM
TE
TE TE
SM
SM
S3
EBS
EBS
Host 4
TE
SM
HDFS
TE
Logically addressable Database
Complete, independent archive
Provisioned host
Copyright © 2013 NuoDB
http://dev.nuodb.com/techblog/tags/moonshot
!14
Copyright © 2013 NuoDB
And now, a few quick demos..
!15
Copyright © 2013 NuoDB
Templates
!16
Copyright © 2013 NuoDB
One host
!17
{ "name" : "Single Host", "summary" : "...", "requirements" : [{ "processes" : [{ "type" : "SM", "host" : "${HOST}" },{ "type" : "TE", "host" : "${HOST}" }] }] }
Copyright © 2013 NuoDB
Many hosts, one region
!18
{ "name" : "Multi Host", "summary" : "...", "requirements" : [{ "region" : "${REGION}", "processes" : [{ "type" : "SM", "min" : 1, "max" : 2 },{ "type" : "TE", "min" : 1, }] }] }
Copyright © 2013 NuoDB
GET /api/1/templates
!19
Copyright © 2013 NuoDB
GET /api/1/databases
!20
Copyright © 2013 NuoDB
Statistics
!21
Copyright © 2013 NuoDB
Java Stored Procedures
!22
Copyright © 2013 NuoDB
Flexible Schema
!23
Copyright © 2013 NuoDB
Want to learn more?‣ http://dev.nuodb.com ‣ Techblog, documentation & forums
‣ http://githib.com/nuodb ‣ Community projects & APIs
!24
Copyright © 2013 NuoDB
Thank You.