Rahul Pathak

Understanding Database Options on AWS

Senior Product Manager

@rahulpathak

We want to make it easy for you to go from

1. Zero to Application in ____ Minutes

2. Zero to Millions of users in ____ Days

3. Zero to “Profits!” ASAP

Focus on your application

Spectrum of options

SQL NoSQL

Low Cost High Cost

Do-it-yourself Fully Managed

Not available on AWS

Spectrum of options

SQL NoSQL

Do-it-yourself Fully Managed

RDS

- MySQL

- Oracle - SQL Server

Spectrum of options

SQL NoSQL

Do-it-yourself Fully Managed MySQL

Oracle

SQL Server

PostgreSQL Your favorite RDBMS

Spectrum of options

SQL NoSQL

Do-it-yourself Fully Managed

MongoDB

Cassandra

Redis

Memcache Amazon DynamoDB

Amazon ElastiCache

Thinking about the questions

Should I use SQL or NoSQL?

Should I use MySQL on EC2 or RDS?

Should I use MongoDB,

Cassandra, or DynamoDB?

Should I use Redis, Memcache, or ElastiCache?

?

Actually, thinking about the right questions

What are my scale and latency needs?

What are my transactional and

consistency needs?

What are my read/write, storage

and IOPS needs?

What are my time to market and server

control needs?

?

What’s important for your application and your team?

Factors SQL NoSQL

Application • App with complex business logic? • Web app with lots of users?

Transactions • Complex transactions, joins, updates? • Simple data model, updates, queries?

Scale • Developer managed • Automatic, on-demand scaling

Performance • Developer architected • Consistent, high performance at scale

Availability • Architected for fail-over • Seamless and transparent

Core Skills • SQL + Java/Ruby/Python/PHP • NoSQL + Java/Ruby/Python/PHP

Best of both worlds: Use both SQL and NoSQL models in one app

Where do you want to spend your time?

Factors Do it Yourself (DIY) Fully Managed

Replication • Granular, app managed • Transparent to the app and configured by the

service

Monitoring • Specific agents and custom • Automated and API driven

Security • Root access, custom configurations • Hardened by the service

Resources • Requires more dev resources and time • Requires minimal dev resources and time

Time to market • Sophistication vs. speed • Rapid iteration

Required Skills • Systems, databases, monitoring focused • Application development, User centric

Best of both worlds: Possible to manage different tiers differently

We believe in choice – one size does not fit all

Amazon RDS

+ ElastiCache

Amazon DynamoDB

Amazon Redshift

Just Launched!

Traditional Apps Relational DB Needs

New Web Apps Massive Scalability

High Performance, High Scale Data Warehouses

Amazon RDS is a fully managed SQL database service

Simple to deploy and scale

Without any operational burden

Reliable and cost effective

Choice of database engines

Schema design

Frequent server upgrades

Storage upgrades

Backup and recovery

Software upgrades

Patching

Hardware mgmt.

Query construction

Query optimization

Configuration management

Migration

Offload the “muck” to RDS

Focus on the App “innovation”

Amazon RDS drives developer and IT productivity

Amazon RDS Configuration

Improve Availability

Increase Throughput

Reduce Latency

Push-Button Scaling

Multi-AZ

Read Replicas

Provisioned IOPS

Read Replicas Push-Button Scaling Provisioned IOPS

Region

Multi-AZ

Availability

Zone

Availability

Zone

Amazon RDS high availability and performance options

Amazon RDS Read Replica

A few clicks or one API call

Do-it-yourself MySQL Read Replica

~30+ manual steps

Creating a read replica

Amazon RDS Multi-AZ

A few clicks or one API call

Do-it-yourself MySQL on AWS

Potentially ~100+ manual steps

Set up primary and standby instances

Set up identical volumes

Create synchronous replication

Create and manage DNS entries

Detect instance failure conditions

Detect network failure conditions

Detect storage failure conditions

Decide when to fail-over….

Re-establish primary secondary connections.

Creating high availability database deployments

Who is succeeding with RDS?

More than 30,000 developers use RDS every single day

Gaming Web Apps Mobile/Social Media

Amazon RDS – Recently announced features

• 3 TB database size & 30,000 IOPS

• Online conversion from Standard to Provisioned IOPS storage

• Promote Read Replica to Master

• Stay tuned…

Amazon ElastiCache is a fully managed

Memcached-compatible caching service

Easy to set up and operate

Scale cache clusters with push button ease

Without any operational burden

Ultra fast response time for read scaling

Amazon ElastiCache – Recently announced features

• Free tier & new instance sizes (Micros and Mediums)

• Amazon VPC support

• Auto Discovery

• Stay tuned…

Amazon DynamoDB is a fully managed NoSQL

database service

Store and retrieve any amount of data

Scale throughput to millions of I/O

Without any operational burden

Single-digit millisecond latencies

From the creators of the first NoSQL technology

Do-it-yourself NoSQL on AWS Amazon DynamoDB

Potentially ~100s of manual steps Three clicks or one API call

Select the right NoSQL Database engine

Deploy hardware configurations

Set up software configurations

Decide and deploy replication configurations

Create and manage DNS entries

Detect instance failure conditions

Detect network failure conditions

Detect storage failure conditions

Decide when to fail-over….

Re-establish application connections.

Creating NoSQL deployment on AWS

Amazon DynamoDB: who is succeeding with it?

Data warehousing done the AWS way

• No upfront costs, pay as you go

• Really fast performance at a really low price

• Open and flexible with support for popular tools

• Easy to provision and scale up massively

Amazon Redshift is a fast, powerful, fully managed,

petabyte-scale data warehouse service

10x cheaper

Without any operational burden

Easy to use

10x faster

Amazon Redshift architecture

• Columnar, massively parallel processing (MPP)

• Scales from hundreds of gigabytes to a

petabyte or more

• Connects to standard SQL-based clients and BI

tools using JDBC/ODBC via Postgres drivers

• Fully-managed service

• Pay as you go, no software license fees

• VPC, SSL, and transparent data encryption

10 GigE (HPC)

Ingestion Backup Restore

JDBC/ODBC

Medidata Solutions

Isaac Wong

VP of Platform Architecture

Choose the best tool for the job

• One size does not fit all

• Managed or do-it-yourself offerings for virtually all use cases

– These aren’t mutually exclusive

• Focus on your application

Resources & Questions

• Rahul Pathak | rapathak@amazon.com | @rahulpathak

• http://aws.amazon.com/dynamodb

http://aws.amazon.com/rds

http://aws.amazon.com/elasticache

http://aws.amazon.com/redshift

• https://aws.amazon.com/marketplace