optimizing production apps on heroku 7.31.13

Join the conversation via #herokuJoin the conversation via #heroku

Optimizing Production Apps Optimizing Production Apps on Herokuon HerokuOptimizing Production Apps Optimizing Production Apps on Herokuon Heroku

Ryan Huber, Customer AdvocateRyan Huber, Customer Advocate@ryan_huber@ryan_huber

Greg Nokes, Technical Account ManagerGreg Nokes, Technical Account Manager@tsykoduk@tsykoduk

IntroductionsIntroductions

Ryan HuberCustomer Advocate

@ryan_huber

Greg NokesTechnical Account

Manager@tsykoduk

AgendaAgendaAgendaAgenda Using CDN to increase app performance

Managing Asset Pipeline (RoR specific)

PG Extras - Postgres

Postgres Database Migrations

Postgres Database Followers

Database Caching

Recommended Monitoring Tools

AssumptionsAssumptionsAssumptionsAssumptions Existing Heroku User

General understanding of Heroku / CLI

Have installed Toolbelt & created / pushed apps

General understanding of Postgres / SQL

Have provisioned Postgres databases on Heroku

*** This webinar is being recorded and distributed online ***

Asset PipelineAsset PipelineAsset PipelineAsset Pipeline

Processes assets for use by Caching

Two hard problems in Computer Science:

1. Cache Invalidation

2. Naming Things

3. Off by One errors

Helps with Cache Invalidation and Naming Things

What about uploading to S3?

Then you have 2 sets of files to manage

Leave them on the Dyno

Use a Edgecache CDN such as:

CDN Sumo

Cloudfront

CDNetworks

Akamai

Why Use a CDN? Why Use a CDN? Why Use a CDN? Why Use a CDN?

CDN vs S3CDN vs S3CDN vs S3CDN vs S3Application Assets User Generated Assets

S3 Best PracticesS3 Best PracticesS3 Best PracticesS3 Best Practices

Direct Upload

Pass-through Upload

* If processing is required *

https://devcenter.heroku.com/articles/s3

CDN Best PracticesCDN Best PracticesCDN Best PracticesCDN Best PracticesCache/Pull CDN

Sync/Push CDN

* Automatic Update*

* Manual Update*

Cache/Pull CDN Recommended

CDN Sumo (Heroku Addon)https://addons.heroku.com/

cdn_sumo

PG ExtrasPG ExtrasPG ExtrasPG Extras

http://www.craigkerstiens.com/2012/10/01/understanding-postgres-performance/

http://www.craigkerstiens.com/2013/01/10/more-on-postgres-performance/

A Heroku plugin for awesome pg:* commands that are also great and fun

and super.

There is a lot in there

We will talk about two

1. heroku pg:cache_hit

2. heroku pg:index_usage

heroku pg:cache_hitheroku pg:cache_hitheroku pg:cache_hitheroku pg:cache_hit

Shows the cache hit ratio.

A good measure of database sizing

We like to see it at 99%

heroku pg:index_usageheroku pg:index_usageheroku pg:index_usageheroku pg:index_usage

Shows the index hit ratio on each table

Big, heavily used tables need to have 99 – 100%

Postgres Database MigrationPostgres Database MigrationPostgres Database MigrationPostgres Database Migration

Dev / Basic vs Production DBsDev / Basic vs Production DBsDev / Basic vs Production DBsDev / Basic vs Production DBs

Dev / Basic* Not suitable for production applications* Expected uptime of 99.5%* Many level features not supported: Fork, follow* Row number limitation: 10K for Dev, 10M for Basic.* The database instance is shared among many other customers

Production* Designed for higher uptime, 99.95%* No row level limitation* You get your own database instance* Fork, follow supported* Suitable for production applications

Migrating Dev / Basic DBsMigrating Dev / Basic DBsMigrating Dev / Basic DBsMigrating Dev / Basic DBs

https://devcenter.heroku.com/articles/upgrade-heroku-postgres-with-pgbackups

Migrating Production DBsMigrating Production DBsMigrating Production DBsMigrating Production DBs

https://devcenter.heroku.com/articles/heroku-postgres-follower-databases

Follower DatabasesFollower DatabasesFollower DatabasesFollower Databases

Starter:

Development

No Fork/Follow

99.5% uptime

Production:

Can Fork/Follow

99.95% uptime

Follower DatabaseFollower DatabaseFollower DatabaseFollower Database

Analytics / Reporting

Octopus gem (https://github.com/tchandy/octopus)

Overcoming Postgres Connection LimitsOvercoming Postgres Connection LimitsOvercoming Postgres Connection LimitsOvercoming Postgres Connection Limits

Limit the number of connections

https://devcenter.heroku.com/articles/forked-pg-connections

Sometimes that’s not enough

https://github.com/gregburek/heroku-buildpack-pgbouncer

Caching for Profit & PerformanceCaching for Profit & PerformanceCaching for Profit & PerformanceCaching for Profit & Performance

https://devcenter.heroku.com/articles/memcachier

http://guides.rubyonrails.org/caching_with_rails.html

Performance MonitoringPerformance MonitoringPerformance MonitoringPerformance Monitoring

New Relic

Dyno Queuing

Runtime Metrics (https://devcenter.heroku.com/articles/log-

runtime-metrics)

Log2viz (http://log2viz.herokuapp.com/)

Logging

New RelicNew RelicNew RelicNew Relic

https://devcenter.heroku.com/articles/newrelic

Python

New Relic: BenefitsNew Relic: BenefitsNew Relic: BenefitsNew Relic: Benefits

New Relic: Pro vs StandardNew Relic: Pro vs StandardNew Relic: Pro vs StandardNew Relic: Pro vs Standard

New Relic: Caveats New Relic: Caveats New Relic: Caveats New Relic: Caveats

Dyno QueuingDyno QueuingDyno QueuingDyno Queuing

Processing in the router

Traveling over the network to a dyno

Queuing in the TCP socket backlog

Processing by the web server

Processing by Rack middleware

https://devcenter.heroku.com/articles/newrelic#interpreting-new-relic-request-queueing

Runtime MetricsRuntime MetricsRuntime MetricsRuntime Metrics

Resident Memory (memory_rss)

Disk Cache Memory (memory_cache)

Swap Memory (memory_swap)

Total Memory (memory_total)

Pages Written to Disk (memory_pgpgout)

Pages Read from Disk (memory_pgpgin)

CPU Load Avg (1 min, 5 min, 15 min avgs)

https://devcenter.heroku.com/articles/log-runtime-metrics

Log2vizLog2vizLog2vizLog2viz

http://log2viz.herokuapp.com/

LoggingLoggingLoggingLogging

https://devcenter.heroku.com/articles/logging

RecapRecapRecapRecap

Cache Assets

PG-Extras to Understand DB Performance

Select the Right DB Plan / Configuration

Leverage App Monitoring Tools

Q&AQ&A

Ryan HuberCustomer Advocate

@ryan_huber

Greg NokesTechnical Account

Manager@tsykoduk

optimizing production apps on heroku 7.31.13

heroku heroku pg

heroku plugin

heroku agendaagenda

cdn sumo heroku addonhttps

herokuon heroku ryan

heroku pg extraspg extras

usageheroku pg

awesome pg

Technology

deploying to heroku · heroku another popular hosting...

optimizing offline data synchronization for mobile apps

introduction to heroku (starting at 11:45) · what is...

ukoug apps 14: optimizing performance for oracle epm systems

dreamforce 13 optimizing data sync for mobile apps

optimizing your apps for emerging markets - droidcon...

optimizing apps oracle solaris studio compilers

heroku introduction

optimizing windows phone apps

heroku - apps are transformative

examples of using heroku with force.com to build apps

heroku features that we love · heroku review apps -...

optimizing tegra apps and games using unity · optimizing...

php on heroku: deploying and scaling apps in the cloud

heroku demo

optimizing your arcgis runtime apps for...

heroku inside

mahindra, india optimizing passenger …...comsol news 33...

february - heroku

best practices for creating scalable apps with heroku