2 years later: loving and hating the cloud justin huff [email protected] @jjhuff

25
2 Years Later: Loving and Hating the Cloud Justin Huff justin@picnik .com @jjhuff

Upload: lewis-bailey

Post on 29-Jan-2016

212 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: 2 Years Later: Loving and Hating the Cloud Justin Huff justin@picnik.com @jjhuff

2 Years Later:Loving and Hating the Cloud

Justin Huff

[email protected]@jjhuff

Page 2: 2 Years Later: Loving and Hating the Cloud Justin Huff justin@picnik.com @jjhuff

Picnik?!

Page 3: 2 Years Later: Loving and Hating the Cloud Justin Huff justin@picnik.com @jjhuff
Page 4: 2 Years Later: Loving and Hating the Cloud Justin Huff justin@picnik.com @jjhuff

Using AWS for 2 years

In production 1½ years

Page 5: 2 Years Later: Loving and Hating the Cloud Justin Huff justin@picnik.com @jjhuff
Page 6: 2 Years Later: Loving and Hating the Cloud Justin Huff justin@picnik.com @jjhuff

Flexibility

(We love it!)

Page 7: 2 Years Later: Loving and Hating the Cloud Justin Huff justin@picnik.com @jjhuff

Buy hardware for average capacity Auto-scale out into the cloud

Page 8: 2 Years Later: Loving and Hating the Cloud Justin Huff justin@picnik.com @jjhuff

• Capacity management– Easily repurpose existing resources

• Hardware purchasing– Buy hardware in batches– Less wasted rack space– Better deals!

Page 9: 2 Years Later: Loving and Hating the Cloud Justin Huff justin@picnik.com @jjhuff

Storage

Page 10: 2 Years Later: Loving and Hating the Cloud Justin Huff justin@picnik.com @jjhuff

Our 4-Step Process

1. Move 'old' files to S3

2. Put some newly created files on S3

3. All files go to S3

4. Profit!

Page 11: 2 Years Later: Loving and Hating the Cloud Justin Huff justin@picnik.com @jjhuff

Storage #fail

• Most of our files are short lived

• We didn't have a good deletion process in place.

– Lots of unused files == really expensive

Page 12: 2 Years Later: Loving and Hating the Cloud Justin Huff justin@picnik.com @jjhuff

What did we do?

Page 13: 2 Years Later: Loving and Hating the Cloud Justin Huff justin@picnik.com @jjhuff

We ignored it.

Page 14: 2 Years Later: Loving and Hating the Cloud Justin Huff justin@picnik.com @jjhuff

We had other stuff to do!

(and limited humans)

Page 15: 2 Years Later: Loving and Hating the Cloud Justin Huff justin@picnik.com @jjhuff

Until it got too expensive

Page 16: 2 Years Later: Loving and Hating the Cloud Justin Huff justin@picnik.com @jjhuff

Lessons

Page 17: 2 Years Later: Loving and Hating the Cloud Justin Huff justin@picnik.com @jjhuff

(Your Network)

Page 18: 2 Years Later: Loving and Hating the Cloud Justin Huff justin@picnik.com @jjhuff

(Your NEW Network)

Page 19: 2 Years Later: Loving and Hating the Cloud Justin Huff justin@picnik.com @jjhuff

Clouds Are

Distributed Systems!

Page 20: 2 Years Later: Loving and Hating the Cloud Justin Huff justin@picnik.com @jjhuff

• Are bigger than you!

• Come with some complications

They:

Page 21: 2 Years Later: Loving and Hating the Cloud Justin Huff justin@picnik.com @jjhuff

• #fail

• Hard Debugging

Be Ready For:

Page 22: 2 Years Later: Loving and Hating the Cloud Justin Huff justin@picnik.com @jjhuff

Clouds are Flexible

Page 23: 2 Years Later: Loving and Hating the Cloud Justin Huff justin@picnik.com @jjhuff

That's the point!

Page 24: 2 Years Later: Loving and Hating the Cloud Justin Huff justin@picnik.com @jjhuff

Just don't get lazy

:)

Page 25: 2 Years Later: Loving and Hating the Cloud Justin Huff justin@picnik.com @jjhuff

Thank you!

http://opte.org/maps/http://www.flickr.com/photos/rscottjones/3068940482http://www.flickr.com/photos/cdm/147947664/http://www.flickr.com/photos/28481088@N00/2631082044/

6/22/09 02:43 PM