choosing the right_data_storage_solution_fg_aws_summit_2014
DESCRIPTION
Apresentações do AWS Summit Sao Paulo 2014. Baixe o conteúdo preparado por nossos especialistas para auxiliá-lo na jornada para a nuvem.TRANSCRIPT
![Page 1: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/1.jpg)
© 2014 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified, or distributed in whole or in part without the express consent of Amazon.com, Inc.
Storage & Archiving: Choosing the Right Data Storage Solution Felipe Garcia, Solutions Architect May 27, 2014
![Page 2: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/2.jpg)
Agenda • Common Data Storage Terms • Introduction to AWS Storage Platforms • Cloud storage use cases • TCO • What to do next • Use Case: Titans
![Page 3: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/3.jpg)
Goals for this session • 101 Level Introduction to AWS Data Storage
– Survey of AWS Data Storage Platforms – Learn how AWS Cloud Storage compares to classic models – Cloud Storage Use Cases – How to get started
![Page 4: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/4.jpg)
AWS Storage Options
• Simple Storage • General Purpose Storage • Archive Storage • Storage Gateway
![Page 5: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/5.jpg)
We are constantly producing more data
![Page 6: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/6.jpg)
From all types of industries
![Page 7: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/7.jpg)
Classic and Contemporary
Applications File Systems Database(s) User Generated Content Machine Generated Content Messaging, Collaboration Backup, Archive, DR
![Page 8: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/8.jpg)
First, let’s visit some storage basics
![Page 9: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/9.jpg)
Storage Basics - Block vs. File vs. Object
• Block Storage : SAN : EBS – Data organized as an array of unrelated blocks – Host File System places data on disk: Microsoft NTFS or Unix ZFS – Structured data is predicted to grow at 34% CAGR until 2018
• File Storage : NAS :EBS – Unrelated data blocks managed by a file (serving) system – Native file system places data on disk: EXT or Filers – Unstructured data is predicted to grow at 45.6% CAGR until 2018
• Object Storage :S3:RRS:Glacier – A new data access, data storage, and data management model
• API access to data vs. traditional block or file system access • Metadata Driven, Policy-based, Self Managing storage • No host overhead for storage functions
– A system that stores virtual containers that encapsulate the data, data attributes, metadata, and Object IDs
![Page 10: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/10.jpg)
Storage Basics – SAN, NAS , Object
SERVERS
Object
NAS
SAN Datacenter Proximity
Ethernet / Optical
Datacenter Proximity
Ethernet
Cloud Proximity
API / HTTP(S)
FILESYSTEMS
APPLICATIONS https://
nfs / cifs
FC / iSCSI / FCoE
• SAN and NAS are integrated with clients via operating system • Cloud Storage is an application level integration
![Page 11: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/11.jpg)
No Up-Front Capital Expense
Pay Only for What You Use
Self-Service Infrastructure
Easily Scale Up and Down
Improve Agility & Time-to-Market
Low Cost
Amazon Storage Service Benefits
![Page 12: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/12.jpg)
AWS Global Infrastructure
10 Regions
25 Availability Zones
51 Edge Locations
![Page 13: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/13.jpg)
AWS Regions and Availability Zones
You decide where your data resides
![Page 14: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/14.jpg)
Storage Services Amazon EBS
EBS
Block storage for use with Amazon EC2
Amazon S3
Images Videos Files Binaries Snapshots
Internet scale storage via API
AWS Storage Gateway
S3, Glacier
Integrates on-premises IT and AWS storage
Amazon Glacier
Images Videos Files Binaries Snapshots
Storage for archiving and backup
![Page 15: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/15.jpg)
#1 Object Storage
●○○○○
![Page 16: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/16.jpg)
AMAZON S3 SIMPLE STORAGE SERVICE
![Page 17: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/17.jpg)
99.999999999% Durability
![Page 18: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/18.jpg)
Trillions Of Unique Customer Objects
Q4 2006
Q1 2007
Q2 2007
Q3 2007
Q4 2007
Q1 2008
Q2 2008
Q3 2008
Q4 2008
Q1 2009
Q2 2009
Q3 2009
Q4 2009
Q1 2010
Q2 2010
Q3 2010
Q4 2010Q1 2011
Q2 2011
Q3 2011
Q4 2011
Q1 2012
Q2 2012
Q3 2012
Q4 2012
Q1 2013
Q2 2013
Q3 2013
![Page 19: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/19.jpg)
1.5 Million+ Peak Transactions Per Second
![Page 20: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/20.jpg)
Storage Tiers: Buckets + Unlimited Objects
![Page 21: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/21.jpg)
Reduced Redundancy Option 99.99% saves 20-30%
![Page 22: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/22.jpg)
Amazon S3 Website: Content
![Page 23: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/23.jpg)
Use Amazon S3 When You Need
• Application level connectivity • Unlimited storage capacity • Extremely High durability • Storage for user or machine generated content • Content Depots and Data Lakes • Gold copy, Backup and Data Life Cycle
![Page 24: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/24.jpg)
#2 Block Storage for
General Computing ●●○○○
![Page 25: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/25.jpg)
AMAZON EBS ELASTIC BLOCK STORAGE
![Page 26: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/26.jpg)
10 GB 1TB
Ú
![Page 27: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/27.jpg)
IOPS
Provisioned 4000 IOPS
![Page 28: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/28.jpg)
![Page 29: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/29.jpg)
Amazon EBS Snapshots
![Page 30: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/30.jpg)
![Page 31: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/31.jpg)
Use Amazon EBS When You Need
• Persistent storage • Data changes frequently • Block storage for your databases – Provisioned IOPS
volumes • Filesystem enablement NTFS, ExtFS, RAID, LVM… • Access to raw, unformatted block-level storage
![Page 32: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/32.jpg)
• O Titans Group é líder em serviços de valor agregado para operadoras de telefonia e provedores de internet. Tem produtos em mais de 40 operadoras móveis, fixas e ISPs em 17 países.
• Um de seus principais produtos é uma
aplicação de sincronização de arquivos para Windows, Mac, Android e iOS, além de web e mobile web.
“Os serviços da AWS permitiram ao nosso time focar no desenvolvimento dos produtos e não em operar e escalar infraestrutura.”
“A AWS também trouxe visibilidade
inédita dos custos e ROI de
infraestrutura.” -‐ Antonio Graeff
![Page 33: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/33.jpg)
O Desafio
• O Titans Group precisava garantir que a solução de storage do produto atendesse os requisitos mais exigentes do ponto de vista de durabilidade, disponibilidade e confidencialidade das informações dos usuários.
• Ta m b é m e r a p r e c i s o g a r a n t i r a
escalabilidade tanto do ponto de vista técnico quanto do ponto de vista de custo.
![Page 34: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/34.jpg)
Sobre o Papel da AWS e Benefícios Alcançados
PARAGRAFO RESUMO CASO _ KEY WORDS
de BENEFICIO, DESAFIO VENCIDO – RESUMO DO CASO EM
UM PARAGRAFO
• S3: 99,999999999% de durabilidade, 99,99% de disponibilidade e recursos de criptografia.
• Foco no desenvolvimento das aplicações. • Lições: deduplicação, diff binário, upload e
download direto para S3. • Outros serviços da AWS: EC2, EBS, ELB,
RDS, VPC, auto-scaling, ElasticCache, SNS, SES.
• Mais de 18 milhões de usuários em 17 países.
![Page 35: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/35.jpg)
AMAZON GLACIER LOW-COST ARCHIVING SERVICE
![Page 36: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/36.jpg)
$0.01 Per GB / Month
![Page 37: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/37.jpg)
$120 Per TB / Year
![Page 38: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/38.jpg)
99.999999999% Durability
![Page 39: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/39.jpg)
3-5 Hours Data Retrieval
![Page 40: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/40.jpg)
Use Amazon Glacier When You Need
• Inexpensive, Long-term archiving. Cold Use. • Unlimited storage capacity • Eliminated Tape Museums • Eliminate Tech Refresh • High durability
![Page 41: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/41.jpg)
Amazon S3 / Amazon Glacier Integration POLICY-BASED ARCHIVING SERVICE
![Page 42: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/42.jpg)
Lifecycle Rule
![Page 43: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/43.jpg)
Archive Recovery Process with Tape
+ Days or Weeks
DA
M
![Page 44: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/44.jpg)
Archive Recovery Process with AWS & Amazon Glacier
$$
Hours
Glacier S3 EC2 /HPC
CloudFront Generating Business Value
![Page 45: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/45.jpg)
Use Amazon S3 and Amazon Glacier When You Need
• Backup and Archive in the cloud
• Archive data from Amazon S3/RRS to Amazon Glacier by policy
• Delete data from Amazon Glacier by policy
• Tiering Strategy to support Information Lifecycle Management
![Page 46: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/46.jpg)
AWS STORAGE GATEWAY
![Page 47: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/47.jpg)
The Good News is that Cloud isn’t an ‘All or Nothing’
Corporate Data
Centers
On-Premises Resources
Cloud Resources Integration
![Page 48: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/48.jpg)
Active Directory
Network Configuration
Encryption
Backup Appliances
Your On-Premises
Apps Corporate
Data Centers
Users & Access Rules (IAM)
Your Private Network (VPC)
Encryption (S3, RDS, HSM)
Backups (Storage Gateway)
Your Cloud Apps
AWS Direct Connect
Integrating AWS with your existing On-Premises Infrastructure
![Page 49: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/49.jpg)
AWS Storage Gateway
![Page 50: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/50.jpg)
What is AWS Storage Gateway?
• Integrates on-prem IT environments with Cloud storage for departmental and remote office backup and DR
• Utilizes a virtual appliance that sits in your datacenter
• Exposes storage and backup interface on front end • Stores primary data on-AWS in Amazon S3 or on-
premise with data backed-up to Amazon S3 as Amazon EBS snapshots or Glacier
![Page 51: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/51.jpg)
IT’S ALL ABOUT CHOICE
PERFORMANCE-ORIENTED COST-ORIENTED
![Page 52: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/52.jpg)
Trusted by Enterprises Around the World
![Page 53: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/53.jpg)
Used by Government Agencies & Educational Institutions Worldwide
![Page 54: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/54.jpg)
2014 Premier Tier Partners
![Page 55: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/55.jpg)
TCO • AWS Storage Platforms Provide Lowest TCO by
13-44% as compared to classic deployments. We take cost out for customers in every engagement.
• When is your next capacity upgrade or refresh?
![Page 56: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/56.jpg)
Goals for this session • 101 Level Introduction to AWS Data Storage
– Survey of AWS Data Storage Platforms – Learn how AWS Cloud Storage compares to classic models – Cloud Storage Use Cases
• How to get started – AWS.AMAZON.COM/FREE – AWS.AMAZON.COM/BACKUP-STORAGE
![Page 57: Choosing the right_data_storage_solution_fg_aws_summit_2014](https://reader034.vdocuments.us/reader034/viewer/2022051611/54b6cdeb4a7959b5318b4608/html5/thumbnails/57.jpg)
Thank you! Questions?