building your aws migration strategy for large data sets
TRANSCRIPT
Building Your AWS Migration Strategy for Large Data SetsMatt BlanchardSolutions Architect, SoftNAS
Brent KaplanDirector Business Development, CloudHesive
February 25, 2016
© 2016 SoftNAS, Inc.
Introducing
Matt BlanchardSolutions Architect
SoftNAS
© 2016 SoftNAS, Inc.
Brent KaplanDirector Business
DevelopmentCloudHesive
Housekeeping
Post your questions here
This session IS being recordedLinks to the recording and presentations will be provided later
To listen using your telephone select the ‘Telephone’ option.
For local numbers click the ‘additional numbers’ link.
You will need to use the Access Code and Audio PIN.
The audio for this webinar is available over VoIP. Just select
the use ‘Mic & Speakers’ option to listen to the webinar
through your computers speakers.
If you CAN NOT hear us, please check your
volume settings.
Webinar Audio1
2
3© 2016 SoftNAS, Inc.
Get My $100 AWS Credit!
First 100 attendees to register
(URL announced later)
© 2016 SoftNAS, Inc.
Agenda
• Overview of Amazon Web Services Benefits• Data Migration Strategies with AWS• 5 Migration Options• Providing Highly Available Shared Storage• Demo
– Building Highly Available Shared Storage& Enabling Disaster Recovery
• SoftNAS Overview• CloudHesive Overview• Q&A
© 2016 SoftNAS, Inc.
Overview of Amazon Web Services Benefits
© 2016 SoftNAS, Inc.
7
What are My Storage Options on AWS?
© 2016 SoftNAS, Inc.
8
• Block storage is an unformatted, POSIX-compliant storage device presented to the host operating system.
• Appropriate for use as the primary storage for file systems, databases, or for any applications that require fine granular updates.
• Can be aggregated into logical arrays using LVM or the software RAID utility of your choice (mdadm in Linux, diskpart/diskmgmt.msc in Windows)
What is Block Storage?
© 2016 SoftNAS, Inc.
?
9
• What’s an object, anyway? An object is essentially any blob, or file: multimedia files, PDFs, and text documents are good examples.
• Object or “file” level storage is generally accessible to an application over a protocol, like CIFS, NFS, or HTTP, rather than as a hardware device available to the operating system.
• Useful for cold storage, log files, backup archives, video files, and much more.
What is Object Storage?
© 2016 SoftNAS, Inc.
?
10
Variety of Storage Options
© 2016 SoftNAS, Inc.
Amazon S3 (Simple Storage Service)
Amazon EBS (Elastic Block Storage)
Amazon EC2 Local Instance Store (Ephemeral volumes)
• Each has a unique combination of performance, durability, cost, and interface
• Often used to form a Storage Hierarchy
Data Migration Strategies with AWS
© 2016 SoftNAS, Inc.
12
• Migrate applications to AWS• Build hybrid model• Deploy disaster recovery site
in an AWS region• Backup and archive into
Amazon S3, Glacier• Load data into AWS analytics
services, such as EMR and Redshift.
When Do We Need To Migrate Data?
© 2016 SoftNAS, Inc.
13
Where Do We Migrate To?
© 2016 SoftNAS, Inc.
Amazon S3Durable object
storage for all types of data
Amazon EBSBlock storage for use
with Amazon EC2
Amazon GlacierArchival storage for infrequently accessed data
Economics Easy to Use Reduce riskPay as you go
No upfront investmentNo commitment
No risky capacity planning
Self service administration
SDKs for simple integration
Durable and Secure
Avoid risks of physical media handling
5 Migration Options
© 2016 SoftNAS, Inc.
© 2016 SoftNAS, Inc. 15
• Rsync• FTP• Jump box• SoftNAS Replication• AWS Snowball
What are my BYOT(Bring your own transfer) Options
© 2016 SoftNAS, Inc.
Option Pro ConRsync • Fast, secure and robust • Not easy to use (needs
specific setup). Can be cumbersome over long hauls
FTP • Well known - wide spread, lots of clients, Fat’ish
• Not secure unless using SFTP (then speed is affected). Has a history of being hacking target
Jump Box • Easy to configure (Windows or Linux). Fast setup and deployment
• Relies on file level protocols. Slow (especially SMB)
SoftNAS Replication
• Fast block based ZFS sync. Easy to setup
• Needs SN instance on each side of transmission with own local storage
AWS Snowball • Native Amazon tool, intended for big data
• Hardware solution, requires shipment of appliance. Extra added cost
What Works Best?
17
AWS Snowball – Petabyte Scale Data Transport
© 2016 SoftNAS, Inc. E-ink shipping
label
Ruggedizedcase
“8.5G Impact”
All data encrypted end-to-end
Rain & dust resistant
Tamper-resistant case & electronics
50 TB10GE network
How Fast is Snowball?
© 2016 SoftNAS, Inc.
• Less than 1 day to transfer 250TB via 5x10G connections with 5 Snowballs, less than 1 week including shipping
• Number of days to transfer 250TB via the Internet at typical utilizations Internet Connection Speed
Utilization 1Gbps 500Mbps 300Mbps 150Mbps25% 95 190 316 63250% 47 95 158 31675% 32 63 105 211
Providing Highly Available Shared Storage
© 2016 SoftNAS, Inc.
20
• SNAP™ HA– Provides high availability seamless failover across zones– Leverages secure block replication with SoftNAS SnapReplicate
• Recommended: SNAP HA in high-availability mode = 99.999% uptime
High-Availability Architecture
© 2016 SoftNAS, Inc.
21
Cross-zone HA: AWS Elastic IP
© 2016 SoftNAS, Inc.
22
Cross-zone HA: Private Virtual IP Addresses
© 2016 SoftNAS, Inc.
Demo: Building Highly Available Shared Storage & Enabling Disaster Recovery
© 2016 SoftNAS, Inc.
SoftNAS Overview
© 2016 SoftNAS, Inc.
25
Six main reasons to consider SoftNAS Cloud on AWS:
1. Powerful, full-featured data storage software2. Pure AWS3. Provides the BEST data protection available4. Fast, performance-tuned5. Easy, no specialized training required6. On-demand in AWS Marketplace
Best Solution
© 2016 SoftNAS, Inc.
26
SoftNAS Products
© 2016 SoftNAS, Inc.
SoftNAS Cloud NAS• Amazon Web Services (AWS)• Microsoft Azure• CenturyLink Cloud• VMware vSphere
SoftNAS for Service Providers• VMware vSphere
Multi-tenant NAS replacement for use with iSCSI and object storage
Public cloud NAS filerOn-premise cloud NAS filer
Technology Partners
© 2016 SoftNAS, Inc.
Brands You Know Trust SoftNAS
CloudHesive Overview
© 2016 SoftNAS, Inc.
30
Sign up for a AWS/SoftNAS Proof of Concept with CloudHesive & earn $75 AWS Credit!
• Contact Brent Kaplan to sign up!– [email protected] – Ph: 754-300-1798
Earn Additional $75 AWS Credit
© 2016 SoftNAS, Inc.
31
• CloudHesive is an Amazon Web Services (AWS) Advanced Consulting Partner
• The ‘Go To’ Technical Partner for SoftNAS deployments.
• Managed Services Provider focused on cloud and security solutions
• Customers Profile that we Protected– HealthCare– Financial services– Regulated industries
Who Is CloudHesive
© 2016 SoftNAS, Inc.
32
• Consulting – Cloud Strategy– Migration planning– Cloud Support
• Managed Security Services– Encryption as a Service (EaaS)– End Point Security – Encryption for data in-flight– Threat Management– Oversight of the security controls
• Managed Services – Migration to a cloud provider– Environments wrapped in security controls– Governance on Release/Change management processes– End to end monitoring and management
What We Do
© 2016 SoftNAS, Inc.
We offer end-to-end cloud services and solutions to migrate and secure your mission critical applications.
33
• Implement Enterprise Solutions for small to mid-sized businesses
• Migration and Cloud security experts
• Allow us to do your migration for you so you can focus on your core business !!!
Cloud Migration Solutions
© 2016 SoftNAS, Inc.
34
• Website : www.cloudhesive.com
• Website : www.softnas.com
• Get a $75 credit voucher with AWS for doing a SoftNAS proof of concept with CloudHesive
CloudHesive Info
© 2016 SoftNAS, Inc.
Earn $100 AWS Credit!
First 100 attendees to register
bit.ly/cloudhesive-aws-credits
© 2016 SoftNAS, Inc.
Next Steps• Learn More – bit.ly/softnas_aws &
cloudhesive.com
• SoftNAS Architecture on AWS White Paper – bit.ly/softnas-aws-wp
• Contact Us – softnas.com/contact
• Follow Us – @SoftNAS
• For additional information contact CloudHesive at [email protected] or 754-300-1798
Try It!
softnas.com/tryaws© 2016 SoftNAS, Inc.
Thank you
© 2016 SoftNAS, Inc.