cloud talk
DESCRIPTION
TRANSCRIPT
whoami
• Johnmwillis.com• Cloud Café
Podcasts
• Redmonk.com/cote • IT Management
Guys Podcast
• Botchagalupe• twitter and gtalk
Cloud TalkGo Big or Go Home
Animoto50 server to 5000 servers in one week25k users to 750k users in one weekTwo weeks later they were back to about 100 servers5 Guys 1 SA!
Cloud TalkThe Myths(The Big Switch “Nick Carr” Syndrome)
Cloud computing will eliminate the need for IT personnel.There will only be one super computer in the future.Cloud HypeEverything is a cloud.
Cloud TalkThe Facts
Cloud technology is realThis technology should not be ignoredThis presentation will try to separate the hype
Cloud TalkThe Advantages
Economies of scale 10’s->100’s->1000’sCommon cloneable infrastructuresElastic and AutonomicThe possibly of green computing
Cloud TalkWhat is the Basis of a Cloud
Abstraction of the hardware infrastructure from the service.Some say it must have an API.
Cloud TalkWhat is my definition of a“Holy-Grail” Cloud
Abstraction of the hardware infrastructure from the service.Abstraction of the software infrastructure from the service.
Cloud Talk
Cloud stuff
Pay as you go No lock inDynamic provisioningLoad Balancing and ClusteringFirewall SupportAutonomics
Windows ServersLive Image MigrationSnapshot ImageCustomizable ImagesAutomated BackupTable Level Backup24 Hour SupportConsulting Services
Cloud Talk
Types of Clouds
Private3Tera, IBM, HP, Cassatt
PublicAmazon, Google, Flexiscale, Gogrid, Joyent, Rackspace, Mosso
Cloud TalkCloud Taxonomy
SaaSSalesforce
PaaSGoogle App Engine, Heroku, Morph, EngineYard, RightScale,Elastra
IaaSAmazon, Flexiscale, GoGrid, Joyent,Rackspace
Cloud TalkCloud Taxonomy
Google “peter laird cloud taxonomy”
Cloud TalkOpen Source Clouds
EucalyptusEnomalismScalr
Cloud TalkCloud Utilities
CohesiveFTrPath (JeOS)BitnamiYlastic
Cloud Talk
Do you Hadoop?
Google does…Yahoo does..IBM does…Facebook does…The New York Times does …Rackspace/Mailtrust does …Now Cloudera does…
Cloud Talk
Amazon
No min – pay as you goEasy to get startedMarket leader All API basedNew (Persistent storage and Windows instances)
Cloud Talk
Flexiscale
Amazon in the UKFractional resources (VPS)Looks like a SP (dedicated VLAN)
Cloud Talk
Mosso
Glorified shared hostingMin investment $100 per monthTransaction fees (3 million puts/gets)No shell accessVery good for elasticity
Cloud Talk
Google App Engine
Python onlyTransaction basedTo early to tell (limited access and free)Unknown cost
Cloud Talk
3Tera
Private or public cloudMore like a gridEntry level is $500 per monthEnterprise is around $1500 per monthPartners with Citrix (Citrix Cloud Center (C3))
Cloud Talk
Cloud Talk
Add Ons
RightscaleElastraYlastic
Cloud Talk
Who’s using the cloud?
The NY TimesAmazon EC2 NasdaqAmazon S3 Major League BaseballJoyentESPNRightscale using Amazon EC2 HasbroAmazon EC2 British Telecom3Tera Taylor WoodrowGoogle Apps CSSAmazon EC2 ActivisionAmazon EC2 Business Objects (A SAP Company)Rightscale using Amazon EC2
Cloud Talk
Vendors in the Cloud?
Red HatGigaSpacesOracleVerticaSun MySQL
Cloud Talk
Cloud Standards?
Elasta (ECML and EDML)3Tera (Cloudware)Citrix (C3)VMWare (Vcloud)DMTF (OVF)
Citrix, Vmware
Cloud Talk
Cloud Developer - Demographics
Small to Medium ($100 per moth) Amazon EC2/S3MossoFlexiscaleGoGrid
Enterprise Entry ($500 per month) 3TeraLayered Technology (3Tera provider)RightScale
Enterprise Large ($1500 per month)3Tera IBM Blue Cloud
Amazon Web Services
EC2 - Elastic Compute CloudS3 - Simple Storage ServiceSQS - Simple Queue ServiceSimpleDB – Simple DatabaseFPS - Flexible Payment ServicesEBS – Elastic Block Storage (New)
EC2 Tutorial
Glossary
ImagesInstancesAMIECU BucketAvailability ZonesStorage VolumesSnapshot
EC2 TutorialStandard Instances
$0.10 - Small Instance (Default) 1.7 GB of memory, 1 EC2 Compute Unit (1 virtual core with 1 EC2 Compute Unit), 160 GB of instance storage, 32-bit platform
$0.40 - Large Instance7.5 GB of memory, 4 EC2 Compute Units (2 virtual cores with 2 EC2 Compute Units each), 850 GB of instance storage, 64-bit platform
$0.80 - Extra Large Instance15 GB of memory, 8 EC2 Compute Units (4 virtual cores with 2 EC2 Compute Units each), 1690 GB of instance storage, 64-bit platform
EC2 Tutorial
High-CPU Instances
$0.20 - High-CPU Medium Instance 1.7 GB of memory, 5 EC2 Compute Units (2 virtual cores with 2.5 EC2 Compute Units each), 350 GB of instance storage, 32-bit platform
$0.80 - High-CPU Extra Large Instance7 GB of memory, 20 EC2 Compute Units (8 virtual cores with 2.5 EC2 Compute Units each), 1690 GB of instance storage, 64-bit platform
EC2 Tutorial
Getting Started
First Signup for an AccountGet Certifications and KeysInstall Tools
EC2 Tutorial
Sign up at aws.amazon.com/ec2
EC2 Tutorial
Getting Certificates and Keys
Access KeysMostly used for Elastic Fox
X509 CertificateMostly used for command line tools
KeyPairUsed for SSH (e.g., putty)
EC2 Tutorial
EC2 Tutorial
Install EC2 Command Line and Setup Environment
Download and unzip EC2 Command Line Tools EC2->Resource Center->Developer Tools
EC2 Tutorial
Configure Command Line Environment
EC2 Tutorial
Configure Command Line Environment
EC2 Tutorial
Use Puttygen create Putty SSH keys
EC2 Tutorial
Save as a Private Key and use in Putty
EC2 Tutorial
EC2 List Images
ec2-describe-images -o amazonec2-describe-images –x all
EC2 Tutorial
EC2 Start, check, and Terminate instances
ec2-run-instances <ami id> -k <keypair file>ec2-describe-instancesec2-terminate-instances <instance id>
EC2 Tutorial
EC2 Elastic IP Addresses
ec2-allocate-addressec2-associate-address –I <ins id> <ip adr>ec2-release-address <ip adr>
EC2 Tutorial
Install Elastic Fox Firefox Extension
Download and install Elastic FoxEC2->Resource Center->Developer Tools
EC2 Tutorial
Configure Elastic Fox
EC2 Tutorial
Configure Elastic Fox
EC2 Tutorial
Configure Elastic Fox
EC2 Tutorial
Configure Elastic Fox
EC2 Tutorial
Launch SSH from Elastic Fox
EC2 Tutorial
EC2 Saving and Registering Images
scp cert and pvt key to /mnt of imageec2-bundle-vol –d /mnt –c <cert> -k <pvtkey> -r i386 –p <out image name>ec2-upload-bundle –b <bid> -m <manifest> -a <access key id> -s <secret key id>ec2-register <bid>/<image name>
EC2 Tutorial
EBS – Elastic Block Storage
Centrally managed storageBuilt-in redundancySnapshot to S3
EC2 Tutorial
EBS – Elastic Block Storage
Create a volume from 1GB to 1TBAttach to an instance$0.10/GB per monthSnapshot (can do incrementals)You can create a new volume from a Snapsot (lazy restore)
EC2 Tutorial
RightScale Tips
Use XFS filesystem for freeze while snap shotingUnmounting can leave data in flightMounting mistakes can be destructiveAlways snapshot after an unmount
EC2 Tutorial
You need to download the latest version of the EBS tools
EC2 Tutorial
Create, Describe, Attach, and Snapshot
ec2-create-volume –size <gb> -z <az>ec2-describe-volumes <vol id>ec2-attach-volume <vol id> -i <iid> -d <mp>ec2-delete-volume <vold id>ec2-create-snapshot <vol id>