oracle on ec2
Post on 19-Jan-2016
30 Views
Preview:
DESCRIPTION
TRANSCRIPT
Running Oracle in EC2
Ahbaid GaffoorAmazon.com/A9.com
2 Oracle on EC2, NoCOUG Aug 20th 2009
Overview• Section 1: Pricing and Licensing• Section 2: Getting Started with AWS• Section 3: Installing Oracle• Section 4: Secure Backup
3 Oracle on EC2, NoCOUG Aug 20th 2009
Section 1Pricing and Licensing
Section 1: Pricing and Licensing1. Amazon Web Services (AWS) Overview2. Pricing of relevant AWS Services3. Oracle Licensing and Support4. Oracle Secure Backup Cloud Module
4 Oracle on EC2, NoCOUG Aug 20th 2009
1.1 AWS Overview:• Amazon Elastic Compute Cloud (EC2)• Amazon Simple Storage Service (S3)• Amazon Cloud Front• Amazon SimpleDB• Amazon Simple Queue Service (SQS)• Amazon Elastic MapReduce
5 Oracle on EC2, NoCOUG Aug 20th 2009
1.2 AWS Pricing EC2:• Elastic Compute Cloud (EC2)– Prices http://aws.amazon.com/ec2/#pricing – Amazon Machine Image (AMI):
• On Demand, Reserved 1 Year, 3 Years
– Standard CPU AMI:• Small $0.10/hr, $325/yr ($0.03/hr),$500/3yr• Large $0.40/hr, $1300/yr($0.12/hr),
$2000/3yr• XLarge $0.80/hr, $2600/yr($0.24/hr),$4000/3yr
– High CPU AMI:• Medium $0.20/hr, $650/yr($0.06/hr),$1000/3yr• XLarge $0.80/hr, $2600/yr($0.24/hr),$4000/3yr
6 Oracle on EC2, NoCOUG Aug 20th 2009
1.2 AWS Pricing EC2 (Cont’d):• Elastic Compute Cloud (EC2)– Elastic IP• Public, Static IP• IP Map/Re-map > 100/month $0.10 each• $0.01 non-attached per hour
– Elastic Block Store (EBS)• $0.10 GB/month provisioned• $0.10 per 1MM/month I/O requests
– EBS Snapshots to S3• $0.15 GB/month • $0.01 per 1,000 PUT requests (when saving a snapshot)• $0.01 per 10,000 GET requests (when loading a snapshot)
7 Oracle on EC2, NoCOUG Aug 20th 2009
1.2 AWS Pricing S3:• Simple Storage Service (S3)– Prices http://aws.amazon.com/s3/#pricing – Operations: PUT, GET, DELETE– Storage• $0.15GB/Month < 50TB• $0.14GB/Month > 50TB, < 400TB• $0.13GB/Month > 400TB, < 500TB• $0.12GB/Month > 500TB
– Data Transfer• $0.10GB all data transfer in
8 Oracle on EC2, NoCOUG Aug 20th 2009
1.2 AWS Pricing S3 (Cont’d):– Requests• $0.01 per 1,000 PUT, COPY, POST or LIST request• DELETES are free• $0.01 per 10,000 GET and all other requests
– AWS Import/Export• Device Handling $80.00 each• Data loading $2.49 per hr (hourly increment)
9 Oracle on EC2, NoCOUG Aug 20th 2009
1.2 AWS Pricing Import/Export:– Not Database exp/imp– AWS Import/Export• Device Handling $80.00 each• Data loading $2.49 per hr (hourly increment)• http://aws.amazon.com/importexport/• Calculator:
http://awsimportexport.s3.amazonaws.com/aws-import-export-calculator.html
10 Oracle on EC2, NoCOUG Aug 20th 2009
1.2 AWS Data Transfer Pricing:• Data Transfer:– Regions: US, EU– Sub-region (zone)– Free within zones on private IP– Elastic IP or Public IP outside AWS, regional charges
11 Oracle on EC2, NoCOUG Aug 20th 2009
1.3 Oracle Licensing:• Existing or New License• http://www.oracle.com/corporate/pricing/cloud-
licensing.pdf• Cost of AMI• Pre-built Oracle AMI (11g)• Roll your own AMI
12 Oracle on EC2, NoCOUG Aug 20th 2009
1.3 Oracle Support:• Virtualization Support – AWS• Database Support• Oracle Secure Backup Cloud Module• http://www.oracle.com/technology/tech/cloud/f
aq.html#support• No RAC
13 Oracle on EC2, NoCOUG Aug 20th 2009
1.4 Oracle Secure Backup Cloud Module:• Backups to S3 via. RMAN• 9i R2 and higher• Pre-installed on Oracle AMIs• EC2 and non-EC2 databases• Requires S3 and OTN accounts• Integrated with Enterprise Manager
14 Oracle on EC2, NoCOUG Aug 20th 2009
15 Oracle on EC2, NoCOUG Aug 20th 2009
Section 2Getting Started with AWS
Section 2: Getting Started with AWS1. AWS account2. AWS EC2 Console3. EC2 Security Groups4. EC2 Key Pairs5. EC2 Amazon Machine Images (AMIs)6. EC2 Elastic IP7. EC2 EBS Volumes8. EC2 Snapshots9. Using EC2 Command Line tools16 Oracle on EC2, NoCOUG Aug 20th 2009
2.1 AWS account• Amazon.com account• Sign up for services at http://aws.amazon.com• EC2 Console: http://console.aws.amazon.com
17 Oracle on EC2, NoCOUG Aug 20th 2009
2.2 AWS EC2 Console
18 Oracle on EC2, NoCOUG Aug 20th 2009
2.2 AWS EC2 Console• Security Groups• Key Pairs• AMIs• Instances• Elastic IPs• EBS Volumes• EBS Snapshots
19 Oracle on EC2, NoCOUG Aug 20th 2009
2.3 EC2 Security Groups
20 Oracle on EC2, NoCOUG Aug 20th 2009
2.3 EC2 Security Groups - Create
21 Oracle on EC2, NoCOUG Aug 20th 2009
2.3 EC2 Security Groups – Configuration
22 Oracle on EC2, NoCOUG Aug 20th 2009
2.4 EC2 Key Pairs
23 Oracle on EC2, NoCOUG Aug 20th 2009
2.4 EC2 Key Pairs – Create
24 Oracle on EC2, NoCOUG Aug 20th 2009
2.4 EC2 Key Pairs – Save PEM file
25 Oracle on EC2, NoCOUG Aug 20th 2009
2.4 EC2 Key Pairs – Save PEM file• Only one opportunity• Make a copy• Make another offline copy• Cannot be retrieved or restored• PEM?
26 Oracle on EC2, NoCOUG Aug 20th 2009
2.5 EC2 AMIs
27 Oracle on EC2, NoCOUG Aug 20th 2009
2.5 EC2 AMIs – List Options• Show/Hide (Owner, Platform, Architecture)• Oracle owner id = 725966715235• Linux only
28 Oracle on EC2, NoCOUG Aug 20th 2009
2.5 EC2 AMIs – Launch Instance
29 Oracle on EC2, NoCOUG Aug 20th 2009
2.5 EC2 AMIs – Instance Options
30 Oracle on EC2, NoCOUG Aug 20th 2009
2.5 EC2 AMIs – Availability Zones• us-east-1a• us-east-1b• us-east-1c• us-east-1d
31 Oracle on EC2, NoCOUG Aug 20th 2009
2.5 EC2 AMIs – Instance Launch
32 Oracle on EC2, NoCOUG Aug 20th 2009
2.5 EC2 Instances - Pending
33 Oracle on EC2, NoCOUG Aug 20th 2009
2.5 EC2 Instances – Launched
34 Oracle on EC2, NoCOUG Aug 20th 2009
2.5 EC2 Instances – Command Line Tools• Scriptable command line tools:– ec2-bundle-instance– ec2-confirm-product-instance– ec2-describe-instances– ec2-describe-reserved-instances– ec2-describe-reserved-instances-offerings– ec2-monitor-instances– ec2-purchase-reserved-instances-offering– ec2-reboot-instances– ec2-run-instances– ec2-terminate-instances– ec2-unmonitor-instances
35 Oracle on EC2, NoCOUG Aug 20th 2009
2.6 EC2 Elastic IP• Static IP tied to account• Assign to any account instance• Unassigned is more expensive• Redirect failed services• Scriptable command line tools:– ec2-allocate-address– ec2-associate-address– ec2-disassociate-address– ec2-release-address
36 Oracle on EC2, NoCOUG Aug 20th 2009
2.6 EC2 Elastic IPs
37 Oracle on EC2, NoCOUG Aug 20th 2009
2.6 EC2 Elastic IP - Allocate
38 Oracle on EC2, NoCOUG Aug 20th 2009
2.6 EC2 Elastic IP - Allocated
39 Oracle on EC2, NoCOUG Aug 20th 2009
2.6 EC2 Elastic IP - Associate
40 Oracle on EC2, NoCOUG Aug 20th 2009
2.6 EC2 Elastic IP - Associated
41 Oracle on EC2, NoCOUG Aug 20th 2009
2.7 EC2 Elastic Block Store (EBS) Volumes• Persistent Storage• Pick zone and region• Assign to an instance within a zone• Scriptable command line tools:– ec2-create-volume– ec2-delete-volume– ec2-attach-volume– ec2-detach-volume– ec2-describe-volume
42 Oracle on EC2, NoCOUG Aug 20th 2009
2.7 EC2 EBS Volumes
43 Oracle on EC2, NoCOUG Aug 20th 2009
2.7 EC2 EBS Volumes - Create
44 Oracle on EC2, NoCOUG Aug 20th 2009
2.7 EC2 EBS Volumes - Creating
45 Oracle on EC2, NoCOUG Aug 20th 2009
2.7 EC2 EBS Volumes - Created
46 Oracle on EC2, NoCOUG Aug 20th 2009
2.7 EC2 EBS Volumes - Attach
47 Oracle on EC2, NoCOUG Aug 20th 2009
2.7 EC2 EBS Volumes - Attached
48 Oracle on EC2, NoCOUG Aug 20th 2009
2.8 EC2 EBS Snapshots• Copy of EBS Volume into S3• S3 replicates snapshots across zones• Snapshots restorable in any zone• Snapshots used to copy EBS volumes within
zones• Scriptable command line tools:– ec2-create-snapshot– ec2-delete-snapshot– ec2-describe-snapshot
49 Oracle on EC2, NoCOUG Aug 20th 2009
2.8 EC2 EBS Snapshots
50 Oracle on EC2, NoCOUG Aug 20th 2009
2.8 EC2 EBS Snapshots - Create
51 Oracle on EC2, NoCOUG Aug 20th 2009
2.8 EC2 EBS Snapshots - Created
52 Oracle on EC2, NoCOUG Aug 20th 2009
2.9 Using EC2 Command Line Tools• Requires at least Java 5 runtime• SSH Acces for Linux (Putty for Windows SSH)• RDC for windows (not covered)• AWS -> Resources – Developer tools – EC2-API
tools (ec2-api-tools.zip)• Setup ENV variables:– JAVA_HOME– EC2_HOME is path to unzipped files– EC2_PRIVATE_KEY (PEM file path)– EC2_CERT (your X.509 cert file path)
53 Oracle on EC2, NoCOUG Aug 20th 2009
54 Oracle on EC2, NoCOUG Aug 20th 2009
Section 3Installing Oracle
Section 3: Installing Oracle1. Connecting to a new instance2. Mount EBS Volumes3. Create database
55 Oracle on EC2, NoCOUG Aug 20th 2009
3.1 Connecting to a New Instance• PEM file is private key• First connection SSH as root• Linux SSH command line connect using PEM file– “ssh -i <PEM_file> root@<ip_address>”
• Windows Putty SSH Client– PuttyGen to load and convert PEM file– Save Windows equivalent Private Key file– Create Session in Putty using new Private Key file for
authentication
56 Oracle on EC2, NoCOUG Aug 20th 2009
3.1 Connecting – License Acceptance
57 Oracle on EC2, NoCOUG Aug 20th 2009
3.1 Connecting – Oracle Password
58 Oracle on EC2, NoCOUG Aug 20th 2009
3.1 Connecting – No DB auto creation
59 Oracle on EC2, NoCOUG Aug 20th 2009
3.2 Mount EBS Volumes• Create Partitions on devices– “fdisk /dev/sdf”
• Create Filesystems – “mkfs.ext3 /dev/sdf1”
• Create mount points, mount, set permissions– “mkdir /m1”– “mount /dev/sdf1 /m1; chown –R oracle:dba /m1”
• Edit /etc/fstab to automount– “/dev/sdf1 /m1 ext3 defaults 1 1”
• Repeat for EBS Volumes60 Oracle on EC2, NoCOUG Aug 20th 2009
3.2 Mount EBS Volume – Create FS
61 Oracle on EC2, NoCOUG Aug 20th 2009
3.2 Mount EBS Volume – /etc/fstab
62 Oracle on EC2, NoCOUG Aug 20th 2009
3.2 Create Database - Choices• 11g Oracle Home: – /u01/app/oracle/product/11.1.0/db_1
• Oracle provided script:– /home/oracle/scripts/run_dbca.sh (as root)– Customize database post creation
• DBA crafted scripts (better)• Free script:– http://ocpdba.net/dbcreate/index.html (10g)
63 Oracle on EC2, NoCOUG Aug 20th 2009
3.2 Create Database - Recommendations• Create separate EBS Volume for /admin• /admin used for:– DB Creation scripts– Admin scripts– DB files (init.ora, spfile, broker files, etc.)
• Symlinks from /admin/<dbname>/<file> to Oracle software home
• EBS volume snapshot used for new DB hosts
64 Oracle on EC2, NoCOUG Aug 20th 2009
3.2 Create Database - Recommendations• Allow only SSH port to be open in Security Group• Tunnel SQL*Net across SSH outside the cloud• If opened, restrict listener port to fixed IPs
65 Oracle on EC2, NoCOUG Aug 20th 2009
3.2 Create Database - Cloning• /admin EBS Snapshot cloneable to new Instances• EBS volume snapshots (cold db) used for new db
cloning of database files
66 Oracle on EC2, NoCOUG Aug 20th 2009
3.2 Create Database - Performance• CPU & Memory fixed• Within the cloud fastest for I/O• I/O can be scaled– Multiple EBS Volumes– Oracle ASM– Stripe across EBS Volumes
67 Oracle on EC2, NoCOUG Aug 20th 2009
68 Oracle on EC2, NoCOUG Aug 20th 2009
Section 4Oracle Secure Backup (OSB)
Cloud Module
Section 4: OSB Cloud Module1. OSB Pre-requisites2. OSB Setup3. OSB RMAN Integration4. OSB Performance5. RMAN / OSB / S3 Use cases
69 Oracle on EC2, NoCOUG Aug 20th 2009
4.1 OSB Pre-requisites• Download Cloud Backup Installer• Included in Oracle AMIs– “/home/oracle/scripts/osbws/osbws_install.jar”
• S3• Oracle 9i R2 and higher• OTN account
70 Oracle on EC2, NoCOUG Aug 20th 2009
4.2 OSB Setup – Installer Options• List options for OSB Installer– “su – oracle”– “java -jar ~oracle/scripts/osbws/osbws_install.jar”– “more ~oracle/scripts/osbws/osbws_readme.txt”
71 Oracle on EC2, NoCOUG Aug 20th 2009
4.2 OSB Setup – Installer Options• Required– AWSID AWS account access key ID– AWSKey AWS account secret access key– otnUser & otnPass OTN Credentials for download– walletDir Stores credentials for use– libDir Location for platform specific
download (RMAN SBT library)
• Optional platform and proxy parameters• Optional Recommended– configFile Initialization parameter file used
by future RMAN jobs– Default: $ORA_HOME/dbs/osbsws<ORACLE_SID>.ora
72 Oracle on EC2, NoCOUG Aug 20th 2009
4.2 OSB Setup – Sample Installer Script
# install_osb.sh# Set before running: AWSID, AWSKEY, OTNUSER, OTNPASS# libDir stores software specific to the platform for RMAN SBT library parms use
java -jar ~oracle/scripts/osbws/osbws_install.jar \-AWSID $AWSID \-AWSKEY $AWSKEY \-otnUser $OTNUSER \-otnPass $OTNPASS \-walletDir /admin/osbws/wallet \-configFile /admin/osbws/osb_config.dat \-libDir /admin/osbws/software
73 Oracle on EC2, NoCOUG Aug 20th 2009
4.2 OSB Setup – Install Platform Library
74 Oracle on EC2, NoCOUG Aug 20th 2009
4.3 OSB RMAN Integration• RMAN SBT Parms configuration• Installed to libDir parameter in installation• RMAN Command:
RMAN> configure channeldevice type sbt parms “SBT_LIBRARY=/admin/osbws/sofware/libosbws11.so ENV=(OSB_WS_PFILE=/admin/osbws/osb_config.dat)
“;
• Ready for backups
75 Oracle on EC2, NoCOUG Aug 20th 2009
4.4 OSB RMAN Performance• 11g Multiple RMAN Channels• 11g datafiles can be backed up across multiple
channels• 11g Fast Backup Compression• RMAN block change tracking
76 Oracle on EC2, NoCOUG Aug 20th 2009
4.5 RMAN / OSB / S3 Use Cases• Cloning• Scalable backups• Moving databases• Regional Backup/Recovery Availability
77 Oracle on EC2, NoCOUG Aug 20th 2009
Thank Youahbaid@{amazon.com|a9.com|att.net}
http://redoblog.wordpress.comhttp://ocpdba.net
top related