oracle on ec2
TRANSCRIPT
Running Oracle in EC2
Cloud Computing GroupSystem Research LabTRDDCPune
2
Overview Section 1: Pricing and Licensing Section 2: Getting Started with AWS Section 3: Installing Oracle Section 4: Secure Backup
3
Section 1Pricing and Licensing
Section 1: Pricing and Licensing1. Amazon Web Services (AWS) Overview
2. Pricing of relevant AWS Services
3. Oracle Licensing and Support
4. Oracle Secure Backup Cloud Module
4
1.1 AWS Overview: Amazon Elastic Compute Cloud (EC2) Amazon Simple Storage Service (S3) Amazon Cloud Front Amazon SimpleDB Amazon Simple Queue Service (SQS) Amazon Elastic MapReduce
5
1.2 AWS Pricing EC2: Elastic Compute Cloud (EC2)
Prices http://aws.amazon.com/ec2/#pricing Amazon Machine Image (AMI):
On Demand, Reserved 1 Year, 3 Years Standard CPU AMI:
Small $0.10/hr, $325/yr ($0.03/hr),$500/3yr Large $0.40/hr, $1300/yr($0.12/hr),
$2000/3yr XLarge $0.80/hr, $2600/yr($0.24/hr),$4000/3yr
High CPU AMI: Medium $0.20/hr, $650/yr($0.06/hr),$1000/3yr XLarge $0.80/hr, $2600/yr($0.24/hr),$4000/3yr
6
1.2 AWS Pricing EC2 (Cont’d): Elastic Compute Cloud (EC2)
Elastic IP Public, Static IP IP Map/Re-map > 100/month $0.10 each $0.01 non-attached per hour
Elastic Block Store (EBS) $0.10 GB/month provisioned $0.10 per 1MM/month I/O requests
EBS Snapshots to S3 $0.15 GB/month $0.01 per 1,000 PUT requests (when saving a snapshot) $0.01 per 10,000 GET requests (when loading a snapshot)
7
1.2 AWS Pricing S3: Simple Storage Service (S3)
Prices http://aws.amazon.com/s3/#pricing Operations: PUT, GET, DELETE Storage
$0.15GB/Month < 50TB $0.14GB/Month > 50TB, < 400TB $0.13GB/Month > 400TB, < 500TB $0.12GB/Month > 500TB
Data Transfer $0.10GB all data transfer in
8
1.2 AWS Pricing S3 (Cont’d): Requests
$0.01 per 1,000 PUT, COPY, POST or LIST request DELETES are free $0.01 per 10,000 GET and all other requests
AWS Import/Export Device Handling $80.00 each Data loading $2.49 per hr (hourly increment)
9
1.2 AWS Pricing Import/Export: Not Database exp/imp AWS Import/Export
Device Handling $80.00 each Data loading $2.49 per hr (hourly increment) http://aws.amazon.com/importexport/ Calculator: http://awsimportexport.s3.amazonaws.com/aws-
import-export-calculator.html
10
1.2 AWS Data Transfer Pricing: Data Transfer:
Regions: US, EU Sub-region (zone) Free within zones on private IP Elastic IP or Public IP outside AWS, regional charges
11
1.3 Oracle Licensing: Existing or New License http://www.oracle.com/corporate/pricing/cloud-
licensing.pdf Cost of AMI Pre-built Oracle AMI (11g) Roll your own AMI
12
1.3 Oracle Support: Virtualization Support – AWS Database Support Oracle Secure Backup Cloud Module http://
www.oracle.com/technology/tech/cloud/faq.html#support
No RAC
13
1.4 Oracle Secure Backup Cloud Module: Backups to S3 via. RMAN 9i R2 and higher Pre-installed on Oracle AMIs EC2 and non-EC2 databases Requires S3 and OTN accounts Integrated with Enterprise Manager
14
15
Section 2Getting Started with AWS
Section 2: Getting Started with AWS1. AWS account
2. AWS EC2 Console
3. EC2 Security Groups
4. EC2 Key Pairs
5. EC2 Amazon Machine Images (AMIs)
6. EC2 Elastic IP
7. EC2 EBS Volumes
8. EC2 Snapshots
9. Using EC2 Command Line tools
16 Oracle on EC2, NoCOUG Aug 20th 2009
2.1 AWS account Amazon.com account Sign up for services at http://aws.amazon.com EC2 Console: http://console.aws.amazon.com
17
2.2 AWS EC2 Console
18
2.2 AWS EC2 Console Security Groups Key Pairs AMIs Instances Elastic IPs EBS Volumes EBS Snapshots
19
2.3 EC2 Security Groups
20
2.3 EC2 Security Groups - Create
21
2.3 EC2 Security Groups – Configuration
22
2.4 EC2 Key Pairs
23
2.4 EC2 Key Pairs – Create
24
2.4 EC2 Key Pairs – Save PEM file
25
2.4 EC2 Key Pairs – Save PEM file Only one opportunity Make a copy Make another offline copy Cannot be retrieved or restored PEM?
26
2.5 EC2 AMIs
27
2.5 EC2 AMIs – List Options Show/Hide (Owner, Platform, Architecture) Oracle owner id = 725966715235 Linux only
28
2.5 EC2 AMIs – Launch Instance
29
2.5 EC2 AMIs – Instance Options
30
2.5 EC2 AMIs – Availability Zones us-east-1a us-east-1b us-east-1c us-east-1d
31
2.5 EC2 AMIs – Instance Launch
32
2.5 EC2 Instances - Pending
33
2.5 EC2 Instances – Launched
34
2.5 EC2 Instances – Command Line Tools Scriptable command line tools:
ec2-bundle-instance ec2-confirm-product-instance ec2-describe-instances ec2-describe-reserved-instances ec2-describe-reserved-instances-offerings ec2-monitor-instances ec2-purchase-reserved-instances-offering ec2-reboot-instances ec2-run-instances ec2-terminate-instances ec2-unmonitor-instances
35
2.6 EC2 Elastic IP Static IP tied to account Assign to any account instance Unassigned is more expensive Redirect failed services Scriptable command line tools:
ec2-allocate-address ec2-associate-address ec2-disassociate-address ec2-release-address
36
2.6 EC2 Elastic IPs
37
2.6 EC2 Elastic IP - Allocate
38
2.6 EC2 Elastic IP - Allocated
39
2.6 EC2 Elastic IP - Associate
40
2.6 EC2 Elastic IP - Associated
41
2.7 EC2 Elastic Block Store (EBS) Volumes Persistent Storage Pick zone and region Assign to an instance within a zone Scriptable command line tools:
ec2-create-volume ec2-delete-volume ec2-attach-volume ec2-detach-volume ec2-describe-volume
42
2.7 EC2 EBS Volumes
43
2.7 EC2 EBS Volumes - Create
44
2.7 EC2 EBS Volumes - Creating
45
2.7 EC2 EBS Volumes - Created
46
2.7 EC2 EBS Volumes - Attach
47
2.7 EC2 EBS Volumes - Attached
48
2.8 EC2 EBS Snapshots Copy of EBS Volume into S3 S3 replicates snapshots across zones Snapshots restorable in any zone Snapshots used to copy EBS volumes within
zones Scriptable command line tools:
ec2-create-snapshot ec2-delete-snapshot ec2-describe-snapshot
49
2.8 EC2 EBS Snapshots
50
2.8 EC2 EBS Snapshots - Create
51
2.8 EC2 EBS Snapshots - Created
52
2.9 Using EC2 Command Line Tools Requires at least Java 5 runtime SSH Acces for Linux (Putty for Windows SSH) RDC for windows (not covered) AWS -> Resources – Developer tools – EC2-
API tools (ec2-api-tools.zip) Setup ENV variables:
JAVA_HOME EC2_HOME is path to unzipped files EC2_PRIVATE_KEY (PEM file path) EC2_CERT (your X.509 cert file path)
53
54
Section 3Installing Oracle
Section 3: Installing Oracle1. Connecting to a new instance
2. Mount EBS Volumes
3. Create database
55
3.1 Connecting to a New Instance PEM file is private key First connection SSH as root Linux SSH command line connect using PEM
file “ssh -i <PEM_file> root@<ip_address>”
Windows Putty SSH Client PuttyGen to load and convert PEM file Save Windows equivalent Private Key file Create Session in Putty using new Private Key file for
authentication
56
3.1 Connecting – License Acceptance
57
3.1 Connecting – Oracle Password
58
3.1 Connecting – No DB auto creation
59
3.2 Mount EBS Volumes Create Partitions on devices
“fdisk /dev/sdf” Create Filesystems
“mkfs.ext3 /dev/sdf1” Create mount points, mount, set permissions
“mkdir /m1” “mount /dev/sdf1 /m1; chown –R oracle:dba /m1”
Edit /etc/fstab to automount “/dev/sdf1 /m1 ext3 defaults 1 1”
Repeat for EBS Volumes
60
3.2 Mount EBS Volume – Create FS
61
3.2 Mount EBS Volume – /etc/fstab
62
3.2 Create Database - Choices 11g Oracle Home:
/u01/app/oracle/product/11.1.0/db_1 Oracle provided script:
/home/oracle/scripts/run_dbca.sh (as root) Customize database post creation
DBA crafted scripts (better) Free script:
http://ocpdba.net/dbcreate/index.html (10g)
63
3.2 Create Database - Recommendations Create separate EBS Volume for /admin /admin used for:
DB Creation scripts Admin scripts DB files (init.ora, spfile, broker files, etc.)
Symlinks from /admin/<dbname>/<file> to Oracle software home
EBS volume snapshot used for new DB hosts
64
3.2 Create Database - Recommendations Allow only SSH port to be open in Security
Group Tunnel SQL*Net across SSH outside the cloud If opened, restrict listener port to fixed IPs
65
3.2 Create Database - Cloning /admin EBS Snapshot cloneable to new
Instances EBS volume snapshots (cold db) used for new
db cloning of database files
66
3.2 Create Database - Performance CPU & Memory fixed Within the cloud fastest for I/O I/O can be scaled
Multiple EBS Volumes Oracle ASM Stripe across EBS Volumes
67
68
Section 4Oracle Secure Backup (OSB)
Cloud Module
Section 4: OSB Cloud Module1. OSB Pre-requisites
2. OSB Setup
3. OSB RMAN Integration
4. OSB Performance
5. RMAN / OSB / S3 Use cases
69
4.1 OSB Pre-requisites Download Cloud Backup Installer Included in Oracle AMIs
“/home/oracle/scripts/osbws/osbws_install.jar” S3 Oracle 9i R2 and higher OTN account
70
4.2 OSB Setup – Installer Options List options for OSB Installer
“su – oracle” “java -jar ~oracle/scripts/osbws/osbws_install.jar” “more ~oracle/scripts/osbws/osbws_readme.txt”
71
4.2 OSB Setup – Installer Options Required
AWSID AWS account access key ID AWSKey AWS account secret access key otnUser & otnPass OTN Credentials for download walletDir Stores credentials for use libDir Location for platform specific
download (RMAN SBT library)
Optional platform and proxy parameters Optional Recommended
configFile Initialization parameter file used by future RMAN jobs
Default: $ORA_HOME/dbs/osbsws<ORACLE_SID>.ora
72
4.2 OSB Setup – Sample Installer Script# install_osb.sh# Set before running: AWSID, AWSKEY, OTNUSER, OTNPASS# libDir stores software specific to the platform for RMAN SBT library parms
use
java -jar ~oracle/scripts/osbws/osbws_install.jar \-AWSID $AWSID \-AWSKEY $AWSKEY \-otnUser $OTNUSER \-otnPass $OTNPASS \-walletDir /admin/osbws/wallet \-configFile /admin/osbws/osb_config.dat \-libDir /admin/osbws/software
73
4.2 OSB Setup – Install Platform Library
74
4.3 OSB RMAN Integration RMAN SBT Parms configuration Installed to libDir parameter in installation RMAN Command:
RMAN> configure channel
device type sbt parms
“SBT_LIBRARY=/admin/osbws/sofware/libosbws11.so
ENV=(OSB_WS_PFILE=/admin/osbws/osb_config.dat)
“;
Ready for backups
75
4.4 OSB RMAN Performance 11g Multiple RMAN Channels 11g datafiles can be backed up across multiple
channels 11g Fast Backup Compression RMAN block change tracking
76
4.5 RMAN / OSB / S3 Use Cases Cloning Scalable backups Moving databases Regional Backup/Recovery Availability
77
Thank You