db virtualization and consolidation at itec 2011
DESCRIPTION
A presentation I gave with Mike Radomski on ITECs consolidation and virtualization approach. We discuss OVM and VMWare server consolidation, as well as database and application server consolidation. I also discuss the DBA 2.0 organizational structure we are engaging to enable us to better manage highly virtualized Oracle databases and WebLogic implementations.TRANSCRIPT
Information Technology Exchange Center • Dan Brint • Mike Radomski1
1Friday, June 17, 2011
SUNYNet
SUNY OIT(Office of Information Technology)
2
2Friday, June 17, 2011
Todays Agenda• Virtualization & Consolidation
WRT:
• Network
• Server
• Storage
• Database Consolidation
• Database Virtualization
• Eye to the Cloud
3
3Friday, June 17, 2011
http://about.me/M
ichaelRadomski
4
4Friday, June 17, 2011
Infrastructure Agenda• Strategy for Consolidation
• Server
• Operating System
• Network
• Storage
• Strategy for Virtualization
• Cloud Definition
• Private Cloud vs. Public Cloud
• Future Services
5
5Friday, June 17, 2011
ITEC’s Consolidation Strategy
• Server
• Operating System
• Network
• Storage
6
6Friday, June 17, 2011
Banner to Linux
7
• Took advantage of Banner 8 upgrade to standardize
• Several campuses migrated from *nix/VMS to Linux
• Most campuses adopted 3-tier Banner Architecture
7Friday, June 17, 2011
8
Campus Banner Status
8Friday, June 17, 2011
Consolidation of Technology
• Server: Dell m610 servers 48-96GB, pick the “sweet spot”
• Operating System: Linux preferred, Windows when necessary.
• Virtualization: Oracle VM for Linux, VMware ESX for Windows
• Fiber Channel: HP EVA Platform
• iSCSI: Dell EqualLogic
• Network: Cisco Core, Nexus, Firewall, NAC, Access Switches/APs
9
9Friday, June 17, 2011
Consolidation Opens Doors
• Technology Stacks
• Capacity planning
• Test and R&D Hardware
• Enterprise Purchases
• Interoperability
10
10Friday, June 17, 2011
ITEC’s Virtualization Strategy
• Cloud Definition
• Private Cloud vs. Public Cloud
• Future Services
11
11Friday, June 17, 2011
The Cloud
12
12Friday, June 17, 2011
NIST Definition of Cloud
• Cloud computing is a model for enabling ubiquitous, convenient, on-demand network access to a shared pool of configurable computing resources (e.g., networks, servers, storage, applications, and services) that can be rapidly provisioned and released with minimal management effort or service provider interaction. This cloud model promotes availability and is composed of five essential characteristics, three service models, and four deployment models.
• Full NIST Definition: http://goo.gl/PLu7J
13
13Friday, June 17, 2011
Cloud Ingredients
14
14Friday, June 17, 2011
Essential Characteristics
• On-demand self-service
• Broad network access
• Resource pooling
• Rapid elasticity
• Measured Service
15
15Friday, June 17, 2011
Service Models
16
Software as a Service (SaaS)
Platform as a Service (PaaS)
Infrastructure as a Service (IaaS)
Applications running in the cloud, access through thin client (i.e. web browser)
Consumer deploys acquired or custom applications onto cloud infrastructure,
does not manage underlying cloud infrastructure
Consumer provisions OS, processing, storage, network, etc resources.
Consumer controls OS & resources, provider manages cloud infrastructure
SalesForce CRM, Google Apps, Microsoft Online
Bungee Connect, Google AppEngine, Microsoft Azure Services Platform
Amazon S3/EC2, VMware vCloud, Rackspace
16Friday, June 17, 2011
Service Models
17
17Friday, June 17, 2011
Deployment Models
• Private cloud - single organization
• Community cloud - several organizations with shared concerns
• Public cloud - a cloud service provider
• Hybrid cloud - composed of two or more of the above
18
18Friday, June 17, 2011
Hybrid Cloud
19
19Friday, June 17, 2011
Current Offerings
20
Softwareas a Service
Platformas a Service
Infrastructureas a Service
Knowledgeas a service
•Confluence
•@task
•Exchange E-mail
•Ensemble Video
•Elluminate
•Banner
•Banner DR
•Angel
•SUNYConnect
•On Demand Servers
•DR for OIT
•ITEC Helpdesk
•Remote Services
•Consulting SUNY Cloud
est. 1988
20Friday, June 17, 2011
Future Services• Software as a Service
• Academic Software as a Service
• Desktop as a Service
• Platform as a Service
• Database as a Service
• Infrastructure as a Service
• Storage as a Service
• Server as a Service
21
21Friday, June 17, 2011
Road to Ubiquity• “Technology is a utility just like electric and water.” ~Ron Brown
• Evaluating vendor’s self service offerings
• Dell Advanced Infrastructure Manager (AIM) & Self-Service Creator
• HP CloudSystem & CloudSystem Matrix
• Oracle Enterprise Manager Cloud Management
• Use self-service internally
• FY2011-2012 - One Virtual Machine Per Member
22
22Friday, June 17, 2011
http://about.me/D
anBrint
23
23Friday, June 17, 2011
Database Agenda
• No boring what or why ‘filler’
• 3 specific case studies
• Library
• Business Intelligence
• Student Information System
24
24Friday, June 17, 2011
• 52 databases
• 3 largish servers
• Virtualized via IBM lPar technology
• Schema based consolidation with ≤ 3 campuses per DB
• 2 Oracle code trees per server
• 1+X application code trees per server (Aleph 500 by ExLibris)
• Advantage - Campus demand lifecycle
Seneca
8 CPU40 GB RAM1 TB Disk
18 DB (p&d)19 Campuses
Saranac
10 CPU50 GB RAM2 TB Disk
18 DB (p&d)19 Campuses
Delaware
8 CPU37 GB RAM2 TB Disk
16 DB (p&d)18 Campuses
Union
1 CPU10 GB RAM3 TB Disk
1 DB56 Campuses
Mohawk
4 CPU5 GB RAM<1 TB Disk
6 DB 6 Campuses
56 8.4 M 303 K 1.3 M
2010
Library
25
25Friday, June 17, 2011
search.sunyconnect.suny.edu
• Replaces a dedicated database, server and somewhat specialized vendor software implementation
• Provides u-wide search capabilities
+
+
=
10,000 / month
26
26Friday, June 17, 2011
SUNYConnect (Library)• Utilizes schema based consolidation
• Multi-tenent friendly application
• ~ 18 databases per server
• 2 Oracle code trees per server
• A single database failure affects < 4 campuses
• But a single server failure affects 19 campuses
• Union catalog = read only uber consolidation
• Replaced Union with an AWS based search service (very modest resources)
• Draws upon existing catalog services
• Little bit of custom code
• ... and yes it was impacted by the AWS outage in April 2011. However, each library specific search remained operational and a workaround was implemented prior to full AWS service restoration
27
27Friday, June 17, 2011
Analysis
TrendsProjections
Information
Campus ERP
Insight
Campus ERP
Decisions
SUNYGoodness
Institution
majors
demographics
curriculum
courses
grades enrollment
programs
budget
SUNY BI Cloud by D. Brint (2010)
Knowledge
ITEC(Hosted ODS,
DataCenter BI, Online Learning)
OAS(Financial, Library ?)
RF(???)
Campus(ODS)
Business Intelligence
28
28Friday, June 17, 2011
BI Cloud
MultitenantODS via VPD
Database
OS: OEL Linux 5.x 64bitCPU: 6RAM: 32 GBStorage: 7300 GB
Admin Server
OS: Windows Server 2003 32bitCPU: 1RAM: 4 GBStorage: 80gb
3 Node WebLogicCluster
Windows AdminToolset
MultitenantODS via VPD
Database
OS: OEL Linux 5.x 64bitCPU: 6RAM: 32 GBStorage: 7300 GB
Admin Server
OS: Windows Server 2003 32bitCPU: 1RAM: 4GBStorage: 80gb
2 Node WebLogicCluster
Windows AdminToolset
Primary Site DR Site
Middleware
OS: OEL Linux 5.x 64bitCPU: 2RAM: 8 GBStorage: 80GB
IdM(Identity Service)
IdM(Identity Service)
Middleware
OS: OEL Linux 5.x 64bitCPU: 2RAM: 8 GBStorage: 80GB
SISSIS
OBIEE OBIEE
29
29Friday, June 17, 2011
SICAS BI Cloud• Shared infrastructure (consolidation AND virtualization)
• ‘schema like’ data consolidation via VPD (Virtual Private Database)
• Consolidation of application via a single shared OBIEE implementation
• Facilitates campus unique data and campus specific BI development as well
• Sized for 24 Campuses • 12,750 active users • 10% concurrency
• 3.6 TB Operational Data Store
• Dramatic reduction in infrastructure management costs (one database, one application)
30
30Friday, June 17, 2011
Student Information System (SIS)
• Built upon SunGardHE Banner
• Managed in conjunction with SICAS and each campus
• Evolved over time
• Increasing value to campus
• Increasing complexity
• Increasing number of moving parts
SIS
31
31Friday, June 17, 2011
DB Server 1
Databases
PROD
Software
Oracle RDBMS
DB Server 2
Databases
PPRD
DEVL
Software
Oracle RDBMS
Banner Server (PROD)
Software
Oracle Client
Oracle Precompilers Pro C, Pro Cobol
Oracle SQR
Databases Accessed
Apps
Proc CProc CobSQR
SQL / OS Shell Scripts
PROD
Banner Server (Dev)
Software
Oracle Client
Oracle Precompilers Pro C, Pro Cobol
Oracle SQR
Databases Accessed
Apps
Proc CProc CobSQR
SQL / OS Shell Scripts
DEVLPPRDWeb (App) Server
Software
Oracle Internet Application Server (10gR2,R3)
Databases Accessed
PROD
Apps
ReportsForms
mod pl/sql OC4J
PPRD DEVL
SIS
32
32Friday, June 17, 2011
SIS
App DApp C
App B
DB Server 1
Databases
PROD
Software
Oracle RDBMS
DB Server 2
Databases
PPRD
DEVL
Software
Oracle RDBMS
Banner Server (PROD)
Software
Oracle Client
Oracle Precompilers Pro C, Pro Cobol
Oracle SQR
Databases Accessed
Apps
Proc CPro CobSQR
SQL / OS Shell Scripts
PROD
Banner Server (Dev)
Software
Oracle Client
Oracle Precompilers Pro C, Pro Cobol
Oracle SQR
Databases Accessed
Apps
Proc CPro CobSQR
SQL / OS Shell Scripts
DEVLPPRDWeb (App) Server
SoftwareOracle Internet Application Server
(10gR2,R3)
Databases AccessedPROD
AppsReportsForms
mod pl/sql OC4J
PPRD DEVL
DB Server 3
Databases
A
Software
Oracle RDBMS
DB Server 4
Databases
AA
Software
Oracle RDBMS
App A
Software
Oracle Client
Java
Databases Accessed
Apps
Comp 2Comp 1
PROD
App DApp C
App BApp A
Software
Oracle Client
Java
Databases Accessed
Apps
Comp 2Comp 1
DEVLPPRD
B C D AA
AA
AA
32
32Friday, June 17, 2011
11 Banner Campuses
Numerous
Other Apps
too ...
193 Oracle
Databases
Thats a lot of ‘stuff ’ to manage !
33
33Friday, June 17, 2011
App DApp C
App B
DB Server 1
Databases
PROD
Software
Oracle RDBMS
DB Server 2
Databases
PPRD
DEVL
Software
Oracle RDBMS
Banner Server (PROD)
Software
Oracle Client
Oracle Precompilers Pro C, Pro Cobol
Oracle SQR
Databases Accessed
Apps
Proc CPro CobSQR
SQL / OS Shell Scripts
PROD
Banner Server (Dev)
Software
Oracle Client
Oracle Precompilers Pro C, Pro Cobol
Oracle SQR
Databases Accessed
Apps
Proc CPro CobSQR
SQL / OS Shell Scripts
DEVLPPRDWeb (App) Server
SoftwareOracle Internet Application Server
(10gR2,R3)
Databases AccessedPROD
AppsReportsForms
mod pl/sql OC4J
PPRD DEVL
DB Server 3
Databases
A
Software
Oracle RDBMS
DB Server 4
Databases
AA
Software
Oracle RDBMS
App A
Software
Oracle Client
Java
Databases Accessed
Apps
Comp 2Comp 1
PROD
App DApp C
App BApp A
Software
Oracle Client
Java
Databases Accessed
Apps
Comp 2Comp 1
DEVLPPRD
B C D AA
AA
AA
App DApp C
App B
DB Server 1
Databases
PROD
Software
Oracle RDBMS
DB Server 2
Databases
PPRD
DEVL
Software
Oracle RDBMS
Banner Server (PROD)
Software
Oracle Client
Oracle Precompilers Pro C, Pro Cobol
Oracle SQR
Databases Accessed
Apps
Proc CPro CobSQR
SQL / OS Shell Scripts
PROD
Banner Server (Dev)
Software
Oracle Client
Oracle Precompilers Pro C, Pro Cobol
Oracle SQR
Databases Accessed
Apps
Proc CPro CobSQR
SQL / OS Shell Scripts
DEVLPPRDWeb (App) Server
SoftwareOracle Internet Application Server
(10gR2,R3)
Databases AccessedPROD
AppsReportsForms
mod pl/sql OC4J
PPRD DEVL
DB Server 3
Databases
A
Software
Oracle RDBMS
DB Server 4
Databases
AA
Software
Oracle RDBMS
App A
Software
Oracle Client
Java
Databases Accessed
Apps
Comp 2Comp 1
PROD
App DApp C
App BApp A
Software
Oracle Client
Java
Databases Accessed
Apps
Comp 2Comp 1
DEVLPPRD
B C D AA
AA
AA
App DApp C
App B
DB Server 1
Databases
PROD
Software
Oracle RDBMS
DB Server 2
Databases
PPRD
DEVL
Software
Oracle RDBMS
Banner Server (PROD)
Software
Oracle Client
Oracle Precompilers Pro C, Pro Cobol
Oracle SQR
Databases Accessed
Apps
Proc CPro CobSQR
SQL / OS Shell Scripts
PROD
Banner Server (Dev)
Software
Oracle Client
Oracle Precompilers Pro C, Pro Cobol
Oracle SQR
Databases Accessed
Apps
Proc CPro CobSQR
SQL / OS Shell Scripts
DEVLPPRDWeb (App) Server
SoftwareOracle Internet Application Server
(10gR2,R3)
Databases AccessedPROD
AppsReportsForms
mod pl/sql OC4J
PPRD DEVL
DB Server 3
Databases
A
Software
Oracle RDBMS
DB Server 4
Databases
AA
Software
Oracle RDBMS
App A
Software
Oracle Client
Java
Databases Accessed
Apps
Comp 2Comp 1
PROD
App DApp C
App BApp A
Software
Oracle Client
Java
Databases Accessed
Apps
Comp 2Comp 1
DEVLPPRD
B C D AA
AA
AA
App DApp C
App B
DB Server 1
Databases
PROD
Software
Oracle RDBMS
DB Server 2
Databases
PPRD
DEVL
Software
Oracle RDBMS
Banner Server (PROD)
Software
Oracle Client
Oracle Precompilers Pro C, Pro Cobol
Oracle SQR
Databases Accessed
Apps
Proc CPro CobSQR
SQL / OS Shell Scripts
PROD
Banner Server (Dev)
Software
Oracle Client
Oracle Precompilers Pro C, Pro Cobol
Oracle SQR
Databases Accessed
Apps
Proc CPro CobSQR
SQL / OS Shell Scripts
DEVLPPRDWeb (App) Server
SoftwareOracle Internet Application Server
(10gR2,R3)
Databases AccessedPROD
AppsReportsForms
mod pl/sql OC4J
PPRD DEVL
DB Server 3
Databases
A
Software
Oracle RDBMS
DB Server 4
Databases
AA
Software
Oracle RDBMS
App A
Software
Oracle Client
Java
Databases Accessed
Apps
Comp 2Comp 1
PROD
App DApp C
App BApp A
Software
Oracle Client
Java
Databases Accessed
Apps
Comp 2Comp 1
DEVLPPRD
B C D AA
AA
AA
App DApp C
App B
DB Server 1
Databases
PROD
Software
Oracle RDBMS
DB Server 2
Databases
PPRD
DEVL
Software
Oracle RDBMS
Banner Server (PROD)
Software
Oracle Client
Oracle Precompilers Pro C, Pro Cobol
Oracle SQR
Databases Accessed
Apps
Proc CPro CobSQR
SQL / OS Shell Scripts
PROD
Banner Server (Dev)
Software
Oracle Client
Oracle Precompilers Pro C, Pro Cobol
Oracle SQR
Databases Accessed
Apps
Proc CPro CobSQR
SQL / OS Shell Scripts
DEVLPPRDWeb (App) Server
SoftwareOracle Internet Application Server
(10gR2,R3)
Databases AccessedPROD
AppsReportsForms
mod pl/sql OC4J
PPRD DEVL
DB Server 3
Databases
A
Software
Oracle RDBMS
DB Server 4
Databases
AA
Software
Oracle RDBMS
App A
Software
Oracle Client
Java
Databases Accessed
Apps
Comp 2Comp 1
PROD
App DApp C
App BApp A
Software
Oracle Client
Java
Databases Accessed
Apps
Comp 2Comp 1
DEVLPPRD
B C D AA
AA
AA
App DApp C
App B
DB Server 1
Databases
PROD
Software
Oracle RDBMS
DB Server 2
Databases
PPRD
DEVL
Software
Oracle RDBMS
Banner Server (PROD)
Software
Oracle Client
Oracle Precompilers Pro C, Pro Cobol
Oracle SQR
Databases Accessed
Apps
Proc CPro CobSQR
SQL / OS Shell Scripts
PROD
Banner Server (Dev)
Software
Oracle Client
Oracle Precompilers Pro C, Pro Cobol
Oracle SQR
Databases Accessed
Apps
Proc CPro CobSQR
SQL / OS Shell Scripts
DEVLPPRDWeb (App) Server
SoftwareOracle Internet Application Server
(10gR2,R3)
Databases AccessedPROD
AppsReportsForms
mod pl/sql OC4J
PPRD DEVL
DB Server 3
Databases
A
Software
Oracle RDBMS
DB Server 4
Databases
AA
Software
Oracle RDBMS
App A
Software
Oracle Client
Java
Databases Accessed
Apps
Comp 2Comp 1
PROD
App DApp C
App BApp A
Software
Oracle Client
Java
Databases Accessed
Apps
Comp 2Comp 1
DEVLPPRD
B C D AA
AA
AA
App DApp C
App B
DB Server 1
Databases
PROD
Software
Oracle RDBMS
DB Server 2
Databases
PPRD
DEVL
Software
Oracle RDBMS
Banner Server (PROD)
Software
Oracle Client
Oracle Precompilers Pro C, Pro Cobol
Oracle SQR
Databases Accessed
Apps
Proc CPro CobSQR
SQL / OS Shell Scripts
PROD
Banner Server (Dev)
Software
Oracle Client
Oracle Precompilers Pro C, Pro Cobol
Oracle SQR
Databases Accessed
Apps
Proc CPro CobSQR
SQL / OS Shell Scripts
DEVLPPRDWeb (App) Server
SoftwareOracle Internet Application Server
(10gR2,R3)
Databases AccessedPROD
AppsReportsForms
mod pl/sql OC4J
PPRD DEVL
DB Server 3
Databases
A
Software
Oracle RDBMS
DB Server 4
Databases
AA
Software
Oracle RDBMS
App A
Software
Oracle Client
Java
Databases Accessed
Apps
Comp 2Comp 1
PROD
App DApp C
App BApp A
Software
Oracle Client
Java
Databases Accessed
Apps
Comp 2Comp 1
DEVLPPRD
B C D AA
AA
AA
App DApp C
App B
DB Server 1
Databases
PROD
Software
Oracle RDBMS
DB Server 2
Databases
PPRD
DEVL
Software
Oracle RDBMS
Banner Server (PROD)
Software
Oracle Client
Oracle Precompilers Pro C, Pro Cobol
Oracle SQR
Databases Accessed
Apps
Proc CPro CobSQR
SQL / OS Shell Scripts
PROD
Banner Server (Dev)
Software
Oracle Client
Oracle Precompilers Pro C, Pro Cobol
Oracle SQR
Databases Accessed
Apps
Proc CPro CobSQR
SQL / OS Shell Scripts
DEVLPPRDWeb (App) Server
SoftwareOracle Internet Application Server
(10gR2,R3)
Databases AccessedPROD
AppsReportsForms
mod pl/sql OC4J
PPRD DEVL
DB Server 3
Databases
A
Software
Oracle RDBMS
DB Server 4
Databases
AA
Software
Oracle RDBMS
App A
Software
Oracle Client
Java
Databases Accessed
Apps
Comp 2Comp 1
PROD
App DApp C
App BApp A
Software
Oracle Client
Java
Databases Accessed
Apps
Comp 2Comp 1
DEVLPPRD
B C D AA
AA
AA
App DApp C
App B
DB Server 1
Databases
PROD
Software
Oracle RDBMS
DB Server 2
Databases
PPRD
DEVL
Software
Oracle RDBMS
Banner Server (PROD)
Software
Oracle Client
Oracle Precompilers Pro C, Pro Cobol
Oracle SQR
Databases Accessed
Apps
Proc CPro CobSQR
SQL / OS Shell Scripts
PROD
Banner Server (Dev)
Software
Oracle Client
Oracle Precompilers Pro C, Pro Cobol
Oracle SQR
Databases Accessed
Apps
Proc CPro CobSQR
SQL / OS Shell Scripts
DEVLPPRDWeb (App) Server
SoftwareOracle Internet Application Server
(10gR2,R3)
Databases AccessedPROD
AppsReportsForms
mod pl/sql OC4J
PPRD DEVL
DB Server 3
Databases
A
Software
Oracle RDBMS
DB Server 4
Databases
AA
Software
Oracle RDBMS
App A
Software
Oracle Client
Java
Databases Accessed
Apps
Comp 2Comp 1
PROD
App DApp C
App BApp A
Software
Oracle Client
Java
Databases Accessed
Apps
Comp 2Comp 1
DEVLPPRD
B C D AA
AA
AA
App DApp C
App B
DB Server 1
Databases
PROD
Software
Oracle RDBMS
DB Server 2
Databases
PPRD
DEVL
Software
Oracle RDBMS
Banner Server (PROD)
Software
Oracle Client
Oracle Precompilers Pro C, Pro Cobol
Oracle SQR
Databases Accessed
Apps
Proc CPro CobSQR
SQL / OS Shell Scripts
PROD
Banner Server (Dev)
Software
Oracle Client
Oracle Precompilers Pro C, Pro Cobol
Oracle SQR
Databases Accessed
Apps
Proc CPro CobSQR
SQL / OS Shell Scripts
DEVLPPRDWeb (App) Server
SoftwareOracle Internet Application Server
(10gR2,R3)
Databases AccessedPROD
AppsReportsForms
mod pl/sql OC4J
PPRD DEVL
DB Server 3
Databases
A
Software
Oracle RDBMS
DB Server 4
Databases
AA
Software
Oracle RDBMS
App A
Software
Oracle Client
Java
Databases Accessed
Apps
Comp 2Comp 1
PROD
App DApp C
App BApp A
Software
Oracle Client
Java
Databases Accessed
Apps
Comp 2Comp 1
DEVLPPRD
B C D AA
AA
AA
App DApp C
App B
DB Server 1
Databases
PROD
Software
Oracle RDBMS
DB Server 2
Databases
PPRD
DEVL
Software
Oracle RDBMS
Banner Server (PROD)
Software
Oracle Client
Oracle Precompilers Pro C, Pro Cobol
Oracle SQR
Databases Accessed
Apps
Proc CPro CobSQR
SQL / OS Shell Scripts
PROD
Banner Server (Dev)
Software
Oracle Client
Oracle Precompilers Pro C, Pro Cobol
Oracle SQR
Databases Accessed
Apps
Proc CPro CobSQR
SQL / OS Shell Scripts
DEVLPPRDWeb (App) Server
SoftwareOracle Internet Application Server
(10gR2,R3)
Databases AccessedPROD
AppsReportsForms
mod pl/sql OC4J
PPRD DEVL
DB Server 3
Databases
A
Software
Oracle RDBMS
DB Server 4
Databases
AA
Software
Oracle RDBMS
App A
Software
Oracle Client
Java
Databases Accessed
Apps
Comp 2Comp 1
PROD
App DApp C
App BApp A
Software
Oracle Client
Java
Databases Accessed
Apps
Comp 2Comp 1
DEVLPPRD
B C D AA
AA
AA
11 Banner Campuses
Numerous
Other Apps
too ...
193 Oracle
Databases
Thats a lot of ‘stuff ’ to manage !
33
33Friday, June 17, 2011
Database Cluster (RAC)
RAC Node1
db1
RAC Node2
db4
RAC Node3
db4
Banner on Linux n-tier
db2 db2
db5
db3 db3 db3
WWW 01
Binghamton
Buffalo StateDutchess
JCCNassau
SuffolkDB10DB 9 SICASDB 8 OldWestbur
DB 1 Binghamton
DB 7 NiagaraDB 6 NewPaltz
DutchessBuffalo State
JCCNassau
DB 2DB 3DB 4DB 5
Web tierINB and SSB
Banner tiergurjobs, command line ‘stuff’
Database tierdatabases
RAC NodeY
db10
db9
RAC NodeZ
db2
db1 db1
db10
Old WestburyNewPaltz
NewPaltzNiagara
Old Westbury
WWW 02
Binghamton
Buffalo StateDutchess
JCCNassau
NewPaltzNiagara
Old Westbury
WWW 03
Binghamton
Buffalo StateDutchess
JCCNassau
NewPaltzNiagara
Old Westbury
WWW x
Binghamton
Buffalo StateDutchess
JCCNassau
NewPaltzNiagara
Old Westbury
WWW y
Binghamton
Buffalo StateDutchess
JCCNassau
NewPaltzNiagara
Old Westbury
WWW z
Binghamton
Buffalo StateDutchess
JCCNassau
NewPaltzNiagara
Old Westbury
Niagara
Binghamton Buffalo State Dutchess JCC
SICASSuffolk
SICASSuffolk
SICASSuffolk
SICASSuffolk
SICASSuffolk
SICASSuffolk
SICAS Suffolk
Nassau
• 100,000+ student population• 10 Campuses• 19,000 students registered in 90 minutes• 10 application servers• 10 banner servers• 6 database servers
every 15 seconds
But ... remember our SunGard Banner on
RAC proof of concept?
52 passenger 34
34Friday, June 17, 2011
Double Payback• Performance yes but .... savings via server consolidation as well as the
management effort required to manage X ‘should be identical’ technology installations
• Application servers are exactly identical, database servers very near identical
• 26 servers vs 40 (10 as + 10 banner + 6 db vs 20 as + 10 banner + 10 db)
• Also, each prod database has at least 3 non-prod databases behind it
• We can build a similar (smaller but more ram) non-prod cluster for that
• 20 servers vs 30 (6 as + 10 banner + 4 db vs 10 as + 10 banner + 10 db)
35
35Friday, June 17, 2011
All three tiers
• THIS is where the campus uniqueness goes
• Balance application location between consolidation and freedom to upgrade dynamics (technology wise)
• Fewer individual Oracle code trees
• Resource allocation on demand (someday even automated)
• Higher Availability
• Increased Complexity
• Eliminate infrastructure uniqueness
• Fewer individual Oracle code trees
• Resource allocation on demand (someday even automated)
• Higher Availability
• Increased Complexity
• Eliminate infrastructure uniqueness
WebLogic Clusters
RAC (database) Clusters
Banner servers (on OVM)
36
36Friday, June 17, 2011
People & Skills 2.0
RAC DBAs
WL DBAs
Traditional DBAs
“Jack & Jill of all trades” DBAs
37
37Friday, June 17, 2011
WebLogic DBA
• Manages the WebLogic Cluster Infrastructure
• Provides a ‘node identical’ environment
• Manages resource allocations across the cluster
• Campus applications reside within individual WL containers IN the cluster and these are managed by either SICAS or iTEC ‘traditional’ DBAs
38
38Friday, June 17, 2011
RAC DBA
• Manages the Oracle RAC Cluster Infrastructure (Clusterware, ASM, Oracle RDBMS software)
• Provides a ‘node identical’ environment
• Manages resource allocations across the cluster
• Campus data resides within individual Oracle databases IN the cluster and these are managed by iTEC ‘traditional’ DBAs
39
39Friday, June 17, 2011
Traditional DBA• Manages WebLogic Containers within the WebLogic Cluster
• Manages Oracle databases within the RAC Cluster
• Manages Oracle client access software on Banner and other 3rd party servers
• Does not install, patch or upgrade RDBMS, RAC, ASM or WebLogic software (this is done by the WL or RAC DBAs)
• Works with the WL and RAC DBAs to meet performance and availability requirements
40
40Friday, June 17, 2011
Chaos Monkey !!!!
41
41Friday, June 17, 2011
Chaos Monkey !!! (courtesy of Netflix)
“One of the first systems our engineers built in AWS is called the Chaos Monkey.
The Chaos Monkey’s job is to randomly kill instances and services within our architecture.
If we aren’t constantly testing our ability to succeed despite failure, then it isn’t likely to work when it matters most – in the event of an unexpected outage.”
42
42Friday, June 17, 2011
Really? A chaos monkey?!
• Chaos != random, unpredictable, unplanned or even damaging (in the world of science)
• Furthermore, those familiar with “KungFuPanda-ology “will recognize that behind this particular monkey is a well trained ‘athlete’ - developed only as the result of dedication, concentration, planning, determination, training, practicing, and structure.
• We’ll start out with something exactly along those lines ....
43
43Friday, June 17, 2011
Really? A chaos monkey?!
• Oracle RAC Assurance Team provides a wonderfully detailed System Test Plan (11gR2 version 2.0)
• 97 specific tests for RAC, ASM, and Clusterware components
• Each with a documented procedure, expected results, and measures of success
• This will be adopted and incorporated into our standard operating procedures - we will be running drills in our development cluster as part of our team staying sharp and ready to react to production issues.
• Ditto for WebLogic44
44Friday, June 17, 2011
Devotion to structure
• This will be the most structured and regimented our team has ever been
• Clearly defined roles and responsibilities driven by well documented policies and procedures
• NOTHING goes into production without being proven first in development
• Includes hardware, software, configuration changes, policies, procedures AND people
45
45Friday, June 17, 2011
“The path to enlightenment elasticity runs first through the valley of self discovery rigidity.”
46
46Friday, June 17, 2011
Path to cloud
• Recognition that flexibility and agility on the front end requires a considerable amount of structure and consistency on the back end.
• “With our forward looking grid computing approach to the hosting of database and application server technology we are positioning ourselves to be able to better facilitate a hosted cloud computing service and the dynamic management capabilities therein.”
47
47Friday, June 17, 2011
Summary
• ITEC already makes use of database consolidation in a couple of ways and is looking towards database and application server virtualization as the next logical step.
• WebLogic and RAC Grid Computing architecture will form the basis of our (future) cloud computing platform.
• Look for a follow up presentation at Wizard and a ‘whitish’ paper over the summer.
48
48Friday, June 17, 2011
Q&A
49
49Friday, June 17, 2011