© 2010 vmware inc. all rights reserved confidential vmware vfabric data director powering...

42
© 2010 VMware Inc. All rights reserved Confidential VMware vFabric Data Director Powering Database-as-a-Service for Oracle, SQL Server, Hadoop and vFabric Postgres

Upload: marilynn-miles

Post on 30-Dec-2015

220 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: © 2010 VMware Inc. All rights reserved Confidential VMware vFabric Data Director Powering Database-as-a-Service for Oracle, SQL Server, Hadoop and vFabric

© 2010 VMware Inc. All rights reserved

Confidential

VMware vFabric Data Director

Powering Database-as-a-Service for Oracle, SQL Server, Hadoop and vFabric Postgres

Page 2: © 2010 VMware Inc. All rights reserved Confidential VMware vFabric Data Director Powering Database-as-a-Service for Oracle, SQL Server, Hadoop and vFabric

2

Traditional IT

Application Team

System Admin

Storage Admin

Network AdminDBA

Days - weeks

to provision a development environment

Page 4: © 2010 VMware Inc. All rights reserved Confidential VMware vFabric Data Director Powering Database-as-a-Service for Oracle, SQL Server, Hadoop and vFabric

4

vFabric Data Director Powers Database-as-a-Service for your Cloud

Enables database-aware virtualization on VMware vSphere and provides database-as-a-service for heterogeneous databases and Hadoop

Reduce capex through database-aware

virtualization

Save cost through database and Hadoop

virtualization

Increase IT agility

Automate database and Hadoop lifecycle

management

Accelerate analytics and application

development

Through self-service and automation

Page 5: © 2010 VMware Inc. All rights reserved Confidential VMware vFabric Data Director Powering Database-as-a-Service for Oracle, SQL Server, Hadoop and vFabric

5

vFabric Data Director Platform Architecture

Cloud Infrastructure Platform

Enterprise Services

vCloud Director

Cloud Foundry

EMC Chorus

EMCData Domain

Cloud Infrastructure Platform

.

.

.

Integration Gatew

ay (AP

I)

vFabric Data Director

ProvisioningBackup/Restore

CloneOne click

HA

ResourceMgmt

Security Mgmt

Template

MgmtMonitor

DBA App Dev

IT Admin

LifecycleServices

InfrastructureServices

DBA

Database

Catalog

PatchMgmt

vPostgres

Database

Ingestion

Application Director

Page 6: © 2010 VMware Inc. All rights reserved Confidential VMware vFabric Data Director Powering Database-as-a-Service for Oracle, SQL Server, Hadoop and vFabric

6

Oracle 10gR2, 11gR2

SQL Server 2008R2, SQL Server 2012

Postgres 9.1.6

Hadoop 1.0 based distributions:

• Apache Hadoop 1.0.x

• Cloudera CDH3

• Greenplum HD 1.1 and 1.2

• Hortonworks Data Platform 1.0

• MapR - Soon

Supported Data Engines

Page 7: © 2010 VMware Inc. All rights reserved Confidential VMware vFabric Data Director Powering Database-as-a-Service for Oracle, SQL Server, Hadoop and vFabric

7

SQL Server Support - New

Confidential

Data Director now supports SQL Server database

• Supports provisioning of SQL Server 2008 R2 and SQL Server 2012 databases

Key features include

• Create SQL Server templates easily with built-in configurations

• Size VMs and configure database settings through a single UI

• Join VMs to domain as part of provisioning

• Compatibility with existing tools

Page 8: © 2010 VMware Inc. All rights reserved Confidential VMware vFabric Data Director Powering Database-as-a-Service for Oracle, SQL Server, Hadoop and vFabric

8

Provision Any Database from Same Web Portal

Page 9: © 2010 VMware Inc. All rights reserved Confidential VMware vFabric Data Director Powering Database-as-a-Service for Oracle, SQL Server, Hadoop and vFabric

9

Provision and Manage Any Hadoop Distribution with One Click

Page 10: © 2010 VMware Inc. All rights reserved Confidential VMware vFabric Data Director Powering Database-as-a-Service for Oracle, SQL Server, Hadoop and vFabric

10

Hadoop Support Powered by Serengeti

Open source project launched in June, 2012

To learn more - projectserengeti.orgSerengeti

Page 11: © 2010 VMware Inc. All rights reserved Confidential VMware vFabric Data Director Powering Database-as-a-Service for Oracle, SQL Server, Hadoop and vFabric

11

Why Virtualize Hadoop?

Shrink and expand cluster on demand

Independent scaling of Compute and data

Strong multi-tenancy

Elasticity & Multi-tenancy

High availability for entire Hadoop stack

One click to setup

Battle-tested

High Availability

Rapid deployment

One stop command center

Easy to configure/reconfigure

Operational Simplicity

Page 12: © 2010 VMware Inc. All rights reserved Confidential VMware vFabric Data Director Powering Database-as-a-Service for Oracle, SQL Server, Hadoop and vFabric

12 Confidential

Data Director Benefits

Don’t Let Your DBAs Hit the 40 DB Ceiling• Automate provisioning and management• Enforce policies and best practices automatically

Double Your DBAs

Reduce Costs by > 50%• Consolidate servers by 10–15X• Save on Hardware, Software, Power and Cooling

Stretch Your Servers

Use the Right Database for the Job• Use the most cost-effective licensing for your application• Leverage low-cost HA and clustering with vSphere

Liberate Your Licenses

Keep Your Data Secure With Automation• Make security a holistic part of the database lifecycle.• Help admins keep systems patched and up-to-date.

Secure Your Stuff

Page 13: © 2010 VMware Inc. All rights reserved Confidential VMware vFabric Data Director Powering Database-as-a-Service for Oracle, SQL Server, Hadoop and vFabric

13 Confidential

vFabric Data Director

Data Director will help you:1. Stretch Your Servers

2. Liberate Your Licenses

3. Double Your DBA Productivity

4. Secure Your Stuff

Page 14: © 2010 VMware Inc. All rights reserved Confidential VMware vFabric Data Director Powering Database-as-a-Service for Oracle, SQL Server, Hadoop and vFabric

14 Confidential

vFabric Data Director

Data Director will help you:1. Stretch Your Servers

2. Liberate Your Licenses

3. Double Your DBA Productivity

4. Secure Your Stuff

Page 15: © 2010 VMware Inc. All rights reserved Confidential VMware vFabric Data Director Powering Database-as-a-Service for Oracle, SQL Server, Hadoop and vFabric

15 Confidential

We Looked at 700,000 Servers

The average PRODUCTION Oracle Database Instance uses:

•4% of CPU

•2MB/second of Network

•1200 IOPS

The average SQL Server database only does slightly better (about 5% CPU).

This does not strain a modern server in any way.

Page 16: © 2010 VMware Inc. All rights reserved Confidential VMware vFabric Data Director Powering Database-as-a-Service for Oracle, SQL Server, Hadoop and vFabric

16 Confidential

How Can We Do Better?

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

5%

75%

0.95

25%

Used Unused Overhead

Physical Server

Virtual Server

You can consolidate 10-15 databases on a single server without affecting overall performance.

Page 17: © 2010 VMware Inc. All rights reserved Confidential VMware vFabric Data Director Powering Database-as-a-Service for Oracle, SQL Server, Hadoop and vFabric

17 Confidential

vFabric Data Director

Data Director will help you:1. Stretch Your Servers

2. Liberate Your Licenses

3. Double Your DBA Productivity

4. Secure Your Stuff

Page 18: © 2010 VMware Inc. All rights reserved Confidential VMware vFabric Data Director Powering Database-as-a-Service for Oracle, SQL Server, Hadoop and vFabric

18 Confidential

How Can We Use fewer Licenses?

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

5%

75%

0.95

25%

Used Unused Overhead

Physical Server

Virtual Server

Oracle and SQL Server are typically licensed by core. If you consolidate by a factor of 10-15x you will need far fewer licenses.

Page 19: © 2010 VMware Inc. All rights reserved Confidential VMware vFabric Data Director Powering Database-as-a-Service for Oracle, SQL Server, Hadoop and vFabric

19 Confidential

TEMP SWAP LOG DATA

T

TEMP SWAP LOG DATA

How Can I Virtualize a Physical Database

Linux

DB Management Server

Data Director Application Oracle 11.1 Template

Linux

Oracle 11.1

Monitoring Agents

Shell Virtual Machines

Empty DBVM

Linux

Oracle 11.1

Monitoring Agents

Clone of Physical DBPhysical DB Server

Page 20: © 2010 VMware Inc. All rights reserved Confidential VMware vFabric Data Director Powering Database-as-a-Service for Oracle, SQL Server, Hadoop and vFabric

20 Confidential

A Single License Management Pane

Don’t get a million dollar surprise because you couldn’t track your database licenses.

Page 21: © 2010 VMware Inc. All rights reserved Confidential VMware vFabric Data Director Powering Database-as-a-Service for Oracle, SQL Server, Hadoop and vFabric

21 Confidential

A Real World Example

EMC is one of the largest Oracle shops in the world and it runs on VMware.

EMC was able to:

•Consolidate their servers by a factor of 13:1

•Reduce RAC to Single Instance databases

•Convert Enterprise to Standard Edition databases

•Add HA to single instance databases.

•Realize millions of dollars in cost savings

See Whitepaper “EMC IT’s Virtual Oracle Deployment Framework”, November 2011

Page 22: © 2010 VMware Inc. All rights reserved Confidential VMware vFabric Data Director Powering Database-as-a-Service for Oracle, SQL Server, Hadoop and vFabric

22 Confidential

vFabric Data Director

Data Director will help you:1. Stretch Your Servers

2. Liberate Your Licenses

3. Double Your DBA Productivity

4. Secure Your Stuff

Page 23: © 2010 VMware Inc. All rights reserved Confidential VMware vFabric Data Director Powering Database-as-a-Service for Oracle, SQL Server, Hadoop and vFabric

23 Confidential

How Many Databases Can a DBA Manage?

40

Page 24: © 2010 VMware Inc. All rights reserved Confidential VMware vFabric Data Director Powering Database-as-a-Service for Oracle, SQL Server, Hadoop and vFabric

24 Confidential

After

Self Service

Policy

Foundation

Developers/Administrators

Database Team

IT

Before

Developers

DBAs IT

Tickets

Data Director Accelerates Productivity

Page 25: © 2010 VMware Inc. All rights reserved Confidential VMware vFabric Data Director Powering Database-as-a-Service for Oracle, SQL Server, Hadoop and vFabric

25 Confidential

Data Director Architecture

vCenter

ESXi

Linux

DB Management Server

Data Director Application

T

TEMP SWAP LOG DATA

Shell Virtual Machines

Operating System

Database

Monitoring Agents

Operating System

Database

Monitoring Agents

Database Template Library

Operating System

Database

Monitoring Agents

Page 26: © 2010 VMware Inc. All rights reserved Confidential VMware vFabric Data Director Powering Database-as-a-Service for Oracle, SQL Server, Hadoop and vFabric

26 Confidential

T

TEMP SWAP LOG DATA

Create Your Own Databases, Virtually

Linux

DB Management Server

Data Director Application

TEMP SWAP LOG DATA

Shell Virtual MachinesDatabase Template Library

Operating System

Database

Monitoring Agents

Operating System

Database

Monitoring Agents

New Database Based Linked to Parent Template

Page 27: © 2010 VMware Inc. All rights reserved Confidential VMware vFabric Data Director Powering Database-as-a-Service for Oracle, SQL Server, Hadoop and vFabric

27 Confidential

A Data Director Database

Operating System

Database

Monitoring Agents

Stores data locally (inside the VM)

Uses binaries from linked clone disks on the parent template

Has a unique ID and IP address

Runs software and database processes locally (in the VM)

Page 28: © 2010 VMware Inc. All rights reserved Confidential VMware vFabric Data Director Powering Database-as-a-Service for Oracle, SQL Server, Hadoop and vFabric

28 Confidential

Linux

Oracle 11.1

Monitoring Agents

DB Based on Oracle 11.1 TemplateDB Based on Oracle 11.2 Template

Upgrading or Patching a Database

Linux

DB Management Server

Data Director Application Oracle 11.1 Template

Linux

Oracle 11.1

Monitoring Agents

Oracle 11.2 Template

Linux

Oracle 11.2

Monitoring Agents

Linux

Oracle 11.2

Monitoring Agents

Page 29: © 2010 VMware Inc. All rights reserved Confidential VMware vFabric Data Director Powering Database-as-a-Service for Oracle, SQL Server, Hadoop and vFabric

29 Confidential

TEMP SWAP LOG DATA

T

TEMP SWAP LOG DATA

DB Based on Oracle 11.1 Template

Cloning a Database

Linux

DB Management Server

Data Director Application Oracle 11.1 Template

Linux

Oracle 11.1

Monitoring Agents

Shell Virtual Machines

Linux

Oracle 11.1

Monitoring Agents

Empty DBVM

Linux

Oracle 11.1

Monitoring Agents

Exact Clone of DB

Page 30: © 2010 VMware Inc. All rights reserved Confidential VMware vFabric Data Director Powering Database-as-a-Service for Oracle, SQL Server, Hadoop and vFabric

30 Confidential

Complex Operations Made Simple

Creating or cloning a database takes about 5 minutes.

Page 31: © 2010 VMware Inc. All rights reserved Confidential VMware vFabric Data Director Powering Database-as-a-Service for Oracle, SQL Server, Hadoop and vFabric

31 Confidential

Administrators Are Still In Control

Standards and Best Practices are automatically enforced.

Page 32: © 2010 VMware Inc. All rights reserved Confidential VMware vFabric Data Director Powering Database-as-a-Service for Oracle, SQL Server, Hadoop and vFabric

32 Confidential

Users Still Get What They Need

Users can still configure some options and parameters, guided by policy and best practices.

Page 33: © 2010 VMware Inc. All rights reserved Confidential VMware vFabric Data Director Powering Database-as-a-Service for Oracle, SQL Server, Hadoop and vFabric

33 Confidential

Why You Should Care

Using Data Director, complex database operations are automated and simplified.

1. Database Creation

2. Database Cloning

3. Data Movement

4. Backup and Recovery

5. Load Balancing

6. Database Retirement Developers and Analysts can create their own databases without an administrator.

Page 34: © 2010 VMware Inc. All rights reserved Confidential VMware vFabric Data Director Powering Database-as-a-Service for Oracle, SQL Server, Hadoop and vFabric

34 Confidential

How Many Databases Can a DBA Manage with Data Director?

80?We break the direct relationship between DBAs and the number of databases under management.

Page 35: © 2010 VMware Inc. All rights reserved Confidential VMware vFabric Data Director Powering Database-as-a-Service for Oracle, SQL Server, Hadoop and vFabric

35 Confidential

vFabric Data Director

Data Director will help you:1. Stretch Your Servers

2. Liberate Your Licenses

3. Double Your DBA Productivity

4. Secure Your Stuff

Page 36: © 2010 VMware Inc. All rights reserved Confidential VMware vFabric Data Director Powering Database-as-a-Service for Oracle, SQL Server, Hadoop and vFabric

36 Confidential

Database Security is Baked In

Concepts like database expiration are built into the provisioning process.

Page 37: © 2010 VMware Inc. All rights reserved Confidential VMware vFabric Data Director Powering Database-as-a-Service for Oracle, SQL Server, Hadoop and vFabric

37 Confidential

Network Security is Baked In

Network Security is built into the provisioning process as well.

Page 38: © 2010 VMware Inc. All rights reserved Confidential VMware vFabric Data Director Powering Database-as-a-Service for Oracle, SQL Server, Hadoop and vFabric

38 Confidential

Centralized DBaaS monitoring

All service level actions are closely monitored, logged, and tracked.

Page 39: © 2010 VMware Inc. All rights reserved Confidential VMware vFabric Data Director Powering Database-as-a-Service for Oracle, SQL Server, Hadoop and vFabric

39 Confidential

A Real World Use Case

A Production Finance Database has data quality problems and an analyst needs to examine some highly sensitive data.

This is a very difficult challenge for:

1. Security

2. Compliance

3. Database Operations

4. System Administration

Page 40: © 2010 VMware Inc. All rights reserved Confidential VMware vFabric Data Director Powering Database-as-a-Service for Oracle, SQL Server, Hadoop and vFabric

40 Confidential

TEMP SWAP LOG DATA

T

TEMP SWAP LOG DATA

DB Based on Oracle 11.1 Template

Linked Clones of a Database

Linux

DB Management Server

Data Director Application Oracle 11.1 Template

Linux

Oracle 11.1

Monitoring Agents

Shell Virtual Machines

Linux

Oracle 11.1

Monitoring Agents

Empty DBVM

Linux

Oracle 11.1

Monitoring Agents

Linked Clone of DB

∆The linked clone is a separate DB that shares the original storage and keeps a local copy of disk block changes.

Page 41: © 2010 VMware Inc. All rights reserved Confidential VMware vFabric Data Director Powering Database-as-a-Service for Oracle, SQL Server, Hadoop and vFabric

41 Confidential

A Real World Use Case

Data Director can:

•Create a linked clone of the original database that has an identical O/S and DB configuration.

•Ensure changes do not impact original DB.

•Automatically discover and mask sensitive data.

•Expire and delete the linked clone after 7 days.

•Automatically remove any backups or snapshots.

•Quickly create and apply a patch any databases with a similar configuration. Security

Compliance Database Operations System Administration

Page 42: © 2010 VMware Inc. All rights reserved Confidential VMware vFabric Data Director Powering Database-as-a-Service for Oracle, SQL Server, Hadoop and vFabric

42

Summary

vFabric Data Director enables database-aware virtualization on VMware vSphere and provides database-as-a-service for heterogeneous databases and Hadoop

Reduce cost through database-aware virtualization

Increase IT agility

Accelerate analytics and application development