integrated data management: product strategy and vision.ppt

© 2007 IBM Corporation

IBM Information Management

Integrated Data Management Product Strategy and Vision

Curt CotnerIBM FellowVice President and CTO for IBM Database [email protected]


© 2007 IBM Corporation2

© Copyright IBM Corporation 2009. All rights reserved.U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.

THE INFORMATION CONTAINED IN THIS PRESENTATION IS PROVIDED FOR INFORMATIONAL PURPOSES ONLY. WHILE EFFORTS WERE MADE TO VERIFY THE COMPLETENESS AND ACCURACY OF THE INFORMATION CONTAINED IN THIS PRESENTATION, IT IS PROVIDED “AS IS” WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED. IN ADDITION, THIS INFORMATION IS BASED ON IBM’S CURRENT PRODUCT PLANS AND STRATEGY, WHICH ARE SUBJECT TO CHANGE BY IBM WITHOUT NOTICE. IBM SHALL NOT BE RESPONSIBLE FOR ANY DAMAGES ARISING OUT OF THE USE OF, OR OTHERWISE RELATED TO, THIS PRESENTATION OR ANY OTHER DOCUMENTATION. NOTHING CONTAINED IN THIS PRESENTATION IS INTENDED TO, NOR SHALL HAVE THE EFFECT OF, CREATING ANY WARRANTIES OR REPRESENTATIONS FROM IBM (OR ITS SUPPLIERS OR LICENSORS), OR ALTERING THE TERMS AND CONDITIONS OF ANY AGREEMENT OR LICENSE GOVERNING THE USE OF IBM PRODUCTS AND/OR SOFTWARE.

IBM, the IBM logo, ibm.com, and DB2 are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries, or both. If these and other IBM trademarked terms are marked on their first occurrence in this information with a trademark symbol (® or ™), these symbols indicate U.S. registered or common law trademarks owned by IBM at the time this information was published. Such trademarks may also be registered or common law trademarks in other countries. A current list of IBM trademarks is available on the Web at “Copyright and trademark information” at www.ibm.com/legal/copytrade.shtml

Other company, product, or service names may be trademarks or service marks of others.

Disclaimer



What do Businesses Have?

A Collection of Disparate, Single-Purpose Products

CA ERwin

IBM InfoSphere Data Architect Embarcadero ER/Studio

Sybase PowerDesigner Design

IBM DB2 tools

BMC Patrol

Quest Central

Oracle DiagnosticPack

Operate

Oracle Tuning Pack

Solix EDMS

IBM Optim Data Growth Solution Optimize

Quest Spotlight

Quest TOAD

IBM Data Studio Developer

Oracle JDeveloper

Develop

Embarcadero Rapid SQL

IBM ComparisonTool for DB2 z/OS

EmbarcaderoChange Manager

Data Studio AdministratorDeploy

Oracle Change Management Pack

Quest InTrust

Guardium

IBM Optim

Govern

Oracle Vault



The gaps create risk …

Loss of customers Average customer churn rate up 2.5%

after a breach

Loss of revenue $197 USD per customer record leaked Average cost was ~ $6.3 million / breach

in this study Average cost for financial services

organizations was 17% higher than average

Fines, penalties or inability to conduct business based on non-compliance

PCI Sarbanes-Oxley (SOX) HIPAA Data Breach Disclosure Laws Gramm-Leach-Bliley Act Basel II

Source: “2007 Annual Study: Cost of a Data Breach” , The Ponemon Institute



Driven by the increasing numbers of physical

systems, system management

has become the main component of IT costs and is growing rapidly

Many Servers, Much Capacity, Low Utilization =$140B unutilized server assets



What do Businesses Need?An integrated environment to span today’s flexible roles

Manage data throughout its lifecycle From design to sunset

Manage data across complex IT environments Multiple interrelated databases, applications and platforms

Facilitate cross-functional collaboration Within IT Among Line of Business, Compliance functions Across disparate skill sets

Optimize business value Respond quickly to emerging opportunities Improve quality of service Reduce cost of ownership Mitigate risk



Integrated Data Management – What’s Different?

AppDev

Produce enterprise-ready applications faster Improve data access, speed iterative testing and empower collaboration across the lifecycle

Consistently achieve service level targets Automate and simplify operations with contextual intelligence across the solution stack

Support business growth Accommodate new initiatives without expanding infrastructure Simplify application upgrades, consolidation and retirement

Facilitate alignment, consistency and governance Upfront business policies and standards; share, extend, and apply throughout the lifecycle

Data ArchitectDBAs Application ManagerTesters



InfoSphere Data ArchitectInfoSphere Discovery

Optim Development Studio

Optim Test Data Management

Optim Data Growth Solutions

Optim Data Privacy Solutions

The broadest range of capabilities for managing the value of your data throughout its lifetime

DB2 Performance Expert and Extended Insight Feature

Optim pureQuery Runtime

GuardiumDB2 Audit Management Expert

Database Encryption Expert

Optim Database Administrator

Develop

Design

Deploy

Optimize

Operate

PoliciesModelsMetadataDB2

Optim Query Tuner(a.k.a. Optimization Expert)



InfoSphere Data ArchitectInfoSphere Data Architect is a collaborative, data design solution to discover, model, relate, and standardize diverse data assets.

Key Features Create logical and physical data models Discover, explore, and visualize the

structure of data sources Discover or identify relationships between

disparate data sources Compare and synchronize the structure

of two data sources Analyze and enforce compliance to

enterprise standards Support across heterogeneous databases Integration with the Rational Software

Delivery Platform, Optim, IBM Information Server, and IBM Industry Models



Automate Data Design via Model-driven TransformationRational Software Architect

InfoSphere Data Architect Optim Database AdministratorWebSphere Business Modeler

XSD

INTEGRATION DEVELOPER

DATA ARCHITECT

SOLUTION ARCHITECT

Built-in transformation

Compare and sync facilitates merge

DATABASE ADMINISTRATOR

UML

PDM



Optim Test Data Management Solution

Accelerate time to market Create “right sized” test databases Extract referentially intact subsets Compare baseline data against test results to

pinpoint and resolve application defects faster Edit test data to create error and boundary

conditions Easily refresh, reset and maintain test

environments Cut storage costs

Reduce storage requirements by using smaller subsets for testing

Enable compliance De-identify or mask data

Optim

Production or Clone

Dev

QA

Test

Extract

Streamline building test databases, improve application quality, cut IT costs and accelerate solution delivery



Enterprise Challenge: Data PrivacyOptim Data Privacy Solution

A comprehensive set of data masking techniques to transform or de-identify data, including:

String literal valuesCharacter substringsRandom or sequential numbers

Arithmetic expressionsConcatenated expressionsDate aging

Lookup valuesIntelligence

Application-aware masking capabilities ensure data is realistic but fictional Prepackaged data masking routines make it easy to de-identify elements

E.g. credit card numbers & email addresses

Data is masked with realistic but fictional information



Aligning Around Data Privacy

Define policies once and reuse Flow definitions to team members Drive consistent practices around privacy

Data Architect

Tester

Developer

Define privacy policies

Analyse use of sensitive data

Provision fictionalized test data



Active

HistoricalRetrieveRetrieved

Archives

Reporting Data

Historical Data

Reference Data

Archive

Optim Data Growth Solution

Complete business object provides historical reference snapshot of business activity Storage device independence enables storage cost optimization Immutable file format enables data retention compliance

Freed

Facilitates application growth, application upgrades, application retirement, and retention management.

Application Application XML ODBC / JDBC

Universal Access to Application Data



Guardium -- Non-invasive, real-time monitoring

15

DB2SQL Server

• Non-invasive architecture

• Outside database

• Minimal performance impact

• No DBMS or application changes

• Cross-DBMS solution

• 100% visibility including local DBA access

• Enforces separation of duties• Does not rely on DBMS-resident logs that can be

erased by attackers, rogue insiders

• Granular, real-time policies & auditing• Who, what, when, how

• Automated compliance reporting, sign-offs & escalations (SOX, PCI, NIST, etc.)


© 2007 IBM Corporation16 16

Managing the entire lifecycle of security, risk, compliance

Critical Data

Infrastructure

Audit&

Report

Assess&

Harden

Identify&

Classify

Monitor &

Enforce

Identify and classify sensitive data

Critical Data

Infrastructure

Audit&

Report

Assess&

Harden

Identify&

Classify

Monitor &

Enforce

Identify and classify sensitive data



Deploy without DisruptionOptim Database Administrator

DevelopDevelop

DesignDesign

DeployDeploy

OptimizeOptimize

OperateOperate

ModelsModelsPoliciesPoliciesMetadataMetadata

DeployInstall,

configure, change, promote

DatabaseAdministrator

Enhance DBA productivity and accelerate complex changes while ensuring data and process integrity

Automatically manages dependent objects Saves and restores data for extended alters Generates needed maintenance commands

Reduce errors and downtime Provides impact analysis visualization Factors in impacts and side effects automatically Automatically generates commands to undo

changes Foster teamwork and enhance auditability

Integrated into Rational Software Delivery Platform

Document changes for collaboration and audit



Optim Database Administrator

Models, automates and deploys complex schema changes

Identifies dependencies and analyzes impact to mitigate deployment risk

Preserves data, dependent objects, privileges, and application binding

Synchronizes, copies, clones, or merges database schema definitions from the source to the target

Documents changes for collaboration and audit

Enables undo or restart -- if needed Manages common database

maintenance tasks

Improves DBA productivity and reduces application outages by automating and simplifying complex DB2 structural changes including

change-in-place as well as database migration scenarios.



Data & Object Movement Value Proposition –

• Copying database objects and data between homogeneous and heterogeneous databases within Optim Development Studio and Optim Database Administrator

Key Features• Copy objects at various levels –

complete databases to a fixed number of rows from a single table

• Action performed in Data Source Explorer – Copy/Paste and Drag/Drop

• Can automatically copy rows from related tables using:

• RI in database• Data Architect model• Optim application models• Optim Discovery

• Can optionally annonymize the rows using Optim Test Database Manager



Optim Performance Manager - Overview dashboard

Enlarge ( Shows average and max values in the selected timeframe )

Open details ( shows timeseries in the selected timeframe )

• Focus on specific database to see key performance indicators



Optim Performance Manager - Active SQL dashboard

Show top running statements at a point in time according to selected metric, e.g. Elapsed time.

“Tune” launches Query Tuner

“Identify Workloads” refers to defined workloads in Extended Insight



Optim Performance Manager – Reporting

Reporting

... gives you the flexibility you need to adapt OPM on your own environment

coming with sample reports for - disk space usage - system configuration - top resource using SQL statements - DB connections

easy to modify and adapt to your environment because report definition stored in XML document

can be saved and shared as PDF with your colleagues

a graphical report builder will also follow soon



Optim Query Tunerand

Option Workload Tuner for z/OS



Optim Query Tuner Key Features at a GlanceQuery Tuner Key Features at a Glance

Access Path Graph

Access Path Graph

Visual Plan Hint

Visual Plan Hint

Workload Control Center

Workload Control Center

Query ReportQuery Report

Index AdvisorIndex

AdvisorQuery AdvisorQuery Advisor Workload

Statistics Advisor

Workload Statistics Advisor

Workload Index

Advisor

Workload Index

Advisor

Workload Query

Advisor

Workload Query

Advisor

Query Tuner User Interface Query Tuner User Interface

EclipseEclipse

Statistics Advisor

Statistics Advisor

Access Path Advisor

Access Path Advisor

FormatterFormatter AnnotationAnnotation

Query Based Tools and AdvisorsWorkload Advisors

Query AdvisorsQuery Tools

Database

Capture QueryEnviron.

Capture QueryEnviron.

ProfileMonitorProfileMonitor

Workload Report

Workload Report

CaptureWorkloadEnviron

CaptureWorkloadEnviron



IBM Optim Query Tuner key functionsFunctions Query Tuner (single Query) Query Workload

Tuner for DB2 for z/OS

Query Formatter Yes Yes

Query Annotation Yes Yes

Access Plan Graph Yes Yes

Visual Plan Hint Yes Yes

Query Advisor Yes Yes

Access Path Advisor Yes Yes

Statistics Advisor Yes Yes

Index Advisor Yes Yes

Query Reports Yes Yes

Query Environment Capture Yes Yes

Workload Query Advisor Yes

Workload Statistics Advisor Yes

Workload Index Advisor Yes

Workload Query Reports Yes

Workload Environment Capture Yes

Profile Based Monitor Yes



Understanding Query with Query Annotation

Original and transformed Query

Original and transformed Query

Formatted, reorganized query textFormatted, reorganized query text

Annotations (catalog stats, cost estimation)Annotations (catalog stats, cost estimation)



VISUAL PLAN HINT



Provide hints for AccessType



ACCESS PLAN GRAPH (APG)The Access Plan Graph screen displays the access path on the right, and relevant statistics on the left.



Query Advisor

Predicate that should be considered for re-write to get

better performance

Re-write advice and

details



Access Path Advisor



STATISTICS ADVISOR



Index Advisor

Index Recommendations

DDL to create the new index

statement



Database Support by Product (as of today)

VormetricsVormetricsVormetricsEE for DB2 and IMSDatabase Encryption Expert

OPM Extended Edition

OmegamonOptim Performance Manager

Optim Data Growth

Optim Data Privacy

Optim Test Data Management

DB2 Admin Tool/Object CompareOptim Database Administrator

+

WorkloadOptim Query Tuner

Optim pureQuery Runtime

Optim Development Studio

InfoSphere Data Architect

OpenAdmin

Tool Data Studio Administration Console

alphaworks derivativeData Studio

MySQLSybaseSQL

ServerOracleIDSDB2 for i

DB2 for

LUWDB2 for

z/OS



IBM Data Studio www.ibm.com/software/data/studio

• FAQs / Tutorials • Downloads• Forum / Blogs• Join the IBM Data Studio user community

Data Studio Bookhttp://bit.ly/dstudiobook

NEW!!!

integrated data management: product strategy and vision.ppt

Documents

optim performance

mask data

data breach

static sql

selected timeframe

information

create error

pci standards