data warehouse and business intelligence on system z...db2 data sharing group cfcf cec one cfcf cec...

55
1 © 2009 IBM Corporation Data Warehouse and Business Intelligence on System z Fritz Oosterbeek, IT-Specialist Data Warehouse on System z

Upload: others

Post on 20-May-2020

4 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

1 © 2009 IBM Corporation

Data Warehouse and Business Intelligence on System z

Fritz Oosterbeek, IT-SpecialistData Warehouse on System z

Page 2: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

2 © 2009 IBM Corporation

Agenda

• Market Trends:From Business Automation to Business Optimization

• Operational BI:What is it, Examples

• Why key markets trends are playing off for System z:Positioning System z strengths for Business Intelligence and Data Warehousing

• What is and will be available on System z

• Summary

Page 3: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

3 © 2009 IBM Corporation

BusinessOptimization

InformationAgenda

BusinessAutomation

ApplicationAgenda

Faster Processing, Reduced Costs

Competitive AdvantageBusiness Optimization Growth is 2 Times Faster thanBusiness Automation

$594B5.1% CGR

Call CenterOperations

ERP & Financials

Supply ChainManagement

CustomerProfitability

Financial Risk Insight

5.1% CGR$594B

IT Spending Estimate*2008

Dynamic DemandPlanning

New Initiatives Increasingly Focus on OptimizationOrganizations Striving for Competitive Advantage

Page 4: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

4 © 2009 IBM Corporation

OLAP & Data Mining−Merchandising, Inventory,

Operations

Information On Demand−Optimize Each Transaction−Call Centers, Field Ops

Query & Reporting− Financials, Sales

Traditional Data Warehousing

Dynamic Warehousing /Operational BI

Leveraging Information to Create Business ValueInsightful, Relevant Information When and Where it’s Needed

Page 5: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

5 © 2009 IBM Corporation

Dynamic warehousing Traditional warehousingInsurance fraud

analysis and reporting

Identifying potentially fraudulent claims prior to approval and payment

--------------- Transforms healthcare

Reporting on customer issues

Identifying possible related issues, churn risk and cross-sell opportunities while engaged with the customer

--------------- Transforms customer serviceHistorical sales

analysis and reporting

Understanding relevant customer info to identify cross sell opportunities & improve negotiating position at point of sale

--------------- Transforms sales effectivenessCrime statisticsand reporting

Identifying related incidents and potential suspects prior to arriving at the crime scene

--------------- Transforms crime fighting

Examples of Dynamic Warehousing in ActionEnabling Information On Demand for Business Advantage

Page 6: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

6 © 2009 IBM Corporation

Getting Information to Decision Makers: Operational BI

What is it?“Operational BI assembles data from the business as it happens, analyzes it and makes it available to drive decisions across the business. It is the linking of the historical analysis systems with the operational business process systems”

Why do I need it?• Business Optimization

• More value if information is in the hands of decision makers at time of decision• Business Agility

• Enables fact based decisions to be made at point of decision• Compliance

• Provides executives with immediate Information to drive the business while enabling regulatory information distribution

“Operational BI starts by asking what outcome company officials want, rather than seeing what data is lying around and then generating a report. It truly works when managers forget it exists and the technology becomes a seamless and invisible part of the business process.”

Source: Operational BI Comes of Age, TDWI

Page 7: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

7 © 2009 IBM Corporation

Getting the Information to Where it Provides the Most Value

IT Power(Analysts)

Business(Managers)

Casual(Front Line)

Extended(Customers/Suppliers)

0

10

20

30

40

50

60

70

80

90

100

Who is using business intelligence tools today?

Who can get most value out of business insights?

IT Power(Analysts)

Business(Managers)

Casual(Front Line)

Extended(Customers/Suppliers)

0

10

20

30

40

50

60

70

80

90

100

Typically only 18% of potential BI users actually make use of this vital information

Page 8: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

8 © 2009 IBM Corporation

The Evolving Landscape of Business Intelligence

BI Capability

“C” Level

Board Room

Executive

Managerial

Analyst Level (Analytics)

Customer Facing Personnel

(e.g., Service Center)

Customers

<50

<500

<1,000

K’s

Users

M’s

1985

1990

1995

2005

2008

Customer ServiceSelf Service

Transactions (Requests)

Occasional

Thousands

Hundreds

Millions

KPI applications

Page 9: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

9 © 2009 IBM Corporation

Aggregation Level and Decision Making“C” Level

Board Room

Executive

Managerial

Analyst Level

Sales and Customer Service

(customer, account, transaction)

Customers

(Transaction)

Massive Data Aggregation

Data Aggregation Level Strategic

Strategic but Focused

Strategic but More Narrow

Customer based

Decision Making

Transactional

Massive

Light

Light DataAggregation

Page 10: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

10 © 2009 IBM Corporation

The Three Levels of Business Intelligence (copyright Imhoff)

10

Strategic BI Tactical BI Operational BI

Business focus

Achieve long-term business goals

Manage tactical initiatives

to achieve strategic goals

Manage and optimize daily business operations

Primary users

Executives & business analysts

Executives, analysts& LOB managers

Analysts, LOB managersand users, and

operational processes

Time-frame

Monthsto years

Days to weeksto months Intra-day

Data Historicaldata

Historicaldata

Real-time, low-latency & historical data

System zSweet Spot

Page 11: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

11 © 2009 IBM Corporation

Where you put your Data Matters….Confidence in System z, z/OS and DB2 for z/OS

(1) WW Banks from The Banker.com: www.thebanker.com/news/fullstory.php/aid/1699/Tio_1000_World_Banks.html(2) US Retailers from National Retail Federation July 2005: www.stores.org/pdf/TOP100printwithad.pdf(3) Insurance - 2005 Ward's 50 Benchmark Group: www.memic.com/news/Wards50.asp(4) Kathy Auerbach, Winter Corporation, Top Ten Program Press release, September, 14 2005 (www.wintercorp.com/PressReleases/ttp2005_pressrelease_091405.htm)

• 25 of the top 25 WW banks (1)

• 23 of the top 25 US retailers (2)

• 9 of the top 10 global life/ health insurance providers (3)

• The world’s largest OLTP System is Land Registry for England and Wales. 23.1 TB system (4)

• UPS' shipping system achieved a peak workload of 1.1 Billion SQL statements per hour

• A major Swiss bank – 41TB• A major French financial institution –

35TB• Land Registry for England and Wales -

23TB• UPS - 9TB• Postbank - 4TB• . . .

Page 12: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

12 © 2009 IBM Corporation

Why key markets trends are playing off for System z:Positioning System z strengths for Business Intelligence

and Data Serving

Page 13: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

13 © 2009 IBM Corporation

Mission Critical Workloads Require Highest QoS§ More than 90% of Global 2000 companies plan to

incorporate analytics into multiple operational applications that access the data warehouse by 2010, but fewer than 15% of data warehouses have been designed to provide high availability, failover, disaster recovery and the remaining components of mission-critical systems.

§ By the end of 2009, 90% of Global 2000 companies will have implemented some type of mission-critical dependency between the warehouse and at least one revenue supporting or cost-controlling operational application — up from less than 25% in 2007.

§ Fewer than 15% of data warehouses in 2007 have been designed to provide high availability, failover, disaster recovery and the remaining components of mission-critical systems.

0 20 40 60 80 100

The majority of companies using data from a data warehouse for in-line, operational analytics have reported that a data warehouse production failure caused operational systems to cease daily operations, resulting in lost revenue or increased costs.

> 90%

Plan to incorporate Analytics

90%Mission Critical Dependency w/ BI

<15% of DW are designed for HA & DR

Global 2000 customers

Business Impact:

1 Operational Analytics and the Emering Mission-Critical Data Warehouse, 14 May 2007

Page 14: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

14 © 2009 IBM Corporation

Key questions for your DW Platform Design

1. Which DBMS to use for Datawarehousing

2. Where to place your Datawarehouse

3. How to solve the biggest challenge for dynamic DW: the mixed workload performance challenge

4. Plan for growth, the requirement for Scalability

5. TCO for your DW

Page 15: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

15 © 2009 IBM Corporation

1. Which DBMS to use for Datawarehousing

“The transactional DBMSs have an edge

that challenges the DW DBMSs (such as Teradata)”Gartner Data Warehouse Magic Quadrant, 2006

TransactionalDBMS

DWDBMS

Advanced Data Partioning

MQTs

Cubing Services

2008

1970s IBM Information Management, 2008

Page 16: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

16 © 2009 IBM Corporation

Which DBMS to use for Datawarehousing

“The transactional DBMSs have an edge

that challenges the DW DBMSs (such as Teradata)”Gartner Data Warehouse Magic Quadrant, 2006

In Memory Technology

TransactionalDBMS

DWDBMS

Advanced Data Partioning

MQTs

Cubing Services

2008

1970s IBM Information Management, 2008

Page 17: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

17 © 2009 IBM Corporation

2. Where to place your DatawarehouseThe larger the amount of data, the more likely it is to deploy operational BI centrally. Ventana Research 2007

A centralized approach can incorporate Information management to consolidate

• data integration • data transformation• metadata management

rather than have these information processes handled differently by each department or line of business.

Simplification • IBM Mainframes already host most company’s “true” real-time data• Distributed alternatives requires additional systems, complex and

costly data movement• Increased requirements for compliance across end-to-end data

integration and analytic components

Ventana Research 2007

Page 18: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

18 © 2009 IBM Corporation

2. Where to place your Datawarehouse: DW on z Solution Architecture

Member A

OLTP

CEC One

Member B

OLTP

CEC Two

DB2 DataSharingGroup

CFCF

CEC One CEC TwoCFCF

DB2 DataSharingGroupMember C

DWHMember D

DWH

Within a data sharing environment, the data warehouse resides in the same group as the transactional data.

Page 19: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

19 © 2009 IBM Corporation

The mixed workload performance will become the single mostimportant performance issue in DW

3. How to solve the biggest challenge for dynamic DW: The mixed workload performance challenge

The emergence of issues based on a mix of 4 DW workloads• Continous (near-real-time) data loading – similar to an OLTP

workload • Large numbers of standard reports • An incresing number of true ad hoc query users • An increasing level of analytics and BI-oriented functionality in

OLTP

Information On Demand to Optimize Real-Time

Processes

Dynamic Warehousing +

Operational BI

Gartner Data Warehouse Magic Quadrant, 2006

Page 20: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

20 © 2009 IBM Corporation

Traditional workload management approach

• Screen queries before they start execution

• Time consuming for DBAs.

• Some large queries slip through the crack.

• Running these queries degrade system performance.

• Cancellation of the queries wastes CPU cycles.

Page 21: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

21 © 2009 IBM Corporation

Workload Management

The ideal workload manager policy for data warehousing:

Consistent favoring ofshorter running work........

with select favoring of criticalbusiness users

keep em shortthrough WLM period aging

through WLM explicit prioritization of critical users

Page 22: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

22 © 2009 IBM Corporation

Workload Management

discretionary543010000004340100000326050000228050001ImportanceVelocityDurationPeriod

Period aging can be used to lower the priorities of a query execution after it exceeds a specific amount of CPU time. This way, short running queries run with higher priority while long running queries are not blocking important resources.

Page 23: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

23 © 2009 IBM Corporation

Workload Management assigned to Service classes

service class A velocity 50 importance 3

service class B velocity 100 importance 1

1 hour to complete

5 minutes to complete

Some queries (the “CEO” queries) still need to return in a minimum amount of time. Their priority can override the period aging through their service class assignments.

Page 24: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

24 © 2009 IBM Corporation

4. Plan for growth, the requirement for Scalability:Scalability with DB2: Single Query Parallelism

CPU Intensive Queries

10 CPU

20 CPU

20 CPU

0

500

1,000

1,500

2,000

Tim

e in

sec

onds

92% scalability

1874s

1020s

937s

PerfectScalability

Sysplex

measured

SMP

Page 25: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

25 © 2009 IBM Corporation

Query Throughput

0

100

200

300

400

500

600

700

293

551

C

ompl

etio

ns @

3 H

ours

94% scalability

(Sysplex)10 CPU

20 CPU

(30 users)

(60 users)

S M P

4. Plan for growth, the requirement for Scalability:Scalability with DB2: Multiuser Throughput

Page 26: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

26 © 2009 IBM Corporation

5. TCO for your DW

When system z is the lowest cost platform

… just some pricing aspects for DWing

Page 27: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

27 © 2009 IBM Corporation

Mainframe Cost Per Unit of Work Goes Down as Workload Increases

Data Center Workload

Cos

t per

uni

t of w

ork

Mainframe

Distributed scale out

Most TCO benchmarks compare single applications

Most businesses operate here

Page 28: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

28 © 2009 IBM Corporation

Mainframe Cost Per Unit of Work Goes Down as Workload Increases

Page 29: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

29 © 2009 IBM Corporation

Mainframe Cost Per Unit of Work Goes Down as Workload Increases

Page 30: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

30 © 2009 IBM Corporation

Worldwide IT spending trend is playing off for system z

Source: IDC, Virtualization 2.0: The Next Phase in Customer Adoption, Doc #204904, Dec 2006

$0

$50

$100

$150

$200

$250

$300

19971998

19992000

20012002

20032004

20052006

20072008

20092010

Installed Base(M Units)

Spending(US$B)

0

5

10

15

20

25

30

35

40

45

50

1996

Power and cooling costs

Server mgm t and admin costs

New server spending

Worldwide IT Spending TrendWorldwide IT Spending Trend

$0

$50

$100

$150

$200

$250

$300

19971998

19992000

20012002

20032004

20052006

20072008

20092010

Installed Base(M Units)

Spending(US$B)

0

5

10

15

20

25

30

35

40

45

50

1996

$0

$50

$100

$150

$200

$250

$300

19971998

19992000

20012002

20032004

20052006

20072008

20092010

Installed Base(M Units)

Spending(US$B)

0

5

10

15

20

25

30

35

40

45

50

1996

$0

$50

$100

$150

$200

$250

$300

19971998

19992000

20012002

20032004

20052006

20072008

20092010

Installed Base(M Units)

Spending(US$B)

0

5

10

15

20

25

30

35

40

45

50

1996

Power and cooling costs

Server mgm t and admin costs

New server spending

Power and cooling costs

Server mgm t and admin costs

New server spending

Worldwide IT Spending TrendWorldwide IT Spending Trend

2000 – Raw processing Raw processing ““horsepowerhorsepower”” is the primary is the primary goal, while the infrastructure goal, while the infrastructure to support it is assumed to support it is assumed readyready

2006 –– Raw processing Raw processing ““horsepowerhorsepower”” is a given, but is a given, but the infrastructure to support the infrastructure to support deployment is a limiting factordeployment is a limiting factor

Power and cooling spend may eventually exceed new server spending

Management/Administration costs are already exceeding new server spending

Page 31: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

31 © 2009 IBM Corporation

Technology Evolution with Mainframe Specialty Engines

Internal Coupling Facility (ICF) 1997

Integrated Facility for Linux (IFL) 2001

IBM System z9 Integrated Information Processor (IBM zIIP) 2006

System z9 Application Assist Processor (zAAP) 2004

vBuilding on a strong track record of technology innovation with specialty engines, IBM is introducing the System z9 Integrated Information Processor

§Support for new workloads and open standards

§ Designed to help improve resource optimization for eligible data workloads within the enterprise

§ Centralized data sharing across

mainframes

§ Incorporation of JAVA into existing mainframe solutions

Page 32: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

32 © 2009 IBM Corporation

• Portions of the following DB2 for z/OS V8 workloads may benefit from zIIP*:

2 - Data warehousing applications*• Requests that utilize parallel queries

3 - DB2 for z/OS V8 utilities LOAD, REORG & REBUILD*• DB2 utility functions used to maintain index maintenance structures

1 - ERP, CRM, Business Intelligence or other enterprise applications• Via DRDA over a TCP/IP connection (enclave SRBs, not stored procedures or UDFs)

DB2 V8 (and later) exploitation of IBM zIIP value add

New Specialty Engine

Page 33: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

33 © 2009 IBM Corporation

Measured zIIP offload for a DW workload

0 10 20 30 40 50 60 70 80 90

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

% Offload to zIIP% offload to zIIP

TPC

-H li

ke q

uerie

s

Page 34: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

34 © 2009 IBM Corporation

… last not least

Page 35: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

35 © 2009 IBM Corporation

Hardware-assisted data compression

0

20

40

60

80

100

Com

pressed Ratio

Compressed Non-compressed

53%46%

61%

I/O Intensive CPU Intensive

281

157

283

200

354

412

Elapsed tim

e (sec)

Non-Compressed Compressed 60%I/O Wait I/O WaitCPU

CPU

Compress CPUOverhead

Effects of Compression on

Elapsed Time

Compression Ratios

Achieved

In V9Indexes

can also be compressed

Page 36: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

36 © 2009 IBM Corporation

TCA vs. TCO for the Mainframe

• Do not compare Total Cost of Acquisition with distributed systems

• Always look at Total Cost of Ownership• Cost of Hardware

• Cost of Software

• Environmentals

• Cost of Labor

• Financial terms

• Don‘t be shy to promote Mainframe strengths

Page 37: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

37 © 2009 IBM Corporation

Summary of why DW on z

zLinux z/OS

DWH z SolutionDWH z Solution

Page 38: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

38 © 2009 IBM Corporation

Key questions for your DW Platform Design - Summary

1. Which DBMS to use for Datawarehousing

2. Where to place your Datawarehouse

3. How to solve the biggest challenge for dynamic DW: the mixed workload performance challenge

4. Plan for growth, the requirement for Scalability

5. TCO for your DW

Page 39: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

39 © 2009 IBM Corporation

Top 10 Reasons for DW and BI on System z

10. DB2 9 for z/OS

9. Consolidation through Virtual Partitioning

8. Mixed Workload Support

7. Disaster Recovery

6. Where the data resides - Collocation

5. Environment Savings - power, cooling, foot print

4. Security

3. Availability

2. Administration Costs

1. Total Cost of Ownership

Page 40: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

40 © 2009 IBM Corporation

What is available on System z & How to implement

Page 41: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

41 © 2009 IBM Corporation

Better BusinessOutcomes

Flexible Architecture for Leveraging Existing Investments

Other Information& Application Sources

Customer & Product Profitability

Workforce Optimization

Dynamic Supply Chain Multi-channel

Marketing

Financial Risk Insight

Business OptimizationOptimization

Automation

Cognos 8 BI for System z

Business Intelligence & Performance Management

Information Integration, Warehousing & Management

Data Warehousing on System zInformation Server for System z

IMS Integration with Info2.0InfoSphere MDM Server for System z

DB2 9 for z/OSIMS 10

Content Manager v8.4 Content Manager OnDemand v8.4

Enterprise Content Management, Enterprise Data Management

End-to-endCapabilities

System z and Information On DemandUnlocking the Business Value of Information for Competitive Advantage

Page 42: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

42 © 2009 IBM Corporation

Data Warehouse & BI Architecture for System z

Core Offering for Enterprise Data Warehouse and BI:§ InfoSphere Information Server for Linux on System z

§ Complete, Consistent, Cost Effective§ Same products, functionality, and leverages IFLs and Hipersockets

§ DB2 Value Unit Edition§ An alternate value point for new DB2 for z/OS workloads

§ Cognos 8 BI for Linux on System z § A comprehensive System z offering for Enterprise BI

Watch for 2009

Additions!

Information Server for System z

DB2 for z/OS VUE

OLTPdata

Data Warehouse

Cognos 8 BI for System z

Enterprise BI

Understand, Cleanse Transform, Deliver Trusted

Information The Enterprise Data Warehouse

Page 43: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

43 © 2009 IBM Corporation

Understand Cleanse Transform Deliver

Platform ServicesParallel

ProcessingServices

ConnectivityServices

MetadataServices

DeploymentServices

AdministrationServices

IBM Information Server for System z

IBM Information Server for System z

Information Analyzerfor Linux on System z

Business Glossaryfor Linux on System z

Data Architect

Federation Server & Classic Federation

Data Event Publisher& Classic Data EP

Replication Server & Classic Replication

DataStage for z/OS

DataStage MVS

QualityStage forLinux on System z

ü COMPLETE All productsü CONSISTENT Same functionality in the Linux for System z productsü COST EFFECTIVE Can leverage lower-cost IFL MIPS with native z/OS data

DataStage for Linuxon System z

Information Services Director forLinux on System z

Metadata Workbench for Linux on System z

IBM Information Server for System z

Page 44: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

44 © 2009 IBM Corporation

• Adhoc query, reporting and analysis (Query Studio, Report Studio & Analysis Studio)

• Dashboards and charting (Cognos Connection & Report Viewer)

• Event management (Event Studio)

IBM Cognos 8 BI for Linux on System z

Introduction to IBM Cognos 8 BI for Linux on System zIntroduction to IBM Cognos 8 BI for Linux on System z““10 TB Study10 TB Study””

http://www.ibm.com/support/techdocs/atsmastr.nsf/WebIndex/WP1014http://www.ibm.com/support/techdocs/atsmastr.nsf/WebIndex/WP10143737

Enterprise BICognos 8 BI for Linux on System z

DB2 for z/OS Data

Warehouse

Z10

• Integration with Microsoft Office (Go! Office and CAFÉ)

• Cube building (Transformer)• Go! Mobile• Go! Dashboards

Page 45: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

45 © 2009 IBM Corporation

InfoSphere Warehouse on System z

• Lower cost way to design, populate and optimize a DB2 for z/OS data warehouse

• Leverages Linux on System z to target DB2 for z/OS

• http://www.ibm.com/software/data/info/new-systemz-software/

Page 46: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

46 © 2009 IBM Corporation

InfoSphere Warehouse on System z

Source Systems

DB2 for z/OS

DB2 for z/OS IMS VSAM RDBMS

Data Warehouse Server

Cubing Services Engine

SQW Runtime

WebSphere App Server

Linux on System z Partition / IFL

Design Studio

Admin Console

Windows / Linux

Application Server

Cognos 8 BI for System z

Excel

Third Parties / BPs

Client Layer•Design and admin client•BI / Reporting tools and Apps

MQT Advisor

MQT Cube Metadata Control DB

JDBC/DB2 Connect

JDBC/DB2 Connect

MDX

IE/Firefox

Eclipse

SQL

Page 47: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

47 © 2009 IBM Corporation

Why Linux on System z for the solution?

• Unify the infrastructure – Get it all “in the box”• Manageability and Environmental benefits

• Significant cost savings• MIPs charged at IFL rate … NOT z/OS rate

• All processing is on Linux for System z, except the z/OS data access

• Minimizes impact on other z/OS software costs• DB2 access qualifies for zIIP specialty engine

• Keep your data access and information integration processes close to your data• Eliminate "wire" connectivity – data can flow over hipersockets

• Simplify, less parts

Page 48: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

48 © 2009 IBM Corporation

Information On DemandAcquisitions and Continued Innovation Drive Increased Value

2005

2007

2006

DB2 Viper

FileNetAcquisitionAscential,

Trigo, DWL, SRD, Venetica,

iPhrase…Acquisitions

PrincetonAcquisition

DataMirrorAcquisition

Information Server

Dynamic Warehousing

FileNet P8

UnicornAcquisition

pureXML

Data Studio

Content Manager 8.4

IMS 10

IDS 11

2008…

SolidAcquisition

CognosAcquisition

LASAcquisition

Content Analyzer

InfoSphere MDM ServerInfoSphere Warehouse

Delivering End-to-End Capabilities Data Management

Enterprise Content ManagementInformation Integration, Warehousing & ManagementBusiness Intelligence & Performance Management

and more…

Public Launch of IOD

Page 49: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

49 © 2009 IBM Corporation

Information On DemandInvestment, Innovation and Deliveries Drive New Capabilities for System z

and more…

DB2 9 for z/OS

Ascential,& DWL

Acquisitions2005

Information Serverfor System z

Data Studio pureQueryfor z/OS

Content Manager 8.4

2008…CognosAcquisition

InfoSphere MDM Serverfor System z

Unlocking the Business Value of Informationfor Competitive Advantage

2007

IMS 10Princeton

Acquisition

Optim/Data Governancefor System z

Cognos 8 BI for System z

FileNetAcquisition

2006

Business Optimization

Page 50: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

50 © 2009 IBM Corporation

Share everythingUnlimited scalability

Adv

ance

d C

apab

ility

OLAP

Design Studio

Data Compression

Workload Management

Alphablox

DataQuant

Embedded DataMovement

Analysis & Discovery

Design & Management

Extreme Performance

Market EntryTheme

Reporting Olap

DataServer

Information Integration

Master Data Mgmt.

1Q08 2Q08 3Q08 4Q08 1Q09 2Q09<07

Federation, Event Publishing

MDM Server

Information Server

Data Retention

Cognos on z/Linux

Data Archiving

ETL

DB2 9

MDMBI Extreme

Performance

Business IntelligencePerformance Mgmt

Reporting

InfoSphereWarehouse on

System z

Data Warehouse on System z – Trends and Directions

Page 51: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

51 © 2009 IBM Corporation

Recent papers

ftp://ftp.software.ibm.com/software/data/businessintelligence/systemz/DW_BI_IBM_SysZ.pdf

http://www.ibm.com/software/data/businessintelligence/systemz/

ftp://ftp.software.ibm.com/software/data/businessintelligence/systemz/Data_Warehousing_with_DB2_for_System_z_Jan_2009.pdf

Page 52: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

52 © 2009 IBM Corporation

Some key Redbooks

• Enterprise Data Warehousing with DB2 9 for z/OS• http://www.redbooks.ibm.com/abstracts/sg247637.html

• 50 TB Data Warehouse Benchmark on IBM System z• http://www.redbooks.ibm.com/redbooks.nsf/RedpieceAbstracts/sg247674.ht

ml• This is the draft

• DB2 for z/OS: Data Sharing in a Nutshell• http:// www.redbooks.ibm.com/abstracts/sg247322.html

• System Programmer’s Guide To: Workload Manager• http:// www.redbooks.ibm.com/abstracts/sg246472.html

• Workload Management for DB2 Data Warehouse, REDP-3927• http:// www.redbooks.ibm.com/abstracts/redp3927.html

Page 53: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

53 © 2009 IBM Corporation

Other recent articles in the press

• Enhanced Query Parallelism with zIIP processors• February 2008 • http://www.ibmsystemsmag.com/mainfra

me/enewsletterexclusive/18822p1.aspx• Operational BI and System z

• March 2008 • http://www.ibmsystemsmag.com/mainfram

e/enewsletterexclusive/19475p1.aspx• Business Intelligence's New Look: IBM

extends its BI portfolio with Cognos 8 BI for Linux on System z• July / August 08 • http://www.ibmsystemsmag.com/mainfram

e/julyaugust08/features/20870p1.aspx• Take the Reins - An Information On Demand

Strategy helps deliver a competitive edge for today's businesses• July / August 08 • http://www.ibmsystemsmag.com/mainfram

e/julyaugust08/coverstory/20860p1.aspx

• Three part series: Myths of Doing BI on the mainframe• http://www.dmreview.com/issues/2

007_53/10002140-1.html• http://www.dmreview.com/issues/2

007_54/10002171-1.html• http://www.information-

management.com/issues/2007_55/10014861-1.html

• Data Warehousing With DB2 for z/OS …Again!!!• June/July 2008• http://zjournal.com/index.cfm?section=a

rticle&aid=1013

Page 54: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

54 © 2009 IBM Corporation

Contact

• Feel free to call us any time!

• Via your Sales contact, Technical Field Sales,

• or call me directly:

Fritz Oosterbeek Gustav-Heinemann-Ufer 120-122IT-Specialist D-50968 KoelnInformation Management GermanyData Warehouse on System z phone +49-221-304-2017

mobile: +49-151-1429 3714email: [email protected]

Fritz Oosterbeek Gustav-Heinemann-Ufer 120-122IT-Specialist D-50968 KoelnInformation Management GermanyData Warehouse on System z phone +49-221-304-2017

mobile: +49-151-1429 3714email: [email protected]

Page 55: Data Warehouse and Business Intelligence on System z...DB2 Data Sharing Group CFCF CEC One CFCF CEC Two DB2 Data Sharing Member C Group DWH Member D DWH Within a data sharing environment,

55 © 2009 IBM Corporation