tools for data governance

31
TOOLS FOR DATA GOVERNANCE PASSIONATE BY DATA AND THE PRECISION OF THE RESULTS

Upload: mavis

Post on 23-Feb-2016

22 views

Category:

Documents


0 download

DESCRIPTION

TOOLS FOR DATA GOVERNANCE. PASSIONATE BY DATA AND THE PRECISION OF THE RESULTS. DATA are at the HEART of I.S. And guaranteeing BUSINESS CONTINUITY. DOMAIN. APPLICATIONS. Data. PROGRAMS. APPLICATIONS. DBMS. REVER. Data Access. PROGRAMS. Data Access. DBMS. Data. REVER. - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: TOOLS FOR DATA GOVERNANCE

TOOLS FOR DATA GOVERNANCE

PASSIONATE BY DATAAND

THE PRECISION OF THE RESULTS

Page 2: TOOLS FOR DATA GOVERNANCE

DOMAIN

APPLICATIONS

REVERPROGRAMS

DBMSData Access

Processes

Presentation

Programs management(web server, transactional, jcl, …)

Data

Data

DBMSData Access

ProcessesPresentation

Programs management

REVER

APPLICATIONS

PROGRAMS

DATA are at the HEART of I.S.

And guaranteeing BUSINESS CONTINUITY

Page 3: TOOLS FOR DATA GOVERNANCE

SOLUTIONS

EVOLVE-EASY

DEV-EASY

D.I.S.Q.

S.E.A.L.

DOC-EASY

SHARED KNOWLEDGE

RISKLESS ÉVOLUTIONS

DATA QUALITYI.S. QUALITY

DB-MAINKNOWLEDGEMODELLING

TESTS ACCELERATOREXTRACTIONS,

ANONYMIZATIONS,GENERATIONS, COMPARISONS

DEVELOPMENT ACCELERATOR

DATA ACCESS LAYER

Page 4: TOOLS FOR DATA GOVERNANCE

MODELLINGDB-MAIN

GENERATORS

ANALYZERS.DATABASES

STRUCTURESAND RULES

PROGRAMS & PROCESSES

SOURCE CODEDATA

DATABASESOURCE CODE

PROGRAMS & PROCESSES

SOURCE CODEDATA

DOCEASY

EVOLVEEASY

S.E.A.L. DEVEASY

D.I.S.Q.

DB_MAIN REPOSITORY

LEGACY DB

programsCOBOL,

PLI,..jcl

Rel. DB

programsJAVA, PHP,

Web servic

es

ARCHITECTURE

Page 5: TOOLS FOR DATA GOVERNANCE

CHARACTERISTICS

INDUSTRIAL AUTOMATIC

CONTROL

REVER

SOLUTIONS

AGILES

GENERIC

FLEXIBLE

PROGRAMMABLE

SERVICES SUBCONTRACTING

SUPPORT

Page 6: TOOLS FOR DATA GOVERNANCE

BENEFITS

DEADLINE

DECREASE

WORKLOAS

DECREASE

RISKS

DECREASE

PROCESSES AUTOMATISATION

OBJECTSMODELLING

SOLUTIONS FLEXIBILITY

RESULTSRELIABILITY

COMPLETE AND CONTINUOUS CONTROL OF THE PROGRAMS AND THE APPLICATIONS

In order to actWITHOUT RISKS

•EXHAUSTIVENESS•SPEED

•UNDERSTANDING•RISKLESS

•ADEQUACY•AGILITY

•SECURITY•QUALITY

Page 7: TOOLS FOR DATA GOVERNANCE

SOLUTIONS

EVOLVE-EASY

DEV-EASY

D.I.S.Q.

S.E.A.L.

DOC-EASY

DB-MAIN

Page 8: TOOLS FOR DATA GOVERNANCE

EVOLVE-EASY

APPLICATION RE_ENGINEERING Re-writing

Use of a new database Technical re-architecture Applications spread over several DBMS

types Simplification of redundancy within

application …

DATA MIGRATION To a new DB To a software package …

DATABASE MIGRATION

DATABASE MERGE

DATABASE SPLIT

Page 9: TOOLS FOR DATA GOVERNANCE

PHASE III PROGRAMS ADAPTATION

PHASE II DATA MIGRATION

PHASE I I.S. UNDERSTANDING AND MASTERY

PROJECT APPROACH

ETL

SOURCE I.S. understandi

ng

Data validation

validation migration

Wrappers Source code adaptation

SOURCE -TARGET

correspondences

TARGET I.S. understandin

gTARGET I.S.

designor

Page 10: TOOLS FOR DATA GOVERNANCE

Data

DBMSData access

Processes

PresentationPrograms management

REVER

I.S. UNDERSTANDING

Page 11: TOOLS FOR DATA GOVERNANCE

DDL source code

Source code

inventory

Programs source code &

JCL

Application technical schema

(data logical model)structures & implicit

links Data – data links

Application architecture

Links data-programs

Links programs-programs

Links data-data Applic.Cartography Specific markings

REPOSITORY (DB-MAIN)

Missing Source code

Data validation

conceptua-lization

Non compliant data or rules

DB technical schema(data physical model)

structures & explicit links

Applic. «business» schema

(data conceptual model)« Business » concepts

Technical risk control

Galois graph « weight

watcher »

I.S. UNDERSTANDING

Page 12: TOOLS FOR DATA GOVERNANCE

APPLICATION TECHNICAL SCHEMA

APPLICATION « BUSINESS » SCHEMA

REVERSE-EASY

DB-MAIN

DB TECHNICAL SCHEMA

THE DATA SCHEMA

I.S. UNDERSTANDING

Links via programs

Page 13: TOOLS FOR DATA GOVERNANCE

APPLICATION CARTOGRAPHY

APPLICATION ARCHITECTURE

DATA - DATA

PROGRAMS- PROGRAMS

DATA - PROGRAMS

I.S. UNDERSTANDING

Applic.linkApplic.li

nk

Page 14: TOOLS FOR DATA GOVERNANCE

APPLICATION ARCHITECTURE

DATA - DATA

PROGRAMS - PROGRAMS

DATA - PROGRAMS

DATA FLOW

I.S. UNDERSTANDING.

Page 15: TOOLS FOR DATA GOVERNANCE

WEIGHT WATCHER

RISKS CONTROLDATADATALINKS

PROGRAMSPROGRAMS

LINKS

DATAPROGRAMS

LINKS+ + =

I.S. UNDERSTANDING

Page 16: TOOLS FOR DATA GOVERNANCE

PHASE I I.S. UNDERSTANDING AND MASTERY

PROJECT APPROACH

SOURCE I.S. understandi

ng

TARGET I.S. understandin

gTARGET I.S.

designor

Page 17: TOOLS FOR DATA GOVERNANCE

RESULTS

Database creation source code (DDL)

TARGET I.S. DESIGN

DB-MAINConceptual model

SOURCEModel

TARGETmodel

Page 18: TOOLS FOR DATA GOVERNANCE

PHASE II DATA MIGRATION

PROJECT APPROACH

ETLData validation

validation migration

SOURCE -TARGET

correspondences

Page 19: TOOLS FOR DATA GOVERNANCE

RESULTS

SOURCE-TARGETIncompatibility list

Help tool for establishing the correspondences SOURCE - TARGET

List of SOURCE tables and columns without correspondence

List of TARGET tables and columns without correspondences

DATA MIGRATION

Conceptual modelSOURCE model TARGET modelDB-MAIN

Correspondences

Page 20: TOOLS FOR DATA GOVERNANCE

RESULTS

DATA MIGRATION

« Neutral »

DB (only the tables)

Unload/Load Validation

requests executionUnload/

Load

Validation requests

Non compliant data report

(HTML)

SOURCE I.S.

Conceptual modelSOURCE model TARGET model

DB-MAIN

Correspondences

Page 21: TOOLS FOR DATA GOVERNANCE

RESULTS

« Specific »transformations code

« Standards » Transformations

code

Data migration codeMigration

securisation and validation code

DATA MIGRATION

Conceptual modelSOURCE model TARGET model

DB-MAIN

Correspondences

Page 22: TOOLS FOR DATA GOVERNANCE

DATA MIGRATION

Page 23: TOOLS FOR DATA GOVERNANCE

PHASE III PROGRAMS ADAPTATION

PROJECT APPROACH

Wrappers Source code adaptation

Page 24: TOOLS FOR DATA GOVERNANCE

PROGRAMS ADAPTATION

Wrappers source code+ which wrapper in which

program

Conceptual modelSOURCE model TARGET modelDB-MAIN

Correspondences

Page 25: TOOLS FOR DATA GOVERNANCE

Programs source code adapted to the use of the

wrappers

Programs source code

PROGRAMS ADAPTATION

Page 26: TOOLS FOR DATA GOVERNANCE

DATABASE MIGRATION

Page 27: TOOLS FOR DATA GOVERNANCE

TARGET

DATABASE MIGRATIONscenario 1 :

New DB design + data migration (with replication)

After projectBefore project

New prog.

Data access

New DB

Replication

SOURCE

Processes

Presentation

DB

Data access

jcl, server, ...

SOURCE

Processes

Presentation

DB

Data access

jcl, server, ...

Page 28: TOOLS FOR DATA GOVERNANCE

TARGET

DATABASE MIGRATION

After projectBefore project

newprogra

ms

data access

new DB

SOURCE

processings

presentation

DB

dataaccess

jcl, server, ...

SOURCE

procesings

presentation

wrappers

jcl, server, ...

scenario 2 :New DB design + data migration + access

modifications

Page 29: TOOLS FOR DATA GOVERNANCE

TARGET

DATABASE MIGRATION

After projectBefore project

new progra

ms

data access

new DB

SOURCE

processings

presentation

DB

data access

jcl, server, ...

processings

presentation

wrappers

jcl, server, ...

scenario 3 :New DB design + data migration + access

modifications + programs modifications

Page 30: TOOLS FOR DATA GOVERNANCE

CUSTOMER

PARTNER OBJECTIVE QUANTITY TIME LOAD

Ministère des

Finances (BE)

BULL belgium

DB ReplicationGCOS8, IDS2 SOLARIS, DB2

380 tables 3 months 3 m*m

O.E.S.C.(US) Bull US

DB MigrationGCOS8, IDS2

UNIX, POSTGRESS

3 bd – 780 tables

4500 prog.6 months 9 m*m

Xxxx (FR) Metaware

Application Migration Z/OS,

IMS UNIX, ORACLE

300 tables3500 prog. 6 months 4 m*m

GIAL (BE) AnubexDB Migration

BS2000, leasy UNIX, ORACLE

140 tables 3 months 4 m*m

Ministère des

Finances (BE)

CSC Flat file data migration

1 file 86 tables 2 months 2 m*m

PROJECTS

Page 31: TOOLS FOR DATA GOVERNANCE

THANK YOU FOR YOUR ATTENTION