tools for data governance passionate by data and the precision of the results

Download TOOLS FOR DATA GOVERNANCE PASSIONATE BY DATA AND THE PRECISION OF THE RESULTS

If you can't read please download the document

Upload: hilary-bradford

Post on 23-Dec-2015

212 views

Category:

Documents


0 download

TRANSCRIPT

  • Slide 1
  • TOOLS FOR DATA GOVERNANCE PASSIONATE BY DATA AND THE PRECISION OF THE RESULTS
  • Slide 2
  • DOMAIN REVER DBMS Data Access Processes Presentation Programs management (web server, transactional, jcl, ) Data DBMS Data Access Processes Presentation Programs management REVER DATA are at the HEART of I.S. And guaranteeing BUSINESS CONTINUITY DATA are at the HEART of I.S. And guaranteeing BUSINESS CONTINUITY
  • Slide 3
  • SOLUTIONS EVOLVE-EASY DEV-EASY D.I.S.Q. S.E.A.L. DOC-EASY SHARED KNOWLEDGE SHARED KNOWLEDGE RISKLESS VOLUTIONS DATA QUALITY I.S. QUALITY DATA QUALITY I.S. QUALITY DB-MAIN KNOWLEDGE MODELLING TESTS ACCELERATOR EXTRACTIONS, ANONYMIZATIONS, GENERATIONS, COMPARISONS TESTS ACCELERATOR EXTRACTIONS, ANONYMIZATIONS, GENERATIONS, COMPARISONS DEVELOPMENT ACCELERATOR DATA ACCESS LAYER DEVELOPMENT ACCELERATOR DATA ACCESS LAYER
  • Slide 4
  • MODELLING DB-MAIN GENERATORS ANALYZERS. DATABASES STRUCTURES AND RULES DATABASES STRUCTURES AND RULES PROGRAMS & PROCESSES SOURCE CODE DATA DATABASE SOURCE CODE DATABASE SOURCE CODE PROGRAMS & PROCESSES SOURCE CODE DATA DOC EASY EVOLVE EASY S.E.A.L.DEV EASY D.I.S.Q. DB_MAIN REPOSITORY LEGACY DB programs COBOL, PLI,.. programs COBOL, PLI,.. jcl Rel. DB programs JAVA, PHP, programs JAVA, PHP, Web services ARCHITECTURE
  • Slide 5
  • CHARACTERISTICS INDUSTRIAL AUTOMATIC CONTROL REVER SOLUTIONS AGILES GENERIC FLEXIBLE PROGRAMMABLE SERVICES SUBCONTRACTING SUPPORT
  • Slide 6
  • BENEFITS DEADLINE DECREASE DEADLINE DECREASE WORKLOAS DECREASE WORKLOAS DECREASE RISKS DECREASE RISKS DECREASE PROCESSES AUTOMATISATION OBJECTS MODELLING SOLUTIONS FLEXIBILITY RESULTS RELIABILITY COMPLETE AND CONTINUOUS CONTROL OF THE PROGRAMS AND THE APPLICATIONS In order to act WITHOUT RISKS COMPLETE AND CONTINUOUS CONTROL OF THE PROGRAMS AND THE APPLICATIONS In order to act WITHOUT RISKS EXHAUSTIVENESS SPEED EXHAUSTIVENESS SPEED UNDERSTANDING RISKLESS UNDERSTANDING RISKLESS ADEQUACY AGILITY ADEQUACY AGILITY SECURITY QUALITY SECURITY QUALITY
  • Slide 7
  • SOLUTIONS EVOLVE-EASY DEV-EASY D.I.S.Q. S.E.A.L. DOC-EASY DB-MAIN
  • Slide 8
  • EVOLVE-EASY APPLICATION RE_ENGINEERING Re-writing Use of a new database Technical re-architecture Applications spread over several DBMS types Simplification of redundancy within application DATA MIGRATION To a new DB To a software package DATABASE MIGRATION DATABASE MERGE DATABASE SPLIT
  • Slide 9
  • PHASE IIIPROGRAMS ADAPTATION PHASE II DATA MIGRATION PHASE I I.S. UNDERSTANDING AND MASTERY PROJECT APPROACH ETL SOURCE I.S. understanding Data validation validation migration Wrappers Source code adaptation SOURCE - TARGET correspondences TARGET I.S. understanding TARGET I.S. design or
  • Slide 10
  • Data DBMS Data access Processes Presentation Programs management REVER I.S. UNDERSTANDING
  • Slide 11
  • DDL source code Source code inventory Source code inventory Programs source code & JCL Application technical schema (data logical model) structures & implicit links Data data links Application technical schema (data logical model) structures & implicit links Data data links Application architecture Links data-programs Links programs-programs Links data-data Applic.Cartography Specific markings Application architecture Links data-programs Links programs-programs Links data-data Applic.Cartography Specific markings REPOSITORY (DB-MAIN) Missing Source code Data validation conceptua- lization Non compliant data or rules DB technical schema (data physical model) structures & explicit links DB technical schema (data physical model) structures & explicit links Applic. business schema (data conceptual model) Business concepts Applic. business schema (data conceptual model) Business concepts Technical risk control Galois graph weight watcher Technical risk control Galois graph weight watcher I.S. UNDERSTANDING
  • Slide 12
  • APPLICATION TECHNICAL SCHEMA APPLICATION BUSINESS SCHEMA REVERSE- EASY DB-MAIN DB TECHNICAL SCHEMA THE DATA SCHEMA I.S. UNDERSTANDING Links via programs
  • Slide 13
  • APPLICATION CARTOGRAPHY APPLICATION ARCHITECTURE DATA - DATA PROGRAMS- PROGRAMS DATA - PROGRAMS I.S. UNDERSTANDING Applic.link
  • Slide 14
  • APPLICATION ARCHITECTURE DATA - DATA PROGRAMS - PROGRAMS DATA - PROGRAMS DATA FLOW I.S. UNDERSTANDING.
  • Slide 15
  • WEIGHT WATCHER RISKS CONTROL DATA LINKS PROGRAMS LINKS DATA PROGRAMS LINKS + += I.S. UNDERSTANDING
  • Slide 16
  • PHASE I I.S. UNDERSTANDING AND MASTERY PROJECT APPROACH SOURCE I.S. understanding TARGET I.S. understanding TARGET I.S. design or
  • Slide 17
  • RESULTS Database creation source code (DDL) TARGET I.S. DESIGN DB-MAIN Conceptual model SOURCE Model SOURCE Model TARGET model
  • Slide 18
  • PHASE II DATA MIGRATION PROJECT APPROACH ETL Data validation validation migration SOURCE - TARGET correspondences
  • Slide 19
  • RESULTS SOURCE-TARGET Incompatibility list Help tool for establishing the correspondences SOURCE - TARGET List of SOURCE tables and columns without correspondence List of TARGET tables and columns without correspondences DATA MIGRATION Conceptual model SOURCE model TARGET model DB-MAIN Correspondences
  • Slide 20
  • RESULTS DATA MIGRATION Neutral DB (only the tables) Neutral DB (only the tables) Unload/ Load Unload/ Load Validation requests execution Unload/ Load Unload/ Load Validation requests Non compliant data report (HTML) SOURCE I.S. Conceptual model SOURCE model TARGET model DB-MAIN Correspondences
  • Slide 21
  • RESULTS Specific transformations code Standards Transformations code Data migration code Migration securisation and validation code DATA MIGRATION Conceptual model SOURCE model TARGET model DB-MAIN Correspondences
  • Slide 22
  • DATA MIGRATION
  • Slide 23
  • PHASE IIIPROGRAMS ADAPTATION PROJECT APPROACH Wrappers Source code adaptation
  • Slide 24
  • PROGRAMS ADAPTATION Wrappers source code + which wrapper in which program Wrappers source code + which wrapper in which program Conceptual model SOURCE model TARGET model DB-MAIN Correspondences
  • Slide 25
  • Programs source code adapted to the use of the wrappers Programs source code PROGRAMS ADAPTATION
  • Slide 26
  • DATABASE MIGRATION
  • Slide 27
  • TARGET DATABASE MIGRATION scenario 1 : New DB design + data migration (with replication) After project Before project New prog. Data access New DB Replication SOURCE Processes Presentation DB Data access jcl, server,... SOURCE Processes Presentation DB Data access jcl, server,...
  • Slide 28
  • TARGET DATABASE MIGRATION After project Before project new programs data access new DB SOURCE processings presentation DB data access jcl, server,... SOURCE procesings presentation wrappers jcl, server,... scenario 2 : New DB design + data migration + access modifications
  • Slide 29
  • TARGET DATABASE MIGRATION After project Before project new programs data access new DB SOURCE processings presentation DB data access jcl, server,... processings presentation wrappers jcl, server,... scenario 3 : New DB design + data migration + access modifications + programs modifications
  • Slide 30
  • CUSTOMERPARTNEROBJECTIVEQUANTITYTIMELOAD Ministre des Finances (BE) BULL belgium DB Replication GCOS8, IDS2 SOLARIS, DB2 380 tables3 months3 m*m O.E.S.C.(US)Bull US DB Migration GCOS8, IDS2 UNIX, POSTGRESS 3 bd 780 tables 4500 prog. 6 months9 m*m Xxxx (FR)Metaware Application Migration Z/OS, IMS UNIX, ORACLE 300 tables 3500 prog. 6 months4 m*m GIAL (BE)Anubex DB Migration BS2000, leasy UNIX, ORACLE 140 tables3 months4 m*m Ministre des Finances (BE) CSCFlat file data migration 1 file 86 tables 2 months2 m*m PROJECTS
  • Slide 31
  • THANK YOU FOR YOUR ATTENTION