talend metadata bridge

15
1 ©2015 Talend Inc. Presentation under NDA Talend Metadata Bridge Jean-Michel Franco – Talend (@jmichel_franco)

Upload: jean-michel-franco

Post on 16-Jul-2015

738 views

Category:

Software


4 download

TRANSCRIPT

Page 1: Talend Metadata Bridge

1

©2015 Talend Inc. Presentation under NDA

Talend Metadata Bridge Jean-Michel Franco – Talend (@jmichel_franco)

Page 3: Talend Metadata Bridge

3

• Metadata describes the characteristics of any data object:

- Name, type, location, author, date created, size

- Relationships with other data

• Metadata Management is the end-to-end process and governance framework for creating, controlling, enhancing, attributing, defining and managing a metadata model

Metadata Management 101

Page 4: Talend Metadata Bridge

4

Business needs for Metadata Management

Modeling & Design Real-time Real-time Implementation Maintenance Real-time Business users

Access

Increase development

speed & agility

Increase Developer

Productivity & Quality

Improve continuously & minimize the

impact of change

Provide Self Service, Deliver

Lineage & Auditability

Page 5: Talend Metadata Bridge

5

Introducing Talend Metadata Bridge

Modeling & Design

Import/Export from design and

modeling environments

Real-time Real-time Implementation

Integrate with other data and development

platforms

Continuous Improvement

Reduce update & conversion costs and accelerate ETL offloading

projects

Real-time Utilization

Provide Self Service access for

Designers and Analysts

• General Availability in March 2015 • Based on OEM with Meta Integration Inc.

• Available for all Talend Enterprise and Platform customers • More that 100 connectors

Page 6: Talend Metadata Bridge

6

Over 100 connectors

Data modeling

DB, ETL & Big Data Productivity Tools

Business Intelligence

Real-time

Page 7: Talend Metadata Bridge

7

1. Import Data Models

• Enterprise and Data Architects define authoritative models in their modeling tools

• The Bridge propagates changes to the Talend Repository

• Conversely the Bridge allows Talend to export and maintain physical metadata back into the modeling tools

- CA ERwin Data Modeler

- Embarcadero ER/Studio

- SAP Sybase PowerDesigner

- IBM InfoSphere Data Architect

- …

Talend Repository

Page 8: Talend Metadata Bridge

8

2. Business Intelligence

• Propagate / sync integration metadata with BI tools’ semantic layer

• Ensures consistent metadata definition from modeling, through integration, to reporting

Talend Repository - IBM Cognos

- Microsoft SQLServer

- Microstrategy

- Oracle Essbase and OBI

- QlikView

- SAP BW or Business Objects

- Tableau

Page 9: Talend Metadata Bridge

9

3. ETL Conversion and offloading to Hadoop

• Accelerates migration project with an automated process

• Semantic mappings to convert 50-80% (subject to the jobs complexity)

• Migration ETL directly to Hadoop

Talend Repository

Load

Trans form

Extract

Talend Job

Page 10: Talend Metadata Bridge

10

3. ETL Migration and offloading to Hadoop

• Talend Metadata Bridge accelerate the migration process through direct import/export of schema and job metadata including between 2 different ETLs : IBM Infosphere Datastage and Informatica

• Talend is committed to work with partners to facilitate migration projects

• Note: Some manual migration will be required

Page 11: Talend Metadata Bridge

11

4. Define Mapping in Excel for Non-IT People

• Edit mappings & transformations in a spreadsheet

• Generate a job with no ETL skill

• Empower users to author or stewardship ETL jobs

Talend Repository

Talend Job

Talend Mapping Tool for Excel Talend Repository

Page 12: Talend Metadata Bridge

12

Talend Metadata Management roadmap

• Import / Export to modeling tools, BI, Excel, Database, ETL, standards…

• Centralize metadata authoring and sync it across the Enterprise Metadata Bridge

• Business Glossary

• Enterprise Semantic Flow a lineage Data Governance

• Import/Export data model to/from modeling tools

• Content Marketplace Master Data Management

• Full Enterprise Version & Configuration Management

• Impact analysis, Visual modeling and cross referencing across tools

Enterprise Architecture & Life Cycle Change Management

• Referencing Big Data flows inside and outside Hadoop or other Big Data environment Big Data Lineage

A complete Enterprise Metadata management solution

Page 13: Talend Metadata Bridge

13

Meta Integration Roadmap

• Talend Metadata Bridge

- Bi-directional metadata import/export from/to a wide range of tools (databases, modeling tools, data integration tools, BI tools, other metadata repositories)

- Standards (CWM, XMI, MS XIF…)

STEP 1 – Talend 5.6.2

STEP 2 – Talend 6.0

• Talend Metadata Management - Comprehensive Enterprise Metadata Management console

- Business Glossary

STEP 3 -Talend 6.1

• Talend Metadata Bridge for MDM - Import/export of Master Data Models

Page 14: Talend Metadata Bridge

14

What it brings to Talend’s solution

Talend is Open -> now also at the Metadata level

Empowering data governance and self service

Addressing the challenge of Big Data re-platforming and lineage

Page 15: Talend Metadata Bridge

15

©2015 Talend Inc. Presentation under NDA

Talend Metadata Bridge

Contact us:

[email protected]

Learn more:

www.talend.com