deep dive - dataversitycontent.dataversity.net/rs/656-wmw-918/images/deepdivegovernan… · deep...

25
DEEP DIVE The Value of Data Governance with Collibra www.dmradio.biz

Upload: others

Post on 13-Apr-2020

12 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: DEEP DIVE - DATAVERSITYcontent.dataversity.net/rs/656-WMW-918/images/DeepDiveGovernan… · DEEP DIVE. The Value of Data Governance with Collibra

DEEP DIVEThe Value of Data Governance with Collibra

www.dmradio.biz

Page 2: DEEP DIVE - DATAVERSITYcontent.dataversity.net/rs/656-WMW-918/images/DeepDiveGovernan… · DEEP DIVE. The Value of Data Governance with Collibra

Featured Speakers

Page 3: DEEP DIVE - DATAVERSITYcontent.dataversity.net/rs/656-WMW-918/images/DeepDiveGovernan… · DEEP DIVE. The Value of Data Governance with Collibra

Can Data Be Governed?

https://www.flickr.com/photos/tonynetone/

Governance controls animate things:- People- Processes- Engines- Decisions- Machines

Page 4: DEEP DIVE - DATAVERSITYcontent.dataversity.net/rs/656-WMW-918/images/DeepDiveGovernan… · DEEP DIVE. The Value of Data Governance with Collibra

Global Data Protection Regulation

Adopted by the EU, but affects the USAhttps://www.flickr.com/photos/hyku/

Page 5: DEEP DIVE - DATAVERSITYcontent.dataversity.net/rs/656-WMW-918/images/DeepDiveGovernan… · DEEP DIVE. The Value of Data Governance with Collibra

Key Provisions Put Organizations On NoticeThe right to portabilityThe right to erasurePrivacy First policies for dataData breach notification: 72 hours!Data protection impact assessmentsData Protection Officers required for someInternational companies implicatedAnd last but not least: 4% of revenue fine!

https://www.flickr.com/photos/57777529@N02/

Page 6: DEEP DIVE - DATAVERSITYcontent.dataversity.net/rs/656-WMW-918/images/DeepDiveGovernan… · DEEP DIVE. The Value of Data Governance with Collibra

Seeing the Big Picture Will Pay Dividends

By World Imaging - Own work, GFDL, https://commons.wikimedia.org/w/index.php?curid=11736454

Page 7: DEEP DIVE - DATAVERSITYcontent.dataversity.net/rs/656-WMW-918/images/DeepDiveGovernan… · DEEP DIVE. The Value of Data Governance with Collibra

Trust Is the Anchor of Every Business!Gaining a better understanding of data will improve trust, and that will in turn improve your

business! Viewing compliance initiatives through the proper

lens will not only help achieve desired goals, but it will also

foster a culture of data awareness, and that will pay dividends for years to come!

https://www.flickr.com/photos/78365458@N00/

Page 8: DEEP DIVE - DATAVERSITYcontent.dataversity.net/rs/656-WMW-918/images/DeepDiveGovernan… · DEEP DIVE. The Value of Data Governance with Collibra

©2016 Collibra Inc

THE IMPORTANCE OF DATA GOVERNANCE

Enabling Value from Data

Daniel ShollerChief Evangelist

1/10/18

Page 9: DEEP DIVE - DATAVERSITYcontent.dataversity.net/rs/656-WMW-918/images/DeepDiveGovernan… · DEEP DIVE. The Value of Data Governance with Collibra

CEOs are looking at solving for digital growthProduct improvement & technology are the biggest-rising

priorities for CEOs in 2017, - Gartner CEO Survey

Forward looking digital strategies impact all parts of the business

Data value is still not being realized

Source: McKinsey Quarterly, The Case for Digital Reinvention, Feb 2017

Source: Boston Consulting Group

Amount trusted uses of big data and advanced analytics could unlock annually by 20201

$1TMoreThan

2

13

14

21

49

Supply chains

Ecosystem

Processes

Product and services

Marketing and Disitribution

Where are companies focusing their forward-looking digital strategies?

Page 10: DEEP DIVE - DATAVERSITYcontent.dataversity.net/rs/656-WMW-918/images/DeepDiveGovernan… · DEEP DIVE. The Value of Data Governance with Collibra

FocusToday

Sample Organization

Source: Gartner, Organizing Your Teams for Modern Data and Analytics Deployment March, 2017

Goal is to reach needs of all data citizensWhere are you focused? Where should you be focused?

ROLE COUNT

Casual User/Data Customer 1000

Business Analyst 90

Engineer 10

Scientist 1

UnmetValue

Page 11: DEEP DIVE - DATAVERSITYcontent.dataversity.net/rs/656-WMW-918/images/DeepDiveGovernan… · DEEP DIVE. The Value of Data Governance with Collibra

Challenges remain

Percentage (55%) who feel they are somewhat or very effective at using

insights to guide future strategy1

Describe their companies as open about sharing data1

Flat

10%

Over the past 5 years

Only

1Research Report: Analytics as a Source of Business Innovation, MIT Sloan Management Review, 20172CEO Outlook, KPMG 20173Bridging the Trust Gap: The Hidden Landmine in Big Data, BCG, 2016

CEO’s are concerned about the integrity of their data on which they

base their decisions2

50%Nearly

Amount customers reduce their spending by in the first year after

finding about misuse of their data3

1/3

Find & Understand Trust Risk ManagementReduce by

Page 12: DEEP DIVE - DATAVERSITYcontent.dataversity.net/rs/656-WMW-918/images/DeepDiveGovernan… · DEEP DIVE. The Value of Data Governance with Collibra

5 | ©Collibra 2016

Step 1 - Subsume the old notions of governance

Usage focusedCitizen enablement

IncrementalSocial and collaborative

Regulatory FocusIT enablementLocked down

Technical

Policy drivenCatalog/Search/ML/AIInteractive lineageVisual contextProblem resolution

Efficiency drivenTechnical artifact drivenRecordkeepingToo broadNo processes

Page 13: DEEP DIVE - DATAVERSITYcontent.dataversity.net/rs/656-WMW-918/images/DeepDiveGovernan… · DEEP DIVE. The Value of Data Governance with Collibra

Best practiceSuccess comes from a balance of a good offense and defense

OFFENSE DEFENSE

FIND

TRUST

UNDERSTAND

Catalog

DataExperience

CoreGovernance

Page 14: DEEP DIVE - DATAVERSITYcontent.dataversity.net/rs/656-WMW-918/images/DeepDiveGovernan… · DEEP DIVE. The Value of Data Governance with Collibra

7 | ©Collibra 2016

Identify measures and outcomes

Trust

Access Quality

Most data does not have value unless it is used. Exception is regulatory data

• Trust• Usage/Impact• Identified errors• Increasing description

• Access• Discovery speed• Scope• Provisioning

• Quality • Error rates• Rule/policy compliance• Economic value

Page 15: DEEP DIVE - DATAVERSITYcontent.dataversity.net/rs/656-WMW-918/images/DeepDiveGovernan… · DEEP DIVE. The Value of Data Governance with Collibra

8 | ©Collibra 2016

Focusing on realized value

• Distributed data stewardship• Crowdsourced information

Business users are the primary stakeholders

• Widely distributed - part of day to day work

• Automated and tracked Business processes

• Measured effects • Value metrics• Inputs for scale

Outcome oriented

Page 16: DEEP DIVE - DATAVERSITYcontent.dataversity.net/rs/656-WMW-918/images/DeepDiveGovernan… · DEEP DIVE. The Value of Data Governance with Collibra

Step 2 – flexible approaches

BI/Analytics Data Management Compliance & RiskManagement

Self-Service Analytics & BI

Regulatory ReportingCompliance

Data Lake & Data Warehouse

Digital Transformation • Customer 360 • Operational Excellence • M&A • GDPR

Page 17: DEEP DIVE - DATAVERSITYcontent.dataversity.net/rs/656-WMW-918/images/DeepDiveGovernan… · DEEP DIVE. The Value of Data Governance with Collibra

10 | ©Collibra 2016

Data lake/data warehouse Ingest/re

gister Search Select Prepare Combine Store Provision

.

Each touch delivers value and collects metadata

MetadataData Processes

Page 18: DEEP DIVE - DATAVERSITYcontent.dataversity.net/rs/656-WMW-918/images/DeepDiveGovernan… · DEEP DIVE. The Value of Data Governance with Collibra

11 | ©Collibra 2016

BI and analytics

Page 19: DEEP DIVE - DATAVERSITYcontent.dataversity.net/rs/656-WMW-918/images/DeepDiveGovernan… · DEEP DIVE. The Value of Data Governance with Collibra

12 | ©Collibra 2016

Regulatory complianceOriginating applications

Authoritative sources

Critical Data Elements

Report

Page 20: DEEP DIVE - DATAVERSITYcontent.dataversity.net/rs/656-WMW-918/images/DeepDiveGovernan… · DEEP DIVE. The Value of Data Governance with Collibra

13 | ©Collibra 2016

Changing the process

• Tailor the approach to the use case at hand– Incremental processes for data lakes– Catalog for Business Intelligence– Middle out for Regulatory compliance

Page 21: DEEP DIVE - DATAVERSITYcontent.dataversity.net/rs/656-WMW-918/images/DeepDiveGovernan… · DEEP DIVE. The Value of Data Governance with Collibra

14 | ©Collibra 2016

FIND

ReportingData Risk ManagementGDPRBCBS 239CCAR Solvency II

Operating ModelProcess FlowsPoliciesStewardshipReference DataCertification

SearchCollaboration

ShareIntelligence

Helpdesk

Map value to stakeholder capabilities

TRUST

UNDERSTAND

CatalogGlossaryDictionaryMetadata

LineageQuality

ProfilingSampling

DataExperience

Governance

Page 22: DEEP DIVE - DATAVERSITYcontent.dataversity.net/rs/656-WMW-918/images/DeepDiveGovernan… · DEEP DIVE. The Value of Data Governance with Collibra

15 | ©Collibra 2016

Step 3 - stakeholder value Data Scientist -Data Experience• Search, Machine

assisted discovery• Lineage, profiling,

quality, • Usage, reported errors• Easy sandboxing• Model Tracking

Supported activities• Utilization of

new data• Comparison,

similarity• Profiling

Metrics • New models• New data• New

visiualizations

Stakeholders• Strategic

planning • COO

Data Stewards –Governance•Workflows and approvals•Definition and completeness

•Quality and errors

Supported Activities•Data access requests

•Data Sharing agreements

•Semantic search•Authoritative source identification

Metrics•Operational reporting accuracy

•Definition and disambiguation

Stakeholders•CDO•Data Architects

Page 23: DEEP DIVE - DATAVERSITYcontent.dataversity.net/rs/656-WMW-918/images/DeepDiveGovernan… · DEEP DIVE. The Value of Data Governance with Collibra

16 | ©Collibra 2016

Major metrics

• Utilization of known value• Creation of new value• Potential value unrealized

Page 24: DEEP DIVE - DATAVERSITYcontent.dataversity.net/rs/656-WMW-918/images/DeepDiveGovernan… · DEEP DIVE. The Value of Data Governance with Collibra

17 | ©Collibra 2016

Bottom line

Create a data experience Subsume old notions of governance Balance “offense” and “defense” Focus on realized value

Flexible approach by use case Top down, bottom up, middle out

Establish metrics based on value to stakeholders

Page 25: DEEP DIVE - DATAVERSITYcontent.dataversity.net/rs/656-WMW-918/images/DeepDiveGovernan… · DEEP DIVE. The Value of Data Governance with Collibra

©2016 Collibra Inc

THE IMPORTANCE OF DATA GOVERNANCE

Daniel ShollerChief Evangelist

1/10/18

www.collibra.com

University.collibra.com

[email protected]