fasten you seatbelt and listen to the data steward

47
@Djeepy1 | @Fleid_bi | @GUSS_France Fasten your seatbelt and listen to the (Data) Steward Jean-Pierre Riehl Florian Eiden http://blog.djeepy1.net | @djeepy1 http :// fleid.net | @fleid_BI

Upload: jean-pierre-riehl

Post on 08-Sep-2014

602 views

Category:

Technology


2 download

DESCRIPTION

In that session we will discuss about Data Governance, mainly around that fantastic platform Power BI (but also around on-prem concerns). How to avoid dataset-hell ? What are the best practices for sharing queries ? Who is the famous Data Steward and what is its role in a department or in the whole company ? How do you choose the right person ? Keywords : Power Query, Data Management Gateway, Power BI Admin Center, Datastewardship, SharePoint 2013, eDiscovery Level 200

TRANSCRIPT

Page 1: Fasten you seatbelt and listen to the Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

Fasten your seatbelt and

listen to the (Data) StewardJean-Pierre Riehl

Florian Eidenhttp://blog.djeepy1.net | @djeepy1

http://fleid.net | @fleid_BI

Page 2: Fasten you seatbelt and listen to the Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

Jean-Pierre RiehlPractice Manager Data & BI – AZEO

MVP SQL ServerPresident at GUSS

Florian EidenManaging Consultant, Data & Analytics - CellenzaMVP SQL ServerBoard Member at GUSS

Who are we ?

Page 3: Fasten you seatbelt and listen to the Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

GUSS : PASS France chapter

Webcasts, Conferences, Afterworks

.Pro

Next event : SQLSaturday Paris 2014September 13thTour Montparnasse, ParisEnglish-speaking track

Page 4: Fasten you seatbelt and listen to the Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

THE CONTEXT

Page 5: Fasten you seatbelt and listen to the Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

Self-Service BI

Corporate BI• Managed• DatawareHouse• Company-wide

Team BI• Shared• Models• Department-wide

Self-Service BI• Quick & Easy• Personal data• Document-centric

Page 6: Fasten you seatbelt and listen to the Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

Empower UsersRelease Data, Release usages

Page 7: Fasten you seatbelt and listen to the Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

Governance noun.« Leading the conduct of things or persons »

Page 8: Fasten you seatbelt and listen to the Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

THE ISSUES

Page 9: Fasten you seatbelt and listen to the Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

Writer’s blockalso known as

White Worksheet

Syndrom

Issue #1

?

Page 10: Fasten you seatbelt and listen to the Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

Too much Data !« I want the Employee’s List »

– Duplicates– Wrong sources– Bad Data– Poor or Bad description– Etc.

Issue #2

Page 11: Fasten you seatbelt and listen to the Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

Compliance– Security– Encryption– Anonymization

Issue #3

Page 12: Fasten you seatbelt and listen to the Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

How does it scale ?

Page 13: Fasten you seatbelt and listen to the Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

POWER BIThe Microsoft Way

Page 14: Fasten you seatbelt and listen to the Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

Features and toolsCollaborate in Office 365

Insights in Excel

Analyze

Visualize

Share

Question

Q&A

Mobility

Discover Search, access, and transform public and internal data sources with Power Query

Share datasets and workbooks refreshable from on-premises and cloud based data sources, with Power BI Sites

Easy data modeling and lightning fast in-memory analytics with Power Pivot

Bold new interactive data visualizations with Power View and Power Map

Ask questions and get immediate answers with natural language query

Mobile access through HTML5 and touch optimized apps

Scalable | Manageable | Trusted

Page 15: Fasten you seatbelt and listen to the Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

Power BI - Big Picture

Power BI O365 Tenant

Power BI Admin Center

SQL

Data Catalog

External Data

Q&A

Cloud On-Prem

Oracle …

Excel

Power BI SitesPower Query

Power Pivot

Power View Power Map

Cloud

Power Query

Data Refresh

IndexSearch Data

Management Gateway

Page 16: Fasten you seatbelt and listen to the Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

Ideas of costsAcquire Data

Modelize0€

Geo-Reporting

Excel 2010* (with limitations)Excel 2013Sharing in SharePoint On-Prem

Visualize

360€by user / year

Mobility

NaturalLangage

Q&AShareCollaborate

Search

Base on SharePoint Online (O365 Tenant)Possible de ne partager que les métadonnées

Rendre opérationnel

Data Refresh : ouverture de flux

450€by user / year

All Inclusive (ie. including Office 2013 ProPlus Licences)

Page 17: Fasten you seatbelt and listen to the Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

Power BI* On-PremData Sources

Gateways & Data SourcesShared Data Sources (SSRS)

Office Data Connection

Datasets QueriesShared Datasets (SSRS)

Power Pivot for SharePoint

Models Power PivotData Management Gateway Power Pivot for SharePoint

Dashboards

Power ViewPower View (BISM)

SSRS over Power Pivot

There was some SSBI before Power BI

Power BI vs. On-Prem

* Many more features to come

Page 18: Fasten you seatbelt and listen to the Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

demo

Page 19: Fasten you seatbelt and listen to the Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

• Tools are only a part of the solution

• Good formula : People + Processes + Tools– « Data governance is between 80 and 95%

communication » - Dec 2006 Data Governance Conference

• We have the tools, let’s talk about the rest…

If all you have is hammer…

Page 20: Fasten you seatbelt and listen to the Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

THE DATA STEWARD

Page 21: Fasten you seatbelt and listen to the Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

• Wikipedia: Stewardship is an ethic that embodies the responsible planning and management of resources.

A Steward?

Data Steward of Gondor…Not our idea, see Matthew Roche for complaints

Page 22: Fasten you seatbelt and listen to the Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

IT : Information Technology

My pretty typical organization

Piercing items

Slashing items

Bludgeoning items

Armors & Shield

Business Divisions Functional Units

Finance HR Legal

Page 23: Fasten you seatbelt and listen to the Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

Where are stewards needed in the org?

Piercing items

Slashing items

Bludgeoning items

Armors & Shield

Business Divisions Functional Units

Finance HR Legal

IT : Information Technology

Page 24: Fasten you seatbelt and listen to the Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

My organization : actual perception

Piercing items

Slashing items

Bludgeoning items

Armors & Shield

Business Divisions Functional Units

Finance HR Legal

IT

Page 25: Fasten you seatbelt and listen to the Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

Well, let’s be honest about what it looks like

Piercing items

Slashing items

Bludgeoning items

Armors & Shield

Business Divisions Functional Units

Finance HR Legal

IT

Page 26: Fasten you seatbelt and listen to the Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

For maximum results: local initiatives

Piercing items

Slashing items

Bludgeoning items

Armors & Shield

Business Divisions Functional Units

Finance HR Legal

IT

Page 27: Fasten you seatbelt and listen to the Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

• Why : – Specific to your company, to be defined in your master plan

• How : – “Responsible planning and management of resources”

• What :– Elect data stewards that will enable, teach, police

Let’s get back to our stewardSlashing items

Page 28: Fasten you seatbelt and listen to the Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

• Skills– Interpersonal skills– Good personal organization– Data-awareness

• Data lifecycle specific to the company• General understanding of BI/data technologies• Data merging, cleaning, metadata maintenance

– Training in tools used in the company

• A chosen career path– It’s an actual job, usually part time– But not just an additional task in the schedule!

Required skills

Page 29: Fasten you seatbelt and listen to the Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

The Journey of a Data Steward

Page 30: Fasten you seatbelt and listen to the Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

The Journey of a Data Steward• Help to find data

– Manage the Data Lake– Create Data Sources– Facilitate exploration– Manage metadata

Page 31: Fasten you seatbelt and listen to the Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

The Journey of a Data Steward• Manage new data

– Find new Data Sources– Find new Datasets

• Verify new datasets– Check for Accuracy– Check for duplicates– Fix sources and queries

• Use of Workflows

Page 32: Fasten you seatbelt and listen to the Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

The Journey of a Data Steward• Certify

– Ensure Corporate Policies

• Train & Teach – Help for modeling– Help for analysis

Page 33: Fasten you seatbelt and listen to the Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

demo

Page 34: Fasten you seatbelt and listen to the Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

Information Management Platform

ITDevelopers

Data Stewar

d

Importance of relations

Business Users

Tools Tools Tools

Page 35: Fasten you seatbelt and listen to the Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

Information Management Platform

SalesIT

And reality is more complex

Mktg Production

Page 36: Fasten you seatbelt and listen to the Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

DATA(source) LIFECYCLE MANAGEMENT

Page 37: Fasten you seatbelt and listen to the Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

Data Lifecycle Management

Page 38: Fasten you seatbelt and listen to the Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

Data Lifecycle Management

Page 39: Fasten you seatbelt and listen to the Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

Data Lifecycle Management

Page 40: Fasten you seatbelt and listen to the Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

Data Lifecycle Management

Page 41: Fasten you seatbelt and listen to the Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

Data Source Lifecycle Management

Manage, enable

Teach, assist

Analyse, mergeDataSteward

Page 42: Fasten you seatbelt and listen to the Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

• Data asset administration– Create, Delete– Update, Maintain– Give/revoke access– Refresh schedule– Monitor– …

• Business metadata understanding

• Data manipulation• Applied to : data artifacts– Data sets

• Files: CSV, XLSX

– Metadata• Data Models• Documentation

– Data sources– Queries– …

Data Source Lifecycle Management

Page 43: Fasten you seatbelt and listen to the Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

CONCLUSION

Page 44: Fasten you seatbelt and listen to the Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

• Tools are nothing without people and processes

• Governance is different in every company– Decided and sponsored by the executives,

inscribed in a global strategy– Adapted to your organization– The Data Steward as the local implementation of it

A matter of governance

Page 45: Fasten you seatbelt and listen to the Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

1. Build an Information Management Platform

2. Identify your processes & Org Chart3. Write the Data Steward « Job Profile »4. Identify the right people for the job5. Leverage Self-Service BI

• Ask your local experts

How to start tomorrow ?

Page 46: Fasten you seatbelt and listen to the Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

• A Data Culture– See Satya Nadella April 15th 2015 presentation in SF

• To at last step up in the knowledge pyramid!– Machine learning \o/

All this for what?

Page 47: Fasten you seatbelt and listen to the Data Steward

@Djeepy1 | @Fleid_bi | @GUSS_France

Any questions ?

Thank You !