governing big data, smart data, data lakes, and the internet of things

1

Copyright © 2017 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com

Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting #RWDG @RSeiner

Real World Data Governance

Governing Big Data, Smart Data, Data Lakes,and the Internet of Things

Monthly Webinar Series Hosted by DATAVERSITYRobert S. Seiner – KIK Consulting / TDAN.comSpecial Guest – Anthony Algmin – Uturn DataDecember 21, 2017 – 2:00 p.m. EST

2

2



• Real-World Data Governance – Monthly Webinar SeriesJanuary 18, 2018 – Everybody is a Data Steward; Get Over It!February 15, 2018 – Formalize Data Governance with Policies and ProceduresThird Thurs @ 2pm EST – Register at TDAN.com, KIKconsulting.com, DATAVERSITY.net

• Non-Invasive Data Governance BookISBN 9781935504856 / Technics Publishing / Amazon.com

• Speaking EventsEnterprise Data Governance Online – Virtual Conference – January 24, 2018Enterprise Data World 2018 – San Diego, CA – April 22-27, 2018

• Online Learning PlanNon-Invasive Data Governance - DATAVERSITY Training CenterSeven Online Courses with Evaluations

• The Data Administration Newsletter (TDAN.com)Twice Monthly – Articles, Columns, Blogs and Feature

Produced by DATAVERSITY – Subscribe for emails

Real-World Data GovernanceCurrent Events

3

3



• Anthony J. Algmin helps businesses use data to get better at what they do best. He iscurrently Chief Data Officer at Uturn Data Solutions, a Chicago-based consulting firmat the nexus of data and cloud technologies. Learn more at www.uturndata.com.

• Previously, Mr. Algmin was the first Chief Data Officer at the Chicago Transit Authority,developing data analytics capabilities to help provide affordable transportation formillions of Chicagoans. He also spent several years as a data strategy and managementconsultant transforming businesses in a variety of industries. His early career was inthe capital markets industry developing technology and data-driven applications.

Governing Big & Smart Data, Data Lakes and the IoTSpecial Guest – Anthony Algmin

4

4



• During this webinar Anthony and I will discuss:– The relationship between Big Data, Smart Data and Data Governance– The relationship between the Internet of Things, Data Lakes and Data Governance– How the Internet of Things and Data Lakes change the way we govern data– Extending existing data governance programs to embrace these technologies– Staying one step ahead of the competition by governing these items

Governing Big & Smart Data, Data Lakes and the IoTAgenda for Today’s Webinar

5

5



• Data Governance– Data Governance is the Execution and Enforcement of Authority

Over the Management of Data and Data-Related Resources.

• Data Stewardship– Data Stewardship is the Formalization of Accountability

Over the Management of Data and Data-Related Resources.

Governing Big & Smart Data, Data Lakes and the IoTDefinitions

6

6



• Relationship Between Big Data and Data Governance– What is Big Data?

• Big data is data sets that are so voluminous and complex that traditional dataprocessing application software are inadequate to deal with them.

• Big data challenges include capturing data, data storage, data analysis, search,sharing, transfer, visualization, querying, updating and information privacy.

• There are 3 dimensions to big data known as Volume, Variety and Velocity.• Others consider the Vs Volume, Velocity, Variety and Veracity

– What is the relationship between Big Data and Data Governance?

Governing Big & Smart Data, Data Lakes and the IoTRelationship Between Big Data and Data Governance

7

7




8

8




9

9



• Relationship Between Smart Data and Data Governance– What is Smart Data?

• Smart data is digital information that is formatted so it can be acted upon atthe collection point before being sent to a downstream analytics platform forfurther data consolidation and analytics.

• In the past, most analytics was done with batch processing.• Big Data Vs

– Volume, Velocity, Variety and Veracity (conformity to facts; accuracy.)– smart data is about Veracity, along with another often used V: Value.

– What is the relationship between Smart Data and Data Governance?

Governing Big & Smart Data, Data Lakes and the IoTRelationship Between Smart Data and Data Governance

10

10




11

11




12

12



• Relationship Between the IoT and Data Governance– What is the Internet of Things?

• The Internet of things (IoT) is the network of physical devices, vehicles, homeappliances, and other items embedded with electronics, software, sensors,actuators, and network connectivity which enable these objects to connectand exchange data.

– What is the relationship between the IoT and Data Governance?

Governing Big & Smart Data, Data Lakes and the IoTRelationship Between the IoT and Data Governance

13

13




14

14




15

15



• Relationship Between Data Lakes and Data Governance– What is a Data Lake?

• A data lake is a 1) method of storing data within a system or repository, in its2) natural format, that 3) facilitates the collocation of data in various schemasand structural forms, usually object blobs or files.

• The idea of data lake is to have a single store of all data in the enterpriseranging from raw data (which implies exact copy of source system data) totransformed data which is used for various tasks including reporting,visualization, analytics and machine learning.

– What is the relationship between Data Lakes and Data Governance?

Governing Big & Smart Data, Data Lakes and the IoTRelationship Between the Data Lakes and Data Governance

16

16




http://jeffa.tech/datalake/

17

17




18

18



• How will the technologies spoken about today change the way that organizations govern their data in the future?

Governing Big & Smart Data, Data Lakes and the IoTHow the IoT and Data Lakes Change the Way We Govern Data

19

19



• What are some of the ways that we can extend our existing Data Governance programs to embrace the technologies we have spoken about?

Governing Big & Smart Data, Data Lakes and the IoTExtending Existing DG Programs to Embrace These Technologies

20

20



• How can organizations stay a step ahead of their competition by focusing their Data Governance programs on these technologies?

Governing Big & Smart Data, Data Lakes and the IoTStay One Step Ahead of the Competition by Governing These Items

21

21



• During this webinar Anthony and I discussed:– The relationship between Big Data, Smart Data and Data Governance– The relationship between the Internet of Things, Data Lakes and Data Governance– How the Internet of Things and Data Lakes change the way we govern data– Extending existing data governance programs to embrace these technologies– Staying one step ahead of the competition by governing these items

Governing Big & Smart Data, Data Lakes and the IoTToday’s Webinar

22

22



• Questions and Answers

Governing Big & Smart Data, Data Lakes and the IoTSummary

23

23



• Robert S. SeinerKIK Consulting & Educational Services – KIKconsulting.comThe Data Administration Newsletter – TDAN.comPost Office Box 112571, Upper St. Clair, Pennsylvania 15241412.220.9643, [email protected]@RSeiner @TDAN_com

Governing Big & Smart Data, Data Lakes and the IoTContact Information

governing big data, smart data, data lakes, and the internet of things

Business