denodo datafest 2017: data virtualization in the world of edge computing

16
OCTOBER 19-20, 2017 NEW YORK, NY Redefining Analytics for Successful Self-Service BI, Cloud, and Big Data The Agile Data Management and Analytics Conference #DenodoDataFest

Upload: denodo

Post on 21-Jan-2018

38 views

Category:

Data & Analytics


3 download

TRANSCRIPT

Page 1: Denodo DataFest 2017: Data Virtualization in the World of Edge Computing

O C T O B E R 1 9 - 2 0 , 2 0 1 7 N E W Y O R K , N Y

Redefining Analytics for Successful Self-Service BI, Cloud, and Big Data

The Agile Data Management and Analytics Conference

#DenodoDataFest

Page 2: Denodo DataFest 2017: Data Virtualization in the World of Edge Computing

Data Virtualization in the world of Edge Computing

Pablo Alvarez

Principal Solution Architect, Denodo

Page 3: Denodo DataFest 2017: Data Virtualization in the World of Edge Computing

3

What’s the Edge

Cliffs of Moher by Giusseppe Calsamiglia, CC license

Page 4: Denodo DataFest 2017: Data Virtualization in the World of Edge Computing

Edge computing is a method of optimizing computing

systems by performing data processing at the edge of the

network, near the source of the data.

What is Edge Computing?

Page 5: Denodo DataFest 2017: Data Virtualization in the World of Edge Computing

5

The Edge Computing Model

Page 6: Denodo DataFest 2017: Data Virtualization in the World of Edge Computing

6

Why Edge Computing?

▪ Lower Cost

▪ Reduced storage, traffic and processing in the central hubs

▪ Minimize latency

▪ Data is analyzed at the local level

▪ Reduced network traffic

▪ Only necessary data is transmitted to the central hub

▪ Two tier access for better performance

▪ Critical applications can access the Edge directly instead of the central hub

Page 7: Denodo DataFest 2017: Data Virtualization in the World of Edge Computing

7

Where is the Edge?Ronda by Paucal, CC license

Page 8: Denodo DataFest 2017: Data Virtualization in the World of Edge Computing

8

How far does it makes sense to push the edge?

▪ What is your business problem and

where can you benefit from the

ideas of Edge Computing?

▪ Keep in mind that Data

virtualization is a data integration

and data delivery technology

▪ What’s the global architecture?

▪ Cloud vs data center

▪ Geographical distribution

▪ Etc.

Source: https://medium.com/iotforall/whats-proximity-computing-4b713ecf3666

Page 9: Denodo DataFest 2017: Data Virtualization in the World of Edge Computing

9

Example: Country as the Edge

▪ Multinational company with

independent regional units

▪ Have to comply with multiple

data privacy laws

▪ Need for centralize world-wide

perspective

Your Edge is the country/region

Two-tier Logical Data Warehouse

ArchitectureUSA data center Europe data center

Page 10: Denodo DataFest 2017: Data Virtualization in the World of Edge Computing

10

Example: Factory as the Edge

▪ Multiple factories with locally

replicated systems for some

operations (supply chain, HR,

IoT manufacturing systems,

etc.)

▪ Large amount of data

generated at the factory level

▪ Huge potential for distributed

processing for aggregated

global reporting

Your Edge is the Factory

Page 11: Denodo DataFest 2017: Data Virtualization in the World of Edge Computing

Moving to an iPaaS Edge

Page 12: Denodo DataFest 2017: Data Virtualization in the World of Edge Computing

An Integration Platform as a Service (iPaaS) is an data

integration platform that combines the benefits of a PaaS

platform (cloud hosted) with the performance of local

processing via execution agents

What is iPaaS?

Page 13: Denodo DataFest 2017: Data Virtualization in the World of Edge Computing

13

Beyond Denodo 7: Denodo’s iPaaS Architecture

Execution Agent Execution Agent

MetadataRepository

Execution Engine& Optimizer

Data center A Data center B

Corporate Security

Monitoring & Auditing

“The Cloud”

Page 14: Denodo DataFest 2017: Data Virtualization in the World of Edge Computing

14

iPaaS model and Edge Computing

Decouples metadata layer (Cloud) from the execution layer (on-prem):

▪ Data sources, view definitions and usage info are stored centrally in the cloud

Actual query execution can be pushed down to local “execution agents”

deployed at the edge to avoid heavy network traffic

Simplifies operations:

▪ Development is done directly in the cloud via a web tool

▪ Components are either web-based (clients) or automatically updated (agents)

▪ Execution agents are monitored centrally from the cloud UI

Page 15: Denodo DataFest 2017: Data Virtualization in the World of Edge Computing

Q&A

Page 16: Denodo DataFest 2017: Data Virtualization in the World of Edge Computing

Thank you!

© Copyright Denodo Technologies. All rights reservedUnless otherwise specified, no part of this PDF file may be reproduced or utilized in any for or by any means, electronic or mechanical, including photocopying and microfilm, without prior the written authorization from Denodo Technologies.

#DenodoDataFest