Flamingo

The Maestro of Big Data

Hadoop Flamingo Analytics | Management

Smart Factory

EXEM Big Data

FlamingoAnalytics

FlamingoManagement

IoTSensors

Web/SNS

Log

RDBMS

…

File

Crawler

ETL

ESB

Sqoop

Flume

SFTP/FTP

OpenAPI

Dashboard

Open API

Service

Service

Service

AnalyticsModule

Big Data PlatformManagement Data Catalog Open APIBig Data Infra

Management Data Management

Unified Big Data Query(SQL)

HadoopConnector RStudio

TableauSpotfire

…

SPSSSAS…

Data Integrator

Hive Pig Mahout

Flamingo MLlib

Spark In-Memory MapReduce

YARN( )

R

HDFS( )

NoSQL

2

XDP

Data Lifecycle&

Governance

Falcon

Atlas

Data Workflow

Sqoop

Flume

Kafka

NFS

WebHDFS

TOOLS

Zeppelin FlamingoAnalytics

MapReduce

Solr/ElasticSearch

HDFSHadoop Distributed File System

Administration

Authentication

AuthorizationAuditing

Data Protection

Provisioning,Managing,

&Monitoring

FlamingoManagement

Ranger

Knox

Atlas

HDFS Encryption

Ambari

Cloudbreak

ZooKeeper

Oozie

Pig

SQLHiveTez

NoSQL

HBaseAccumuloPhoenix

Silder

StormSilder

YARN:

ISV Engines Spark

3

AI

h3

h2

h1

v

W 3

W 2

W 1

RBM

SigmoidBeliefNetwork

h0 h0

X0

h0

X0

h3

X2

h2

X2X0

=

time

A A A A A

Convolutional layer

layer 1FC 6layer 2

layer 3 layer 4 layer 5

4

Smart Factory

DBApache Tajo

Apache Spark

Flum

e

Apache

DBMS

Storm

Cascading

Sentry

Sq

oop

MapReduce

Hive R Pig

HDFS

SocialData

6

7

Flamingo

RStudio Server[Batch Analytics]

R

Management

time1

windowat time1

windowat time2

windowat time3

time2

window basedoperation

time3 time4 time5

ISO/IEC30128

MQTT

HTTP

Realtime Analytics

Flamingo

one M2M

Kaf

ka

MQTT

FTP

HDFS

Kafka

MQTT

FTP

HTTP

Kafka

Realtime Distributed Message Broker

Spark Streaming

Batch Analytics

R/RStudio

Hadoop EcoSystem

SQL onHadoop Spark ZooKeeper Sqoop

Hive

MapReduce

R Pig

Flume HDFS

HD

FS

MR, Spark

Oozie

HDFS

8

Workflow Designer[Batch Analytics]

HDFS Browser[Batch Analytics]

9

Apache Hive ManagementHadoop Data Warehouse

[Batch Analytics]A

YARN, MapReduce Monitoring[Batch Analytics]

10

[Management]

Spark MonitoringIn-Memory

SQL on HadoopHadoop DW

[Batch Analytics]

11

[Management]

HDFS Audit

HDFS Audit

Web CLI[Management]

12