integrating bi - data warehouse and big data
DESCRIPTION
Towards the integration of traditional Business Intelligence Systems and Big Data. An introduction for young big data fans.TRANSCRIPT
Dr. Raúl Arrabales
Academic / Innovation Director@MbitSchool
Integrating BI/DW & Big Data
(for young big data fans)
BIG & OPEN DATA. Análisis y
Programación con R. Jul. ‘14
There seem to be two different worlds out there
“Plumbers” “Real IT crowd”
BI vs. Big Data
Is it all about trends?Are there different needs?Should they be integrated?
Can these guys really talk to each other?
Different perspectivesIT crowd standpoint
“Legacy” BI/DW
Pre-existing Boiler Room interior. Ford Assembly Building in Richmond - Photo by Billy Hustace.
Different perspectivesPlumbers standpoint
What’s the real deal with traditional BI and Big Data?
What’s the real deal with traditional BI and Big Data?
Big Data Marketing and Media
Created Bubble
What’s the real deal with traditional BI and Big Data?
Big Data Hype
BI Plateau
We are lighter during high tide…
Let’s have a look to real needs
Increased data flow (volume, velocity)
Let’s have a look to real needs
Let’s have a look to real needs
Increased need to process
un-structured
data (variety,
viscosity)
Yes, we need real-time big data sometimes
But careful! You might get the goodies analyzing small data
(cheaper and faster)
Avoid data hoarding!
Remember…
Compulsive hoarding in a private apartment - Photo by Thomas Haemmerli.
Compulsive hoarding in its
worst forms can cause fires,
unclean conditions (e.g. rat and
roach infestations), injuries from
tripping on clutter, and other
health and safety hazards.
OK, what we need is…,
sometimes it’s “traditional” BI, sometimes it’s Big Data,
sometimes it is…
Different worlds?
Different worlds?
The three worlds that need to be connected
Online analytical processing (OLAP)Online Transaction Processing (OLTP)
The magic of integration
Predictive analysis
Enterprise BI
Departamental BI
Personal BI
Mobile BI
Business Analytics
Big Data
Ops
BI as a Service
The magic of integration
Predictive analysis
Enterprise BI
Departamental BI
Personal BI
Mobile BI
Business Analytics
Big Data
Ops
TOOLS NEED TO CONVERGE
BI as a Service
BI Tools are now mature and well tested
Big Data still needs some refinement
And current integrations… Look like this
Well trained IT professionals are needed
Well trained IT professionals are needed
Módulo 1:
El entorno de la Inteligencia de Negocio (BI) y el Big Data.
Módulo 2:
Arquitecturas BI y Big Data.
Módulo 3:
Implantación de soluciones BI y Big Data.
Módulo 4:
Análisis de la Información y Extracción de Conocimiento.
Módulo 5:
Visualización y Reporting.
Módulo 6: Integración de conocimientos y competencias –
Proyecto Final de Máster.
All BI vendors are
now also Big Data converts
By 2015, the shifting tide of BI platform
requirements, moving from reporting-centric
to analysis-centric, will mean the majority of
BI vendors will make governed data discovery
capabilities an expansion of, and the prime
competitive capability for, their BI platform
offerings*.
* Gartner Magic Quadrant for Business Intelligence and Analytics Platforms” by Rita L. Sallam, Joao Tapadinhas, Josh Parenteau, Daniel Yuen and Bill Hostmann, 20 February 2014.
BI reporting analytics
Big Data
data set size
analytics
Same goals: extract value from data.
Analytics
Structured Data
Unstructured Data
Reporting
Real-Time
Customized
Visualization
Interactive
Customized
Technological hype provides exciting
learning opportunities… Take advantage of it.
Dr. Raúl Arrabales
Academic / Innovation Director@MbitSchool
Integrating BI/DW & Big Data
(for young big data fans)
BIG & OPEN DATA. Análisis y
Programación con R. Jul. ‘14