spark, nosql and real time processing by oscar mendez at big data spain 2014
DESCRIPTION
Big Data Spain welcomes everyone. The event will be a two-day intense conference. We will meet many people, learn a lot and have fun. Data is value. In this third edition of the conference we talk about real-time processes, machine learning, NoSql databases and how fast we can process the data using Spark technologies. Session presented at Big Data Spain 2014 Conference 17th Nov 2014 Kinépolis Madrid http://www.bigdataspain.org Event promoted by: http://www.paradigmatecnologico.com Abstract: http://www.bigdataspain.org/2014/conference/welcome-keynote https://www.youtube.com/watch?v=1ew-CUH93A4TRANSCRIPT
WELCOME NOTE BDS14
ÓSCAR MÉNDEZCEO STRATIO AND PARADIGMA TECNOLÓGICO
Big Data Spain 2.014
Big Data Spain third edition36 SPEAKERS
10 WORKSHOPS500 ATTENDEES
DATA = VALUE
Actualmente el valor de lasempresas se mide por sus datos
467.142Mill $
373.608Mill $
150.211 Mill $
148.210Mill $
1 3 20 21
Data Value
DowJones PER2014 = 13
Facebook PER2014 = 48
Differentiation 35
PER = PER + PDR+
PER = 13 + 35 = 48+
TECHNOLOGY
Technology
At the beginning it was batch
Then came InteractiveDiscovery of data
< 40 secondsTo analyze petabytes in seconds
Enable decisions on real-time data
Real time Data Streaming Analysis
Machine LearningAlgorithms
Future Data
COMBINATIONPAST DATA > STORED
CURRENT DATA FLOWS > REAL-TIME DATA STREAMING
FUTURE DATA > MACHINE LEARNING & ALGORITHMS
NoSQL databasesTHE BEST OF BOTH WORLDS
COMBINED
“Two plus two is four? Sometimes… Sometimes it is five.” G. ORWELL
NoSQLdatabases
BD Processing
SIMPLIFICATION: Visual tools
Simplify Building Process
Clear Data Visualization
New ways of Data Visualization
IT THIRD GENERATION
CURRENT IT PARADIGM
CRM
E-COMMERCE
LOGISTIC
SALES
APPLICATION
SPECIALIZED
APPLICATIONS BI
DASHBOARD
REPORTING
R, SPS, SAS
BA
TERADATA
DW
DATA REPLICATION
HUMAN INTERVENTION
Current it paradigm
OPERATIONAL INFORMATIONAL
NEW IT PARADIGM
OPERATIONAL
DATA LAYER
INFORMATIONAL
Data layer Integration between Operational and Informational Applications
The spoon
Data exists by itself
OPERATIONAL
DATA
INFORMATIONAL
Companies will buy data, sell data, trade data andMake specific deals and partnerships to share or get data
Already Happening: RTB
THE ORACLE: THE FUTURE OF DATA
Millions of data analyzed in real time
Wearables & Mobile: One ring to rule them allThe small heart of the big system
Wearables: Sensors all around us
Nano Data Meets Big Data
CONCLUSSIONS
Take the Red pill and see reality: World is data, and data is your value
17TH ~ 18th NOV 2014MADRID (SPAIN)