exploring the talend unified big data toolset for sentiment analysis - ben bryant, talend
DESCRIPTION
Presented at JAX London 2013 as a last-minute addition to the schedule.TRANSCRIPT
WELCOME TOTalend
Connect London
2013
© Talend 2012 2
“Sentiment Analysis” aims to understand what people say about your organisation on social media, eg. Twitter
Demonstrate interoperability of Talend tools
Demonstrate our Big Data capabilities
This is a shameless excuse to play with all the shiny tools in
Talend’s box!
Not intended as a masterclass in Sentiment Analysis
Exploring the Talend Unified Big Data toolset for Sentiment Analysis.
© Talend 2012 3
Talend’s Unique Integration Solution
➜ Reduce costs➜ Eliminate risk➜ Reuse skills➜ Economies of scale➜ Incremental adoption
Best-of-Breed Solutions +
Talend Unified Platform
=
Unique Integration Solution
© Talend 2012 4
© Talend 2013
Sentiment Dashboard
TALENDESB
(Stream)
TALENDESB
(Stream)
TALENDBIG DATA
(Integration)
TALENDBIG DATA
(Integration)
TALENDESB
(Service)
TALENDESB
(Service)
HADOOP
HDFS Map/Reduce
Anatomy of a demo
© Talend 2012 5
Streaming Tweets
An ESB Mediation Route to ‘stream’ tweet data from Twitter’s public API
Perfect example of Talend’s open standard extensibility Apache Camel enterprise integration patterns
© Talend 2012 7
Demo part 1. Tweet tweet.
© Talend 2012 8
Processing in Hadoop
Map/Reduce processing of data in-situ across Hadoop Zero installation/configuration required Thousands of graphical ETL developers can now be Big Data
developers
© Talend 2012 10
Demo part 2. John Noakes trembles in his boots …
© Talend 2012 11
Expose results as a Service
Talend real-time Service exposes results held in a database Same tooling and deployment platform as normal Data
Integration Request/Response model for end user dashboard
© Talend 2012 13
Demo part 3. Waiter! Service please …
© Talend 2012 14
Talend Unified Platform provides a broad toolset for data projects
Streaming Routes for pulling raw data from an API
Batch processing (including Map/Reduce, PIG, HIVE on Hadoop)
Real-time Services for provision to end user visualisation
Key takeaways from today
There’s value in them there tools …
Big data skills no longer too costly
Shallow learning curve from data integration to data services and
beyond
Yes, you can connect to it, and extract value from it
Thank You and on with the show!