exploring the talend unified big data toolset for sentiment analysis - ben bryant, talend

12
WELCOME TO Talend Connect London 2013

Upload: jaxlondonconference

Post on 12-May-2015

483 views

Category:

Technology


3 download

DESCRIPTION

Presented at JAX London 2013 as a last-minute addition to the schedule.

TRANSCRIPT

Page 1: Exploring the Talend unified Big Data toolset for sentiment analysis - Ben Bryant, Talend

WELCOME TOTalend

Connect London

2013

Page 2: Exploring the Talend unified Big Data toolset for sentiment analysis - Ben Bryant, Talend

© Talend 2012 2

“Sentiment Analysis” aims to understand what people say about your organisation on social media, eg. Twitter

Demonstrate interoperability of Talend tools

Demonstrate our Big Data capabilities

This is a shameless excuse to play with all the shiny tools in

Talend’s box!

Not intended as a masterclass in Sentiment Analysis

Exploring the Talend Unified Big Data toolset for Sentiment Analysis.

Page 3: Exploring the Talend unified Big Data toolset for sentiment analysis - Ben Bryant, Talend

© Talend 2012 3

Talend’s Unique Integration Solution

➜ Reduce costs➜ Eliminate risk➜ Reuse skills➜ Economies of scale➜ Incremental adoption

Best-of-Breed Solutions +

Talend Unified Platform

=

Unique Integration Solution

Page 4: Exploring the Talend unified Big Data toolset for sentiment analysis - Ben Bryant, Talend

© Talend 2012 4

© Talend 2013

Sentiment Dashboard

TALENDESB

(Stream)

TALENDESB

(Stream)

TALENDBIG DATA

(Integration)

TALENDBIG DATA

(Integration)

TALENDESB

(Service)

TALENDESB

(Service)

HADOOP

HDFS Map/Reduce

Anatomy of a demo

Page 5: Exploring the Talend unified Big Data toolset for sentiment analysis - Ben Bryant, Talend

© Talend 2012 5

Streaming Tweets

An ESB Mediation Route to ‘stream’ tweet data from Twitter’s public API

Perfect example of Talend’s open standard extensibility Apache Camel enterprise integration patterns

Page 6: Exploring the Talend unified Big Data toolset for sentiment analysis - Ben Bryant, Talend

© Talend 2012 7

Demo part 1. Tweet tweet.

Page 7: Exploring the Talend unified Big Data toolset for sentiment analysis - Ben Bryant, Talend

© Talend 2012 8

Processing in Hadoop

Map/Reduce processing of data in-situ across Hadoop Zero installation/configuration required Thousands of graphical ETL developers can now be Big Data

developers

Page 8: Exploring the Talend unified Big Data toolset for sentiment analysis - Ben Bryant, Talend

© Talend 2012 10

Demo part 2. John Noakes trembles in his boots …

Page 9: Exploring the Talend unified Big Data toolset for sentiment analysis - Ben Bryant, Talend

© Talend 2012 11

Expose results as a Service

Talend real-time Service exposes results held in a database Same tooling and deployment platform as normal Data

Integration Request/Response model for end user dashboard

Page 10: Exploring the Talend unified Big Data toolset for sentiment analysis - Ben Bryant, Talend

© Talend 2012 13

Demo part 3. Waiter! Service please …

Page 11: Exploring the Talend unified Big Data toolset for sentiment analysis - Ben Bryant, Talend

© Talend 2012 14

Talend Unified Platform provides a broad toolset for data projects

Streaming Routes for pulling raw data from an API

Batch processing (including Map/Reduce, PIG, HIVE on Hadoop)

Real-time Services for provision to end user visualisation

Key takeaways from today

There’s value in them there tools …

Big data skills no longer too costly

Shallow learning curve from data integration to data services and

beyond

Yes, you can connect to it, and extract value from it

Page 12: Exploring the Talend unified Big Data toolset for sentiment analysis - Ben Bryant, Talend

Thank You and on with the show!