ibm big data analytics & watson for fintech - byte...

16
© 2016 IBM Corporation Sunny Prakash Data Scientist /Spark Evangelist IBM Cognitive Studio IBM Big Data Analytics & Watson for Fintech

Upload: phamngoc

Post on 19-Mar-2018

222 views

Category:

Documents


3 download

TRANSCRIPT

© 2016 IBM Corporation

Sunny Prakash

Data Scientist /Spark Evangelist

IBM Cognitive Studio

IBM Big Data Analytics & Watson for Fintech

© 2016 IBM Corporation

© 2016 IBM Corporation3

The Big Data Opportunity

Variety:

Velocity:

Volume:

Manage the complexity

of multiple relational and

non-relational data types

and schemas

Streaming data and

large- volume data

movement

Scale from terabytes to

zettabytes

© 2016 IBM Corporation4

Hadoop Pioneered by Google and Yahoo!

Open source project

Written in Java

Optimized to handle:

Massive amounts of data through parallelism

A variety of data (structured,unstructured, semi-structured)

Uses inexpensive commodity hardware

Reliability provided through data replication

Great performance for extreme volumes of data

Batch oriented

Large streaming, or sequential processes

Data can be appended but not updated

Generate business intelligence related reports

Not for OLTP, OLAP, or DSS

Not intended to be a replacement to traditional RDMS

© 2016 IBM Corporation5

Text Analytics

POSIX Distributed

Filesystem

Multi-workload,

multi-tenant

scheduling

IBM BigInsights

Enterprise

Management

Machine

Learning

Big R

IBM Open Platform with Apache HadoopHDFS, YARN, MapReduce, Ambari, Flume, HBase, Hive, Kafka,

Oozie, Pig, Slider, Solr, Spark, Sqoop, Zookeeper

IBM

BigInsights

Data

Scientist

IBM

BigInsights

AnalystBig SQL

BigSheets

Big SQL

BigSheets

IBM BigInsights – Our Hadoop On Premise Offering

Free Quick Start (non

production):

• IBM Open Platform

• BigInsights Analyst, Data

Scientist features

• Community support

. . .

© 2016 IBM Corporation6

BigInsights for Apache Hadoop on Bluemix Compute

Infrastructure and Services

© 2016 IBM Corporation7

Watson Data Platform

Experience Watson Data Platform with a tool designed for your role

© 2016 IBM Corporation8

© 2016 IBM Corporation9

© 2016 IBM Corporation10

Watson AlchemyLanguage

AlchemyLanguage is a collection of APIs that offer text analysis through natural language

processing. This set of APIs can analyze text to help you understand its concepts, entities,

keywords, sentiment, and more. Additionally, you can create a custom model for some APIs

to get specific results that are tailored to your domain

AlchemyAPI is trained on billions of webpages and can detect and extract information such

as concepts, entities, sentiment, and keywords.

Tutorial Link :- https://www.ibm.com/watson/developercloud/alchemy-language.html

Demo Link :- https://conversation-demo.mybluemix.net/

© 2016 IBM Corporation11

IBM Watson News Explorer

News Explorer is a Bluemix-hosted web application that uses Watson’s AlchemyData News

API to allow users to explore a large collection of news stories by surfacing the topics,

people, companies, organizations, and locations mentioned in those article

Tutorial Link :- https://developer.ibm.com/watson/blog/2015/07/20/presenting-watson-news-

explorer/

Demo Link :- http://news-explorer.mysbluemix.net/

© 2016 IBM Corporation12

Watson Conversation service

The IBM Watson Conversation service allows you to understand what users are saying and

respond with natural language.

IT combines a number of cognitive techniques to help you build and train a bot - defining

intents and entities and crafting dialog to simulate conversation. The system can then be

further refined with supplementary technologies to make the system more human-like or to

give it a higher chance of returning the right answer. Watson Conversation allows you to

deploy a range of bots via many channels, from simple, narrowly focused Bots to much

more sophisticated, full-blown virtual agents across mobile devices, messaging platforms

like Slack, or even through a physical robot

Tutorial Link :- https://www.ibm.com/watson/developercloud/conversation.html

Demo Link :- https://conversation-demo.mybluemix.net/

© 2016 IBM Corporation13

Visual Recognition Service

Visual Recognition uses deep learning algorithms to analyze images that can give you

insights into your visual content. You can organize image libraries, understand an individual

image, and create custom classifiers for specific results that are tailored to your needs.

Tutorial Link :- http://www.ibm.com/watson/developercloud/visual-recognition.html

Demo Link :- http://visual-recognition-demo.mybluemix.net/

© 2016 IBM Corporation14

Tone Analyzer

The IBM Watson Tone Analyzer Service uses linguistic analysis to detect three types of

tones from text: emotion, social tendencies, and language style. Emotions identified include

things like anger, fear, joy, sadness, and disgust. Identified social tendencies include things

from the Big Five personality traits used by some psychologists. These include openness,

conscientiousness, extroversion, agreeableness, and emotional range. Identified language

styles include confident, analytical, and tentative.

Tutorial Link :- http://www.ibm.com/watson/developercloud/tone-analyzer.html

Demo Link :- https://tone-analyzer-demo.mybluemix.net/

© 2016 IBM Corporation15

Tradeoff Analytics

The IBM Watson Tradeoff Analytics service helps people make better choices when faced

with multiple, often conflicting, goals and alternatives. By using mathematical filtering

techniques to identify the best candidate options based on different criteria, the service can

help users explore the tradeoffs between options to make complex decisions. The service

combines smart visualization and analytical recommendations for easy and intuitive

exploration of tradeoffs.

Tutorial Link :- http://www.ibm.com/watson/developercloud/doc/tradeoff-analytics/

Demo Link :- https://tradeoff-analytics-demo.mybluemix.net/

© 2016 IBM Corporation16