Engage and be Engaging: Building Compassionate and Personalized Conversational Systems Rama Akkiraju IBM Distinguished Engineer

Building applications using Cognitive Services

Rama AkkirajuIBM Distinguished Engineer

1

Please noteIBMsstatements regarding its plans, directions, and intent are subject tochange orwithdrawalwithout notice and at IBMssole discretion.Information regardingpotential future products is intended to outline our general productdirection and it should not be relied on in making a purchasing decision.The information mentionedregarding potential future products is not a commitment, promise, orlegal obligation to deliver any material, code orfunctionality. Information about potential futureproducts maynot be incorporated into any contract.Thedevelopment, release, and timing of any future features orfunctionality described for our products remains at our sole discretion.Performance is based onmeasurements and projections using standard IBM benchmarks in acontrolled environment. The actual throughput or performance that anyuser will experience willvary depending upon many factors, including considerationssuch as the amount of multiprogramming in the users job stream, theI/O configuration, the storage configuration, and theworkloadprocessed. Therefore, no assurance can be given that an individualuser will achieve results similar to those stated here.4/11/2017World of Watson 2016 2

< Click in screen to play video >4/11/2017Devoxx 20173

3

A few snippets of AIs Historic Timeline4/11/2017Devoxx 201741950: Alan Turings Turing Test1950: Issac Asimovs Three laws of Robotics1951-52: Checkers playing programs (Univ. of Manchester, IBM)1958: John McCarthy invents LISP1959: John McCcrthy & Marvin Minsky founded MIT AI lab.1961: Robots in General Motors automobile assembly line1965: MIT builds ELIZA, first Dialog system1975: Marvin Minsky published Frames for knowledge representation1980s: Expert SystemsMid 1980s: Neutral nets 1990s: TD-gammon, back-gammon program by Gerry Tesauro, IBM.1990s: Datamining, NLP, case-based reasoning,

Source: Wikipedia

First of all, we have to acknowledge that our generation of developers are standing on a whole range of foundational theories laid by our predecessors. 4

AI has come a long way!4/11/201752015

20092011

1997

2011

1990s

2017

2010

Deep blue image source: https://en.wikipedia.org/wiki/Deep_Blue_versus_Garry_Kasparov

AI has come a long way in the past two decades building on the foundations of various advancements!

From the AI inventions of MIT media lab to beating a world-champion at the game of chess, and Go to self-driving cars to beating humans in the general knowledge question and answering games to Digital Virtual Assistants, all the way to the recent announcements in achieving almost-human parity in Speech Recognition 5

Whats next for AI?4/11/20176

Some people projected doomsday scenarios with AI, that Robots will become overlords and will take over humanity and all. Yes, there are many other genuine ethical, social, moral, and political topics around the rise of AI to discuss and sort out and Im sure we will figure those things out over time as a human society. What is more interesting and productive is to think of the many ways AI can help us.

Source:

http://www.dailymail.co.uk/sciencetech/article-4275844/AI-scientists-meet-discuss-doomsday-scenarios.html

From to malware on steroids to hacks that cause driverless cars to recklessly break the rules of the road, artificial intelligence could soon threaten humanity in ways that once existed only in science fiction. An image from Terminator Genisys is pictured

Read more:http://www.dailymail.co.uk/sciencetech/article-4275844/AI-scientists-meet-discuss-doomsday-scenarios.html#ixzz4btcq5Emg

6

New Computing Era4/11/2017Devoxx 20177

TabulatingSystems EraProgrammableSystems EraCognitiveSystems Era190019502011

If the previous generation of computing was about painstakingly telling computers how to do scientific calculations and how to solve problems by writing programs in languages that computers can understand, we believe the next era of computing will be all about computers trying to understand human natural language and interacting with us in more natural mediums than ever before. Of course, humans have to write programs for them too! But even that is fast changing where computers can reason, learn and reprogram themselves. So, we believe we are at the threshold of a new era of computing!7

Self-Learning at-scale

Reason with purpose

Interact with humans naturally

Cognitive Computing Systems

To deal with this kind of massive unstructured data we need systems:

Rather than being explicitly programmed, they learn and reason from their interactions with us and from their experiences with their environment.

Many of the Artificial Intelligence (AI) techniques such as Machine Learning, Data mining, Natural Language Processing are coming together with the field of psychology, linguistics, and marketing to build what we are calling as cognitive computing systems to augment human expertise.

What might such a system look like?8

Cognitive Systems augmenting Human Intelligence4/11/20179

HealthcareLegal case Research

Social Media Listening for Marketing and Personalization

Face Recognition for Security and Personalization

Speech Recognition for Customer Care

Emotion Recognition for Personalization

Company Analysis for business growth opportunity identification

9

Cognitive systems are not about mimicking humans.

The success of cognitive computing will not be measured by Turing tests or a computers ability to mimic humans. It will be measured in more practical ways, like return on investment, new market opportunities, diseases cured and lives saved. 10

Cognitive systems augment human abilities.

Think of the number of new papers that get published each year in medical journals. How can doctors keep up with all the relevant papers, new research studies, new and effective treatment plans. It would be easy, given enough computational power, for cognitive systems, to read all such information and summarize the information for doctors or find patterns that match the current patients symptoms.11

Cognitive systems dont do your thinking for you. They do your research for you so that you can think better.

This is all still abstract. Lets get to specifics.12

Need Building Blocks to Build Cognitive Applications4/11/2017Devoxx 201713

Text-to-SpeechSpeech-to-textNatural Language UnderstandingConversationTone AnalysisEmotion AnalysisDiscoveryVisual RecognitionPersonality InsightsNatural Language ClassifierLanguage Translation

Use Conversation API to build Conversational bots

4/11/201714

https://conversation-demo.mybluemix.net/

Use Discovery Service to add a cognitive search and content analytics engine to applications.

4/11/201715

https://discovery-news-demo.mybluemix.net/

Use Personality Insights to engage with individuals at personalized level

4/11/201716

Watson-pi-demo.mybluemix.net

Source: https://www.army.mil/article/78562/Leaving_the_battlefield__Soldier_shares_story_of_PTSD

Emotional Analysis helps build empathetic systems

4/11/201717

sentiment-and-emotion.mybluemix.net

Use Tone Analyzer to understand and fine tune your message

4/11/201718

tone-analyzer-demo.mybluemix.net

Cutting a Movie Trailer with Visual Recognition and Emotion Analysis4/11/2017Devoxx 201719

19

Personalizing shopping Experience with Personality Insights 4/11/2017Devoxx 201720

20

Tone-aware Expressions in Conversations4/11/201721food-coach.mybluemix.net

21

4/11/2017Page 22

Bot Personas & Expressive Paraphrasing 23

The race for AI platforms is on! 4/11/2017Devoxx 201724

If you are a AI platform and services vendor, you cant win this race with algorithms alone!4/11/2017Devoxx 201725

Data is the key differentiator!4/11/2017Devoxx 201726

Developer tools to help assemble cognitive applications is also very important!4/11/2017Devoxx 201727

If you are a cognitive application developer, you will most likely have to customize vendor services to impart domain knowledge to make the services relevant!4/11/2017Devoxx 201728

28

4/11/2017Devoxx 201729

Source: Guru Banavar (IBM)s talk at Stamps school of art & Design

Next Gen Cognitive Applications with Immersive User Interfaces4/11/2017Devoxx 201730

4/11/2017Devoxx 201731What do you want to build today?

Tanmay Bakshi: a 13 yr old IBM Watson Developer

31

Thank you4/11/2017WatsonDeveloperConference201632

Wednesday: 11:20-12:20 Grand Ball Room 220CBits, Bytes and Brains - Where Watson Is and Where its going?

LL 20 B: Thursday from 11:00 AM til 11:50 AMThink. Think again. Watson and the Cognitive Developer

Mission Badge #6:SMS TextYour mission should you choose to accept it.

Join us at the IBM Booth for hands-on labs, demos, games and talk to our developers.Text Cognitive to 41411to discover, was it Science Fact or Science Fiction?Enter the raffle by completing missions for a chance to wina DroneTJBot Kit VR glasses

2017 IBM Corporation

Notices and disclaimers continued Information concerning non-IBM products was obtained from the suppliers of those products, their published announcements or other publicly available sources. IBM has not tested those products in connection with this publication and cannot confirm the accuracy of performance, compatibility or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products. IBM does not warrant the quality of any third-party products, or the ability of any such third-party products to interoperate with IBMs products. IBM EXPRESSLY DISCLAIMS ALL WARRANTIES, EXPRESSED OR IMPLIED, INCLUDING BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE. The provision of the information contained herein is not intended to, and does not, grant any right or license under any IBM patents, copyrights, trademarks or other intellectual property right. IBM, the IBM logo, ibm.com, Aspera, Bluemix, Blueworks Live, CICS, Clearcase, Cognos, DOORS, Emptoris, Enterprise Document Management System, FASP, FileNet, Global Business Services , Global Technology Services , IBM ExperienceOne, IBM SmartCloud, IBM Social Business, Information on Demand, ILOG, Maximo, MQIntegrator, MQSeries, Netcool, OMEGAMON, OpenPower, PureAnalytics, PureApplication, pureCluster, PureCoverage, PureData, PureExperience, PureFlex, pureQuery, pureScale, PureSystems, QRadar, Rational, Rhapsody, Smarter Commerce, SoDA, SPSS, Sterling Commerce, StoredIQ, Tealeaf, Tivoli, Trusteer, Unica, urban{code}, Watson, WebSphere, Worklight, X-Force and System z Z/OS, are trademarks of International Business Machines Corporation, registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the Web at "Copyright and trademark information" at: www.ibm.com/legal/copytrade.shtml.344/11/2017World of Watson 2016