Building a conversational UI with SAPUI5 and Amazon Lex

SAP Inside Track Walldorf2018

@TudorRiscutia

https://riscutiatudor.gitlab.io

http://dilbert.com/strip/2016-06-29

Conversational UI aka “ChatBot”

Conversational UI aka “ChatBot”

• A ChatBot is a computer program which conducts a conversation via auditory or textual methods

• Is the privilege of interacting with the computer on human terms

Phone SMS Email

Your Apps

Virtual Assistants

Alexa Siri

CortanaGoogle

Your Website

Text Messaging Platforms

…

Jarvis

Wally

I need the stock for material

1000-5212 in plant ABC.

Jarvis

Hello,

How may I help you?

Wally

Hi Jarvis

INPUT

“I need the stock for material

1000-5212 in plant ABC.”

Result: Unrestricted use: 3700

Reserved: 1400

Unit of measure: KG

EXECUTE BUSINESS LOGIC

Intent: QueryStock

Slots: Material Number: 1000-5212

Plant: ABC

EXTRACT STRUCTURED

DATA

FORMULATE ANSWER

“Here are the stocks for material number 1000-5212 in plant ABC:

Unrestricted use: 3,700 kg

Reserved: 1,400 kg”

OUTPUT

Jarvis

Wally

Thanks Jarvis, you’re the best!

Here are the stocks for material number 1000-5215 in plant ABC:

Unrestricted use: 3,700 kgReserved: 1,400 kg

Wally

Hi Jarvis

Jarvis

Hello,

How may I help you?

Wally

I need the stock for material

1000-5212 in plant ABC.

“SAP CoPilot will be to enterprise users what Siri, Alexa, and

Cortana are to consumers.”

The Digital Assistant for the EnterpriseSAP CoPilot

http://dilbert.com/strip/2016-01-15

Building a ChatBot…

What is Lex?

• Amazon Lex is an AWS service for building conversational interfaces for any applications using voice and text

• No deep learning expertise is necessary!

• It’s what’s inside Alexa

• It was opened for developers earlier last year

Lex – Bot Structure

Utterance- is a spoken or typed phrases that invokes an intentCreate ToDo with priority high

Slots- are input data required to fulfill the intent

Prompt- is a question that asks the user to supply data for a slot that is needed to fulfill the intent

Book a hotel in Walldorf

What is the task?

Intent- represents a goal that the bot’s user wants to achieveCreateToDo

Fulfillment- is the business logic that carriers out the user’s intent

Intent CreateToDo is ReadyForFulfillment:Priority: HighTask: Book a hotel in Walldorf

Lex – Save, Build, and Publish

SAVE

Saving your bot preserves the current state on the

server

BUILD PUBLISH

Building your bot creates versions that you can test

Publishing your app will create a version of your bot and provide an alias to your

clients

TEST

Test your bot in a chat window on the console

Advertising

“Conversational systems shift from a model where people adapt to computers to one where the computer “hears” and adapts to a person’s desired outcome.”

(Gartner)

http://dilbert.com/strip/2016-07-01

30 percent of web browsing sessions will be done without a screen.

(Gartner)

30%85%

85% of customer interactions will be managed without a human.

(Gartner)

Digital assistants will generate 600 billion dollars in revenue.

(Bill Meisel, TMA Associates)

$600billion

By 2020…

http://dilbert.com/strip/2016-06-30

(Some of the) challenges

Awareness“Who am I speaking to?”

Authentication“Who is speaking?”

Context“What are you talking about?”

Thank you!

@TudorRiscutia

https://riscutiatudor.gitlab.io

References

• https://www.gartner.com/smarterwithgartner/gartners-top-10-technology-trends-2017/• https://www.gartner.com/smarterwithgartner/gartner-predicts-a-virtual-world-of-exponential-change/• https://www.gartner.com/imagesrv/summits/docs/na/customer-360/C360_2011_brochure_FINAL.pdf• https://www.gartner.com/doc/490171/evolving-user-interface-graphical-ui• https://usabilitygeek.com/automatic-speech-recognition-asr-software-an-introduction/• https://uxdesign.cc/what-we-can-learn-from-alexas-mistakes-a4670a9e6c3e• https://uxdesign.cc/making-chatbots-talk-writing-conversational-ui-scripts-step-by-step-62622abfb5cf• https://chatbot.fail/https://www.infoq.com/news/2016/12/AWS-LEX-BOT• https://www.youtube.com/watch?v=I5OlTMLinio• https://chatbotsmagazine.com/conversational-interfaces-the-future-of-chatbots-18975a91fe5a• https://chatbotsmagazine.com/conversational-interfaces-beyond-the-hype-457c18290644• https://blogs.sap.com/2017/05/10/sap-copilot-1705-now-available-to-customers/• https://experience.sap.com/news/the-human-touch-sap-introduces-a-digital-assistant-for-the-enterprise/• https://experience.sap.com/documents/sapinsider-april-2017-qa.pdf• https://techcrunch.com/2016/11/30/amazon-launches-amazon-ai-to-bring-its-machine-learning-smarts-to-

developers/

Polly

• Amazon Polly is an AWS service that performs text-to-speech conversion

• It features 47 male and female voices and supports 24 languages

Text-to-Speech (TTS)

A voice actor records many speech units

1

The speech units are sorted into linguistic categories

2

Normalization3

Unit selection4

Sound