[email protected] @garypretty...(language understanding intelligence service) - a 0 a a 22 a...
TRANSCRIPT
“The most profound technologies are
those that disappear. They weave
themselves into the fabric of everyday
life until they are indistinguishable
from it.”
Mark Weiser, 1991 “The Computer for the 21st Century”
What is Conversational AI?
46% Of people today think that using a chatbot or virtual agent will be
faster and more convenient than dealing with a human
Accenture Customer Service Survey 2018
Send
15% Of all customer service interactions globally will be handled
completely by AI by 2021
Gartner
Send
Understanding Knowledge Conversation
Key components of Conversational AI
Understanding
AR255 G
185 B
0
AA
R106 G
75 B
22
AA
R254 G
240 B
0
R230 G
230 B
230
AA
R0 G
120 B
212
AA
R36 G
58 B
94
AA
R80 G
230 B
255
R80 G
80 B
80
AA
R134 G
97 B
197
AA
R59 G
46 B
88
AA
R213 G
157 B
255
R47 G
47 B
47
AA
R216 G
59 B
1
AA
R107 G
41 B
41
AA
R255 G
147 B
73
R242 G
242 B
242
AA
R0 G
133 B
117
AA
R39 G
75 B
71
AA
R48 G
229 B
208
R115 G
115 B
115
Ric
h B
lack
R0 G
0 B
0
AR16 G
124 B
16
AA
R5 G
75 B
22
AA
R155 G
240 B
11
R210 G
210 B
210
Wh
iteR
255 G
255 B
255
https://preview.luis.ai
LUIS (Language Understanding Intelligence Service) - https://luis.ai
AR255 G
185 B
0
AA
R106 G
75 B
22
AA
R254 G
240 B
0
R230 G
230 B
230
AA
R0 G
120 B
212
AA
R36 G
58 B
94
AA
R80 G
230 B
255
R80 G
80 B
80
AA
R134 G
97 B
197
AA
R59 G
46 B
88
AA
R213 G
157 B
255
R47 G
47 B
47
AA
R216 G
59 B
1
AA
R107 G
41 B
41
AA
R255 G
147 B
73
R242 G
242 B
242
AA
R0 G
133 B
117
AA
R39 G
75 B
71
AA
R48 G
229 B
208
R115 G
115 B
115
Ric
h B
lack
R0 G
0 B
0
AR16 G
124 B
16
AA
R5 G
75 B
22
AA
R155 G
240 B
11
R210 G
210 B
210
Wh
iteR
255 G
255 B
255
LUIS (Language Understanding Intelligence Service) - https://luis.ai
Lig
ht B
lue
R0 G
188 B
242
Gre
en
R16 G
124 B
16
Red
R232 G
17 B
35
Mag
en
taR
180 G
0 B
158
Pu
rple
R92 G
45 B
145
Blu
eR
0 G
120 B
212
Teal
R0 G
130 B
114
Yello
wR
255 G
185 B
0
Ora
ng
eR
216 G
59 B
1
Lig
ht Y
ello
wR
255 G
241 B
0Lig
ht O
ran
ge
R255 G
140 B
0Lig
ht M
ag
en
taR
227 G
0 B
140
Lig
ht P
urp
leR
180 G
160 B
255
Lig
ht T
eal
R0 G
178 B
148
Lig
ht G
reen
R186 G
216 B
10
Dark
Red
R168 G
0 B
0D
ark
Mag
en
ta
R92 G
0 B
92
Dark
Pu
rple
R50 G
20 B
90
Mid
Blu
eR
0 G
24 B
143
Dark
Teal
R0 G
75 B
80
Dark
Gre
en
R0 G
75 B
28
Dark
Blu
eR
0 G
32 B
80
Mid
Gra
yR
115 G
115 B
115
Dark
Gra
yR
80 G
80 B
80
Ric
h B
lack
R0 G
0 B
0
Wh
iteR
255 G
255 B
255
Gra
yR
210 G
210 B
210
Lig
ht G
ray
R230 G
230 B
230
So
ft Bla
ck
for T
ext
R26 G
26 B
26
So
ft Bla
ck
for B
ackg
rou
nd
sR
13 G
130 B
13
[Utility](./Utility.lu) # Greeting - Hi - Hello - Good morning # BookFlight - book a flight from {fromCity=new york} to {toCity=seattle}
## None - Why is the sky blue > # Entity definitions $KEYWORD:simple > # PREBUILT Entity definitions $PREBUILT:number $PREBUILT:geographyV2
# Greeting - Hi - Hello - Good morning # BookFlight - book a flight from {fromCity=new york} to {toCity=seattle}
### ? What can you do? ```markdown I can greet and provide help ```
Language Understanding format (.LU)
AR255 G
185 B
0
AA
R106 G
75 B
22
AA
R254 G
240 B
0
R230 G
230 B
230
AA
R0 G
120 B
212
AA
R36 G
58 B
94
AA
R80 G
230 B
255
R80 G
80 B
80
AA
R134 G
97 B
197
AA
R59 G
46 B
88
AA
R213 G
157 B
255
R47 G
47 B
47
AA
R216 G
59 B
1
AA
R107 G
41 B
41
AA
R255 G
147 B
73
R242 G
242 B
242
AA
R0 G
133 B
117
AA
R39 G
75 B
71
AA
R48 G
229 B
208
R115 G
115 B
115
Ric
h B
lack
R0 G
0 B
0
AR16 G
124 B
16
AA
R5 G
75 B
22
AA
R155 G
240 B
11
R210 G
210 B
210
Wh
iteR
255 G
255 B
255
LUIS demo
Lig
ht B
lue
R0 G
188 B
242
Gre
en
R16 G
124 B
16
Red
R232 G
17 B
35
Mag
en
taR
180 G
0 B
158
Pu
rple
R92 G
45 B
145
Blu
eR
0 G
120 B
212
Teal
R0 G
130 B
114
Yello
wR
255 G
185 B
0
Ora
ng
eR
216 G
59 B
1
Lig
ht Y
ello
wR
255 G
241 B
0Lig
ht O
ran
ge
R255 G
140 B
0Lig
ht M
ag
en
taR
227 G
0 B
140
Lig
ht P
urp
leR
180 G
160 B
255
Lig
ht T
eal
R0 G
178 B
148
Lig
ht G
reen
R186 G
216 B
10
Dark
Red
R168 G
0 B
0D
ark
Mag
en
ta
R92 G
0 B
92
Dark
Pu
rple
R50 G
20 B
90
Mid
Blu
eR
0 G
24 B
143
Dark
Teal
R0 G
75 B
80
Dark
Gre
en
R0 G
75 B
28
Dark
Blu
eR
0 G
32 B
80
Mid
Gra
yR
115 G
115 B
115
Dark
Gra
yR
80 G
80 B
80
Ric
h B
lack
R0 G
0 B
0
Wh
iteR
255 G
255 B
255
Gra
yR
210 G
210 B
210
Lig
ht G
ray
R230 G
230 B
230
So
ft Bla
ck
for T
ext
R26 G
26 B
26
So
ft Bla
ck
for B
ackg
rou
nd
sR
13 G
130 B
13 Knowledge
AR255 G
185 B
0
AA
R106 G
75 B
22
AA
R254 G
240 B
0
R230 G
230 B
230
AA
R0 G
120 B
212
AA
R36 G
58 B
94
AA
R80 G
230 B
255
R80 G
80 B
80
AA
R134 G
97 B
197
AA
R59 G
46 B
88
AA
R213 G
157 B
255
R47 G
47 B
47
AA
R216 G
59 B
1
AA
R107 G
41 B
41
AA
R255 G
147 B
73
R242 G
242 B
242
AA
R0 G
133 B
117
AA
R39 G
75 B
71
AA
R48 G
229 B
208
R115 G
115 B
115
Ric
h B
lack
R0 G
0 B
0
AR16 G
124 B
16
AA
R5 G
75 B
22
AA
R155 G
240 B
11
R210 G
210 B
210
Wh
iteR
255 G
255 B
255
• Extract Q&A pairs from FAQ pages, support
websites, manuals, SharePoint docs
• Manage, test and train in an easy-to-use UI
• Easily add personality (chit-chat)
5 personalities (professional, friendly, witty,
enthusiastic, caring)
• Create multi-turn conversations – extract hierarchy
with contextual ranking
• Support for 50+ languages
QnA Maker Build a conversational layer over your data
AR255 G
185 B
0
AA
R106 G
75 B
22
AA
R254 G
240 B
0
R230 G
230 B
230
AA
R0 G
120 B
212
AA
R36 G
58 B
94
AA
R80 G
230 B
255
R80 G
80 B
80
AA
R134 G
97 B
197
AA
R59 G
46 B
88
AA
R213 G
157 B
255
R47 G
47 B
47
AA
R216 G
59 B
1
AA
R107 G
41 B
41
AA
R255 G
147 B
73
R242 G
242 B
242
AA
R0 G
133 B
117
AA
R39 G
75 B
71
AA
R48 G
229 B
208
R115 G
115 B
115
Ric
h B
lack
R0 G
0 B
0
AR16 G
124 B
16
AA
R5 G
75 B
22
AA
R155 G
240 B
11
R210 G
210 B
210
Wh
iteR
255 G
255 B
255
QnA Maker demo
Lig
ht B
lue
R0 G
188 B
242
Gre
en
R16 G
124 B
16
Red
R232 G
17 B
35
Mag
en
taR
180 G
0 B
158
Pu
rple
R92 G
45 B
145
Blu
eR
0 G
120 B
212
Teal
R0 G
130 B
114
Yello
wR
255 G
185 B
0
Ora
ng
eR
216 G
59 B
1
Lig
ht Y
ello
wR
255 G
241 B
0Lig
ht O
ran
ge
R255 G
140 B
0Lig
ht M
ag
en
taR
227 G
0 B
140
Lig
ht P
urp
leR
180 G
160 B
255
Lig
ht T
eal
R0 G
178 B
148
Lig
ht G
reen
R186 G
216 B
10
Dark
Red
R168 G
0 B
0D
ark
Mag
en
ta
R92 G
0 B
92
Dark
Pu
rple
R50 G
20 B
90
Mid
Blu
eR
0 G
24 B
143
Dark
Teal
R0 G
75 B
80
Dark
Gre
en
R0 G
75 B
28
Dark
Blu
eR
0 G
32 B
80
Mid
Gra
yR
115 G
115 B
115
Dark
Gra
yR
80 G
80 B
80
Ric
h B
lack
R0 G
0 B
0
Wh
iteR
255 G
255 B
255
Gra
yR
210 G
210 B
210
Lig
ht G
ray
R230 G
230 B
230
So
ft Bla
ck
for T
ext
R26 G
26 B
26
So
ft Bla
ck
for B
ackg
rou
nd
sR
13 G
130 B
13 Conversation
Lig
ht B
lue
R0 G
188 B
242
Gre
en
R16 G
124 B
16
Red
R232 G
17 B
35
Mag
en
taR
180 G
0 B
158
Pu
rple
R92 G
45 B
145
Blu
eR
0 G
120 B
212
Teal
R0 G
130 B
114
Yello
wR
255 G
185 B
0
Ora
ng
eR
216 G
59 B
1
Lig
ht Y
ello
wR
255 G
241 B
0Lig
ht O
ran
ge
R255 G
140 B
0Lig
ht M
ag
en
taR
227 G
0 B
140
Lig
ht P
urp
leR
180 G
160 B
255
Lig
ht T
eal
R0 G
178 B
148
Lig
ht G
reen
R186 G
216 B
10
Dark
Red
R168 G
0 B
0D
ark
Mag
en
ta
R92 G
0 B
92
Dark
Pu
rple
R50 G
20 B
90
Mid
Blu
eR
0 G
24 B
143
Dark
Teal
R0 G
75 B
80
Dark
Gre
en
R0 G
75 B
28
Dark
Blu
eR
0 G
32 B
80
Mid
Gra
yR
115 G
115 B
115
Dark
Gra
yR
80 G
80 B
80
Ric
h B
lack
R0 G
0 B
0
Wh
iteR
255 G
255 B
255
Gra
yR
210 G
210 B
210
Lig
ht G
ray
R230 G
230 B
230
So
ft Bla
ck
for T
ext
R26 G
26 B
26
So
ft Bla
ck
for B
ackg
rou
nd
sR
13 G
130 B
13
User input Channels Cognitive Services Bot Application
Language understanding
QnA Maker
aka.ms/cognitive
Speech
Bot Framework
aka.ms/botservice
Bot Framework Composer (preview)
Power Virtual Agents
Bot Framework SDK
A comprehensive framework for building enterprise-grade conversational AI experiences
Lig
ht B
lue
R0 G
188 B
242
Gre
en
R16 G
124 B
16
Red
R232 G
17 B
35
Mag
en
taR
180 G
0 B
158
Pu
rple
R92 G
45 B
145
Blu
eR
0 G
120 B
212
Teal
R0 G
130 B
114
Yello
wR
255 G
185 B
0
Ora
ng
eR
216 G
59 B
1
Lig
ht Y
ello
wR
255 G
241 B
0Lig
ht O
ran
ge
R255 G
140 B
0Lig
ht M
ag
en
taR
227 G
0 B
140
Lig
ht P
urp
leR
180 G
160 B
255
Lig
ht T
eal
R0 G
178 B
148
Lig
ht G
reen
R186 G
216 B
10
Dark
Red
R168 G
0 B
0D
ark
Mag
en
ta
R92 G
0 B
92
Dark
Pu
rple
R50 G
20 B
90
Mid
Blu
eR
0 G
24 B
143
Dark
Teal
R0 G
75 B
80
Dark
Gre
en
R0 G
75 B
28
Dark
Blu
eR
0 G
32 B
80
Mid
Gra
yR
115 G
115 B
115
Dark
Gra
yR
80 G
80 B
80
Ric
h B
lack
R0 G
0 B
0
Wh
iteR
255 G
255 B
255
Gra
yR
210 G
210 B
210
Lig
ht G
ray
R230 G
230 B
230
So
ft Bla
ck
for T
ext
R26 G
26 B
26
So
ft Bla
ck
for B
ackg
rou
nd
sR
13 G
130 B
13
Create a more natural experience with multiple, dynamic responses
# NewUserIntroCard [Activity Attachments = {json(NewUserIntroCardJson())} ] # NewUserIntroCardTitle - Hi There {Name} - Hi There - Welcome - Pleased to meet you! - Hello and welcome! # NewUserIntroCardTitle - Now that I’m up and running, explore the links here to learn what I can do. # NewUserIntroCardJson - ``` { "type": "AdaptiveCard", "id": "NewUserGreeting", "text": "@{NewUserIntroCardTitle()}", "subtitle": "@{NewUserIntroCardsSubtitle()}"
Language Generation (LG)
AR255 G
185 B
0
AA
R106 G
75 B
22
AA
R254 G
240 B
0
R230 G
230 B
230
AA
R0 G
120 B
212
AA
R36 G
58 B
94
AA
R80 G
230 B
255
R80 G
80 B
80
AA
R134 G
97 B
197
AA
R59 G
46 B
88
AA
R213 G
157 B
255
R47 G
47 B
47
AA
R216 G
59 B
1
AA
R107 G
41 B
41
AA
R255 G
147 B
73
R242 G
242 B
242
AA
R0 G
133 B
117
AA
R39 G
75 B
71
AA
R48 G
229 B
208
R115 G
115 B
115
Ric
h B
lack
R0 G
0 B
0
AR16 G
124 B
16
AA
R5 G
75 B
22
AA
R155 G
240 B
11
R210 G
210 B
210
Wh
iteR
255 G
255 B
255
Adaptive Dialogs
AR255 G
185 B
0
AA
R106 G
75 B
22
AA
R254 G
240 B
0
R230 G
230 B
230
AA
R0 G
120 B
212
AA
R36 G
58 B
94
AA
R80 G
230 B
255
R80 G
80 B
80
AA
R134 G
97 B
197
AA
R59 G
46 B
88
AA
R213 G
157 B
255
R47 G
47 B
47
AA
R216 G
59 B
1
AA
R107 G
41 B
41
AA
R255 G
147 B
73
R242 G
242 B
242
AA
R0 G
133 B
117
AA
R39 G
75 B
71
AA
R48 G
229 B
208
R115 G
115 B
115
Ric
h B
lack
R0 G
0 B
0
AR16 G
124 B
16
AA
R5 G
75 B
22
AA
R155 G
240 B
11
R210 G
210 B
210
Wh
iteR
255 G
255 B
255
language understanding:
utterance [intent X
entities]
LU
language generation:
Spoken, display strings,
cards
LG
dialog: conversational flow
between bot & user incl.
biz logic that directs flow
DIA
AR255 G
185 B
0
AA
R106 G
75 B
22
AA
R254 G
240 B
0
R230 G
230 B
230
AA
R0 G
120 B
212
AA
R36 G
58 B
94
AA
R80 G
230 B
255
R80 G
80 B
80
AA
R134 G
97 B
197
AA
R59 G
46 B
88
AA
R213 G
157 B
255
R47 G
47 B
47
AA
R216 G
59 B
1
AA
R107 G
41 B
41
AA
R255 G
147 B
73
R242 G
242 B
242
AA
R0 G
133 B
117
AA
R39 G
75 B
71
AA
R48 G
229 B
208
R115 G
115 B
115
Ric
h B
lack
R0 G
0 B
0
AR16 G
124 B
16
AA
R5 G
75 B
22
AA
R155 G
240 B
11
R210 G
210 B
210
Wh
iteR
255 G
255 B
255
Bot Framework Composer is an integrated development tool for developers and multi-disciplinary
teams to create, edit, test and refine conversational apps (bots)
• Open source development tool
• Visual editing canvas for authoring conversation flow
• Language understanding in-context of conversation
• Maintain language understanding (.LU) files, training
and publishing models
• Author language generation
• A ready-to-use bot runtime
Bot Framework Composer
http://github.com/microsoft/botframework-composer
AR255 G
185 B
0
AA
R106 G
75 B
22
AA
R254 G
240 B
0
R230 G
230 B
230
AA
R0 G
120 B
212
AA
R36 G
58 B
94
AA
R80 G
230 B
255
R80 G
80 B
80
AA
R134 G
97 B
197
AA
R59 G
46 B
88
AA
R213 G
157 B
255
R47 G
47 B
47
AA
R216 G
59 B
1
AA
R107 G
41 B
41
AA
R255 G
147 B
73
R242 G
242 B
242
AA
R0 G
133 B
117
AA
R39 G
75 B
71
AA
R48 G
229 B
208
R115 G
115 B
115
Ric
h B
lack
R0 G
0 B
0
AR16 G
124 B
16
AA
R5 G
75 B
22
AA
R155 G
240 B
11
R210 G
210 B
210
Wh
iteR
255 G
255 B
255
Composer demo
Lig
ht B
lue
R0 G
188 B
242
Gre
en
R16 G
124 B
16
Red
R232 G
17 B
35
Mag
en
taR
180 G
0 B
158
Pu
rple
R92 G
45 B
145
Blu
eR
0 G
120 B
212
Teal
R0 G
130 B
114
Yello
wR
255 G
185 B
0
Ora
ng
eR
216 G
59 B
1
Lig
ht Y
ello
wR
255 G
241 B
0Lig
ht O
ran
ge
R255 G
140 B
0Lig
ht M
ag
en
taR
227 G
0 B
140
Lig
ht P
urp
leR
180 G
160 B
255
Lig
ht T
eal
R0 G
178 B
148
Lig
ht G
reen
R186 G
216 B
10
Dark
Red
R168 G
0 B
0D
ark
Mag
en
ta
R92 G
0 B
92
Dark
Pu
rple
R50 G
20 B
90
Mid
Blu
eR
0 G
24 B
143
Dark
Teal
R0 G
75 B
80
Dark
Gre
en
R0 G
75 B
28
Dark
Blu
eR
0 G
32 B
80
Mid
Gra
yR
115 G
115 B
115
Dark
Gra
yR
80 G
80 B
80
Ric
h B
lack
R0 G
0 B
0
Wh
iteR
255 G
255 B
255
Gra
yR
210 G
210 B
210
Lig
ht G
ray
R230 G
230 B
230
So
ft Bla
ck
for T
ext
R26 G
26 B
26
So
ft Bla
ck
for B
ackg
rou
nd
sR
13 G
130 B
13
@garypretty
Bot Framework Composer - http://github.com/microsoft/botframework-composer
Bot Framework SDK - https://github.com/Microsoft/botframework-sdk
Language Understanding (LUIS) - https://luis.ai
QnA Maker - https://qnamaker.ai
Enterprise Virtual Assistant template and solution accelerators – https://aka.ms/VirtualAssistant
Bot Builder Community GitHub project – https://github.com/BotBuilderCommunity
Useful Resources