natural language - lindholmen software development day · natural language interfaces for ......
TRANSCRIPT
![Page 1: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons](https://reader033.vdocuments.us/reader033/viewer/2022060213/5f05331c7e708231d411c5d1/html5/thumbnails/1.jpg)
![Page 2: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons](https://reader033.vdocuments.us/reader033/viewer/2022060213/5f05331c7e708231d411c5d1/html5/thumbnails/2.jpg)
Natural language interfaces for your connected car2018-05-29 Tomas Carlfalk – Chief Architect – WirelessCar
![Page 3: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons](https://reader033.vdocuments.us/reader033/viewer/2022060213/5f05331c7e708231d411c5d1/html5/thumbnails/3.jpg)
• Tomas Carlfalk
• WirelessCar since 15 years, currently Chief Architect
• Software Developer & Architect
• Computing Science at Göteborg University
Who am I?
![Page 4: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons](https://reader033.vdocuments.us/reader033/viewer/2022060213/5f05331c7e708231d411c5d1/html5/thumbnails/4.jpg)
What WirelessCar offer
![Page 5: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons](https://reader033.vdocuments.us/reader033/viewer/2022060213/5f05331c7e708231d411c5d1/html5/thumbnails/5.jpg)
Beijing
Gothenburg
GreensboroAllentown
connected cars across 5 continents, increasing with 70,000 vehicles per month.
2 300 000 Active
through long track record and unique knowledge in connected off-board platforms combined with vehicle integration expertise.
Global reach
Highly skilled and experienced staff across the globe. Specialized in telematics and connected car services.
300 staff > 3000 years of experience
WirelessCar Today
![Page 6: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons](https://reader033.vdocuments.us/reader033/viewer/2022060213/5f05331c7e708231d411c5d1/html5/thumbnails/6.jpg)
Connected brands
In total 13 programs in 65 markets over 18 years
![Page 7: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons](https://reader033.vdocuments.us/reader033/viewer/2022060213/5f05331c7e708231d411c5d1/html5/thumbnails/7.jpg)
Some history
Voice call services (late 1990’s)
Data (SMS)
Data (IP)
VoiceEmergency CallAutomatic Crash NotificationRoadside AssistanceConcierge Call
Icons made by Freepik from Flaticon are licensed by Creative Commons BY 3.0
![Page 8: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons](https://reader033.vdocuments.us/reader033/viewer/2022060213/5f05331c7e708231d411c5d1/html5/thumbnails/8.jpg)
Some history
Theft services (late 1990’s)
Data (SMS)
Data (IP)
Voice
Theft NotificationStolen Vehicle Tracking
Request (SMS)
Request (IP)
Icons made by Freepik from Flaticon are licensed by Creative Commons BY 3.0
![Page 9: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons](https://reader033.vdocuments.us/reader033/viewer/2022060213/5f05331c7e708231d411c5d1/html5/thumbnails/9.jpg)
Some history
Remote services with app (around 2010)
Data (IP/SMS)
Data (IP)
Vehicle Health StatusVehicle LocationRemote Heater Start
![Page 10: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons](https://reader033.vdocuments.us/reader033/viewer/2022060213/5f05331c7e708231d411c5d1/html5/thumbnails/10.jpg)
Why natural language interfaces?• Intuitive
• Accessible
• Technology is available
• Technology is becoming good enough
Icons made by Freepik from Flaticon are licensed by Creative Commons BY 3.0
![Page 11: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons](https://reader033.vdocuments.us/reader033/viewer/2022060213/5f05331c7e708231d411c5d1/html5/thumbnails/11.jpg)
Use Cases for natural language interface
Voice based services
Data (SMS)
Data (IP)
Voice
$$$Hard to add or change services
Emergency CallAutomatic Crash NotificationRoadside AssistanceConcierge CallTheftIcons made by Freepik from Flaticon are licensed by Creative Commons BY 3.0
![Page 12: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons](https://reader033.vdocuments.us/reader033/viewer/2022060213/5f05331c7e708231d411c5d1/html5/thumbnails/12.jpg)
What we’re working on now
Automate voice based services
Data
Data
Voice
Roadside AssistanceConcierge Call
Voice
Emer
genc
y Ca
llCr
ash
Not
ifica
tion
Icons made by Freepik from Flaticon are licensed by Creative Commons BY 3.0
![Page 13: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons](https://reader033.vdocuments.us/reader033/viewer/2022060213/5f05331c7e708231d411c5d1/html5/thumbnails/13.jpg)
What we’re working on now
Automate voice based services
Data
Data
Voice
Roadside AssistanceConcierge Call
Voice
Emer
genc
y Ca
llCr
ash
Not
ifica
tion
AmazonConnect
Amazon Lex
AmazonLambda
Amazon Polly
Icons made by Freepik from Flaticon are licensed by Creative Commons BY 3.0
![Page 14: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons](https://reader033.vdocuments.us/reader033/viewer/2022060213/5f05331c7e708231d411c5d1/html5/thumbnails/14.jpg)
![Page 15: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons](https://reader033.vdocuments.us/reader033/viewer/2022060213/5f05331c7e708231d411c5d1/html5/thumbnails/15.jpg)
Polly is a text-to-speech service from AWS.In our usecase, we use it via Amazon Connect. But Polly can be used also as a standalone service.
Polly
![Page 16: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons](https://reader033.vdocuments.us/reader033/viewer/2022060213/5f05331c7e708231d411c5d1/html5/thumbnails/16.jpg)
Amazon Lex
![Page 17: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons](https://reader033.vdocuments.us/reader033/viewer/2022060213/5f05331c7e708231d411c5d1/html5/thumbnails/17.jpg)
Amaz
on L
ambd
a
![Page 18: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons](https://reader033.vdocuments.us/reader033/viewer/2022060213/5f05331c7e708231d411c5d1/html5/thumbnails/18.jpg)
Use Cases for natural language interface
Remote Services
Data (IP/SMS)
Data (IP)
Vehicle Health StatusVehicle LocationRemote Heater Start
Complement or replacement for apps and portals
![Page 19: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons](https://reader033.vdocuments.us/reader033/viewer/2022060213/5f05331c7e708231d411c5d1/html5/thumbnails/19.jpg)
Communication by user
CloudWatch schedules events
Foreca sends possible weather info
Lex interprets input
Queries to car are made through API:s
The car reacts to request by sending
info or executing task
Lambda decides and delivers answer
CloudWatch logs event
What we’re working on now
Chat with your car for remote services
Icons made by Freepik from Flaticon are licensed by Creative Commons BY 3.0
![Page 20: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons](https://reader033.vdocuments.us/reader033/viewer/2022060213/5f05331c7e708231d411c5d1/html5/thumbnails/20.jpg)
Chat example(Facebook Messenger)
![Page 21: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons](https://reader033.vdocuments.us/reader033/viewer/2022060213/5f05331c7e708231d411c5d1/html5/thumbnails/21.jpg)
What we’re working on now
Amazon Alexa for remote services
AWS Lambda
Platform
Icons made by Freepik from Flaticon are licensed by Creative Commons BY 3.0
![Page 22: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons](https://reader033.vdocuments.us/reader033/viewer/2022060213/5f05331c7e708231d411c5d1/html5/thumbnails/22.jpg)
• Designing conversational interfaces is really hard
Learnings
• The UI is quite different from Mobile / Web UIs• Technology is becoming very good and easily accessible• Background noise can be a problem for voice interfaces• Accents can be a problem for voice interfaces
![Page 23: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons](https://reader033.vdocuments.us/reader033/viewer/2022060213/5f05331c7e708231d411c5d1/html5/thumbnails/23.jpg)
Recommendations• Embrace the fact that conversational interface design is different from GUI design• Include linguistics experts in your development teams• Use advanced Machine Learning based services that adapt to user input• Adopt voice-first design patterns
![Page 24: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons](https://reader033.vdocuments.us/reader033/viewer/2022060213/5f05331c7e708231d411c5d1/html5/thumbnails/24.jpg)
What’s next?
Chat with your car – the entire lifecycle
Build
online
Order
Manufacture
![Page 25: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons](https://reader033.vdocuments.us/reader033/viewer/2022060213/5f05331c7e708231d411c5d1/html5/thumbnails/25.jpg)
What’s next?
Improve conversations with insights from data
Data
DataData
Insights
Icons made by Freepik from Flaticon are licensed by Creative Commons BY 3.0
![Page 27: Natural language - Lindholmen Software Development Day · Natural language interfaces for ... Lambda Amazon Polly Icons made by Freepik from Flaticon are licensed by Creative Commons](https://reader033.vdocuments.us/reader033/viewer/2022060213/5f05331c7e708231d411c5d1/html5/thumbnails/27.jpg)
If you want to know more about our technology or talk career opportunities –come and visit us in the exhibition area!