intelligent information discovery: machine driven search - liferay symposium north america 2017,...
TRANSCRIPT
Intelligent Information Discovery
André de Oliveira
#LSNA17
The explosion of content
#LSNA17
#LSNA17
What is your
information discovery strategy?
#LSNA17
▪ 1st Generation: BrowseWhat is your discovery strategy?
#LSNA17
▪▪▪▪
1st Generation: Browsing for content
#LSNA17
▪▪ 2nd Generation: Search
What is your discovery strategy?
#LSNA17
▪▪▪▪
2nd Generation: Searching for content
#LSNA17
▪▪▪ Next Generation: Predict
What is your discovery strategy?
#LSNA17
▪▪
▪▪▪
Next Generation: Predicting relevant content
#LSNA17
Intelligent
information discovery
#LSNA17
▪▪▪▪▪
It all starts with Search...
#LSNA17
Predicting with a search engine
Autocomplete
Did you mean…?
Suggest as you type
More like this
Percolators
#LSNA17
▪▪
▪▪
▪▪
▪
Rise of the machines
#LSNA17
The essential challenge in Machine Learning
Picture?
Voice?
Search query?
User indication of
interest?
Scored prediction
Scored prediction
#LSNA17
⇒ ⇒
Image classification
#LSNA17
⇒ ⇒
Speech recognition
#LSNA17
⇒ ⇒
Face detection
#LSNA17
⇒ ⇒ ⇒
Predicting with Deep Learning: Confidence
Picture?
Voice?
Search query?
User indication of
interest?
Scored prediction
Scored prediction
Carlos Hernandez: Image classification with Liferayhttps://youtu.be/ShAUafF2yfw
https://web.liferay.com/web/carlos.hernandez/blog/-/blogs/liferay-dxp-and-machine-learning-liferay-as-an-integration-platform
#LSNA17
▪▪
▪▪▪▪
▪▪
▪
Predicting with Search: Similarity
#LSNA17
▪▪▪▪▪
Textual analysis
Term Term Countthis 1is 1a 2sample 1
Document 1
Term Term Countthis 1is 1another 2example 3
Document 2
#LSNA17
TF–IDF (Term Frequency–Inverse Document Frequency)
In question form... Score increases...
Term Frequency How often does a term appear in a field? + When the term pops up a lot of times along the text
Inverse Document Frequency
How rare is the term in the whole index? + When the term is found in this document and not many others
Field-length Norm How short is the field where the term is? + When there isn't much else in the same field (like, a title)
See the math in: https://www.elastic.co/guide/en/elasticsearch/guide/current/scoring-theory.html
#LSNA17
▪▪
▪▪
▪▪
▪▪
▪▪
Improving textual analysis for better predictions
#LSNA17
Machine driven search
#LSNA17
▪▪▪▪▪
▪▪▪
Machine Driven Search
#LSNA17
▪▪▪▪
▪▪
▪▪
▪▪
Predict with Search: Instant results in search bar
#LSNA17
▪▪▪
▪▪
▪▪▪▪▪
Predict with Search: More Like This
#LSNA17
▪▪
▪▪
▪▪
Predict with Search: Percolate
Jan Verweij: Autotagging Liferay with Elasticsearch Percolatehttps://youtu.be/Pxu06zgiNLc
https://github.com/jverweijL/ElasticAutoTagger
#LSNA17
▪▪▪
▪▪
▪▪▪
Predict with Search: Recommended for YOU
#LSNA17 Highlight
"Single Customer View Demystified"Jonathan Lee, Product Manager, Liferay
#LSNA17
▪▪▪▪▪▪
▪▪
▪▪
Smart Content Delivery
#LSNA17
What’s next for Liferay Search
#LSNA17
Elasticsearch 6
#LSNA17
▪▪▪▪▪▪
Modular Search infrastructure
#LSNA17
▪▪▪▪▪▪▪▪▪
New Search Components
#LSNA17
▪▪▪▪
Liferay Commerce
#LSNA17 Highlight
"Liferay Commerce: A Preview of Our Upcoming Features"Marco Leo, Software Architect, Liferay
#LSNA17
Intelligent Information Discovery
LiferayDXP
Search engine (Elasticsearch 6)
AIaaS(APIs)
- Autocomplete- Did you mean…?
- Suggest as you type- More like this- Percolators- Similarity
- Image classification- Speech recognition
- Face detection
Data Drivenapplication infrastructure
(WeDeploy)
- Search classification- Customer interest prediction
- Machine learning trained models- Recommendation engines
Thank you
#LSNA17