social media - cortical.io business case
TRANSCRIPT
Drinking from the FirehoseHow Semantic Fingerprinting makes the Social Media Stream affordable
contact [email protected]
© c
ortic
al.io
inc.
201
5
Raw-Data for Social Media Analytics
timely
worldwide
generic
completeSocial Media
Firehose
Brands &
Businesses
Volume
Variety
Velocity
© c
ortic
al.io
inc.
201
5
Filtering Out Relevant Data is Expensive
multi-language, vocabulary mismatch, ambiguity, keyword based
© c
ortic
al.io
inc.
201
5
The Solution: Semantic Content Filter
real-time, across languages, intelligent, meaning based
#finance#markets
#mobile
#movies#products
#trend
Topic of interest
Analytics
© c
ortic
al.io
inc.
201
5
Example: Twitter Filter The State of the Art
desired topic
Every tweet related to
smart phones
200 catch words
mobile phone
Iphone
cell
Android
…
sim-card
text message
network
Verizon
AppleGoogle
…
5 words per tweet
Required throughput for one filter 200 X 5 X 20,000 = 20,000,000 comparisons per second
20,000 tweets/sec
© c
ortic
al.io
inc.
201
5
The State of the Art
Cost per Filter: $ 10,000+ per Month
© c
ortic
al.io
inc.
201
5
Example: Twitter Filter Semantic Fingerprinting
stream of semantic fingerprintstwitter firehose
realtime content sub-stream
Filter Fingerprint
not matching
matchmatchmatch
© c
ortic
al.io
inc.
201
5
Cost per Filter: $ 10 per Month
Cortical.io Streaming Text Filter
convert 100.000+tweets per second
1.000+ semantic filters
+
one per firehose scalable with number of Filters
© c
ortic
al.io
inc.
201
5
How does this work
?
© c
ortic
al.io
inc.
201
5
The Cortical.io Retina Technology …
… converts any text into a semantic fingerprint.
teens like playing good music with their mobile
phonesFingerprint Generation
© c
ortic
al.io
inc.
201
5
organ
Step 1: Word Fingerprints
piano
church
liver
© c
ortic
al.io
inc.
201
5
aggregation +
sparsification
Step 2: Text Fingerprintsteens like to hear music on their mobile phones
teens like to hear music on their mobile
phones
© c
ortic
al.io
inc.
201
5
Similar meanings …
… look similar
37% overlap
teens like using itunes on their iphone he consumes chart hits on his notebook
© c
ortic
al.io
inc.
201
5
Different meanings …
… look different
the fishermen are sailing out of
5% overlap
teens like using itunes on their iphone the fishermen are sailing out of the harbor
© c
ortic
al.io
inc.
201
5
The more the Retina Engine knows …
“cholecystitis”
… the better it sees
© c
ortic
al.io
inc.
201
5
philosophy philosophie filosofía философия فلسفة 哲學EN FR ES RU AR ZH
Every meaning looks the same …
… in all languages
© c
ortic
al.io
inc.
201
5
Why does this work
?
© c
ortic
al.io
inc.
201
5
Semantic Folding Theory
• Based on recent findings in Neuroscience
• Implemented as Unsupervised Machine Learning approach
• Replaces complex statistical modeling by Binary Matching
• 10x simpler to use, 100x more precision, 1000x faster
© c
ortic
al.io
inc.
201
5
website: cortical.io
product: https://aws.amazon.com/marketplace/pp/B00T5794P6/
twitter: http://twitter.com/cortical_io
video: https://www.youtube.com/watch?v=g3ZxJokDpds
demos: http://www.cortical.io/demos.html
API: http://api.cortical.io
Numenta: http://numenta.com