deep learning & unstructured data
DESCRIPTION
Morning talk given at Big Mountain Data Conference Oct 2014TRANSCRIPT
Deep Learning & Unstructured
Dataor why you should use ☺
??
The problem of doing justice to the implicit, the imponderable, and the unknown is of course not unique in politics. It is always with us in science, it is with us in the most trivial of personal affairs, and it is one of the great problems of writing and of all forms
of art. The means by which it is solved is sometimes called style. It is style
which complements affirmation with limitation and with humility; it is style which makes it possible to act effectively, but not absolutely; it is style which, in the domain of foreign policy, enables us to find harmony between the pursuit of ends essential to us, and the regard for the views, the sensibilities, the aspirations of
those to whom the problem may appear in another light; it is style which is the deference that action pays to uncertainty; it is above all style through which power defers to reason.
Elements of styleFrom: David Gonzalez <[email protected]>Mime-Version: 1.0 (1.0)Date: Mon, 6 Mar 2011 14:57:38 -0700Delivered-To: [email protected]: <4484555894252760987@unknownmsgid>Subject: Should I take Friday off?To: Mindy Gonzalez <******@gmail.com>Content-Type: text/plain; charset=ISO-8859-1
We could go out early and maybe just get take-out for the kiddos?
??
data?
Gathering text
store
{u'message_id': 4484555894252760987, u’subject’: 'Should I take Friday off', u’body’: 'We could go out early and maybe just get take-out for the kiddos. \n ??', u’time_sent’: u’Mon, 6 Mar 2011 14:57:38 -0700’, u'user_id': 1}
Options?
Lexicon● Curated● Easy to understand● Often wrong● Not great w/
novelty
NN-style● More accurate● Domain specific● Not great w/
novelty
Optimize Response?
Optimize Sentiment?
Optimize Emotion?
Options?
Lexicon?
Unsupervised?
What counts?
Subjective vs Objective statements
Polarity+, ?, -
Sentiment “Lexicon”
Sentiment “Lexicon”
Emotional State
Emotional State?
Lexicon
Sponsors!