sentimental market segmentation

Upload: argamon

Post on 04-Jun-2018

217 views

Category:

Documents


0 download

TRANSCRIPT

  • 8/13/2019 Sentimental Market Segmentation

    1/53

    Sentimental Market Segmentation

    Shlomo Argamon, Ph.D.

    CEO & Cofounder, Subtext3

    Based on a presentation given at

    Sentiment Analysis SymposiumApril 13, 2010, New York, NY

  • 8/13/2019 Sentimental Market Segmentation

    2/53

    http://www.subtext3.com

    Lots of sentiment analysis

  • 8/13/2019 Sentimental Market Segmentation

    3/53

    http://www.subtext3.com

    Why??Lots of sentiment analysis

  • 8/13/2019 Sentimental Market Segmentation

    4/53

    http://www.subtext3.com

    Why sentiment analysis

    What are they thinking?

    What do they want?

    What will they buy?

  • 8/13/2019 Sentimental Market Segmentation

    5/53

    http://www.subtext3.com

    Wheres the ROI?

    What should I fix?

    Find comparatively negative aspects of my

    product or positive areas about competitors

    Howm I doing?

    Examine sentiment trends to examine effects of

    marketing or new products

    Wheres the action? Find the customersunfulfilled needs

  • 8/13/2019 Sentimental Market Segmentation

    6/53

  • 8/13/2019 Sentimental Market Segmentation

    7/53http://www.subtext3.com

    Perceptions

    Choices

    Products &

    Features

    Advertising

    Potential

    Customer

    Opinions

    Texts

    Needs &

    Wants

    Customer Model

  • 8/13/2019 Sentimental Market Segmentation

    8/53

  • 8/13/2019 Sentimental Market Segmentation

    9/53

  • 8/13/2019 Sentimental Market Segmentation

    10/53http://www.subtext3.com

    PerceptionsProducts &

    Features

    Advertising

    Potential

    Customer

    Opinions

    Texts

    Needs &

    Wants

    Choices

    Customer Model

  • 8/13/2019 Sentimental Market Segmentation

    11/53http://www.subtext3.com

    Products &

    Features

    Advertising

    Potential

    Customer

    Opinions

    Texts

    Needs &

    WantsPerceptions

    Perceptions

    Perceptions

    Choices

    Customer Model

  • 8/13/2019 Sentimental Market Segmentation

    12/53http://www.subtext3.com

    Products &

    Features

    Advertising Opinions

    Texts

    Needs &

    WantsPerceptions

    Perceptions

    Perceptions PotentialCustomer

    Potential

    Customer

    Potential

    Customer

    Potential

    Customer

    Choices

    Customer Model

  • 8/13/2019 Sentimental Market Segmentation

    13/53http://www.subtext3.com

    Products &

    Features

    Advertising Opinions

    Texts

    Needs &

    WantsPerceptions

    Perceptions

    Perceptions PotentialCustomer

    Potential

    Customer

    Potential

    Customer

    Potential

    Customer

    Choices

    Customer Model

  • 8/13/2019 Sentimental Market Segmentation

    14/53

  • 8/13/2019 Sentimental Market Segmentation

    15/53http://www.subtext3.com

    Market Segmentation

    Product/brand segmentation

    What products are close to which?

    Based on customer needs and perceptions, notproduct features

    Customer/community segmentation

    Meaningful subsets of potential customers

    Relative to a given market!

    Know their characteristics

  • 8/13/2019 Sentimental Market Segmentation

    16/53http://www.subtext3.com

    Perceptual Maps

  • 8/13/2019 Sentimental Market Segmentation

    17/53http://www.subtext3.com

    CommunityMaps

  • 8/13/2019 Sentimental Market Segmentation

    18/53http://www.subtext3.com

    Understand The Community

    Not just whatthey are sayingWhois saying it?

    What groups of people have similar

    opinions (about X)?

    What kinds of people are they?

    Howdo they see things? How do they group products, brands, or

    features?

  • 8/13/2019 Sentimental Market Segmentation

    19/53http://www.subtext3.com

    Varieties of Sentiment Analysis

  • 8/13/2019 Sentimental Market Segmentation

    20/53http://www.subtext3.com

    DocumentFilter(topic, source)

    SentimentClassifier

    Positive

    Negative

    Neutral

    Trend

    Snapshot

    Multidimensional

  • 8/13/2019 Sentimental Market Segmentation

    21/53http://www.subtext3.com

    Sentiment

    Finder

    Topic

    Classifier

    Topic/Sentiment

    Correlation

    0%

    10%

    20%

    30%

    40%

    50%

    60%

    70%

    80%

    90%

    100%

    Coke Pepsi RC

    Neutral

    Negative

    Positive

    Trend

    Snapshot

    Multidimensional

  • 8/13/2019 Sentimental Market Segmentation

    22/53http://www.subtext3.com

    Sentiment

    Finder

    Target

    Finder

    Target/Sentiment

    Correlation

    0%

    10%

    20%

    30%

    40%

    50%

    60%

    70%

    80%

    90%

    100%

    Coke Pepsi RC

    Neutral

    Negative

    Positive

    Trend

    Snapshot

    Multidimensional

  • 8/13/2019 Sentimental Market Segmentation

    23/53http://www.subtext3.com

    But

    Who are they and what do they think

    We still need

    More detail on their opinions

    Profiles of the writers

  • 8/13/2019 Sentimental Market Segmentation

    24/53http://www.subtext3.com

    Detailed

    Sentiment

    Finder

    Target

    Finder

    Sentiment

    Complexes

    Demographic

    Profiling

    Demographic Trends

    Perceptual Map

    Customer Map

  • 8/13/2019 Sentimental Market Segmentation

    25/53

    http://www.subtext3.com

    Detailed Sentiment Finding

    Based on research in the Linguistic Cognition Lab

    at Illinois Institute of Technology

    http://lingcog.iit.edu

    http://lingcog.iit.edu/http://lingcog.iit.edu/
  • 8/13/2019 Sentimental Market Segmentation

    26/53

    http://www.subtext3.com

    Different kinds of sentiment

  • 8/13/2019 Sentimental Market Segmentation

    27/53

    http://www.subtext3.com

    Different kinds of sentiment

    This uniquedog or chicken housewasmade with green practices in mind.

    PositiveAppreciation

    Valuation

    Oh, and on principle Ihateextremists /zealotsof any ilk.

    NegativeAffect

    Affection

    ...if your sitelooks a complete mess then

    you will loose[sic]that visitor for good.

    NegativeAppreciation

    Quality

    Oh and Spooks, with this really tough

    and sexy old ladyin it, kicking ass.

    PositiveJudgment

    Tenacity

  • 8/13/2019 Sentimental Market Segmentation

    28/53

    http://www.subtext3.com

    Syntactic connections

  • 8/13/2019 Sentimental Market Segmentation

    29/53

    http://www.subtext3.com

    More sentiment expressions

    [I]evaluator[couldnt]polaritybring myselfto [like]attitude

    [him]target.

    [It]target-1is [not]polarity[as [good]attitudeas]comparator[theMinolta D7]target-2.

    [Gap.Com]targetis an [excellent]attitudeexample of [aretailer]superordinate[using its online shopping store as an

    extension and expansion of its retailing]aspect.

  • 8/13/2019 Sentimental Market Segmentation

    30/53

    http://www.subtext3.com

    Detailed sentiment finding

    Texts

    LexiconLinkage

    Rules

    ComplexSentiment

    Expressions

    Dependency

    Parsing

    Syntactic

    Relations

    Find

    Chunks

    (attitudes,targets,

    hinges,)

    ChunksExpression

    LinkageDisambiguation

  • 8/13/2019 Sentimental Market Segmentation

    31/53

    http://www.subtext3.com

    Demographic Profiling

  • 8/13/2019 Sentimental Market Segmentation

    32/53

    http://www.subtext3.com

    Authorship Profiling

    Infer things about the author from the style of

    the language

    Gender

    Age

    Native language

    Personality type

    Education level

    Etc

  • 8/13/2019 Sentimental Market Segmentation

    33/53

    http://www.subtext3.com

    Capturing language style

    Linguistic variation independent of the topic Function words

    Parts-of-speech

    Syntactic structures Morphology

    Linguistic complexity

    Vocabulary size

    Mistakes

    Slang

  • 8/13/2019 Sentimental Market Segmentation

    34/53

    http://www.subtext3.com

    Male/Female Classification

    20th Century narrative fiction: 79%

    20th Century non-fiction: 83%

    21st Century blogs: 77%

    17th-19th Century French lit.: 76%

    Male Features Female Features

    the, this, that, those,as, one, of, to,

    prepositionsadjectives numbers

    she, for, with, not, and,in, I, you, pronounspresent-tense-verbs

  • 8/13/2019 Sentimental Market Segmentation

    35/53

  • 8/13/2019 Sentimental Market Segmentation

    36/53

    http://www.subtext3.com

    Other dimensions

    Native language: ~80%

    Personality:

    Neuroticism: ~68%

    Extraversion: ~55-70%

  • 8/13/2019 Sentimental Market Segmentation

    37/53

  • 8/13/2019 Sentimental Market Segmentation

    38/53

    http://www.subtext3.com

    Simple Prototype

    53,983 blog snippets from the ICWSM task

    corpus (Aug-Sep, 2008)

    268,665 sentiment expressions found

    Examples:

    I think that Sarah [Palin]targetwould be a

    [terrible]attitude[vice president]superordinate

    [the game]targetwas [too simplistic]attitude[to serve as

    proper material for argument]aspect

  • 8/13/2019 Sentimental Market Segmentation

    39/53

    http://www.subtext3.com

    Authorship Profiling

    Gender (Male/Female)

    Age (Younger/Older)

    Based on features from previous studies

    Education level (LowerEd, MediumEd, HigherEd)

    Based on linguistic complexity

  • 8/13/2019 Sentimental Market Segmentation

    40/53

    http://www.subtext3.com

    Trend Analysis

  • 8/13/2019 Sentimental Market Segmentation

    41/53

    http://www.subtext3.com

    Apartment sentiment by gender

    -0.6

    -0.4

    -0.2

    0

    0.2

    0.4

    0.6

    0.8

    1

    1.2

    8/3/

    08

    8/5/

    08

    8/7/

    08

    8/9/08

    8/11/08

    8/13/

    08

    8/15/

    08

    8/17/

    08

    8/19/08

    8/21/08

    8/23/

    08

    8/25/

    08

    8/27/

    08

    8/29/08

    8/31/08

    9/2/

    08

    9/4/08

    9/6/08

    9/8/08

    9/10/08

    9/12/

    08

    9/14/08

    9/16/08

    9/18/08

    9/20/08

    9/22/

    08

    9/24/08

    9/26/08

    9/28/08

    apartment/Female

    apartment/Male

  • 8/13/2019 Sentimental Market Segmentation

    42/53

    http://www.subtext3.com

    Apartments - gender difference

    apartment/Male-Female

    -0.4

    -0.2

    0

    0.2

    0.4

    0.6

    0.8

    1

    1.2

    8/3/

    08

    8/5/

    08

    8/7/

    08

    8/9/08

    8/11

    /08

    8/13

    /08

    8/15

    /08

    8/17

    /08

    8/19

    /08

    8/21

    /08

    8/23

    /08

    8/25

    /08

    8/27

    /08

    8/29

    /08

    8/31

    /08

    9/2/

    08

    9/4/08

    9/6/08

    9/8/08

    9/10

    /08

    9/12

    /08

    9/14

    /08

    9/16

    /08

    9/18

    /08

    9/20

    /08

    9/22

    /08

    9/24

    /08

    9/26

    /08

    9/28

    /08

  • 8/13/2019 Sentimental Market Segmentation

    43/53

    http://www.subtext3.com

    McCain & Palin - gender difference

    -1

    -0.5

    0

    0.5

    1

    1.5

    Date

    9/1

    9/2

    9/3

    9/4

    9/5

    9/6

    9/7

    8/10

    8/11

    8/12

    8/13

    8/14

    8/15

    8/16

    8/17

    8/18

    9/19

    9/20

    9/21

    9/22

    9/23

    9/24

    9/25

    9/26

    9/27

    9/29

    mccain/Male-Female

    palin/Male-Female

  • 8/13/2019 Sentimental Market Segmentation

    44/53

  • 8/13/2019 Sentimental Market Segmentation

    45/53

    Perceptual Map - Relationships

  • 8/13/2019 Sentimental Market Segmentation

    46/53

    Perceptual Map - Relationships

  • 8/13/2019 Sentimental Market Segmentation

    47/53

  • 8/13/2019 Sentimental Market Segmentation

    48/53

  • 8/13/2019 Sentimental Market Segmentation

    49/53

    Perceptual Map - Issues

  • 8/13/2019 Sentimental Market Segmentation

    50/53

  • 8/13/2019 Sentimental Market Segmentation

    51/53

  • 8/13/2019 Sentimental Market Segmentation

    52/53

    http://www.subtext3.com

    Sentimental Market Segmentation

    Construct perceptual and community maps, by: Detailed extraction of sentiment expressions

    Semantic and structural detail

    Authorship profilingTells us what kinds of people are writing which opinions

    (Also need to attribute third-party sources)

    Dimensionality reduction over author opinions and

    profiles (PCA, MDS, etc.)

  • 8/13/2019 Sentimental Market Segmentation

    53/53

    Thank you

    Contact us:

    Shlomo Argamon

    [email protected]@ShlomoArgamon

    http://www.subtext3.com