music recommendation by daniel mcennis. outline sociology of music recommendation infrastructure...

24
Music Recommendation By Daniel McEnnis

Post on 21-Dec-2015

213 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Music Recommendation By Daniel McEnnis. Outline Sociology of Music Recommendation Infrastructure –Relational Analysis Toolkit Description Evaluation –GATE

Music RecommendationBy Daniel McEnnis

Page 2: Music Recommendation By Daniel McEnnis. Outline Sociology of Music Recommendation Infrastructure –Relational Analysis Toolkit Description Evaluation –GATE

Outline

• Sociology of Music Recommendation

• Infrastructure– Relational Analysis Toolkit

• Description• Evaluation

– GATE and Review Mining

Page 3: Music Recommendation By Daniel McEnnis. Outline Sociology of Music Recommendation Infrastructure –Relational Analysis Toolkit Description Evaluation –GATE

Why do we like what we like?

• Personal Identity and Music– Music and Lifestyle Correlations

• Social Associations• Peer Groups• Content of the Music and Lyrics

– Culture specific understanding of music– Social meanings of musical forms– Ability to understand the lyrics

Page 4: Music Recommendation By Daniel McEnnis. Outline Sociology of Music Recommendation Infrastructure –Relational Analysis Toolkit Description Evaluation –GATE

Social Networks and Music Recommendation

• What is social information?– Age and personal collections/preferences– Friends’ musical tastes– Opinions of local associations or groups– Local (geographical) opinions about music– Cultural background of the person

Page 5: Music Recommendation By Daniel McEnnis. Outline Sociology of Music Recommendation Infrastructure –Relational Analysis Toolkit Description Evaluation –GATE

Where is the Data?

• Play-lists, personal music collections, and recorded listening habits

• Social network sites such as Facebook and Live Journal

• Web sites such as blogs and lists of favorite web pages

• Relationships between these artifacts

Page 6: Music Recommendation By Daniel McEnnis. Outline Sociology of Music Recommendation Infrastructure –Relational Analysis Toolkit Description Evaluation –GATE

What Infrastructure is Needed

• Toolkit for synthesizing social data.

• Text mining tools for analyzing web-pages, music reviews, and blogs.

• Play-list analyzers• Content-based music

analysis toolkits

Page 7: Music Recommendation By Daniel McEnnis. Outline Sociology of Music Recommendation Infrastructure –Relational Analysis Toolkit Description Evaluation –GATE

Social Toolkit Requirements

• Intuitive Java-Based Graph Toolkit

• Arbitrary multi-valued properties on nodes

• Social network analysis algorithms

• Efficient back-end processing

• Scripting support for experiments

Page 8: Music Recommendation By Daniel McEnnis. Outline Sociology of Music Recommendation Infrastructure –Relational Analysis Toolkit Description Evaluation –GATE

Relational Analysis Toolkit (RAT)

• Low Level – Graph– Actor (Node)– Link (Arc, Edge)

• High Level – Collection of

algorithms– Scripting support

Page 9: Music Recommendation By Daniel McEnnis. Outline Sociology of Music Recommendation Infrastructure –Relational Analysis Toolkit Description Evaluation –GATE

Exponential Similarity

-1.3k +2k 0

Page 10: Music Recommendation By Daniel McEnnis. Outline Sociology of Music Recommendation Infrastructure –Relational Analysis Toolkit Description Evaluation –GATE

Music Recommendation

Page 11: Music Recommendation By Daniel McEnnis. Outline Sociology of Music Recommendation Infrastructure –Relational Analysis Toolkit Description Evaluation –GATE

Degree Centrality

Page 12: Music Recommendation By Daniel McEnnis. Outline Sociology of Music Recommendation Infrastructure –Relational Analysis Toolkit Description Evaluation –GATE

Djikstra Shortest paths

• Djikstra’s shortest path algorithm over this graph. Closeness measures are stored in a Path object cached at the graph object.

• Optimized version used inside Closeness and Betweeness for performance reasons.

Page 13: Music Recommendation By Daniel McEnnis. Outline Sociology of Music Recommendation Infrastructure –Relational Analysis Toolkit Description Evaluation –GATE

Closeness Centrality

Page 14: Music Recommendation By Daniel McEnnis. Outline Sociology of Music Recommendation Infrastructure –Relational Analysis Toolkit Description Evaluation –GATE

Betweeness Prestige

Page 15: Music Recommendation By Daniel McEnnis. Outline Sociology of Music Recommendation Infrastructure –Relational Analysis Toolkit Description Evaluation –GATE

Page Rank

Page 16: Music Recommendation By Daniel McEnnis. Outline Sociology of Music Recommendation Infrastructure –Relational Analysis Toolkit Description Evaluation –GATE

Kleinberg’s HITS

• Generates a set of ‘hubs’ (central actors) and ‘authorities’ (prestigious actors).

• Intuitively good hubs (User) point (Knows) to good authorities (User) and vice versa.

• Implemented in naïve and optimized versions.

Page 17: Music Recommendation By Daniel McEnnis. Outline Sociology of Music Recommendation Infrastructure –Relational Analysis Toolkit Description Evaluation –GATE

Clique Definition

Page 18: Music Recommendation By Daniel McEnnis. Outline Sociology of Music Recommendation Infrastructure –Relational Analysis Toolkit Description Evaluation –GATE

Evaluation

• How well can this method recreate a persons list of liked music

• 4% average precision

• 16% average recall

• Standard deviation > 100 for both– Sometimes it works really well, but often

doesn’t

Page 19: Music Recommendation By Daniel McEnnis. Outline Sociology of Music Recommendation Infrastructure –Relational Analysis Toolkit Description Evaluation –GATE

Weka in RATArtist-User User Music Beatles BeachBoys Monkeys Metallica ListensTo

Beatles-A B + T T F F TC - F T T F TE 0 F F F F T

Beach Boys-A B + T T F F FC - F T T F FE 0 F F F F F

Monkeys-A B + T T F F FC - F T T F FE 0 F F F F F

Metallica-A B + T T F F FC - F T T F FE 0 F F F F F

Page 20: Music Recommendation By Daniel McEnnis. Outline Sociology of Music Recommendation Infrastructure –Relational Analysis Toolkit Description Evaluation –GATE

Weka Evaluation

Same data as Ad Hoc algorithm

J48 Classifier

• 1% Precision

• 62% Recall

More coming….

Page 21: Music Recommendation By Daniel McEnnis. Outline Sociology of Music Recommendation Infrastructure –Relational Analysis Toolkit Description Evaluation –GATE

Music Reviews - epinions.com

• Uses GATE Parts of speech analyzer

• Predicting positive/negative reviews

• Useful for tag extraction

• Negation problems

Page 22: Music Recommendation By Daniel McEnnis. Outline Sociology of Music Recommendation Infrastructure –Relational Analysis Toolkit Description Evaluation –GATE

Conclusions

• Social information is important for music recommendation

• RAT has centrality algorithms, but requires more clustering and learning algorithms

• Music review mining ready for integration into the RAT environment

Page 23: Music Recommendation By Daniel McEnnis. Outline Sociology of Music Recommendation Infrastructure –Relational Analysis Toolkit Description Evaluation –GATE

Future Work

• Evaluate with more Weka algorithms• Implement graph-based clustering algorithms• Implement other distance measures• Implement blog and web-page text mining• Integrate existing content based methods• Evaluate results with a user study

Page 24: Music Recommendation By Daniel McEnnis. Outline Sociology of Music Recommendation Infrastructure –Relational Analysis Toolkit Description Evaluation –GATE

Questions?