similarity measurement preliminary results
DESCRIPTION
TRANSCRIPT
Similarity measurement:Folksonomyvs.LSA
Preliminary Results
The Tripartite structure of tagging• Folksonomy is a set of triples < user , tag, object>• A folksonomy is a tuple F :=(U, T, R, Y) where U, T, and R are finite
sets, whose elements are called users, tags and resources. Y is a ternary relation between user, tags and resources.
Del.icio.us Tag distributionTag distribution Log-log Tag distribution
After crawling the delicious.com site, the total number tags (tokens) obtained was 7,528,528, among which the number of types was 188,964. All the tags are stemmed using the Porter Stemmer and the total number of stemmed tags ended up to be 174,887.
LSA Processing Workflow in R
tm = textmatrix(‘dir/‘)
tm = lw_logtf(tm) * gw_idf(tm)
space = lsa(tm, dims=dimcalc_share())
as.textmatrix(tm)
LSA corpus preparing
• A total number of 17,085 web pages were crawled and were later parsed to remove all the HTML markups.
• Stemming and Stop-word removal• The processed corpus:14,993,620 tokens, 259,464 types of
words. • Only words with frequency more than 100 were kept to be
entered into a word-by-document matrix. There were 1047 words with frequency more than 100. The text length kept in the corpus is from ranges from 51 words per document to 4009 words per document .
• Therefore, the resulting term-document matrix have 3465 columns (documents) and 1082 rows (words).
LSA document length distribution
The text length kept in the corpus is from ranges from 51 words per document to 4009 words per document .
Three similarity measurements
• Tag Co-coccurrence counts
• Tag vector cosine similarity
• LSA
Similarity Measurement
• Tag Co-occurrence Counts: 1)simple count: how many times two tags are
used by the same user to annotate the same resource
2)normalized count: Jaccard IndexThe co-occurrence counts of tag A and tag B divided by the joint frequency of A and B.
Distribution of Tag co-occurrence Counts (simple counts)
Distribution of Tag co-occurrence Counts (normalized)
Measurement 2: Cosine Similarity
• Based on the co-occurrence vector of each tag with every other tag.
• Since there are normalized and unnormalized tag co-occurrence counts, we then ended up with two
• X and Y are the co-occurrence vectors of two distinct tags.
Distribution of Tag Cosine Similarity
Distribution of Tag Cosine Similarity based on normalized Tag Co-occurrence
counts
Results
• The pair-wise Pearson correlation and Spearman correlation among 5 measurements [Tag-cooccurrence count, Tag cosine similarity, LSA, normalized Tag-cooccurrence count, Tag cosine similarity based on normalized tag-tag cooccurrence matrix]
Correlation
Pearson (p)
Spearman(s)
Tag Cooccur
TagCosine
LSA TagCooccurnorm
TagCosinenorm
Tag Cooccur
S:0.299478p: 0.17257
S: 0.078392p:0.0861644
TagCosine
S:0.098562P: 0.114581
S:0.1042865p:0.307023
LSA S:0.0770016p:0.1930085
S:0.07058p:0.152654
TagCooccurnorm
S: 0.155882p:0.648709
TagCosinenorm
Qualitative Insight – ‘linguistics’
Tag Cooccur LSA Tag Cosine Norm TagCooccur
Norm TagCosine
Languag Teach English Languag Languag
Refer Languag Alphabet Nlp Nlp
English Teacher Learn Cultur English
Nlp bibliographi Natur English Research
Cultur Select Chines Word Write
Grammar Tesol Russian Grammar Word
Write Center Pronunci Research Refer
Research profession Interest Histori Grammar
Dictionari statement Word Dictionari Dictionari
blog standard identifi scienc tool
Top 10 “linguistics” related words according to 5 measurements
Correlation between two measurements:normalized tag co-occurrence counts vs. normalized tag cosineP= 0.7547