moz 2013 ranking factors - matt peters mozcon

77
#MozCon @mattthemathman Hot Off the Press: 2013 Ranking Factors Matthew Peters, Ph.D. Data Scientist, Moz

Upload: mattthemathman

Post on 20-Aug-2015

220.935 views

Category:

Technology


0 download

TRANSCRIPT

Page 1: Moz 2013 Ranking Factors - Matt Peters MozCon

#MozCon @mattthemathman

Hot Off the Press: 2013 Ranking FactorsMatthew Peters, Ph.D.

Data Scientist, Moz

Page 2: Moz 2013 Ranking Factors - Matt Peters MozCon

#MozCon @mattthemathman

On Page signals: 8.4PageRank: 7.8Anchor text: 5.9Social signals: 3.8etc …

How does a search engine work?

Page 3: Moz 2013 Ranking Factors - Matt Peters MozCon

#MozCon @mattthemathman

Search quality raters

On Page signals: 8.4PageRank: 7.8Anchor text: 5.9Social signals: 3.8etc …

How does a search engine work?

Page 4: Moz 2013 Ranking Factors - Matt Peters MozCon

#MozCon @mattthemathman

TheAlgorithm

Search quality raters

On Page signals: 8.4PageRank: 7.8Anchor text: 5.9Social signals: 3.8etc …

How does a search engine work?

Page 5: Moz 2013 Ranking Factors - Matt Peters MozCon

#MozCon @mattthemathman

TheAlgorithm

Search quality raters

On Page signals: 8.4PageRank: 7.8Anchor text: 5.9Social signals: 3.8etc …

How does a search engine work?

Page 6: Moz 2013 Ranking Factors - Matt Peters MozCon

6 #MozCon @mattthemathmanDifferent feature types include: On-page, links, anchor text, social signals and properties of the URL

Page 7: Moz 2013 Ranking Factors - Matt Peters MozCon

7 #MozCon @mattthemathmanDifferent feature types include: On-page, links, anchor text, social signals and properties of the URL

URL www.mrqe.com

Page 8: Moz 2013 Ranking Factors - Matt Peters MozCon

8 #MozCon @mattthemathmanDifferent feature types include: On-page, links, anchor text, social signals and properties of the URL

On-page

URL www.mrqe.com

Page 9: Moz 2013 Ranking Factors - Matt Peters MozCon

9 #MozCon @mattthemathmanDifferent feature types include: On-page, links, anchor text, social signals and properties of the URL

On-page Links

URL www.mrqe.com

Page 10: Moz 2013 Ranking Factors - Matt Peters MozCon

10 #MozCon @mattthemathmanDifferent feature types include: On-page, links, anchor text, social signals and properties of the URL

On-page

“movie reviews”

Links

Anchor Text

URL www.mrqe.com

Page 11: Moz 2013 Ranking Factors - Matt Peters MozCon

11 #MozCon @mattthemathmanDifferent feature types include: On-page, links, anchor text, social signals and properties of the URL

On-page

“movie reviews”

Links

Anchor Text

Social

URL www.mrqe.com

Page 12: Moz 2013 Ranking Factors - Matt Peters MozCon

#MozCon @mattthemathman12

Which factors are important?

Page 13: Moz 2013 Ranking Factors - Matt Peters MozCon

#MozCon @mattthemathman13

Which factors are important?

What Google says

Page 14: Moz 2013 Ranking Factors - Matt Peters MozCon

#MozCon @mattthemathman14

Which factors are important?

What’s in the algorithmWhat Google says

Page 15: Moz 2013 Ranking Factors - Matt Peters MozCon

#MozCon @mattthemathman15

Which factors are important?

What’s in the algorithmWhat Google says

What SEOs say

Page 16: Moz 2013 Ranking Factors - Matt Peters MozCon

#MozCon @mattthemathman16

Which factors are important?

What’s in the algorithmWhat Google says

What SEOs sayCharacteristics of sites that rank well

Page 17: Moz 2013 Ranking Factors - Matt Peters MozCon

17 #MozCon @mattthemathman

Survey

Thanks to everyone who participated and Cyrus Shepard and Matt Brown for organizing

120 professional SEOs surveyed in mid-June 2013

Page 18: Moz 2013 Ranking Factors - Matt Peters MozCon

18 #MozCon @mattthemathman

Survey

Page 19: Moz 2013 Ranking Factors - Matt Peters MozCon

19 #MozCon @mattthemathman

Survey

Page 20: Moz 2013 Ranking Factors - Matt Peters MozCon

20 #MozCon @mattthemathman

Survey

Respondents rated each factor from 1-10 on their importance in ranking.

Use average importance rating.

Highest rated factors scored 7-8, lower rated factors scored 3-5.

Page 21: Moz 2013 Ranking Factors - Matt Peters MozCon

21 #MozCon @mattthemathman

Correlations• 14,000+ keywords from Google Adwords

• All categories and search volumes included

• Top 50 results from Google US

• De-personalized, de-localized organic results

• First week of June 2013

Page 22: Moz 2013 Ranking Factors - Matt Peters MozCon

22 #MozCon @mattthemathman

Correlations• Mean Spearman Correlation

• Compute for each keyword, then average

• Measures extent to which increases in one factor are related to rank

• Correlations between -1 and 1. Values of 0.1 - 0.3 are common.

• Thanks to Jerry Feng and Mike O’Leary for extracting features!

Page 23: Moz 2013 Ranking Factors - Matt Peters MozCon

23 #MozCon @mattthemathman

"Correlation is not causation but it sure is a hint" - Edward Tufte

Links

Correlation and causation

Higher rank

??

Page 24: Moz 2013 Ranking Factors - Matt Peters MozCon

24 #MozCon @mattthemathman

"Correlation is not causation but it sure is a hint" - Edward Tufte

Links

Correlation and causation

Higher rank

Page 25: Moz 2013 Ranking Factors - Matt Peters MozCon

25 #MozCon @mattthemathman

"Correlation is not causation but it sure is a hint" - Edward Tufte

Links

Higher rank

Correlation and causation Correlation, but causation?

Higher rank

More words on page

??

Page 26: Moz 2013 Ranking Factors - Matt Peters MozCon

26 #MozCon @mattthemathman

"Correlation is not causation but it sure is a hint" - Edward Tufte

Links

Higher rank

Correlation and causation Correlation, but causation?

Higher rank

Higher quality

More words on page

??

Page 27: Moz 2013 Ranking Factors - Matt Peters MozCon

27 #MozCon @mattthemathman

"Correlation is not causation but it sure is a hint" - Edward Tufte

Links

Higher rank

Correlation and causation Correlation, but causation?

Higher rank

Higher quality

More words on page

?? Links

Page 28: Moz 2013 Ranking Factors - Matt Peters MozCon

28 #MozCon @mattthemathman

"Correlation is not causation but it sure is a hint" - Edward Tufte

Links

Higher rank

Correlation and causation Correlation, but causation?

Higher rank

Higher quality

More words on page

Links

Page 29: Moz 2013 Ranking Factors - Matt Peters MozCon

29 #MozCon @mattthemathman

Links

Page 30: Moz 2013 Ranking Factors - Matt Peters MozCon

30 #MozCon @mattthemathman

Correlations: Page level links

Link diversity still very important.Page Authority highest overall correlated metric.

Page 31: Moz 2013 Ranking Factors - Matt Peters MozCon

31 #MozCon @mattthemathman

Page Authority is a machine learning model that predicts ranking based on links.

See: http://moz.com/learn/seo/page-authority

Page 32: Moz 2013 Ranking Factors - Matt Peters MozCon

32 #MozCon @mattthemathman

Correlations: Domain level links

Domain in-link correlations generally lower the page links.Sub-domain metrics now have higher correlation then domain metrics.

Page 33: Moz 2013 Ranking Factors - Matt Peters MozCon

33 #MozCon @mattthemathman

Survey: Links

Consistent with correlations, links from domains most important.Relevance of page/domain also thought to be very important.

Page 34: Moz 2013 Ranking Factors - Matt Peters MozCon

34 #MozCon @mattthemathman

Anchor Text

Page 35: Moz 2013 Ranking Factors - Matt Peters MozCon

35 #MozCon @mattthemathman

Correlations: Anchor text

Partial and exact match have same correlation.Internal anchor text correlations significantly lower then external.

Page 36: Moz 2013 Ranking Factors - Matt Peters MozCon

36 #MozCon @mattthemathman

Survey: Anchor text

After Penguin, organic (mix of branded, non-branded) anchor text distribution thought to be more important the quantity.

Page 37: Moz 2013 Ranking Factors - Matt Peters MozCon

37 #MozCon @mattthemathman

Site Speed

Page 38: Moz 2013 Ranking Factors - Matt Peters MozCon

38 #MozCon @mattthemathman

Correlations: Site speed

Zoompf to provided the speed data.Response time has negative correlation, but total load time does not!

Page 39: Moz 2013 Ranking Factors - Matt Peters MozCon

39 #MozCon @mattthemathman

Speed and users

Jonathon Colman: http://www.slideshare.net/jcolman/seo-site-speed-and-battlestar-galactica-searchfest-2012-11735155

• 40% of customers will abandon any site that takes longer than 3 seconds to load

• Conversion rate drops by 7% for every 1 second of load time

Page 40: Moz 2013 Ranking Factors - Matt Peters MozCon

40 #MozCon @mattthemathman

On-Page

Page 41: Moz 2013 Ranking Factors - Matt Peters MozCon

41 #MozCon @mattthemathmanIn 2011, we found low on-page keyword related factors.

2011

Correlations: Keyword on-page

Page 42: Moz 2013 Ranking Factors - Matt Peters MozCon

42 #MozCon @mattthemathman

Survey: On-page

General consensus that KW in are important.

2013

Page 43: Moz 2013 Ranking Factors - Matt Peters MozCon

43 #MozCon @mattthemathman

Beyond TF-IDF

See http://moz.com/blog/determining-relevance-how-similarity-is-scored

> 700 papers

Page 44: Moz 2013 Ranking Factors - Matt Peters MozCon

44 #MozCon @mattthemathman

Beyond TF-IDF

See http://moz.com/blog/determining-relevance-how-similarity-is-scored

> 700 papers

Language ModelP(optimization | search, engine) >>P(walking | search, engine)

Page 45: Moz 2013 Ranking Factors - Matt Peters MozCon

45 #MozCon @mattthemathman

Correlations: Keyword on-page

Using a more sophisticated model increases correlations.We also used a larger corpus in 2013 that should increase correlations.

2013

Page 46: Moz 2013 Ranking Factors - Matt Peters MozCon

46 #MozCon @mattthemathman

Correlations: Keyword on-page

Title, meta description and H1 all have relatively high correlations.

2013

Page 47: Moz 2013 Ranking Factors - Matt Peters MozCon

47 #MozCon @mattthemathman

Correlations: Other on-page

Document length has relatively high correlation.Structured data and Google+ markup has no correlation

Page 48: Moz 2013 Ranking Factors - Matt Peters MozCon

48 #MozCon @mattthemathman

Are sites implementing structured data?

Markup Percent of URLs

Open graph 36.9%schema.org 9.9%G+ publisher 7.1%G+ author 2.2%

Page 49: Moz 2013 Ranking Factors - Matt Peters MozCon

49 #MozCon @mattthemathman

Don’t ignore authorship

Page 50: Moz 2013 Ranking Factors - Matt Peters MozCon

50 #MozCon @mattthemathman

URL-Domain

Page 51: Moz 2013 Ranking Factors - Matt Peters MozCon

51 #MozCon @mattthemathman

Correlations: URL

Query: “adidas sneakers”Exact Match Domain (EMD): www.adidassneakers.comPartial Match Domain (PMD): www.adidas.com

Page 52: Moz 2013 Ranking Factors - Matt Peters MozCon

52 #MozCon @mattthemathman

Survey: URL

Query: “adidas sneakers”Exact Match Domain (EMD): www.adidassneakers.comPartial Match Domain (PMD): www.adidas.com

Page 53: Moz 2013 Ranking Factors - Matt Peters MozCon

53 #MozCon @mattthemathman

Exact match domain over time

Page 54: Moz 2013 Ranking Factors - Matt Peters MozCon

54 #MozCon @mattthemathman

Exact match domain over time

Page 55: Moz 2013 Ranking Factors - Matt Peters MozCon

55 #MozCon @mattthemathman

Exact match domain over time

Page 56: Moz 2013 Ranking Factors - Matt Peters MozCon

56 #MozCon @mattthemathman

Exact match domain over time

Page 57: Moz 2013 Ranking Factors - Matt Peters MozCon

57 #MozCon @mattthemathman

Exact match domain over time

Removal of low quality EMDs??

Page 58: Moz 2013 Ranking Factors - Matt Peters MozCon

58 #MozCon @mattthemathman

Brand metrics

Page 59: Moz 2013 Ranking Factors - Matt Peters MozCon

59 #MozCon @mattthemathman

Correlations: Brand metrics

Page 60: Moz 2013 Ranking Factors - Matt Peters MozCon

60 #MozCon @mattthemathman

Correlations: Brand metrics

Fresh and brand mentions have a relatively high correlation.

Page 61: Moz 2013 Ranking Factors - Matt Peters MozCon

61 #MozCon @mattthemathman

Survey: Brand metrics

Other then search volume, SEOs thought that brand mentions were relatively unimportant.

Page 62: Moz 2013 Ranking Factors - Matt Peters MozCon

62 #MozCon @mattthemathman

Social

Page 63: Moz 2013 Ranking Factors - Matt Peters MozCon

63 #MozCon @mattthemathman

Correlations: Social

Google +1’s second highest correlation metric (behind PA)!

Page 64: Moz 2013 Ranking Factors - Matt Peters MozCon

64 #MozCon @mattthemathman

Survey: Social

Overall, SEOs didn’t score social factors as highly as links or keywords.Google +1’s ranked highest, followed by Tweets, then Facebook shares.

Page 65: Moz 2013 Ranking Factors - Matt Peters MozCon

65 #MozCon @mattthemathman

Some words of caution

Methodology matters!

Page 66: Moz 2013 Ranking Factors - Matt Peters MozCon

66 #MozCon @mattthemathman

Comparing studies

Page 67: Moz 2013 Ranking Factors - Matt Peters MozCon

67 #MozCon @mattthemathman

Comparing studies

Our correlation is 0.29 for keyword in anchor text.

Searchmetrics removed navigation queries, but we included them. Does this explain the difference?

Page 68: Moz 2013 Ranking Factors - Matt Peters MozCon

68 #MozCon @mattthemathman

Comparing studies

Our correlation is 0.29 for keyword in anchor text.

Searchmetrics removed navigation queries, but we included them. Does this explain the difference?

EMD is their highest correlation at 0.43, except they used rank-biserial correlation.

Using Spearman for EMD gives 0.15 (we have 0.17).

Page 69: Moz 2013 Ranking Factors - Matt Peters MozCon

69 #MozCon @mattthemathman

Takeaways

Page 70: Moz 2013 Ranking Factors - Matt Peters MozCon

70 #MozCon @mattthemathman

Overall algorithm

Page 71: Moz 2013 Ranking Factors - Matt Peters MozCon

71 #MozCon @mattthemathman

Overall algorithm

Links are still very important, both as judged by SEOs and in the data.

Page 72: Moz 2013 Ranking Factors - Matt Peters MozCon

72 #MozCon @mattthemathman

Overall algorithm

On page keyword and content features still fundamental.

Page 73: Moz 2013 Ranking Factors - Matt Peters MozCon

73 #MozCon @mattthemathman

Overall Algorithm

Despite high correlations, SEOs don’t think social is important.

Correlation vs. Causation?

Page 74: Moz 2013 Ranking Factors - Matt Peters MozCon

74 #MozCon @mattthemathman

Overall algorithm, 2011 vs 2013

2011 2013

SEOs think EMD/PMDs decreased in importance.

Prevalence decreases but correlations remain same.

Page 75: Moz 2013 Ranking Factors - Matt Peters MozCon

75 #MozCon @mattthemathman

Future predictions

1. Quality, authorship, structured data, social all predicted to increase in importance.

Page 76: Moz 2013 Ranking Factors - Matt Peters MozCon

76 #MozCon @mattthemathman

Future predictions

1. Quality, authorship, structured data, social all predicted to increase in importance.

2. EMD, paid links, anchor text expected to decrease.

Page 77: Moz 2013 Ranking Factors - Matt Peters MozCon

#MozCon @mattthemathman