hot off the press: 2013 ranking factors

77
#MozCon @mattthemathman Hot Off the Press: 2013 Ranking Factors Matthew Peters, Ph.D. Data Scientist, Moz

Upload: brosh

Post on 15-Feb-2016

32 views

Category:

Documents


0 download

DESCRIPTION

Hot Off the Press: 2013 Ranking Factors. Matthew Peters, Ph.D. Data Scientist, Moz. How does a search engine work?. On Page signals: 8.4 PageRank : 7.8 Anchor text: 5.9 Social signals: 3.8 etc …. How does a search engine work?. On Page signals: 8.4 PageRank : 7.8 - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Hot Off the Press: 2013 Ranking Factors

#MozCon @mattthemathman

Hot Off the Press: 2013 Ranking FactorsMatthew Peters, Ph.D.

Data Scientist, Moz

Page 2: Hot Off the Press: 2013 Ranking Factors

#MozCon @mattthemathman

On Page signals: 8.4PageRank: 7.8Anchor text: 5.9Social signals: 3.8etc …

How does a search engine work?

Page 3: Hot Off the Press: 2013 Ranking Factors

#MozCon @mattthemathman

Search quality raters

On Page signals: 8.4PageRank: 7.8Anchor text: 5.9Social signals: 3.8etc …

How does a search engine work?

Page 4: Hot Off the Press: 2013 Ranking Factors

#MozCon @mattthemathman

TheAlgorithm

Search quality raters

On Page signals: 8.4PageRank: 7.8Anchor text: 5.9Social signals: 3.8etc …

How does a search engine work?

Page 5: Hot Off the Press: 2013 Ranking Factors

#MozCon @mattthemathman

TheAlgorithm

Search quality raters

On Page signals: 8.4PageRank: 7.8Anchor text: 5.9Social signals: 3.8etc …

How does a search engine work?

Page 6: Hot Off the Press: 2013 Ranking Factors

6 #MozCon @mattthemathmanDifferent feature types include: On-page, links, anchor text, social signals and properties of the URL

Page 7: Hot Off the Press: 2013 Ranking Factors

7 #MozCon @mattthemathmanDifferent feature types include: On-page, links, anchor text, social signals and properties of the URL

URL www.mrqe.com

Page 8: Hot Off the Press: 2013 Ranking Factors

8 #MozCon @mattthemathmanDifferent feature types include: On-page, links, anchor text, social signals and properties of the URL

On-page

URL www.mrqe.com

Page 9: Hot Off the Press: 2013 Ranking Factors

9 #MozCon @mattthemathmanDifferent feature types include: On-page, links, anchor text, social signals and properties of the URL

On-page Links

URL www.mrqe.com

Page 10: Hot Off the Press: 2013 Ranking Factors

10 #MozCon @mattthemathmanDifferent feature types include: On-page, links, anchor text, social signals and properties of the URL

On-page

“movie reviews”

Links

Anchor Text

URL www.mrqe.com

Page 11: Hot Off the Press: 2013 Ranking Factors

11 #MozCon @mattthemathmanDifferent feature types include: On-page, links, anchor text, social signals and properties of the URL

On-page

“movie reviews”

Links

Anchor Text

Social

URL www.mrqe.com

Page 12: Hot Off the Press: 2013 Ranking Factors

#MozCon @mattthemathman12

Which factors are important?

Page 13: Hot Off the Press: 2013 Ranking Factors

#MozCon @mattthemathman13

Which factors are important?

What Google says

Page 14: Hot Off the Press: 2013 Ranking Factors

#MozCon @mattthemathman14

Which factors are important?What’s in the algorithmWhat Google says

Page 15: Hot Off the Press: 2013 Ranking Factors

#MozCon @mattthemathman15

Which factors are important?What’s in the algorithmWhat Google says

What SEOs say

Page 16: Hot Off the Press: 2013 Ranking Factors

#MozCon @mattthemathman16

Which factors are important?What’s in the algorithmWhat Google says

What SEOs sayCharacteristics of sites that rank well

Page 17: Hot Off the Press: 2013 Ranking Factors

17 #MozCon @mattthemathman

Survey

Thanks to everyone who participated and Cyrus Shepard and Matt Brown for organizing

120 professional SEOs surveyed in mid-June 2013

Page 18: Hot Off the Press: 2013 Ranking Factors

18 #MozCon @mattthemathman

Survey

Page 19: Hot Off the Press: 2013 Ranking Factors

19 #MozCon @mattthemathman

Survey

Page 20: Hot Off the Press: 2013 Ranking Factors

20 #MozCon @mattthemathman

Survey

Respondents rated each factor from 1-10 on their importance in ranking.

Use average importance rating.

Highest rated factors scored 7-8, lower rated factors scored 3-5.

Page 21: Hot Off the Press: 2013 Ranking Factors

21 #MozCon @mattthemathman

Correlations• 14,000+ keywords from Google Adwords

• All categories and search volumes included

• Top 50 results from Google US

• De-personalized, de-localized organic results

• First week of June 2013

Page 22: Hot Off the Press: 2013 Ranking Factors

22 #MozCon @mattthemathman

Correlations• Mean Spearman Correlation

• Compute for each keyword, then average

• Measures extent to which increases in one factor are related to rank

• Correlations between -1 and 1. Values of 0.1 - 0.3 are common.

• Thanks to Jerry Feng and Mike O’Leary for extracting features!

Page 23: Hot Off the Press: 2013 Ranking Factors

23 #MozCon @mattthemathman

"Correlation is not causation but it sure is a hint" - Edward Tufte

Links

Correlation and causation

Higher rank

??

Page 24: Hot Off the Press: 2013 Ranking Factors

24 #MozCon @mattthemathman

"Correlation is not causation but it sure is a hint" - Edward Tufte

Links

Correlation and causation

Higher rank

Page 25: Hot Off the Press: 2013 Ranking Factors

25 #MozCon @mattthemathman

"Correlation is not causation but it sure is a hint" - Edward Tufte

Links

Higher rank

Correlation and causation Correlation, but causation?

Higher rank

More words on page

??

Page 26: Hot Off the Press: 2013 Ranking Factors

26 #MozCon @mattthemathman

"Correlation is not causation but it sure is a hint" - Edward Tufte

Links

Higher rank

Correlation and causation Correlation, but causation?

Higher rank

Higher quality

More words on page

??

Page 27: Hot Off the Press: 2013 Ranking Factors

27 #MozCon @mattthemathman

"Correlation is not causation but it sure is a hint" - Edward Tufte

Links

Higher rank

Correlation and causation Correlation, but causation?

Higher rank

Higher quality

More words on page

?? Links

Page 28: Hot Off the Press: 2013 Ranking Factors

28 #MozCon @mattthemathman

"Correlation is not causation but it sure is a hint" - Edward Tufte

Links

Higher rank

Correlation and causation Correlation, but causation?

Higher rank

Higher quality

More words on page

Links

Page 29: Hot Off the Press: 2013 Ranking Factors

29 #MozCon @mattthemathman

Links

Page 30: Hot Off the Press: 2013 Ranking Factors

30 #MozCon @mattthemathman

Correlations: Page level links

Link diversity still very important.Page Authority highest overall correlated metric.

Page 31: Hot Off the Press: 2013 Ranking Factors

31 #MozCon @mattthemathman

Page Authority is a machine learning model that predicts ranking based on links.

See: http://moz.com/learn/seo/page-authority

Page 32: Hot Off the Press: 2013 Ranking Factors

32 #MozCon @mattthemathman

Correlations: Domain level links

Domain in-link correlations generally lower the page links.Sub-domain metrics now have higher correlation then domain metrics.

Page 33: Hot Off the Press: 2013 Ranking Factors

33 #MozCon @mattthemathman

Survey: Links

Consistent with correlations, links from domains most important.Relevance of page/domain also thought to be very important.

Page 34: Hot Off the Press: 2013 Ranking Factors

34 #MozCon @mattthemathman

Anchor Text

Page 35: Hot Off the Press: 2013 Ranking Factors

35 #MozCon @mattthemathman

Correlations: Anchor text

Partial and exact match have same correlation.Internal anchor text correlations significantly lower then external.

Page 36: Hot Off the Press: 2013 Ranking Factors

36 #MozCon @mattthemathman

Survey: Anchor text

After Penguin, organic (mix of branded, non-branded) anchor text distribution thought to be more important the quantity.

Page 37: Hot Off the Press: 2013 Ranking Factors

37 #MozCon @mattthemathman

Site Speed

Page 38: Hot Off the Press: 2013 Ranking Factors

38 #MozCon @mattthemathman

Correlations: Site speed

Zoompf to provided the speed data.Response time has negative correlation, but total load time does not!

Page 39: Hot Off the Press: 2013 Ranking Factors

39 #MozCon @mattthemathman

Speed and users

Jonathon Colman: http://www.slideshare.net/jcolman/seo-site-speed-and-battlestar-galactica-searchfest-2012-11735155

• 40% of customers will abandon any site that takes longer than 3 seconds to load

• Conversion rate drops by 7% for every 1 second of load time

Page 40: Hot Off the Press: 2013 Ranking Factors

40 #MozCon @mattthemathman

On-Page

Page 41: Hot Off the Press: 2013 Ranking Factors

41 #MozCon @mattthemathmanIn 2011, we found low on-page keyword related factors.

2011

Correlations: Keyword on-page

Page 42: Hot Off the Press: 2013 Ranking Factors

42 #MozCon @mattthemathman

Survey: On-page

General consensus that KW in are important.

2013

Page 43: Hot Off the Press: 2013 Ranking Factors

43 #MozCon @mattthemathman

Beyond TF-IDF

See http://moz.com/blog/determining-relevance-how-similarity-is-scored

> 700 papers

Page 44: Hot Off the Press: 2013 Ranking Factors

44 #MozCon @mattthemathman

Beyond TF-IDF

See http://moz.com/blog/determining-relevance-how-similarity-is-scored

> 700 papers

Language ModelP(optimization | search, engine) >>P(walking | search, engine)

Page 45: Hot Off the Press: 2013 Ranking Factors

45 #MozCon @mattthemathman

Correlations: Keyword on-page

Using a more sophisticated model increases correlations.We also used a larger corpus in 2013 that should increase correlations.

2013

Page 46: Hot Off the Press: 2013 Ranking Factors

46 #MozCon @mattthemathman

Correlations: Keyword on-page

Title, meta description and H1 all have relatively high correlations.

2013

Page 47: Hot Off the Press: 2013 Ranking Factors

47 #MozCon @mattthemathman

Correlations: Other on-page

Document length has relatively high correlation.Structured data and Google+ markup has no correlation

Page 48: Hot Off the Press: 2013 Ranking Factors

48 #MozCon @mattthemathman

Are sites implementing structured data?

Markup Percent of URLs

Open graph 36.9%schema.org 9.9%G+ publisher 7.1%G+ author 2.2%

Page 49: Hot Off the Press: 2013 Ranking Factors

49 #MozCon @mattthemathman

Don’t ignore authorship

Page 50: Hot Off the Press: 2013 Ranking Factors

50 #MozCon @mattthemathman

URL-Domain

Page 51: Hot Off the Press: 2013 Ranking Factors

51 #MozCon @mattthemathman

Correlations: URL

Query: “adidas sneakers”Exact Match Domain (EMD): www.adidassneakers.comPartial Match Domain (PMD): www.adidas.com

Page 52: Hot Off the Press: 2013 Ranking Factors

52 #MozCon @mattthemathman

Survey: URL

Query: “adidas sneakers”Exact Match Domain (EMD): www.adidassneakers.comPartial Match Domain (PMD): www.adidas.com

Page 53: Hot Off the Press: 2013 Ranking Factors

53 #MozCon @mattthemathman

Exact match domain over time

Page 54: Hot Off the Press: 2013 Ranking Factors

54 #MozCon @mattthemathman

Exact match domain over time

Page 55: Hot Off the Press: 2013 Ranking Factors

55 #MozCon @mattthemathman

Exact match domain over time

Page 56: Hot Off the Press: 2013 Ranking Factors

56 #MozCon @mattthemathman

Exact match domain over time

Page 57: Hot Off the Press: 2013 Ranking Factors

57 #MozCon @mattthemathman

Exact match domain over time

Removal of low quality EMDs??

Page 58: Hot Off the Press: 2013 Ranking Factors

58 #MozCon @mattthemathman

Brand metrics

Page 59: Hot Off the Press: 2013 Ranking Factors

59 #MozCon @mattthemathman

Correlations: Brand metrics

Page 60: Hot Off the Press: 2013 Ranking Factors

60 #MozCon @mattthemathman

Correlations: Brand metrics

Fresh and brand mentions have a relatively high correlation.

Page 61: Hot Off the Press: 2013 Ranking Factors

61 #MozCon @mattthemathman

Survey: Brand metrics

Other then search volume, SEOs thought that brand mentions were relatively unimportant.

Page 62: Hot Off the Press: 2013 Ranking Factors

62 #MozCon @mattthemathman

Social

Page 63: Hot Off the Press: 2013 Ranking Factors

63 #MozCon @mattthemathman

Correlations: Social

Google +1’s second highest correlation metric (behind PA)!

Page 64: Hot Off the Press: 2013 Ranking Factors

64 #MozCon @mattthemathman

Survey: Social

Overall, SEOs didn’t score social factors as highly as links or keywords.Google +1’s ranked highest, followed by Tweets, then Facebook shares.

Page 65: Hot Off the Press: 2013 Ranking Factors

65 #MozCon @mattthemathman

Some words of caution

Methodology matters!

Page 66: Hot Off the Press: 2013 Ranking Factors

66 #MozCon @mattthemathman

Comparing studies

Page 67: Hot Off the Press: 2013 Ranking Factors

67 #MozCon @mattthemathman

Comparing studies

Our correlation is 0.29 for keyword in anchor text.

Searchmetrics removed navigation queries, but we included them. Does this explain the difference?

Page 68: Hot Off the Press: 2013 Ranking Factors

68 #MozCon @mattthemathman

Comparing studies

Our correlation is 0.29 for keyword in anchor text.

Searchmetrics removed navigation queries, but we included them. Does this explain the difference?

EMD is their highest correlation at 0.43, except they used rank-biserial correlation.

Using Spearman for EMD gives 0.15 (we have 0.17).

Page 69: Hot Off the Press: 2013 Ranking Factors

69 #MozCon @mattthemathman

Takeaways

Page 70: Hot Off the Press: 2013 Ranking Factors

70 #MozCon @mattthemathman

Overall algorithm

Page 71: Hot Off the Press: 2013 Ranking Factors

71 #MozCon @mattthemathman

Overall algorithm

Links are still very important, both as judged by SEOs and in the data.

Page 72: Hot Off the Press: 2013 Ranking Factors

72 #MozCon @mattthemathman

Overall algorithm

On page keyword and content features still fundamental.

Page 73: Hot Off the Press: 2013 Ranking Factors

73 #MozCon @mattthemathman

Overall Algorithm

Despite high correlations, SEOs don’t think social is important.

Correlation vs. Causation?

Page 74: Hot Off the Press: 2013 Ranking Factors

74 #MozCon @mattthemathman

Overall algorithm, 2011 vs 20132011 2013

SEOs think EMD/PMDs decreased in importance.Prevalence decreases but correlations remain same.

Page 75: Hot Off the Press: 2013 Ranking Factors

75 #MozCon @mattthemathman

Future predictions

1. Quality, authorship, structured data, social all predicted to increase in importance.

Page 76: Hot Off the Press: 2013 Ranking Factors

76 #MozCon @mattthemathman

Future predictions

1. Quality, authorship, structured data, social all predicted to increase in importance.

2. EMD, paid links, anchor text expected to decrease.

Page 77: Hot Off the Press: 2013 Ranking Factors

#MozCon @mattthemathman