does media concentration lead to biased coverage? evidence from movie reviews

45
Does Media Concentration Lead to Biased Coverage? Evidence from Movie Reviews Stefano DellaVigna, UC Berkeley and NBER Alec Kennedy, San Francisco Fed Moscow Media Conference October 29, 2011 Preliminary, comments most welcome

Upload: iorwen

Post on 13-Feb-2016

54 views

Category:

Documents


4 download

DESCRIPTION

Does Media Concentration Lead to Biased Coverage? Evidence from Movie Reviews. Stefano DellaVigna, UC Berkeley and NBER Alec Kennedy, San Francisco Fed Moscow Media Conference October 29, 2011 Preliminary, comments most welcome. Introduction. - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Does Media Concentration Lead to Biased Coverage? Evidence from Movie Reviews

Does Media Concentration Lead to Biased Coverage? Evidence from Movie

Reviews

Stefano DellaVigna, UC Berkeley and NBERAlec Kennedy, San Francisco Fed

Moscow Media ConferenceOctober 29, 2011

Preliminary, comments most welcome

Page 2: Does Media Concentration Lead to Biased Coverage? Evidence from Movie Reviews

Introduction Dec. 13, 2007: News Corp. acquires from

Bancroft family Dow Jones & Company Wall Street Journal

Unlike Bancroft family, Murdoch's holdings include:

Cable channels (i.e., Fox Sports and Fox News) Satellite television (Sky group) Movie distributor (20th Century Fox) …

Media conglomerate implies conflict of interest Coverage of such businesses (or their competitors) in the Wall Street Journal may be biased.

Page 3: Does Media Concentration Lead to Biased Coverage? Evidence from Movie Reviews

Introduction Wall Street Journal situation hardly unique Media conglomerates:

Comcast owns NBC Hearst Corporation owns ESPN and print outlets Time Warner owns AOL and Time magazine

Pervasive conflict of interest

But should media consolidation lead to distortion?

Cost: Loss of reputation if bias is revealed Benefit: Can persuade audience (if audience naïve

about bias) Generally, persuasion rates of 5-10% from the

media (DellaVigna-Gentzkow, ARE 2010)

Page 4: Does Media Concentration Lead to Biased Coverage? Evidence from Movie Reviews

Introduction

This paper: Focus on two conglomerates News Corp. Time-Warner

Measure how media outlets in these groups review movies distributed by an affiliate

20th Century Fox Warner Bros.

Identification of bias transparent (diff-in-diff): Compare review of 20th Century Fox movie by WSJ

and NYT Further control group: review of Paramount movie

by WSJ and NYT

Page 5: Does Media Concentration Lead to Biased Coverage? Evidence from Movie Reviews

Introduction

Why movie reviews?1. Frequent (500,000+ reviews in data set)2. Easily quantifiable (coded on 0-100 scale by

metacritic.com)3. Large industry ($60bn annual revenue)4. Some evidence that movie reviews influence

movie attendance (Reinstein and Snyder (2005) benefits to the distributor from increased ticket sales

Page 6: Does Media Concentration Lead to Biased Coverage? Evidence from Movie Reviews

Data First data set of reviews from metacritic.com,

scored 0-100

Page 7: Does Media Concentration Lead to Biased Coverage? Evidence from Movie Reviews

Data Second data set of reviews from

rottentomatoes.com, scored on a 0-1 “freshness” scale

Page 8: Does Media Concentration Lead to Biased Coverage? Evidence from Movie Reviews

Data Merged data set contains 548,764 reviews

from 336 media from 1985 to July 2011

Media Outlet Media Type Years Owner

No. of Reviews While

Owned

No. of Reviews

While Not Owned

Usual Rating System

All Reviews 336 media 1985-2011 17039 531725 VariesChicago Sun-Times Newsp. 1985-2011 News Corp. until 1986 186 5833 0 to 4 stars (1/2

allowed)New York Post Newsp. 1998-2011 News Corp. from 1993 6278 - 0 to 4 stars (1/2 allowed)News Of The World Newsp. (UK) 2008-2011 News Corp. 407 - 0 to 5 stars

TV Guide Weekly 1985-2009 New Corp. 1988-99 980 4876 0 to 4 stars (1/2 allowed)Times Newsp. (UK) 2003-2011 News Corp. 960 - 0 to 5 stars

Wall Street Journal Newsp. 1985-2011 News Corp. from 2008 555 1218 QualitativeCNN.com Website 1997-2007 Time Warner 528 - QualitativeEntertainment Weekly Weekly 1990-2011 Time Warner from 1990 4889 - A to F (+/-

allowed)Time Weekly 1985-2010 Time Warner from 1990 1375 97 QualitativeOther Reviews 326 media 1985-2011 - 519701 Varies

TABLE 1, PANEL ASUMMARY STATISTICS: MEDIA SOURCES OF MOVIE REVIEWS

Page 9: Does Media Concentration Lead to Biased Coverage? Evidence from Movie Reviews

Data Studios which distribute movies in the

sample: Major, Independent, and Other

Distributor of Movie (Studio) Studio Type Years Owner

No. of Reviews

No. of Movies

All Studios 1985-2011 548764 1299920th Century Fox Major 1985-2011 News Corp. 32159 449Fox Searchlight Independent 1995-2011 News Corp. 12547 126Fox (Other) Other 1987-2010 News Corp. 390 13Warner Bros. Major 1989-2011 Time Warner from 1989 44162 575Fine Line Independent 1990-2005 Time Warner from 1989 3764 80HBO Independent 1989-2010 Time Warner from 1989 605 64New Line Independent 1989-2008 Time Warner from 1989 16667 233Picturehouse Independent 2005-2009 Time Warner from 1989 2590 34Warner Independent Independent 2004-2008 Time Warner from 1989 2733 26Warner Home Video Other 1989-2009 Time Warner from 1989 783 59Other Studios 1985-2011 432364 11423

TABLE 1, PANEL BSUMMARY STATISTICS: STUDIOS

Notes: The sources of the movie review data are www.metacritic.com (abbreviated MC) and www.rottentomatoes.com (abbreviated RT). The data covers all reviews available from 1985 until July 2011. See text for additional information.

Page 10: Does Media Concentration Lead to Biased Coverage? Evidence from Movie Reviews

Average Bias: News Corp.0

2040

60News Corp. Studio Other Studios

Mean of the FOX-affiliated publications average score by movieMean of the non-FOX-affiliated publications average score by movie

No. movies (l-to-r):406, 6976.

Mov

ie ra

ting

Graphs by distribution

Page 11: Does Media Concentration Lead to Biased Coverage? Evidence from Movie Reviews

Average Bias: Time Warner0

2040

6080

Time Warner Studio Other Studios

Mean of the TW-affiliated publications average score by movieMean of the non-TW-affiliated publications average score by movie

No. movies (l-to-r):602, 4307.

Mov

ie ra

ting

Graphs by distribution

Page 12: Does Media Concentration Lead to Biased Coverage? Evidence from Movie Reviews

Average Bias: Statistical Test Is the bias for News Corp. statistically significant? Is it robust to introducing controls? OLS regression

captures the effect of conflict of interest in Fox

captures the effect of conflict of interest in Time Warner

Sample of 473,727 reviews (qualitative reviews in RT have no 0-100 score)

Standard errors clustered at the movie level

Page 13: Does Media Concentration Lead to Biased Coverage? Evidence from Movie Reviews

Average Bias: Statistical Test

Specification: OLS RegressionsDep. Var.:

(1) (2) (3) (4)1.0285 1.0886 2.0749** 2.5651***

News Corp. [0.9381] [0.9371] [0.8133] [0.7966]-1.2510 -1.2101 -1.0430 -0.4998

Time Warner [0.7937] [0.7925] [0.6832] [0.6829]-2.9916*** -3.0534***

[0.7443] [0.7418]-3.2318*** -3.2496***

[0.6252] [0.6246]-4.9151*** -4.8264*** -4.4181*** -1.7450***

[0.2299] [0.2186] [0.1939] [0.4612]4.2613*** 4.4035*** 3.7427*** 4.4895*[0.2763] [0.2724] [0.2428] [2.6362]

Year Fixed Effects X X XMovie Fixed Effects X XMedia Outlet f.e. X

0 0.01 0.41 0.46N=474,496 N=474,496 N=474,496 N=474,496

TABLE 2CONFLICT OF INTEREST: AVERAGE BIAS IN REVIEW

Conflict of Interest for

Conflict of Interest for

Movie Review on a 0-100 Scale

Control Variables:

20th Century Fox Movie

Warner Brothers Movie

Media Owned by News Corp.

Media Owned by Time Warner

R2

N

Page 14: Does Media Concentration Lead to Biased Coverage? Evidence from Movie Reviews

Average Bias: Statistical Test

Specification:Dep. Var.:

(1) (2) (3) (4)1.0285 1.0886 2.0749** 2.5651***

News Corp. [0.9381] [0.9371] [0.8133] [0.7966]-1.2510 -1.2101 -1.0430 -0.4998

Time Warner [0.7937] [0.7925] [0.6832] [0.6829]

Year Fixed Effects X X XMovie Fixed Effects X XMedia Outlet f.e. X

61.52 61.52 61.52 61.52

p = 0.0658* p = 0.0633* p = 0.0035*** p = 0.0037***

0 0.01 0.41 0.46N=474,496 N=474,496 N=474,496 N=474,496

Conflict of Interest for

Conflict of Interest for

TABLE 2CONFLICT OF INTEREST: AVERAGE BIAS IN REVIEW

OLS RegressionsMovie Review on a 0-100 Scale

Control Variables:

R2

N

Mean of Dependent Variablep-value of test of equality of conflict of interest for News Corp. and Time Warner:

Page 15: Does Media Concentration Lead to Biased Coverage? Evidence from Movie Reviews

Average Bias: Statistical Test In favorite specification, conflict of interest

increases rating for News Corp. by 2.6 points out of 100

Estimate of bias increases with extra controls Unobservables unlikely to bias coefficient upward (Altonji, Elder, and Taber, 2005)

Magnitude of bias: Equivalent to 1 extra star every ten reviews Small but still economically significant impact

Reinstein and Snyder (2005) estimate 25% higher revenue for two thumbs up by Roger Ebert

Are all media conglomerates the same? No evidence of bias for Time Warner, can reject

bias of 0.9 points

Page 16: Does Media Concentration Lead to Biased Coverage? Evidence from Movie Reviews

Average Bias: Robustness Evidence of bias using RT 0-1 freshness

indicator

Specification:Dep. Var.:

(1) (2) (3) (4)0.0305 0.0294 0.0618*** 0.0659***

News Corp. [0.0228] [0.0228] [0.0207] [0.0206]-0.0041 -0.0046 -0.0197 -0.0127

Time Warner [0.0184] [0.0184] [0.0177] [0.0176]

Year Fixed Effects X X XMovie Fixed Effects X XMedia Outlet f.e. X

0.59 0.59 0.59 0.59

p = 0.2397 p = 0.2460 p = 0.0027*** p = 0.0038***

0 0.01 0.28 0.32N=494,460 N=494,460 N=494,460 N=494,460

Conflict of Interest for

Conflict of Interest for

Control Variables:

Mean of Dependent Variablep-value of test of equality of conflict of interest for News Corp. and Time Warner:

R2

TABLE 3CONFLICT OF INTEREST:FRESHNESS INDICATOR

OLS RegressionsIndicator for "fresh" in Movie Review

N

Page 17: Does Media Concentration Lead to Biased Coverage? Evidence from Movie Reviews

Calculation of benefits

Back-of-the-envelope calculation of estimated benefits from distortion of movie review

Case of New York Post (NYP) Suppose that NYP gives one extra star per Fox movie 500,000 average readers Persuades an extra 1% of readers to watch movie Ticket sales increase by 5,000, or $8*5,000=$40,000 Studio receives about half of increased sales, plus

another half from higher rights from DVD licensing $40,000

About 400 20th Century Fox movies since 1985

Potential benefits to NewsCorp. from one extra star per Fox review by NYP over 25 years: $16,ooo,ooo

Page 18: Does Media Concentration Lead to Biased Coverage? Evidence from Movie Reviews

Average Bias: Explanations Three main explanations for the results:

(E) Explicit editorial policy conveyed to journalists (J) Bias by a journalist ultimately due to the conflict

of interest, but lacking editorial pressure (T) Correlation in taste between the media

reviewer (or the media audience) and the affiliated studio

To separate explanations, we present evidence on:

Clustering of bias within a conglomerate (E and T, maybe J)

Editorial policies (E only) Selective bias by type of movie (E or J, not T) Omission of reviews (E or J)

Page 19: Does Media Concentration Lead to Biased Coverage? Evidence from Movie Reviews

Clustering of Bias: By Media

News Corp. media: Statistical evidence for NYP, 2-3 point bias for all 6 mediaNo evidence of bias for any of the Time Warner media

Specification:

Chicago SunTimes

New York Post

News of the World TV Guide Times (UK)

Wall Street Journal CNN.com

Entertainment Weekly Time

(1) (2) (3) (4) (5) (6) (7) (8) (9)Panel A.Dep Var.: Score (0-100)

2.3530 3.1382*** 3.8096 2.4169 0.0286 0.5175 . -0.3039 -0.9717[4.8051] [0.9877] [3.2221] [1.6519] [2.2918] [3.1342] . [0.7363] [1.3957]

0.49 0.45 0.48 0.43 0.46 0.46 . 0.46 0.41N=3,314 N=362,309 N=36,787 N=46,740 N=73,318 N=47,888 . N=362,266 N=127,688

Panel B.Dep Var.: Indicator for Fresh in Rottentomatoes

-0.0166 0.0718*** 0.0130 0.0672 0.0598 0.1120* -0.0541 -0.0027 -0.0079[0.1261] [0.0258] [0.0769] [0.0913] [0.0593] [0.0615] [0.0436] [0.0208] [0.0457]

0.38 0.30 0.31 0.32 0.30 0.29 0.29 0.31 0.27N=3,435 N=381,533 N=40,551 N=42,286 N=82,516 N=50,265 N=73,883 N=379,758 N=133,835

Movie Fixed X X X X X X X X XMedia Outlet X X X X X X X X X

R2

N

Conflict of Interest

R2

NControl Variables:

TABLE 4THE EFFECT OF CONFLICT OF INTEREST ON MOVIE REVIEWS: BY MEDIA

OLS RegressionsNews Corp. Conflict of Interest Time Warner Conflict of Interest

Conflict of Interest

Page 20: Does Media Concentration Lead to Biased Coverage? Evidence from Movie Reviews

Clustering of Bias: By Journalist

Most media have a small number of journalists reviewing movies

Chicago Sun-Times, News of the World, Wall Street Journal and CNN.com have essentially only one

Media Outlet Reviewer Name No. ReviewsPanel A. News Corp. OutletsChicago Sun-Times Roger Ebert 184New York Post Lou Lumenick 2236New York Post V.A. Musetto 1618New York Post Kyle Smith 1154New York Post Jonathan Foreman 622New York Post Megan Lehmann 366News of the World Robbie Collin 407TV Guide Maitland McDonagh 370TV Guide Ken Fox 134Times Wendy Ide 377Times James Christopher 377Wall Street Journal Joe Morgenstern 286Panel B. Time Warner OutletsCNN.com Paul Clinton 252Entertainment Weekly Owen Gleiberman 2307Entertainment Weekly Lisa Schwarzbaum 1946Time Richard Corliss 724Time Richard Schickel 502

INDIVIDUAL REVIEWERSTABLE 5

Page 21: Does Media Concentration Lead to Biased Coverage? Evidence from Movie Reviews

Clustering of Bias: By Journalist

News Corp: Statistical evidence of bias for 3 out of 4 NYP journalists, and one of TV Guide journalistsTime Warner: No evidence of positive biasSignificant Clustering: Pattern suggestive of editorial bias, but could also be correlated tastes, or similar journalists

Specification:

Lou Loumenick Kyle Smith

Jonathan Foreman

Megan Lehmann

Maitland McDonagh Ken Fox

Owen Gleiberman

Lisa Schwarzbau

m

Richard Corliss

Richard Schickel

(1) (2) (3) (4) (5) (6) (7) (8) (9) (10)Panel A.Dep Var.: Score (0-100)

3.0068** 6.0914*** -0.2606 5.4902* 6.0412*** -4.2065 -0.3830 -0.4791 0.9784 -4.6170**[1.3149] [2.3501] [2.8959] [3.1414] [2.1031] [5.0740] [1.1448] [1.0141] [1.8489] [2.3329]

0.46 0.45 0.46 0.44 0.43 0.47 0.44 0.45 0.42 0.38N=165,133 N=82,384 N=42,165 N=25,553 N=20,826 N=5,708 N=172,627 N=152,808 N=71,569 N=43,975

Panel B.Dep Var.: Indicator for Fresh in Rottentomatoes

0.0614* 0.1537*** 0.0368 0.1479* 0.2377** 0.0105 -0.0097 0.0059 0.0511 -0.0182[0.0348] [0.0558] [0.0769] [0.0837] [0.0918] [0.1812] [0.0309] [0.0298] [0.0639] [0.0719]

0.30 0.31 0.31 0.31 0.32 0.35 0.30 0.30 0.28 0.26N=175,793 N=87,197 N=45,559 N=25,634 N=20,214 N=5,326 N=180,977 N=162,379 N=75,084 N=46,505

Conflict of Interest

R2

N

Conflict of Interest

R2

N

TABLE 6THE EFFECT OF CONFLICT OF INTEREST ON MOVIE REVIEWS: BY REVIEWER

OLS RegressionsNews Corp. Conflict of Interest Time Warner Conflict of Interest

New York Post TV Guide Entertainment Weekly Time

Page 22: Does Media Concentration Lead to Biased Coverage? Evidence from Movie Reviews

Editorial PoliciesTwo tests of editorial policies1.Personnel Policy: Change of reviewers at change

of ownership – No evidence2.Bias in Assignment: Assign affiliated movies to

more generous reviewers Estimate average reviewer generosity in score:

Reviewers differ significantly in their generosity Are movies by affiliate studios more likely to be

assigned to more generous reviewer? No evidence– assignment quasi-random

Bias at Newscorp. is unlikely of editorial originCould be correlation in journalist bias or in tastes

Page 23: Does Media Concentration Lead to Biased Coverage? Evidence from Movie Reviews

Editorial Policies

Media Outlet Reviewer NameNo. of

ReviewsF.e. for Average

Score (s.e.)Share reviews of affiliated studio

Panel A. News Corp. OutletsChicago Sun-Times Roger Ebert ('85-'11) 184 10.23 (.46) 8.70%New York Post Lou Lumenick ('98-'11) 2236 -2.19 (.56) 6.98%New York Post V.A. Musetto ('98-'11) 1618 -1.34 (.57) 0.25%New York Post Kyle Smith ('05-'11) 1154 -7.38 (.78) 6.67%New York Post Jonathan Foreman ('98-'04) 622 -0.74(.80) 6.91%New York Post Megan Lehmann ('02-'04) 366 -3.81 (.98) 7.10%News of the World Robbie Collin ('08-'11) 407 -0.62 (1.17) 9.09%TV Guide Maitland McDonagh ('97- 370 -0.60 (.48) 9.19%TV Guide Ken Fox ('97-'08) 134 4.29 (.50) 9.70%Times Wendy Ide ('03-'10) 377 -7.82 (.96) 5.31%Times James Christopher ('03-'10) 377 -4.59 (1.28) 9.09%Wall Street Journal Joe Morgenstern ('01-'11) 286 -3.64 (.66)Panel B. Time Warner OutletsCNN.com Paul Clinton ('98-'05) 252 . 22.46%Entertainment Weekly Owen Gleiberman ('90-'11) 2307 6.49 (.58) 12.83%Entertainment Weekly Lisa Schwarzbaum ('94-'11) 1946 8.41 (.53) 11.97%Time Richard Corliss ('85-'11) 724 3.53 (.88) 16.71%Time Richard Schickel ('85-'08) 502 2.50 (1.11) 16.73%

TABLE 5REVIEWERS FOR MEDIA AT RISK OF CONFLICT OF INTEREST

Page 24: Does Media Concentration Lead to Biased Coverage? Evidence from Movie Reviews

Selective Bias If bias is due to conflict of interest, should be

optimal: Bias when marginal return (persuasion) is highest Maximize impact on revenue Proposition 2. Small or no bias for very low

quality movies If bias is due to correlated tastes, no such

prediction

Assumption for this test: Movies with negative reviews by others are

unlikely to benefit from a lone positive review Movies with other positive reviews more likely to

benefit from more positive review

Page 25: Does Media Concentration Lead to Biased Coverage? Evidence from Movie Reviews

Selective Bias: News Corp.

Page 26: Does Media Concentration Lead to Biased Coverage? Evidence from Movie Reviews

Selective Bias: News Corp.

Page 27: Does Media Concentration Lead to Biased Coverage? Evidence from Movie Reviews

Selective Bias: New York Post

Page 28: Does Media Concentration Lead to Biased Coverage? Evidence from Movie Reviews

Selective Bias: Time Warner

Page 29: Does Media Concentration Lead to Biased Coverage? Evidence from Movie Reviews

Selective Bias: Statistical Evidence

Evidence of selective bias for NYPost and qualitatively for WSJ – Bias due to conflict of interestNo evidence for other media

Specification:Dependent Variable:

Chicago SunTimes

New York Post

News of the World TV Guide Times (UK)

Wall Street Journal CNN.com

Entertainment Weekly Time

(1) (2) (3) (4) (5) (6) (7) (8) (9)-1.8511 1.6053 9.3846** 2.7745 3.0971 -0.4418 . 0.0172 -1.3100[8.1669] [1.5719] [4.5067] [3.1145] [3.1936] [4.6435] [1.2686] [3.4622]6.6737 1.2414 -15.0553** -3.4936 -5.8530 6.0759 . -0.1049 0.9607

(55<Average Rating<=70) [8.9600] [2.2644] [6.9450] [3.9723] [5.8224] [6.6080] [1.7136] [4.0386]-5.5183 5.6198*** 5.5208 -0.1861 -6.4469 2.1793 . 1.2430 1.6107

(Average Rating>70) [8.7293] [2.1265] [6.1254] [3.9991] [5.0638] [6.2369] [1.7644] [3.9919]

0.58 0.48 0.51 0.47 0.49 0.48 . 0.48 0.43N=3,314 N=362,272 N=36,772 N=46,740 N=73,308 N=47,880 . N=362,230 N=127,682

Movie Fixed Effects X X X X X X X X XMedia Outlet Fixed X X X X X X X X XMedia f.e. *(55<Average Movie Rating<=70)

X X X X X X X X X

Media f.e. *(Average Movie Rating>70)

X X X X X X X X X

Conflict of Interest

Conflict of Interest *

Conflict of Interest *

R2

NControl Variables:

TABLE 7THE EFFECT OF CONFLICT OF INTEREST ON MOVIE REVIEWS: SELECTIVE BIAS

OLS RegressionsMovie review score (0-100)

News Corp. Conflict of Interest Time Warner Conflict of Interest

Page 30: Does Media Concentration Lead to Biased Coverage? Evidence from Movie Reviews

Bias by Omission If bias is due to conflict of interest, and audience

not fully rational, bias by omission: Review high-quality affiliated movies Omit review of low-quality affiliated movies

Do not expect this pattern if correlated tastes Rare setting to separate bias by omission and by

commission

Outlets differ substantially in probability of review Use matching procedure

For each media, find ten matching media in terms of average probability of review of a movie

Plot local polynomial regression of dummy for review on average review score

Page 31: Does Media Concentration Lead to Biased Coverage? Evidence from Movie Reviews

Bias by Omission: New York Post

Page 32: Does Media Concentration Lead to Biased Coverage? Evidence from Movie Reviews

Bias by Omission: Time

Page 33: Does Media Concentration Lead to Biased Coverage? Evidence from Movie Reviews

Bias by Omission: Entertainment Weekly

Page 34: Does Media Concentration Lead to Biased Coverage? Evidence from Movie Reviews

Bias by Omission: Statistical Test

Newscorp.: No systematic evidence of omission biasTime Warner: Evidence for 2 outletsBias by omission and by commission substitutes, not complement

Specification:Dependent Variable:

Chicago SunTimes

New York Post

News of the World TV Guide Times (UK)

Wall Street Journal CNN.com

Entertainment Weekly Time

(1) (2) (3) (4) (5) (6) (7) (8) (9)-0.0189* 0.0011 -0.0008 0.0039* -0.0035** 0.0051* 0.0024** 0.0004 0.0034***

Average Rating [0.0103] [0.0012] [0.0027] [0.0022] [0.0016] [0.0027] [0.0010] [0.0007] [0.0009]1.0969* -0.1214 -0.0142 -0.1896 0.1329 -0.3019** -0.0903 0.0939** -0.1493***[0.5838] [0.0750] [0.1546] [0.1212] [0.0936] [0.1439] [0.0605] [0.0388] [0.0483]

0.31 0.52 0.44 0.44 0.32 0.48 0.23 0.48 0.34N=3,278 N=109,747 N=28,974 N=37,048 N=76,978 N=28,974 N=85,316 N=133,331 N=133,342

Movie f.e. X X X X X X X X XMedia f.e. X X X X X X X X XMedia f.e.*Av. Rating

X X X X X X X X X

Potential review in featured media and in each of 10 matched media, with match based on similar average probability of review

Conflict of Interest *

Conflict of Interest

R2

NControl Variables:

Sample:

TABLE 8CONFLICT OF INTEREST AND OMISSION BIAS: MISSING REVIEWS

OLS RegressionsIndicator variable for review of a movie by media m

News Corp. Conflict of Interest Time Warner Conflict of Interest

Page 35: Does Media Concentration Lead to Biased Coverage? Evidence from Movie Reviews

Bias in Movie Aggregator So far focus on most obvious conflict, for

reviewers

Conflict of interest hardly stops there: Rottentomatoes.com, also independent when launched in 1998, was acquired by IGN Entertainment in June 2004, and IGN was purchased by News Corp. in September 2005. IGN, and hence RottenTomatoes, was then sold in January of 2010 by Newscorp.

Conflict of interest for RT: more positive reviews of the 20th Century Fox movies in 2006-2009

Control for rating of same review in MC

Page 36: Does Media Concentration Lead to Biased Coverage? Evidence from Movie Reviews

Bias in Movie Aggregator

Remarkably, no evidence of bias, even for qualitative reviews, where bias is easier to hide

Can reject small bias

Specification:Dep. Var.: RT 0-100 Score

(2) (3) (4) (5) (6) (7) (8)-0.0637* -0.0073 -0.0075 0.0002 -0.0557 -0.0049 -0.1609

(RT owned by Newscorp.: 2006-09) [0.0330] [0.0069] [0.0069] [0.0084] [0.0349] [0.0188] [0.1471]-0.0366** -0.0082** -0.0070* -0.0060 -0.0470** -0.0255** -0.1698*[0.0161] [0.0037] [0.0038] [0.0049] [0.0185] [0.0111] [0.0948]

0.0182*** 0.0183*** 0.0394***[0.0001] [0.0001] [0.0002]

0.0174*** 0.9597***[0.0001] [0.0012]

Year Fixed Effects X X X X X X XMedia Outlet Fixed Effects X X X X X X X

Only Reviews Scored in RT

Reviews with 50<=Score<=70

Reviews Scored in RT and MC

0.04 0.64 0.65 0.57 0.05 0.56 0.94N=419,375 N=419,375 N=394,908 N=152,343 N=97,375 N=24,467 N=53,108

R2

N

RottenTomatoes 0-1 "Freshness" indicator

0-100 Review Score

0-100 MetaCritic Review Score

Control Variables:

Sample:Only Reviews Unscored

in RT

TABLE 10BIAS IN ROTTEN TOMATO: EFFECT OF NEWSCORP. OWNERSHIP

OLS Regressions

Indicator for 20th Century Fox Movie *

Indicator for 20th Century Fox Movie

Page 37: Does Media Concentration Lead to Biased Coverage? Evidence from Movie Reviews

Bias in Movie Aggregator

Local polynomial regression of ‘fresh’ indicator on average movie score – no evidence of bias

Page 38: Does Media Concentration Lead to Biased Coverage? Evidence from Movie Reviews

Bias in Movie Aggregator

Event study comparing residual freshness (after controlling for score) for FOX and non-FOX movies

Page 39: Does Media Concentration Lead to Biased Coverage? Evidence from Movie Reviews

We documented the extent of bias due to conflict of interest for two media conglomerates

Average bias: 2.6 points bias out of 100 for Newscorp. outlets No bias for Time Warner outlets, can reject even small bias

Bias is clustered within a media conglomerate No evidence of editorial policy to assign movies

Selective Bias: Evidence for New York Post, not for other media

Omission Bias: Evidence for two Time Warner outlets

Interpretation: Best fits with bias due to conflict of interest for journalists, with

clustering of such bias

Summary of Results

Page 40: Does Media Concentration Lead to Biased Coverage? Evidence from Movie Reviews

Overall, remarkably little evidence of distortion from conflict of interest: No distortion in review for Time Warner No distortion for Rottentomatoes No distortion in editorial assignment

However, bias still does occur: Small, but significant, bias for Newscorp. Outlets Some omission bias for Time Warner outlets

Suggests that transparency and emphasis on reputation (for example because of competition) critical to keep media honest

Paper allowed us to decompose potential media bias in novel ways

Relates to Conflict of interest in other settings: Significantly less distortion than for analysts Less distortion than for advertising

Conclusion

Page 41: Does Media Concentration Lead to Biased Coverage? Evidence from Movie Reviews
Page 42: Does Media Concentration Lead to Biased Coverage? Evidence from Movie Reviews

Average Bias

Page 43: Does Media Concentration Lead to Biased Coverage? Evidence from Movie Reviews

Average Bias

Page 44: Does Media Concentration Lead to Biased Coverage? Evidence from Movie Reviews

Selective Bias II Different types of movies can have different

returns to positive reviews Snyder and Reinstein: Larger effect of movie

reviews for independent movies However: Independent movies also have

smaller revenue, so bias may be less worthwhile

Examine the effect of conflict of interest separately

Page 45: Does Media Concentration Lead to Biased Coverage? Evidence from Movie Reviews

Selective Bias: Indy movies

Significant bias for News Corp. only for mainstream movies

Specification:

Dep. Var.:

Sample:(1) (2) (3) (4)

2.5983* 2.8442** 1.6165 1.3400(Measure of Conflict of Interest for News Corp.) [1.4236] [1.3612] [3.0139] [3.1804]

0.4313 0.3885 2.1168 3.1600(Measure of Conflict of Interest Time Warner) [1.0724] [0.9885] [2.2233] [2.4409]

Full Set of Fixed Effects X X

0.0084 0.5381 0.0564 0.619N=109,669 N=109,669 N=5,895 N=5,895

Indicator for Fox Movie on News Corp.-Owned Outlet

Indicator for Warner Bros. Movie on TW-Owned Outlet

Control Variables:

R2

N

TABLE 6CONFLICT OF INTEREST AND MOVIE REVIEWS: MAINSTREAM AND INDY MOVIES

OLS Regressions

Movie Review on a 0-100 Scale for Movie m in Media Outlet o

Mainstream Movies Indy Movies