an image is worth more than a thousand favorites: surfacing the hidden beauty of flickr pictures

27
An Image is Worth More than a Thousand Favorites Surfacing the Hidden Beauty of Flickr Pictures

Upload: rossano-schifanella

Post on 28-Jul-2015

3.101 views

Category:

Art & Photos


7 download

TRANSCRIPT

An  Image  is  Worth  More  than  a  Thousand  Favorites  

Surfacing  the  Hidden  Beauty  of  Flickr  Pictures  

Rossano  Schifanella  Miriam  Redi  Luca  Maria  Aiello  @rschifan    @mad_astronaut    @lajello  

A   B  

A   B  

favorites  comments  views  

686  45  

18,475  

Popular   Unpopular  

favorites  comments  views  

3  1  

190  

98%  

2%   ≥  6    

≤5  

Flickr  100M  

99+  favorites  

Flickr  100M  

1  EXPLORE  UNPOPULAR  CONTENT  

2  SURFACE  HIDDEN  GEMS  

Crowdsourcing  image  aesthe]cs  judgments    

10K  photos  Full  popularity  range  

Evaluate  the  beauty  of  the  picture,  NOT  the  beauty  of  the  subject  

Instruc]ons   Examples  for  each  score  

Good  inter-­‐rater  agreement  

Large  ground  truth  of  aesthe]c  scores  made  by  non-­‐expert    di.unito.it/beautyicwsm15  

10K  photos  

60Kscores  

popularity  ~  beauty  (0.43)  

popular  photos  can  have  low  aesthe]c  value  

Full  range  of  beauty  judgments  

Flickr  100M  

beau]ful  hidden  photos    

0

5

10

15

20

25

30

0 5 10 15 20 25 30

aver

age

# favorites

CommentsPoolTags

unpopular  items  rarely  receive  social  feedback  

PARTIAL  LEAST  SQUARES  REGRESSION  

CrowdBeauty  

CROWDSOURCED  DATASET  

COMPOSITIONAL  VISUAL  FEATURES  

Photographic  Rules  

9M  Flickr  CC  pictures  200  top  CrowdBeauty    vs  baselines  

Evalua]on  

1  

1.5  

2  

2.5  

3  

3.5  

4  

people   urban   nature   animals  

Unpopular         Popular     CrowdBeauty      

CrowdBeauty  Evalua]on  Av

erag

e be

auty

sco

re

1  

1.5  

2  

2.5  

3  

3.5  

4  

people   urban   nature   animals  

CrowdBeauty       CVBaseline  

CrowdBeauty  Evalua]on  Av

erag

e be

auty

sco

re