metadata for manga: metadata vocabulary, schema and tools

36
Metadata for manga: Metadata vocabulary, schema and tools Shigeo Sugimoto Faculty of Library, Information and Media Science University of Tsukuba Japan sugimoto @ slis.tsukuba.ac.jp 2015/8/12 1

Upload: vutuyen

Post on 21-Dec-2016

235 views

Category:

Documents


3 download

TRANSCRIPT

Page 1: Metadata for manga: Metadata vocabulary, schema and tools

Metadata  for  manga: Metadata  vocabulary,  schema  and  tools

Shigeo SugimotoFaculty  of  Library,  Information  and  Media  Science

University  of  TsukubaJapan

sugimoto@  slis.tsukuba.ac.jp

2015/8/12 1

Page 2: Metadata for manga: Metadata vocabulary, schema and tools

Outline

• Background  of  this  talk• Introducing  manga• Why  metadata  for  manga  ?• Pop-­‐culture  resource  description• Digital  and  network-­‐oriented  production  and  publishing  environment

• Manga  metadata  projects  at  Tsukuba• Manga  Metadata  Framework• Identification  of  Works using  bibliographic  records• Software  tools  to  help  create  and  access

• Issues  for  the  future

2015/8/12 2

Page 3: Metadata for manga: Metadata vocabulary, schema and tools

Some  Background  Issues• Manga  – Comics,  Graphic  Novels  – is  a  major  genre  of  Japanese  pop-­‐culture  resources• Many  spin-­‐off  products  of  manga,  e.g.,  anime  and  games• Important  genre  since  early  stage  of  digital  publishing  on  mobile  phones

• Manga  was  not  collected  by  libraries  because  they  were  regarded  as  a  sub-­‐culture  resource• Lack  of  well-­‐developed  resources  for  manga,  e.g.  authority  files• Efforts  to  describe  manga

• Recent  manga  collection  development  at  libraries  and  museums,  e.g.  Kyoto  International  Manga  Museum,  Manga  collection  at  JSC  of  Monash,  etc.

• Media  Arts  Database  by  Agency  for  Cultural  Affairs  of  the  Japanese  Government  

• This  talk  covers  mainly  from  technological  aspects  of  metadata• Intellectual  Property  Rights  (IPR)  issues  are  crucial  but  not  mentioned

2015/8/12 3

Page 4: Metadata for manga: Metadata vocabulary, schema and tools

Introducing  Manga

• Manga  -­‐ a  Japanese  term  meaning  comics,  graphic  novels• what  is  manga?,  how  it  looks  like?,  and  who  creates?

• Manga  and  their  related  resources• Primary  manga  entities• Primary  entities  created  from  manga  entities  – spin-­‐off  products• Secondary  entities  about  manga

• Production  process  and  components  of  manga

2015/8/12 4

Page 5: Metadata for manga: Metadata vocabulary, schema and tools

Manga  

5

Various  publishing   styles  – magazines  (serials),  monographs,   Web  pages.   Multi-­‐modal  content  – images,  texts,  symbols,   layouts  

and  grammar2015/8/12

Page 6: Metadata for manga: Metadata vocabulary, schema and tools

Different  Styles  of  Digital  Manga

2015/8/12 6

Scroll  style

Social  stream

Manga

Book  style

Page 7: Metadata for manga: Metadata vocabulary, schema and tools

Manga  Fans  Community• Comic  Market  – Big  Market  and  Forum  for  Amateur  Creators  and  Fans

• 3  days  event,  twice  a  year  • 35,000  individuals  and  groups,  mostly  non-­‐professionals• 500K+  people  at  a  single  event

72015/8/12

Page 8: Metadata for manga: Metadata vocabulary, schema and tools

Web  Resources  created  by  Manga  Fans

8

Wikipedia  Article  “Naruto” A  review  about  manga  in  Amazon.co.jp

Customer  Review(Point)

Customer  Review(Comment)

2015/8/12

Page 9: Metadata for manga: Metadata vocabulary, schema and tools

Various  Resources  related  to  a  “Work”  of  manga-­‐ NARUTO,  a  popular  manga,  as  an  example  -­‐

9

Bibliographic  Records• Libraries• Commercial  providers  (publishers,  bookstores)

User-­‐generated  Article• Story• Character

Transmedia  products• Animation• Music• Game• etc.

Reviews  and  Chatting  on  SNS

Entities  of  NARUTOItems/Manifestations,

Works

2015/8/12

Page 10: Metadata for manga: Metadata vocabulary, schema and tools

Components  of  manga  – another  view• Manga  has  many  components  which  are  connected  each  other  àManga  creation  is  to  manage  them

10

Manga

Wikipedia

Bookstore

SNS

Portal

Creator,Publisher

Character Story

Picture Text

2015/8/12

Page 11: Metadata for manga: Metadata vocabulary, schema and tools

Production  Process  – Storyboard  (Name)• Manga  creator  makes  many  storyboards(called  “Name”  in  Japanese  publishers  and  creators  community)  to  explain  their  plan  of  the  story  and  their  ideas  about  the  graphic  expressions  to  his/her  collaborator,  e.g.,  publishers  and  editors• Edit  a  Name where  graphic  objects  and  their  descriptions  are  given

11

Name Rough Product

2015/8/12Instances  created  in  a  production  process

Page 12: Metadata for manga: Metadata vocabulary, schema and tools

Structure  a  Manga  page

12Components

Frame

Dialog

Character

Symbol

2015/8/12

Page

Scene

Page 13: Metadata for manga: Metadata vocabulary, schema and tools

Why  metadata  for  Manga  ?  

• Fundamental  changes  in  the  whole  lifecycle• Creators’  environment• From  “paper  and  pencil”  to  drawing  tools  for  production

• Publishing  environment  changes• from  print-­‐only  publishing  to  print  &  network  publishing

• Readers’  environment• from  print-­‐based  reading  to  network-­‐assisted  reading,  e.g.,  SNS

• Information  environment  -­‐-­‐-­‐ Resources  born  in  Digital  • What  is  the  difference  between  digital  manga  and  digital  movie?• Various  resources  used  in  a  unified  environment  – controlled  by  metadata  

2015/8/12 13

Page 14: Metadata for manga: Metadata vocabulary, schema and tools

What  metadata  for  Manga  ?  

• Two  viewpoints  – bibliographic  description  and  structural  description• Bibliographic  description  – primarily  as  finding  aids

• Libraries  – use  standards  for and  conventions  at  libraries,  e.g.,  MARC  and  Item-­‐level  description

• Non-­‐Library  – project-­‐based  databases,  publishers/booksellers’  sites,  Internet  resources,  e.g.,  Wikipedia

• Structural  description• Structure  of  published  materials  – relationships  between  contents  in  serials  and  monographs,  monographs  and  series

• Structural  description  of  constructs  of  manga  – Manga  specific  features,  e.g.,  serial  number,  volume,  page,  frame,  texts,  onomatopoeia

• Relationship  description  of  a  manga  and  related  resources  – spin-­‐off  products,  leading  characters,  etc.

2015/8/12 14

Page 15: Metadata for manga: Metadata vocabulary, schema and tools

Entities  in  a  typical  commercial  publishing  model1. Publication  in  a  magazine  as  a  series

(if  it  gets  good  feedbacks)2. Publication  as  a  monograph

(if  it  gets  good  feedbacks)3. Publication  of  the  monograph  as  a  series  4. Spin-­‐off  products  – animations,  games,  character  goods,  etc.

2015/8/12 15

Page 16: Metadata for manga: Metadata vocabulary, schema and tools

Entities  in  a  typical  commercial  publishing  model  and  their  descriptions1. Publication  in  a  magazine  as  a  series    à Each  manga  in  a  single  

volume  is  not  described  in  library  bibliographic  data2. Publication  as  a  monograph    à Item level  description3. Publication  of  the  monograph  as  a  series  àWork?4. Spin-­‐off  products  – animations,  games,  character  goods,  etc.  à

Relationships  among  the  entitiesà Fans  create  rich  information  resources  for  these  entities

2015/8/12 16

Page 17: Metadata for manga: Metadata vocabulary, schema and tools

Entities  in  metadata  description

• Manga  Entities  (FRBR  Group  1)  • Stories  in  a  magazine,  Monographs,  Series• Item/Manifestation,  Work

• Related  Entities  (FRBR  Group  2  &  3)• Creators,  Publishers,  etc.• Leading  Characters,  Subjects,  Genres,  etc.  • Spin-­‐off  Products

• Secondary  resources• Wikipedia  articles,  Fan  created  sites• Review  sites,  etc.

2015/8/12 17

Page 18: Metadata for manga: Metadata vocabulary, schema and tools

Some  studies  on  Manga  Metadata  at  Tsukuba• Manga  Metadata  Framework  (MMF)• Three  aspects  of  MMF  and  its  base  schema

• bibliographic  description  – based  on  FRBR• structural  description  – based  on  TV-­‐Anytime  (a  standard  for  digital  video  broadcasting)• intellectual  entities  (contained  in  the  manga

• First  presented  at  DC-­‐2009,  Seoul,  Korea• Manga  Path  Language  – Xpath-­‐based  scheme  for  structure  description

• Identification  of  FRBR  Works  using  bibliographic  data• Software  tools  for  production  of  and  access  to  manga

2015/8/12 18

Page 19: Metadata for manga: Metadata vocabulary, schema and tools

Structural  Description

• Bibliographic  Entities• An  Item  of  a  monograph,  a  title  of  a  magazine,  a  Work  of  manga,  etc.

•Manga  as  a  published  material  has  its  structure  • Title  =  a  collection  of  stories• Story  =  a  series  of  episodes  (or  sub-­‐stories)• Episode  =  a  series  of  scenes  (logical  structure)  and  a  series  of  pages  (graphical  structure)• Scene/Page  =  a  series  of  Frames• Frame  =  composed  of  graphic  objects  and  texts,  and  linked  to  other  frames  

•Manga  Path  Language  – XPath-­‐based  scheme  to  express  structure  of  manga

2015/8/12 19

Page 20: Metadata for manga: Metadata vocabulary, schema and tools

Overall  structure  of  MMF

20

Title

Story

Episode

Frame

Visual Object

Non-­‐Frame

Scene Page

character onomatopœia texts

Work Expression Manifestation

charactergenre

titlecreator

timeplace

theme

has subjectcontains

Structural  Description

Bibliographic  Descriptionbased  on  FRBR

Intellectual  Entities

2015/8/12

Page 21: Metadata for manga: Metadata vocabulary, schema and tools

Overall  structure  of  MMF

21

Title

Story

Episode

Frame

Visual Object

Non-­‐Frame

Scene Page

character onomatopœia texts

Work Expression Manifestation

charactergenre

titlecreator

timeplace

theme

has subjectcontains

TV  Anytime(MPEG  7)

FRBR  Group  1  Entities

FRBR  Group  3  Entities    

2015/8/12

Page 22: Metadata for manga: Metadata vocabulary, schema and tools

Structure  a  Manga  page-­‐ an  Xpath-­‐based  description  -­‐

22

<s01/e01/p03/f01>  a  mm:Frame ;mm:frameNumber "1.0"^^xsd:int ;mm:hasLocation "帯広畜産大学畜産

フィールド科学センター"  .mm:hasMObject<s01/e01/p03/f01_mo01>,<s01/e01/p03/f01_mo02>,<s01/e01/p03/f01_mo03>,<s01/e01/p03/f01_mo04>,<s01/e01/p03/f01_mo05>,<s01/e01/p03/f01_mo06>   .

<s01/e01/p03/f01_mo01>   a  mm:MangaObject ;rdf:value "誰…って みのりお姉ちゃん!

"  ;mm:speaker <character02>   .

<s01/e01/p03/f01_mo02>   a  mm:MangaObject ;rdf:value "農場は動物園じゃないんだぞ

"  ;mm:speaker <character03>   .

<s01/e01/p03/f01_mo03>   a  mm:MangaObject ;rdf:value "みのり 畜産フィールド科学セ

ンター職員"  .<s01/e01/p03/f01_mo04>   a  mm:MangaObject ;

rdf:value <character02>   .<s01/e01/p03/f01_mo05>   a  mm:MangaObject ;

rdf:value <character03>   .<s01/e01/p03/f01_mo06>   a  mm:MangaObject ;

rdf:value "集中線"  .

Image  of  manga Metadata  description

Description  about  frame

Description  about  dialog

Description  about  character

Description  about  symbol2015/8/12

Page 23: Metadata for manga: Metadata vocabulary, schema and tools

Identification  of  Works  from  bibliographic  data[1]• Work  of  FRBR  is  a  natural  entity  for  us  to  identify  manga• Bibliographic  records  at  libraries  are  created  based  on  items• Authority  records  are  not  well  developed  for  sub-­‐culture  resources

• Identification  of  Works  of  FRBR  from  Bibliographic  Records  provided  by  Kyoto  International  Manga  Museum• Use  DBpedia in  the  identification  process  as  a  semi-­‐authority• Use  identified  Work  entities  to  find  translations  in  other  languages• Another  approach  using  BIBFRAME  (not  yet  published)

2015/8/12 23

[1]  Identification  of  works  of  manga  using  LOD  resources:  an  experimental  FRBRization ofbibliographic   data  of  comic  books,  WL.  He,  T.Mihara,  M.Nagamori and  S.Sugimoto,   JCDL  2013  

Page 24: Metadata for manga: Metadata vocabulary, schema and tools

Software  tools  to  support  production  and  access

• Digital  Manga  Storyboard  (Name)  Editor:  Metadata  Creation  with  Manga  Authoring  • Improve  the  usability  of  resources  of  manga  to  provide  authoring  tool  for  storyboard  of  manga• Store  them  with  its  metadata  created  automatically

•Manga  Collection  Viewer• Visual  presentation  of  collections  of  manga• Need  Ontology  for  Manga  – vocabularies  for  genres,  characters,  etc.

• Lack  of  Authority  records• Challenges  to  use  Web  resources,  e.g.  DBpedia,  as  a  quasi-­‐authority

2015/8/12 24

Page 25: Metadata for manga: Metadata vocabulary, schema and tools

Some  Instances  in  Manga  Ontology

2015/8/12 25

Page 26: Metadata for manga: Metadata vocabulary, schema and tools

Linking  manga  resources  via  Manga  Ontology

26

Bibliographic  Information• Title• Publisher

User-­‐generated  Article• Story• Character

Transmedia• Animation• Music

Review  on  SNS

Manga  Ontology

2015/8/12

Page 27: Metadata for manga: Metadata vocabulary, schema and tools

Manga  Collection  Viewer  – a  facet-­‐based  tool

2015/8/12 27

Initial  view• Each  circle  shows  a  facet  

(type/genre)• Hierarchical  relations  between  

upper  concepts  and  their  children

Page 28: Metadata for manga: Metadata vocabulary, schema and tools

Manga  Collection  Viewer  – a  facet-­‐based  tool

28

Zoom  into  a  circleThis  is  a  view  when  user  select  

“mo:Theme”  as  a  facet

2015/8/12

Page 29: Metadata for manga: Metadata vocabulary, schema and tools

Manga  Collection  Viewer  – a  facet-­‐based  tool

29

Works  in  a  type/genreThis  is  the  collection  of  circles  when  their  theme  “mo:Robot”  is  selected

2015/8/12

A  Work

Page 30: Metadata for manga: Metadata vocabulary, schema and tools

Create  manga  in  digital  environment

• Tools  to  help  creation  are  crucial• Tools  to  draw  manga• Tools  to  describe  and  maintain  descriptions  of  manga,  i.e.,  Manga  metadata

• Drawing  and  authoring  tools  are  well  used• Tools  for  Manga  metadata  are  not  well  developed• Some  lessons  learned  in  our  projects• Describing  metadata  after  production  is  too  expensive• Not  only  the  final  manga  products  but  also  those  created  in  the  production  process  are  useful  for  re-­‐editing,  re-­‐creation  and  re-­‐use  of  the  manga  and  the  ideas  used  in  the  production

2015/8/12 30

Page 31: Metadata for manga: Metadata vocabulary, schema and tools

Digital  and  network-­‐oriented  production  and  publishing  environment• Current  situation:  Born  in  digital  and  published  in  page-­‐oriented  format,  i.e.,  print-­‐publishing  and  page-­‐oriented  digital  format• Web  comics  – a  new  stream

• “Born  in  digital”  from  a  perspective  for  the  future• Use  structural  metadata  for  functions  based  on  fine  granule  components• Promote  usage  of  creator-­‐created  and  reader-­‐created  metadata• Bridge  to  other  visual  media  resources,  e.g.  digital  video• Link  to  other  resources  on  the  Internet

• Some  fundamental  issues• Identification  scheme  of  “content”,  e.g.,  a  story,  a  page,  a  frame,  a  character,  etc.• Need  standards  and  authority  files  for  physical,  digital,  and  conceptual  entities  

2015/8/12 31

Page 32: Metadata for manga: Metadata vocabulary, schema and tools

Digital  Resources  on  the  Internet

2015/8/12 32

FileBinary  data

pc

File

format

Unbundle

tied

Content

mobile

Medium  +  Content

print

Access

ResourcesUser

Environment Users

Concepts,  etc.

Page 33: Metadata for manga: Metadata vocabulary, schema and tools

A  Metadata  Centric  View  of  Digital  Resource  

2015/8/12 33

FileBinary  data

pc

File

format

Unbundle

tied

Content

mobile

Medium  +  Content

print

metadata

Access

ResourcesUser

Environment Users

metadata

Concepts,  etc.

Page 34: Metadata for manga: Metadata vocabulary, schema and tools

A  Metadata  Centric  View  of  Digital  Resource  

2015/8/12 34

FileBinary  data

pc

File

format

Unbundle

tied

Content

mobile

Medium  +  Content

print

Access

Concepts,  etc.

metadata

ResourcesUser

Environment

metadata

Users

Page 35: Metadata for manga: Metadata vocabulary, schema and tools

Issues  for  the  Future:  Global  vs.  Local– Sharing  Vocabularies  is  a  challenge• Metadata  vocabularies  – the  basis  of  interoperable  metadata• Vocabulary  sharing  – different  requirements• Personal  (individual,  small  group)  vs.  Community• Subject-­‐wise  Local  community  vs.  Global  community• Geographically  Local  community  vs.  Global community  • Temporally  Local  community  vs.  Global community  

• Vocabulary  sharing  for  “Interoperability  across  Communities”• DCMI’s  goal• Metadata  registries  as  an  infrastructure  for  sharing  vocabularies  across  communities  and  over  time

2015/8/12 35

Page 36: Metadata for manga: Metadata vocabulary, schema and tools

Thank  you  very  muchsugimoto@  slis.  tsukuba.  ac.  jp

2015/8/12 36