state of image annotations - i annotate 2016
TRANSCRIPT
![Page 1: State of Image Annotations - I Annotate 2016](https://reader034.vdocuments.us/reader034/viewer/2022052514/589d352b1a28abd17d8b54ed/html5/thumbnails/1.jpg)
The State of Image Annotations
Robert Casties Max Planck Institute for the History of Science, Berlin
![Page 2: State of Image Annotations - I Annotate 2016](https://reader034.vdocuments.us/reader034/viewer/2022052514/589d352b1a28abd17d8b54ed/html5/thumbnails/2.jpg)
What we do• Work with historical sources
• scanned books, manuscripts, notebooks
• digital photos
• scanned drawings and paintings
• digital texts
• data
![Page 3: State of Image Annotations - I Annotate 2016](https://reader034.vdocuments.us/reader034/viewer/2022052514/589d352b1a28abd17d8b54ed/html5/thumbnails/3.jpg)
Galileo Galileis MS72 "Notes on motion" (1998) http://www.mpiwg-berlin.mpg.de/Galileo_Prototype/INDEX.HTM
![Page 4: State of Image Annotations - I Annotate 2016](https://reader034.vdocuments.us/reader034/viewer/2022052514/589d352b1a28abd17d8b54ed/html5/thumbnails/4.jpg)
Musawwarat Graffiti Archive (2011) http://musawwaratgraffiti.mpiwg-berlin.mpg.de
![Page 5: State of Image Annotations - I Annotate 2016](https://reader034.vdocuments.us/reader034/viewer/2022052514/589d352b1a28abd17d8b54ed/html5/thumbnails/5.jpg)
digilib client-side point annotation (since 2002)
![Page 6: State of Image Annotations - I Annotate 2016](https://reader034.vdocuments.us/reader034/viewer/2022052514/589d352b1a28abd17d8b54ed/html5/thumbnails/6.jpg)
HyperImage annotated presentation (2009?) of James Gillray: „Political-Dreamings!” (1801)
![Page 7: State of Image Annotations - I Annotate 2016](https://reader034.vdocuments.us/reader034/viewer/2022052514/589d352b1a28abd17d8b54ed/html5/thumbnails/7.jpg)
Status quo
• lots of digital editions and projects
• nice and diverse features and tools
• re-inventing lots of wheels
• data silos
• solution: annotations and standards
![Page 8: State of Image Annotations - I Annotate 2016](https://reader034.vdocuments.us/reader034/viewer/2022052514/589d352b1a28abd17d8b54ed/html5/thumbnails/8.jpg)
Our vision• "Weaving a web of knowledge" (Jürgen Renn, 2003?)
• close and distant reading of all kinds of sources (works best with Open Access)
• create comments, relations, narratives
• share the results during the process or the result with collaborators or everybody
• bi-directional links (Xanadu) - collect research results related to sources creating a "semantic network" of sources
![Page 9: State of Image Annotations - I Annotate 2016](https://reader034.vdocuments.us/reader034/viewer/2022052514/589d352b1a28abd17d8b54ed/html5/thumbnails/9.jpg)
references to networks
![Page 10: State of Image Annotations - I Annotate 2016](https://reader034.vdocuments.us/reader034/viewer/2022052514/589d352b1a28abd17d8b54ed/html5/thumbnails/10.jpg)
Annotations as bi-directional links
• standardized (open, stable) access to source documents (image, text,…)
• standardized annotation data linking comment to source
• relevant segment needs to be referenced
• annotation server needs to be shared
• relation can be reversed
![Page 11: State of Image Annotations - I Annotate 2016](https://reader034.vdocuments.us/reader034/viewer/2022052514/589d352b1a28abd17d8b54ed/html5/thumbnails/11.jpg)
Annotation standards• Open Annotation Data Model (http://openannotation.org)
• general annotation data model
• last spec 1.0 of 2013
• W3C Web Annotation Working Group (since 2014)
• Abstract Annotation Data Model (spec)
• Data Model Vocabulary
• Data Model Serializations
• HTTP API (spec)
• Client-side API (FindText API spec)
![Page 12: State of Image Annotations - I Annotate 2016](https://reader034.vdocuments.us/reader034/viewer/2022052514/589d352b1a28abd17d8b54ed/html5/thumbnails/12.jpg)
Image annotation in W3C web annotation
• Target of annotation can be an image
• Segment of image can be specified by
• FragmentSelector with W3C media fragment (rectangle specified in pixel or percent)
• SVGSelector with SVG
![Page 13: State of Image Annotations - I Annotate 2016](https://reader034.vdocuments.us/reader034/viewer/2022052514/589d352b1a28abd17d8b54ed/html5/thumbnails/13.jpg)
Annotation standards• SharedCanvas (http://shared-canvas.org)
• data model for ”virtual books“
• uses Open Annotation
• last spec 1.0 in 2013
• IIIF (http://iiif.io)
• Image API standard
• Metadata API standard
• spec 2.1 released May 12, 2016
![Page 14: State of Image Annotations - I Annotate 2016](https://reader034.vdocuments.us/reader034/viewer/2022052514/589d352b1a28abd17d8b54ed/html5/thumbnails/14.jpg)
IIIF (International Image Interoperability Framework)
• ARTstor • Bayerische
Staatsbibliothek (Bavarian State Library)
• La Bibliothèque nationale de France
• Biblissima • British Library • British Museum • Brown University • Centre de
Recherche et de Restauration des Musées de France (C2RMF)
• Cogapp • Columbia
University • e-codices – Virtual
Manuscript Library of Switzerland
• Cornell University • DPLA • Digital Image
Archive of Medieval Music (DIAMM)
• Digirati Ltd • Europeana • The J. Paul Getty
Trust • Ghent University • Gottingen State
and University Library
• Harvard University • Indiana University • Internet Archive • Johns Hopkins
University • Klokan
Technologies • Leiden University
• MIT Libraries • National Gallery of
Art • National Library of
Austria • Nasjonalbiblioteke
t (National Library of Norway)
• National Library of Denmark
• National Library of Egypt
• National Library of Israel
• National Library of New Zealand
• National Library of Poland
• National Library of Scotland
• National Library of Serbia
• National Library of Wales
• New York University Libraries
• Ohio State University
• Oxford University (Bodleian Library)
• Princeton University Library
• Qatar National Library
• Sirma Group • St. Louis
University • Stanford University • TextGrid • text & bytes • University College
Dublin • University of
Edinburgh
• University of Hong Kong
• University of Illinois at Urbana-Champaign
• University of Notre Dame
• University of Pennsylvania
• University of Toronto
• Vatican Library • The Walters Art
Museum • Wellcome Trust • Wikipedia
(Wikimedia Foundation)
• World Digital Library
• Yale Center for British Art
• Yale University
![Page 15: State of Image Annotations - I Annotate 2016](https://reader034.vdocuments.us/reader034/viewer/2022052514/589d352b1a28abd17d8b54ed/html5/thumbnails/15.jpg)
{scheme}://{server}{/prefix}/{identifier}/{region}/{size}/{rotation}/{quality}.{format}
Image API Presentation API
![Page 16: State of Image Annotations - I Annotate 2016](https://reader034.vdocuments.us/reader034/viewer/2022052514/589d352b1a28abd17d8b54ed/html5/thumbnails/16.jpg)
SoftwareIIIF Shapes
Annotorious - (+)
HyperImage / Yenda - / + + / +
digilib + / - +
SemToNotes - +
Mirador + (+)
Diva + -
T-PEN (+) -
AnnoTate - -
![Page 17: State of Image Annotations - I Annotate 2016](https://reader034.vdocuments.us/reader034/viewer/2022052514/589d352b1a28abd17d8b54ed/html5/thumbnails/17.jpg)
Annotorious
![Page 18: State of Image Annotations - I Annotate 2016](https://reader034.vdocuments.us/reader034/viewer/2022052514/589d352b1a28abd17d8b54ed/html5/thumbnails/18.jpg)
Annotorious• http://annotorious.github.io
• Javascript client image annotation toolkit
• annotates images in HTML pages
• can integrate with Annotator.js
• can use scaling image server (OpenSeadragon)
• can do polygons
![Page 19: State of Image Annotations - I Annotate 2016](https://reader034.vdocuments.us/reader034/viewer/2022052514/589d352b1a28abd17d8b54ed/html5/thumbnails/19.jpg)
HyperImage
![Page 20: State of Image Annotations - I Annotate 2016](https://reader034.vdocuments.us/reader034/viewer/2022052514/589d352b1a28abd17d8b54ed/html5/thumbnails/20.jpg)
HyperImage / Yenda• http://hyperimage.ws
• “like hypertext for images”
• Java editor and server, Flash/HTML5 client
• free shapes in layers, linking between images, texts and layers
• used in a number of digital humanities projects
• Yenda (http://yenda.tools)
• new fully web architecture using IIIF
• under development
![Page 21: State of Image Annotations - I Annotate 2016](https://reader034.vdocuments.us/reader034/viewer/2022052514/589d352b1a28abd17d8b54ed/html5/thumbnails/21.jpg)
digilib
![Page 22: State of Image Annotations - I Annotate 2016](https://reader034.vdocuments.us/reader034/viewer/2022052514/589d352b1a28abd17d8b54ed/html5/thumbnails/22.jpg)
digilib• http://digilib.sourceforge.net
• scaling image server (Java)
• HTML + Javascript client
• view state and client-side annotations encoded in URL (since 2002)
• server-side annotations using Annotator.js (since 2012)
• polygon shapes (since 2015)
• IIIF API server
![Page 23: State of Image Annotations - I Annotate 2016](https://reader034.vdocuments.us/reader034/viewer/2022052514/589d352b1a28abd17d8b54ed/html5/thumbnails/23.jpg)
digilib
![Page 24: State of Image Annotations - I Annotate 2016](https://reader034.vdocuments.us/reader034/viewer/2022052514/589d352b1a28abd17d8b54ed/html5/thumbnails/24.jpg)
SemToNotes
![Page 25: State of Image Annotations - I Annotate 2016](https://reader034.vdocuments.us/reader034/viewer/2022052514/589d352b1a28abd17d8b54ed/html5/thumbnails/25.jpg)
SemToNotes
• https://hkikoeln.github.io/SemToNotes
• JavaScript API to develop browser-based image annotation tools
• topological queries on eXist and EXPath Geo Module backend
• under development
![Page 26: State of Image Annotations - I Annotate 2016](https://reader034.vdocuments.us/reader034/viewer/2022052514/589d352b1a28abd17d8b54ed/html5/thumbnails/26.jpg)
Mirador
![Page 27: State of Image Annotations - I Annotate 2016](https://reader034.vdocuments.us/reader034/viewer/2022052514/589d352b1a28abd17d8b54ed/html5/thumbnails/27.jpg)
Mirador• http://projectmirador.org/
• IIIF reference viewer
• Javascript client, can use any IIIF Presentation API feed
• deep zoom, metadata display, book reading, bookmarking, comparison view
• shape annotations (under development)
![Page 28: State of Image Annotations - I Annotate 2016](https://reader034.vdocuments.us/reader034/viewer/2022052514/589d352b1a28abd17d8b54ed/html5/thumbnails/28.jpg)
Diva.js
![Page 29: State of Image Annotations - I Annotate 2016](https://reader034.vdocuments.us/reader034/viewer/2022052514/589d352b1a28abd17d8b54ed/html5/thumbnails/29.jpg)
Diva.js• http://ddmal.github.io/diva.js
• Javascript client
• uses IIIF Image API
• deep zoom, fast scrolling through documents, synchronized information views
• annotation overlays
![Page 30: State of Image Annotations - I Annotate 2016](https://reader034.vdocuments.us/reader034/viewer/2022052514/589d352b1a28abd17d8b54ed/html5/thumbnails/30.jpg)
![Page 31: State of Image Annotations - I Annotate 2016](https://reader034.vdocuments.us/reader034/viewer/2022052514/589d352b1a28abd17d8b54ed/html5/thumbnails/31.jpg)
T-PEN
• http://t-pen.org
• Transcription for Paleographical and Editorial Notation
• Java server, online version free to use
• new version 3 with IIIF support under development
![Page 32: State of Image Annotations - I Annotate 2016](https://reader034.vdocuments.us/reader034/viewer/2022052514/589d352b1a28abd17d8b54ed/html5/thumbnails/32.jpg)
AnnoTate
![Page 33: State of Image Annotations - I Annotate 2016](https://reader034.vdocuments.us/reader034/viewer/2022052514/589d352b1a28abd17d8b54ed/html5/thumbnails/33.jpg)
AnnoTate
• https://anno.tate.org.uk , https://github.com/zooniverse/AnnoTate
• Zooniverse crowdsourcing project for Tate Archive holdings
• transcription of artist’s personal papers
• zoomable view, simple annotations
![Page 34: State of Image Annotations - I Annotate 2016](https://reader034.vdocuments.us/reader034/viewer/2022052514/589d352b1a28abd17d8b54ed/html5/thumbnails/34.jpg)
where are we now• IIIF image server standard incredibly successful
• Annotation use cases growing
• Annotation standards on the way…
• Annotation software development scattered
• Discovering and sharing annotations not yet there
![Page 35: State of Image Annotations - I Annotate 2016](https://reader034.vdocuments.us/reader034/viewer/2022052514/589d352b1a28abd17d8b54ed/html5/thumbnails/35.jpg)
![Page 36: State of Image Annotations - I Annotate 2016](https://reader034.vdocuments.us/reader034/viewer/2022052514/589d352b1a28abd17d8b54ed/html5/thumbnails/36.jpg)
ceterum censeo…
![Page 37: State of Image Annotations - I Annotate 2016](https://reader034.vdocuments.us/reader034/viewer/2022052514/589d352b1a28abd17d8b54ed/html5/thumbnails/37.jpg)
Standards for annotating image areas
• something between very simple (W3C Media Fragments)
"selector": { "type": „FragmentSelector", "conformsTo": "http://www.w3.org/TR/media-frags/", "value": "xywh=135,16,25,53" }
• and very complex (SVG)
"selector": { "type": ["SvgSelector", "Content"], "text": "<svg:svg> … <polygon xmlns="http://www.w3.org/2000/svg" points="5315,5639 5444,5529 5505,5593 5346,5691 5315,5639" /> … </svg:svg>“ }
![Page 38: State of Image Annotations - I Annotate 2016](https://reader034.vdocuments.us/reader034/viewer/2022052514/589d352b1a28abd17d8b54ed/html5/thumbnails/38.jpg)
Standards for annotating image areas
• Proposition
• use resolution independent coordinates (e.g. 0≤x≤1, fraction of image width)
• use GeoJSON / WKT
• points, lines, polygons
• only point coordinates
![Page 39: State of Image Annotations - I Annotate 2016](https://reader034.vdocuments.us/reader034/viewer/2022052514/589d352b1a28abd17d8b54ed/html5/thumbnails/39.jpg)
Annotations as "micro-publications"
• stable URLs for annotations
• provenance information
• copyright and license information
• versioning?
• authority / reputation?