an iterative approach to building sustainable repository services on fedora open repositories 2009,...
TRANSCRIPT
An Iterative Approach to Building Sustainable Repository Services on Fedora
Open Repositories 2009, May 19, 2009
Outline
• Organizational overview and backgroundo Claire Stewart, Head, Digital Collections
• Winterton Collection project o Karen Miller, Monographic and Digital Projects Cataloger, Bibliographic Services
• Iterative approacho Bill Parod, Repository Architect, Enterprise Systems
Parallel committee/department structure
may 2008may 2008
Repository Implementation Group project schedule
Repository Implementation Group project schedule
may 2009
EAD to images to EAD+images
Winterton Collection cataloging
• Full cataloging for each of the 76 original collections and at the container level (album, envelope, etc.) for collections of more than one container.
• Individual photographs are not (generally) cataloged fully:o Titleo Note (optional)o Publisher or Creator (if available)
• Full cataloging includedo Titleo Dates of coverageo Abstracto Scope and contents descriptiono Biographical or historical noteo Physical description (size of album, how many
pages, photos, etc.)o Subject headings
Providing cataloging at the album level means that • Many individual photographs will not be
described concisely by the subject headings assigned.
• Some subject headings may not apply at all to some photographs.
Transcribing only the photograph titles results in such problems as these when keyword searching:• Non-English words are not translated• People referred to in captions by their initials, not
names• Animals referred to by given name, not by
species• Non-descriptive captions
A.E.B. and his well-identified crowd
"Enmei and his rhino"
Repository Development Strategy
1. Implement models and services for ingest, preservation, and access of core content.
2. Provide tools for staff to ingest and manage repository content.
3. Facilitate integration of repository materials with end-user tools and services.
4. Iterate…
Draw Detailed Requirements from Project Commitments:A) OAI-ORE Annotation of OCA texts B) Cross Collection Search ProjectC) Winterton Photography CollectionD) Kirtas Mounting Books ProjectE) EAD InitiativeF) Hesler Photography CollectionG) Chemical BulletinH) Fava Masks I) Curator-driven Digitization ProjectJ) Charlotte Moorman / Prgm. African Studies Audio
Inventory Content Types
1) EAD encoded finding aids2) TEI encoded text transcriptions3) High resolution images4) Virtual crops of high resolution images5) Page imaged books6) 3D objects7) Aggregations: full text, fielded, and faceted search8) Audio 9) Video
Project / Content Type Matrix
Services by Content Type
Text ServiceImage ServiceMetadata Conversion ServiceDiscovery Service
Text ServiceEAD Objects
EAD Disseminator Methods:getEADHeadergetComponentAsHTML(unitid)getComponentStructuregetChildComponents(unitid)getComponentsgetComponentStructure(unitid)getAncestorComponents(unitid)getComponentChildrenAsJSON(unitid)getComponentAsEmbeddedHTML(unitid)getComponent (unitid)getElementById (xml:id)getArchDescNoComponentsgetElementsByName(element_name)getDigest(unitid)getComponentAsDC(unitid)getComponentAsMODS(unitid)reindex
Datastreams:DC MODSEADEAD to DC XSL EAD to MODS XSLEAD to HTML XSLEAD to HTML Frag XSLEAD Children to JSON XSLRELS-EXT
TEI Objects
TEI Disseminator Methods:getTOCgetImageTextTOCgetStructuredTextTOCgetHeader(xml:id)getHeadinggetChunk(xml:id)getPageByNumber(pageOrdinal)getPageByID(xml:id)reindex
Datastreams:DC MARCXMLDejaVuBook ORE REMPage Image ORE REMTEIRELS-EXT
EAD Objects
EAD Service methods:getEADHeadergetComponentAsHTML(unitid)getComponentStructuregetChildComponents(unitid)getComponentsgetComponentStructure(unitid)getAncestorComponents(unitid)getComponentChildrenAsJSON(unitid)getComponentAsEmbeddedHTML(unitid)getComponent (unitid)getElementById (xml:id)getArchDescNoComponentsgetElementsByName(element_name)getDigest(unitid)getComponentAsDC(unitid)getComponentAsMODS(unitid)reindex
Datastreams:DC MODSEADEAD to DC XSL EAD to MODS XSLEAD to HTML XSLEAD to HTML Frag XSLEAD Children to JSON XSLRELS-EXT
Fedora Text Disseminator
getComponent: unitidgetComponentAsHTML: unitidgetComponentAsDC: unitidgetComponentAsMODS: unitid....reindex
SGREPServlet
Encapsulate query syntaxXSLT optional on query result
SGREP : Executable program on service host
Add Fedora Disseminator MethodsAdd Fedora Disseminators
Add/Modify XSLT Processing on RetrievalAdd/Modify SGREP Queries
Replace Retrieval Software
Text Service Stack Enhancement Options
Examples: EAD “Digest”- C0n + title/id of children and ancestorsJSON support for EXT-JSHTML design iterationEAD to MODS conversion maturation
Image Service: Source Image
Cropped Image
Single Image File Referenced By Crop Information:
<svg:svg xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:svg="http://www.w3.org/2000/svg"> <svg:image x="0" y="0" width="10656" height="7992" xlink:href="inu-wint/inu-wint-22.30.jp2"><svg:clipPath><svg:rect x="0" y="1166" width="8034" height="6036"/></svg:clipPath></svg:image></svg:svg>
CroppedPhoto
Single Image File Referenced By Crop Information:
<svg:svg xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:svg="http://www.w3.org/2000/svg"> <svg:use xlink:href="http://repository.library.northwestern.edu/fedora/get/inu:inu-wint-22-30/DELIV-OPS"> <svg:clipPath> <svg:rect x="4246" y="1436" width="2997" height="2518"></svg:rect> </svg:clipPath> </svg:use> </svg:svg>
Image and Crop ObjectsImage Service methods (supported by both image and crop objects):
getWithWidth(width)getWithLongSide(length)getWithHeight(height)getCropWithWidth(x,y,width, height,destwidth)getCropWithHeight(x,y,width, height,destheight)getCropWithSize(x,y,width,height, destwidth , destheight)getWithSize(destwidth , destheight)
Image Object Datastreams:DCMODSPREMISSVGTIFFEXIFJP2MIX_TIFFMIX_JP2RELS-EXT
Crop Object Datastreams:DCMODSPREMISSVGRELS-EXT
http:/.../fedora/get/inu:inu-wint-22-30-2/inu:sdef-addimage/getWithLongSide?length=150
Fedora Image Disseminator
getWithWidth(width)getWithLongSide(length)getWithHeight(height)getCropWithSize(x, y, width, height, destwid…)
Image Servlet
Encapsulate rendering parametersObject specific rendering parameters (SVG)User request rendering parametersRendering service parameters and location
Rendering Service : Aware, DJatoka
Add Fedora Disseminator MethodsAdd Fedora Disseminators
Add/Modify Rendering OptionsAdd/Modify Rendering Service Parameters
Replace Rendering Software
Image Service Stack Enhancement Options
Examples: Added getLongSide(length)Added rotationOptimized rendering parametersRendering features - vector overlayObject reference chainingDjatoka experimentation
EAD Objects
EAD Service methods:
getEADHeadergetComponentAsHTML(unitid)getComponentStructuregetChildComponents(unitid)getComponentsgetComponentStructure(unitid)getAncestorComponents(unitid)getComponentChildrenAsJSON(unitid)getComponentAsEmbeddedHTML(unitid)getComponent (unitid)getElementById (xml:id)getArchDescNoComponentsgetElementsByName(element_name)getDigest(unitid)getComponentAsDC(unitid)getComponentAsMODS(unitid)reindex
Datastreams:DC MODSEADEAD to DC XSL EAD to MODS XSLEAD to HTML XSLEAD to HTML Frag XSLEAD Children to JSON XSLRELS-EXT
Image/Crop Objects
Image Service methods:
getWithWidth(width)getWithLongSide(length)getWithHeight(height)getCropWithWidth(x,y,width,
height,destwidth)getCropWithHeight(x,y,width,
height,destheight)getCropWithSize(x,y,width,height,
destwidth , destheight)getWithSize(destwidth , destheight)
Datastreams:DCMODSPREMISSVGTIFFEXIFJP2MIX_TIFFMIX_JP2RELS-EXT
Searching
• SOLR• MODS described collections• Metadata conversion services• Faceting• “Searchable” Interface
o MODS Collection Datastreamo Facet listo Field List
Project Checklist
A) OAI-ORE Annotation of OCA texts B) Cross Collection Search ProjectC) Winterton Photography CollectionD) Kirtas Mounting Books ProjectE) EAD InitiativeF) Hesler Photography CollectionG) Chemical BulletinH) Fava Masks I) Curator-driven Digitization ProjectJ) Charlotte Moorman / Prgm. African Studies Audio
Next Step:Collection Management Tools
EAD Ingest Processing
Image Ingest Processing
Heterogeneous Ingest Processing
Ingest Management Tools
Curator-selected Ingest (Ad-hoc collections)Digital Image Library (Art Slide Library +)Kirtas Book Scanning
Mounting Books Project - OR09 Tuesday, 3:00: Session 8B