Digital Asset Management Systems & Application

Jim DeRoest, Director Streaming Media

Technologies

Digital Asset Management Systems & Application

Jim DeRoest, Director Streaming Media

Technologies

www.digitalwell.org

DevelopmentDevelopment

• Original focus broadcast-streaming integration.– ResearchChannel, UWTV, KEXP– Automation: encode, ingest, metadata, schedule, deliver– Scalable standard def, high def, uncompressed streams– Support commodity bit rates and formats

• Focus expanded to include institutional collections– High-quality and accessible resources to research information.– Educational outreach– Interoperate with other digital repositories

• Why quality matters …

• Original focus broadcast-streaming integration.– ResearchChannel, UWTV, KEXP– Automation: encode, ingest, metadata, schedule, deliver– Scalable standard def, high def, uncompressed streams– Support commodity bit rates and formats

• Focus expanded to include institutional collections– High-quality and accessible resources to research information.– Educational outreach– Interoperate with other digital repositories

• Why quality matters …

Hours Viewed Increases 200% since Jan 2002Breakout by BandwidthHours Viewed Increases 200% since Jan 2002Breakout by Bandwidth

Webcast and Video OnDemandWebcast and Video OnDemand

Average Viewing TimeAverage Viewing TimeDuration longer for VOD, higher bandwidthsDuration longer for VOD, higher bandwidths

DigitalWell ProjectDigitalWell Project

• Digital Asset Management System– Hierarchical, clustered infrastructure -

Scaling– Pluggable components – Tech Evolution– Interoperation – Auth, Metadata, API– Preservation– Rights – Higher Education

• http://www.digitalwell.org

What We BuiltWhat We Built

• Hardware– Clustered servers – encode, stream, …– NAS Online Storage

• 12TB Isilon IQ• Multi-node, load balancing, single mount

point

– SAN Nearline Storage• STK Silos – 9840 (20GB/cart), 9940

(200GB/cart)

– Mirrored architecture

• Hardware– Clustered servers – encode, stream, …– NAS Online Storage

• 12TB Isilon IQ• Multi-node, load balancing, single mount

point

– SAN Nearline Storage• STK Silos – 9840 (20GB/cart), 9940

(200GB/cart)

– Mirrored architecture

What We BuiltWhat We Built

• Software– HSM: HPSS, UW Karc (bucket service)– Metadata: MS SQL– Web: IIS– Encoding: Flipfactory, Virage– Streaming: WM, Real, Quicktime, MP3,

VideoCharger (MPEG2 5.6mbps,19.2mbps), UW HDCAM/SDTI 270mbps

– Multicast: Amnis– DigitalWell State & Redirector Service

• Software– HSM: HPSS, UW Karc (bucket service)– Metadata: MS SQL– Web: IIS– Encoding: Flipfactory, Virage– Streaming: WM, Real, Quicktime, MP3,

VideoCharger (MPEG2 5.6mbps,19.2mbps), UW HDCAM/SDTI 270mbps

– Multicast: Amnis– DigitalWell State & Redirector Service

Backend DiagramBackend Diagram

Insert diagram image - mass store system

Insert diagram image - mass store system

InteroperabilityInteroperability

• Metadata– Dublin Core, MPEG7, Custom– OAI, possibly METS– API migration to OKI– LDAP Collection Service – LC/AMIA MIC

• Access Controls– Pubcookie, Institutional Groups– Shibboleth under development

• Preservation– OAIS?

• Metadata– Dublin Core, MPEG7, Custom– OAI, possibly METS– API migration to OKI– LDAP Collection Service – LC/AMIA MIC

• Access Controls– Pubcookie, Institutional Groups– Shibboleth under development

• Preservation– OAIS?

Application: BroadcastApplication: Broadcast

• ResearchChannel, UWTV– Automated Encoding

• Dub time Mav70 capture 50mbps i-frame MPEG2

• Transcode farm – Flipfactory, Virage• +1300 hrs of standard def 5.6mbps MPEG2

– Broadcast Scheduling Integration• Protrack, DW metadata -> Dynamic web

schedule• Integrated with DW On-Demand library

– Standard def MPEG2 multicast• International rebroadcast support

– http://www.researchchannel.org

Application: KEXPApplication: KEXP

• Digital Audio Infrastructure• Live Broadcast Stream

– Uncompressed 1.4mbps– Commodity bit rates

• Archived Live Broadcast– 2 weeks, all formats

• Realtime Broadcast Playlist– Dynamic web update integrated with DJ

console– Archived with live broadcast

• http://kexp.org

Institutional CollectionsInstitutional Collections

• Agnostic to data type– Text, docs, photos, video, audio, dataset, …

• Collection Admin Tool– Metadata profile support– Custom metadata

• Interoperation: D-Space, ContentDM, …• Integration with Catalyst teaching tools• Available to UW campus summer qtr

2003

• Agnostic to data type– Text, docs, photos, video, audio, dataset, …

• Collection Admin Tool– Metadata profile support– Custom metadata

• Interoperation: D-Space, ContentDM, …• Integration with Catalyst teaching tools• Available to UW campus summer qtr

2003

Outreach & CollaborationsOutreach & Collaborations

• Pacific Lighthouse– CENIC, UW, I2 K20– High quality audio/video to K20– Content Partners: Densho,

Conversations with History, Jason Project, Exploratorium, Cell Systems Initiative, ResearchChannel, KEXP

• http://depts.washington.edu/paclight

CollaborationCollaboration

• Moving Image Collections– NSDL, Library of Congress, AMIA– Video collection directory and union catalog– http://gondolin.rutgers.edu/MIC

• Viewing the Future– NSDL MERIT Michigan Teachers Network– Audio Video Metadata for K12

• Multi University Research Library– Computer Science Lecture Collection– http://researchchannel.org/MURL/main.html

• Convergence Consortium– CPB, PBS, education collaboration– MARS project – Metadata profile for PBS– http://mars.ischool.washington.edu

Projects & ExperimentsProjects & Experiments

• 1.5mbps uncompressed HD over IP• 270mbps HD/SDTI live, on-demand• 270mbps standard def I2 multicast• Desktop HD – 19.2mbps ATSC

MPEG2• Interested?

– I2 ResearchChannel working group

• 1.5mbps uncompressed HD over IP• 270mbps HD/SDTI live, on-demand• 270mbps standard def I2 multicast• Desktop HD – 19.2mbps ATSC

MPEG2• Interested?

– I2 ResearchChannel working group

iGrid 2002 - Video Across the AtlanticiGrid 2002 - Video Across the Atlantic

International PartnershipsInternational Partnerships

iGrid DemoiGrid Demo