digital asset management systems
TRANSCRIPT
![Page 1: Digital Asset Management Systems](https://reader036.vdocuments.us/reader036/viewer/2022081422/55543721b4c905987e8b525f/html5/thumbnails/1.jpg)
DigitalWell Digital Asset Management Systems
& Applications
Jim DeRoest, Director Streaming Media
Technologies
DigitalWell Digital Asset Management Systems
& Applications
Jim DeRoest, Director Streaming Media
Technologies
www.digitalwell.org
![Page 2: Digital Asset Management Systems](https://reader036.vdocuments.us/reader036/viewer/2022081422/55543721b4c905987e8b525f/html5/thumbnails/2.jpg)
Who We Are – Streaming Media, Video & TV TechnologiesWho We Are – Streaming Media, Video & TV Technologies
• Campus– Institutional repository/Asset Management – Digitalwell Project– Streaming – Distance education, eLearning
• Television – UWTV, uw2.tv, ResearchChannel– Cable & Satellite broadcast 17.1million homes– +2500hrs modem to SD to HD on-demand programming– Live multicast internationally to 30mbps DV
• Radio – KEXP– Analog and Digital broadcast– Streaming audio to 1.4mbps – On demand broadcast & playlist archive
• Video/Audio Research– iHDTV – desktop to uncompressed HD over the Internet
• Campus– Institutional repository/Asset Management – Digitalwell Project– Streaming – Distance education, eLearning
• Television – UWTV, uw2.tv, ResearchChannel– Cable & Satellite broadcast 17.1million homes– +2500hrs modem to SD to HD on-demand programming– Live multicast internationally to 30mbps DV
• Radio – KEXP– Analog and Digital broadcast– Streaming audio to 1.4mbps – On demand broadcast & playlist archive
• Video/Audio Research– iHDTV – desktop to uncompressed HD over the Internet
![Page 3: Digital Asset Management Systems](https://reader036.vdocuments.us/reader036/viewer/2022081422/55543721b4c905987e8b525f/html5/thumbnails/3.jpg)
MissionMission• Exploit Next Generation Network Bandwidth
• High Quality, Low Latency Interactive Systems• Deliver Realism - Quality & Latency Matter
– Health Sciences, Biology, Performance Arts
• System Integration & Automation – End to End• Television, Radio, Internet Technologies
• Middleware Standards• Intellectual Property, Discovery, Metadata
• Research & Outreach• National/International Consortia, K20
• Digital Media Asset Management• On Demand Access, DLib Interoperation, Preservation
• Exploit Next Generation Network Bandwidth• High Quality, Low Latency Interactive Systems• Deliver Realism - Quality & Latency Matter
– Health Sciences, Biology, Performance Arts
• System Integration & Automation – End to End• Television, Radio, Internet Technologies
• Middleware Standards• Intellectual Property, Discovery, Metadata
• Research & Outreach• National/International Consortia, K20
• Digital Media Asset Management• On Demand Access, DLib Interoperation, Preservation
![Page 4: Digital Asset Management Systems](https://reader036.vdocuments.us/reader036/viewer/2022081422/55543721b4c905987e8b525f/html5/thumbnails/4.jpg)
Broadcast, Streaming, On-Demand
www.researchchannel.orgwww.uwtv.orgwww.kexp.org
![Page 5: Digital Asset Management Systems](https://reader036.vdocuments.us/reader036/viewer/2022081422/55543721b4c905987e8b525f/html5/thumbnails/5.jpg)
ResearchChannel
Nationwide 7x24 Hour Television Channel on Cable and Satellite
International Retransmission
Research Consortia
ResearchChannel
Nationwide 7x24 Hour Television Channel on Cable and Satellite
International Retransmission
Research Consortia
![Page 6: Digital Asset Management Systems](https://reader036.vdocuments.us/reader036/viewer/2022081422/55543721b4c905987e8b525f/html5/thumbnails/6.jpg)
ResearchChannel ParticipantsResearchChannel Participants
• Research Universities: Duke UniversityGeorge Mason UniversityJohns Hopkins UniversityMassachusetts Institute of TechnologyNational University of SingaporeOregon State UniversityPenn State UniversityRice UniversityRutgers, The State University of New JerseyStanford UniversityTufts UniversityUniversidad de Puerto RicoUniversitat Politècnica de CatalunyaUniversity of Alaska FairbanksUniversity of ChicagoUniversity of HawaiiUniversity of HoustonUniversity of Maryland - College ParkUniversity of PennsylvaniaUniversity of Southern CaliforniaUniversity of VirginiaUniversity of WashingtonUniversity of Wisconsin-MadisonVirginia TechYale University
• Research Organizations:
Howard Hughes Medical InstituteInternet2National Academies
National Academy of EngineeringNational Academy of Sciences
National Institute of Standards and TechnologyNational Institutes of Health
National Institute of Nursing ResearchNational Library of Medicine
National Science & Technology Medals FoundationNational Science FoundationNational Sea Grant College ProgramPacific Northwest GigapopStanford Hospital & ClinicsWisconsin Public Television
• Corporate Research Centers: Corporation for Education Network Initiatives in CaliforniaIBM CorporationJohnson & JohnsonMicrosoft ResearchSony Electronics Inc.Vulcan Inc.
• RC Global InitiativeAustraliaBrazilChileChinaFinlandKoreaNetherlandsPortugalSpain
![Page 7: Digital Asset Management Systems](https://reader036.vdocuments.us/reader036/viewer/2022081422/55543721b4c905987e8b525f/html5/thumbnails/7.jpg)
Broadcast Subscribers Broadcast Subscribers
• 9.0 million - Dish Network
• 8.1 million - Individual cable systems
• 9.0 million - Dish Network
• 8.1 million - Individual cable systems
• 17.1 million - Total• 17.1 million - Total
![Page 8: Digital Asset Management Systems](https://reader036.vdocuments.us/reader036/viewer/2022081422/55543721b4c905987e8b525f/html5/thumbnails/8.jpg)
International On-Demand & MulticastInternational On-Demand & Multicast
KEXP Listener: “Filipino listeners have a limited music resource. Your online audio streams are able to satisfy hungry listeners such as myself. Thank god for the internet!”
![Page 9: Digital Asset Management Systems](https://reader036.vdocuments.us/reader036/viewer/2022081422/55543721b4c905987e8b525f/html5/thumbnails/9.jpg)
Regional distribution outside U.S.Regional distribution outside U.S.
* Webtrends: October 2002 - 2003. U.S. is 75% of Total, this shows remaining 25%
NetherlandsGermany
Japan
UK
France
Austria
Switzerland
IsraelItaly
Brazil
Sweden
Belgium
Finland
Taiwan
AU
Singapore
Hong Kong
Canada
Saudi Arabia
![Page 10: Digital Asset Management Systems](https://reader036.vdocuments.us/reader036/viewer/2022081422/55543721b4c905987e8b525f/html5/thumbnails/10.jpg)
CollaboratorsCollaborators
• Research & Standards Development• Educational Outreach• Content Sharing• Network Test Beds
• Research & Standards Development• Educational Outreach• Content Sharing• Network Test Beds
![Page 11: Digital Asset Management Systems](https://reader036.vdocuments.us/reader036/viewer/2022081422/55543721b4c905987e8b525f/html5/thumbnails/11.jpg)
DigitalWell: Digital Asset ManagementDigitalWell: Digital Asset Management
• Project focus – Broadcast-”Intercast” integration.– Automation – End to End
• capture, describe, deliver
– High quality, Realism• Commodity, Standard def, High def• Next generation networks
– Asset agnostic• Doc, pic, audio, video, data blobs
– Middleware• Metadata, DRM/IPMP, API
– Scalable/Pluggable Architecture• Evolve with Technology
– Federated DAMS Interoperation– Storage/Preservation
• Project focus – Broadcast-”Intercast” integration.– Automation – End to End
• capture, describe, deliver
– High quality, Realism• Commodity, Standard def, High def• Next generation networks
– Asset agnostic• Doc, pic, audio, video, data blobs
– Middleware• Metadata, DRM/IPMP, API
– Scalable/Pluggable Architecture• Evolve with Technology
– Federated DAMS Interoperation– Storage/Preservation
![Page 12: Digital Asset Management Systems](https://reader036.vdocuments.us/reader036/viewer/2022081422/55543721b4c905987e8b525f/html5/thumbnails/12.jpg)
OAI
DigitalWell Architecture
AccessAPIs
Drivers
Storage Pool Abstraction
DatabasesDB2, SQLServer
Servers
Windows, UnixFile systems
HSM HPSS, ADSM
DataTransport/Streams
Federation
BroadcastAutomation
WS API DW AdminAPI
Metadata Abstraction
MetadataServices
Broadcast, Dlib, eLearning
WebISO, Shibboleth, PKI
Stream State Manager
SRB
Authorization-Authentication-Access Control
LDAP
Request Director
OAI
![Page 13: Digital Asset Management Systems](https://reader036.vdocuments.us/reader036/viewer/2022081422/55543721b4c905987e8b525f/html5/thumbnails/13.jpg)
InternetStreaming Service
InternetMulticast ServiceDV, MPEG2, WM
Satellite & Cable
InternationalRetransmission
Web Broadcast Schedule Program Library
Video On Demand
DigitalWellEnd to End AutomationEnvironment
Broadcast
TrafficSystem Metadata
Digital Asset Repository
VoD Metadata
Synchronization
Video Capture
Single Pass Tape Dub & EncodingMPEG2 SD HDWM, Real, QT
![Page 14: Digital Asset Management Systems](https://reader036.vdocuments.us/reader036/viewer/2022081422/55543721b4c905987e8b525f/html5/thumbnails/14.jpg)
InstantiationInstantiation
• Dub time automation– Single pass ingest
• Virage/Flipfactory• 15mbps MPEG2 master• Format transcoding• Keyframe, metadata
creation
• Queued for review• Archive & publish
– Scheduling• Protrack/Digitalwell• Metadata synchronization
• Automated monitoring• Ingest to delivery
• Dub time automation– Single pass ingest
• Virage/Flipfactory• 15mbps MPEG2 master• Format transcoding• Keyframe, metadata
creation
• Queued for review• Archive & publish
– Scheduling• Protrack/Digitalwell• Metadata synchronization
• Automated monitoring• Ingest to delivery
![Page 15: Digital Asset Management Systems](https://reader036.vdocuments.us/reader036/viewer/2022081422/55543721b4c905987e8b525f/html5/thumbnails/15.jpg)
Automated Encoding ProcessAutomated Encoding Process
![Page 16: Digital Asset Management Systems](https://reader036.vdocuments.us/reader036/viewer/2022081422/55543721b4c905987e8b525f/html5/thumbnails/16.jpg)
MiddlewareMiddleware
• Metadata– Dublin Core, MPEG7, Custom– OAI, possibly METS– WS API– Collection Directory – LoC/AMIA MIC
• Access Controls– Web ISO (Pubcookie), – Institutional Groups– Collection and Asset level ACLs– Shibboleth under development
• Preservation– OAIS?
• Metadata– Dublin Core, MPEG7, Custom– OAI, possibly METS– WS API– Collection Directory – LoC/AMIA MIC
• Access Controls– Web ISO (Pubcookie), – Institutional Groups– Collection and Asset level ACLs– Shibboleth under development
• Preservation– OAIS?
![Page 17: Digital Asset Management Systems](https://reader036.vdocuments.us/reader036/viewer/2022081422/55543721b4c905987e8b525f/html5/thumbnails/17.jpg)
Broadcast Scheduling IntegrationBroadcast Scheduling Integration
• Broadcast Traffic & Web Integration– Program metadata store (DigitalWell)– Broadcast schedule (ProTrack, Louth)– Daily extract ProTrack list metadata– Synchronize metadata (ProTrack,
DigitalWell) • Tape number and program name
– Dynamic generation of ResearchChannel Web• Broadcast schedule• VoD library
• Broadcast Traffic & Web Integration– Program metadata store (DigitalWell)– Broadcast schedule (ProTrack, Louth)– Daily extract ProTrack list metadata– Synchronize metadata (ProTrack,
DigitalWell) • Tape number and program name
– Dynamic generation of ResearchChannel Web• Broadcast schedule• VoD library
![Page 18: Digital Asset Management Systems](https://reader036.vdocuments.us/reader036/viewer/2022081422/55543721b4c905987e8b525f/html5/thumbnails/18.jpg)
Delivery – Little Video … Big VideoDelivery – Little Video … Big Video
• Clustered Load Sharing Server Architecture– WM9, Real10, Quicktime, Shoutcast, VideoCharger,
VideoLAN• Little Video – Smartphones, PDAs,
– Path 1, WM, Shoutcast– Audio/Video streaming, VoD
• Middle Video – Desktop– Modem, DSL, Broadband environments– Audio: 32kbps to 1.4mbps Uncompressed– Video: 56kbps to 5.6mbps SD, 19.2mbps HD– DVTS DV 30mbps– Unicast and Multicast
• Big Video– Studio Quality SDI delivery 250mbps (SD, HDCAM)– Uncompressed HD 1.5mbps
• VoD Demo APAN 2004• International VC Demo SC’04
http://www.researchchannel.org/projects
![Page 19: Digital Asset Management Systems](https://reader036.vdocuments.us/reader036/viewer/2022081422/55543721b4c905987e8b525f/html5/thumbnails/19.jpg)
Interactive High Definition Video SC’04Network Routes
![Page 20: Digital Asset Management Systems](https://reader036.vdocuments.us/reader036/viewer/2022081422/55543721b4c905987e8b525f/html5/thumbnails/20.jpg)
![Page 21: Digital Asset Management Systems](https://reader036.vdocuments.us/reader036/viewer/2022081422/55543721b4c905987e8b525f/html5/thumbnails/21.jpg)
Internet SDTV to DesktopInternet SDTV to Desktop
• Servers, Players, Codecs– VidoeLan, IBM Videocharger– ffmpeg, Elecard– MPEG2 @ 5.6mbps
• Content stored and streamed from UW DigitalWell architecture
• All UWTV, ResearchChannel programming available – over 2000 hrs.
• UWTV, ResearchChannel SD multicast at 2mbps
• Servers, Players, Codecs– VidoeLan, IBM Videocharger– ffmpeg, Elecard– MPEG2 @ 5.6mbps
• Content stored and streamed from UW DigitalWell architecture
• All UWTV, ResearchChannel programming available – over 2000 hrs.
• UWTV, ResearchChannel SD multicast at 2mbps
![Page 22: Digital Asset Management Systems](https://reader036.vdocuments.us/reader036/viewer/2022081422/55543721b4c905987e8b525f/html5/thumbnails/22.jpg)
Internet HDTV to DesktopInternet HDTV to Desktop
• Servers, Players, Codecs– VidoeLan, IBM
Videocharger, MS WM9– ffmpeg, Elecard– 1080i MPEG2 @
19.2mbps– 720p WM9 @ 5mbps
• Content stored and streamed from UW DigitalWell architecture
• Developing HDTV card integration for component out display to HD plasmas, projectors, LCDs
• Servers, Players, Codecs– VidoeLan, IBM
Videocharger, MS WM9– ffmpeg, Elecard– 1080i MPEG2 @
19.2mbps– 720p WM9 @ 5mbps
• Content stored and streamed from UW DigitalWell architecture
• Developing HDTV card integration for component out display to HD plasmas, projectors, LCDs
![Page 23: Digital Asset Management Systems](https://reader036.vdocuments.us/reader036/viewer/2022081422/55543721b4c905987e8b525f/html5/thumbnails/23.jpg)
Storage ManagementStorage Management
• Pluggable Hierarchical Infrastructure– Hardware – NAS/SAN/Robotic Tape
• 30 TB NAS – Isilon IQ• 2 TB SAN staging – EMC Symetrix• STK robotic tape silos – 9840, 9940
– Software – Mass Store System• HPSS, TSM
– Disaster recovery - offsite copies• Content Sharing
– Mirroring/Synchronization – Peer to Peer
• Federated/Disparate Digital Repositories
• SRB OAI
• Pluggable Hierarchical Infrastructure– Hardware – NAS/SAN/Robotic Tape
• 30 TB NAS – Isilon IQ• 2 TB SAN staging – EMC Symetrix• STK robotic tape silos – 9840, 9940
– Software – Mass Store System• HPSS, TSM
– Disaster recovery - offsite copies• Content Sharing
– Mirroring/Synchronization – Peer to Peer
• Federated/Disparate Digital Repositories
• SRB OAI
![Page 24: Digital Asset Management Systems](https://reader036.vdocuments.us/reader036/viewer/2022081422/55543721b4c905987e8b525f/html5/thumbnails/24.jpg)
![Page 25: Digital Asset Management Systems](https://reader036.vdocuments.us/reader036/viewer/2022081422/55543721b4c905987e8b525f/html5/thumbnails/25.jpg)
Open Federated ArchivesOpen Federated Archives
NSDL UW CDL
Media Repositories
Targeted Media Portals
DigitalWell Other DAMS, DLS
SRB/OAI
![Page 26: Digital Asset Management Systems](https://reader036.vdocuments.us/reader036/viewer/2022081422/55543721b4c905987e8b525f/html5/thumbnails/26.jpg)
DigitalWell Institutional R1 DigitalWell Institutional R1
• Institutional Repository Services• Broadcast Migration
– KEXP, UWTV, ResearchChannel– Two Previous Broadcast DW
Implementations
• Production 1QTR 2005
• Institutional Repository Services• Broadcast Migration
– KEXP, UWTV, ResearchChannel– Two Previous Broadcast DW
Implementations
• Production 1QTR 2005
![Page 27: Digital Asset Management Systems](https://reader036.vdocuments.us/reader036/viewer/2022081422/55543721b4c905987e8b525f/html5/thumbnails/27.jpg)
DigitalWell R1DigitalWell R1
• What’s New …– Enhanced Content Upload
• Batch Collection Ingest: Assets and XML Metadata– Validation Assets to Metadata– Recoverable Upload
– Metadata Profiles• DWLite – File System Metadata, Limited
Search• Extended Dublin Core – Search• PBCore – Broadcast Support• Advanced Custom Fields
• What’s New …– Enhanced Content Upload
• Batch Collection Ingest: Assets and XML Metadata– Validation Assets to Metadata– Recoverable Upload
– Metadata Profiles• DWLite – File System Metadata, Limited
Search• Extended Dublin Core – Search• PBCore – Broadcast Support• Advanced Custom Fields
![Page 28: Digital Asset Management Systems](https://reader036.vdocuments.us/reader036/viewer/2022081422/55543721b4c905987e8b525f/html5/thumbnails/28.jpg)
DigitalWell R1DigitalWell R1
• What’s New …– WS API
• Interface Development, Teaching Tools
– System Admin Tool• User Account Management• Automated Account Creation/Expiration• User Quotas• Collection Management
– Selectable per Asset Delivery Option• Stream only, Download or Both
• What’s New …– WS API
• Interface Development, Teaching Tools
– System Admin Tool• User Account Management• Automated Account Creation/Expiration• User Quotas• Collection Management
– Selectable per Asset Delivery Option• Stream only, Download or Both
![Page 29: Digital Asset Management Systems](https://reader036.vdocuments.us/reader036/viewer/2022081422/55543721b4c905987e8b525f/html5/thumbnails/29.jpg)
DigitalWell R1DigitalWell R1
• New Non-broadcast Collections– Health Sciences – MRI imaging– School of Music – 15k hrs Ethnomusicology– College of Forestry – Sat images old growth– Experimental Education – SD video to K12– iEARN – International student video collab
http://www.iearn.org
– PETTT VideoTraces – Collab video toolhttp://epts.washington.edu/pettt/projects/videotraces.html
![Page 30: Digital Asset Management Systems](https://reader036.vdocuments.us/reader036/viewer/2022081422/55543721b4c905987e8b525f/html5/thumbnails/30.jpg)
Sharing PBS Programming Over the Internet between 8 stationsSharing PBS Programming Over the Internet between 8 stations
![Page 31: Digital Asset Management Systems](https://reader036.vdocuments.us/reader036/viewer/2022081422/55543721b4c905987e8b525f/html5/thumbnails/31.jpg)
Microsoft ResearchMicrosoft Research
MURL Goals:
•Increase awareness among researchers everywhere about the recent advances in the availability of streaming video technologies
•Provide access anywhere, at any time, to the rich, distinctive seminars of the partner institutions
•Investigate the potential of streaming video and collaborative technologies to change, and improve, the delivery of information and education
•Explore the social and communication issues that may arise from increasing the audience for seminars that are traditionally targeted to smaller, face-to-face groups
![Page 32: Digital Asset Management Systems](https://reader036.vdocuments.us/reader036/viewer/2022081422/55543721b4c905987e8b525f/html5/thumbnails/32.jpg)
DigitalWell - What’s next…DigitalWell - What’s next…• Content Sharing/Synchronization
– SRB prototype with AARNET• Advanced Search
– CRIM MADIS MPEG7 Video Object Search• Encoding
– Closed Caption, Transcripts– User Initiated Batch Transcoding
• Network and Storage Scaling– Bandwidth > 1.5gbps per stream– Cost
• 1Hr Broadcast HD ~9GB• 1Hr HDCAM/SDI ~120GB• 1Hr Studio HD ~670GB
• Video Conferencing– Low Latency HD and Plasma Resolution
• Tarari HPC hardware• SDI Firewire• Capture Card
– Access Grid and Video Presence integration
• Content Sharing/Synchronization– SRB prototype with AARNET
• Advanced Search– CRIM MADIS MPEG7 Video Object Search
• Encoding– Closed Caption, Transcripts– User Initiated Batch Transcoding
• Network and Storage Scaling– Bandwidth > 1.5gbps per stream– Cost
• 1Hr Broadcast HD ~9GB• 1Hr HDCAM/SDI ~120GB• 1Hr Studio HD ~670GB
• Video Conferencing– Low Latency HD and Plasma Resolution
• Tarari HPC hardware• SDI Firewire• Capture Card
– Access Grid and Video Presence integration