video accessibility: penn state demonstrates its automated captioning solution
DESCRIPTION
July 13, 2012 Captions are text that is time-sychronized with the media. They convey all spoken content as well as relevant sound effects. Captions originated in the early 1980s from an FCC mandate for broadcast TV. The 21st Century Communications and Video Accessibility Act requires all Internet programming that previously aired on television with captions to have captions online, as well. The values of captioning include: - Accessibility for deaf and hard of hearing - Accessibility for ESL viewers - Flexibility to view anywhere, such as noisy environments or offices - Search - Reusability - Navigation, better UX - SEO/discoverability - Used as source for translation Penn State has 55 online courses. They have an increasing need for accommodation in online education. Here is Penn's accommodation process: 1. Student discloses request of accommodation to ODS office 2. If qualified, student receives accommodation letter from ODS 3. Student submits letter to instructor including types of accommodation needed 4. Instructor informs the learning designer of accommodation needed 5. Learning designer coordinates effort to implement accommodation Penn State had many challenges to overcome when developing a captioning solution for video content. For a full demonstration of how they overcome these difficulties and found their solution with 3Play Media, watch the slideshow! Presenters: Dr. Keith D. Bailey Assistant Dean, Online Learning and Education Technology & Director College of Arts and Architecture Tole Khesin VP of Marketing 3Play Media Josh Miller VP of Business Development 3Play MediaTRANSCRIPT
Video Accessibility: Penn State Demonstrates Its
Automated Captioning Solution July 13, 2012
Agenda
Captioning Background
Captioning Process
Beyond captions
Demos
Q&A
What Are Captions?
• Captions are text that is time-synchronized with the media
• Captions convey all spoken content as well as relevant sound effects
• Originated in the early 1980s from an FCC mandate for broadcast TV
What Are Captions?
Terminology
• Captioning vs. Transcription
What Are Captions?
Terminology
• Captioning vs. Transcription
• Captioning vs. Subtitling
What Are Captions?
Terminology
• Captioning vs. Transcription
• Captioning vs. Subtitling
• Closed Captioning vs. Open Captioning
What Are Captions?
Terminology
• Captioning vs. Transcription
• Captioning vs. Subtitling
• Closed Captioning vs. Open Captioning
• Post Production vs. Real-Time
Accessibility Laws
Section 508 “All training and informational video and multimedia productions must contain captions …”
Accessibility Laws
Section 504 “No individual, solely by reason of her or his disability…be denied the benefits of any program, service, or activity…”
Section 508 “All training and informational video and multimedia productions must contain captions …”
Accessibility Laws
21st Century Communications & Video Accessibility Act (CVAA) “Closed captioning on video programming delivered using internet protocol….”
Section 504 “No individual, solely by reason of her or his disability…be denied the benefits of any program, service, or activity…”
Section 508 “All training and informational video and multimedia productions must contain captions …”
Accessibility Laws
CVAA Update Expected timeline for publishers to implement the new captioning requirements
6 months: All prerecorded programming that is not edited for Internet distribution (Sept 30, 2012)
12 months: Live & near-live programming originally broadcast on television.
18 months: Prerecorded programming that is edited for Internet distribution.
24 months: Archival programming
Benefits
• Accessible for deaf and hard of hearing
• For ESL viewers
• Flexibility to view anywhere, such as noisy environments or offices
• Content becomes searchable, reusable
• SEO/discoverability
• Used as source for translation
Captions Formats
Common Caption Formats
SRT YouTube and other web players
DFXP Flash players
SCC iPods, iTunes, DVD encoding
SAMI Windows Media
QT QuickTime
STL DVD Studio Pro
CPT.XML Captionate
SBV YouTube
RT Real Media
WebVTT Emerging HTML5
Custom XML Custom formats
Custom Text Custom formats
SRT Example
Captioning Process
Video Platform Integrations
Upload files
• Secure over HTTP • FTP • Paste links • API • Import
Captioning Process
Captions Plugin
Interactive Plugins
Demo
• Examples of automated captioning workflows
• Searchable, interactive video libraries
Video AccessibilityPenn State University Demonstrates its
Captioning Solution
Dr. Keith D. BaileyAssistant Dean, Online Learning
and Education Technology& Director
College of Arts and Architecture
Tole KhesinVP of Marketing
3PlayMedia
Josh MillerVP of Business Development
3PlayMedia
About Penn State
24 Campus System + 1 Virtual Campus
Penn State Univ.Land Grant & State-related
System Breakdown
• University Park - Main Campus (13 Colleges)
• Commonwealth Campuses - (19 state-wide)
• Special Mission Campuses:
• Dickinson - Law
• Great Valley - Graduate
• Penn College of Tech - Technical
• Hershey - Medical
• World Campus - Virtual (Online only)
The e-Learning Institute
Visual Arts
Theater
Music LandscapeArchitecture
Integrative Arts
Art History
Architecture
E-LearningInstitute
MissionTo work with the disciplines represented in the College of
Arts and Architecture to become a leader in e-learning and instructional technology in
the Arts and Design
World Campus(Virtual Campus)
e-Learning Cooperative(24 Campuses)
UP
Penn State Delivery Options for Online Courses
The A&A Portfolio
General Education
31
MPS in Art Education
6
Digital Arts Certificate
8 *
MPS in GeoDesign
8**
Music Education
2
Number of Courses by Portfolio
* 3 Courses Count Toward GA** Courses in Development
UP Online WD OnlineWD OnlineUP & WD
OnlineWD Online
55 online courses
All academic units
12,000+ enrollments
e-Learning Organization
Director
Instructional Designers
Program Manager
InstructionalTechnologySpecialist
e-LearningSupportSpecialist
e-Learning Admin. Coordinator
Delivery
Design
Instructional MultimediaSpecialist
Sr. ID Faculty Fellows
Video Production Coordinator
Office of online non-Credit Continuing
Education
The Increasing Need for Accommodation in
Online Education
US Trend in Online Learning
0
1,750,000
3,500,000
5,250,000
7,000,000
2002 2003 2004 2005 2006 2007 2008 2009 2010
6,142,280
5,579,022
4,606,353
3,938,1113,488,381
3,180,050
2,329,7831,971,397
1,602,970
Source: Going the Distance: Online Education in the United States, 2011 by Babson Survey Research Group
Online Enrollments at PSU2011/12 Data
• 524,892 total enrollments (WD & UP)
• 9% (47,777) of course enrollments were fully online (WD & UP)
University Accommodation Requests
• 2011/12 Academic Year - 1,140 students registered with ODS
• 6 students needed either an interpreter or captioning in 2011/12 compared to 4 in 2010/11
• 5 blind student’s across the university including World Campus
WD Accommodation Requests• All Requests
• Fa10: 18 students enrolled in 52 unique courses
• Sp12: 37 students enrolled in 82 unique courses
• Blind
• Fa10: 0 students enrolled in 0 unique courses
• Sp12: 3 students enrolled in 6 unique courses
• Deaf or Hearing-impaired
• Fa10: 3 students enrolled in 11 unique courses
• Sp12: 9 students enrolled in 27 unique courses
Accommodation Process1. Student discloses request of accommodation to ODS
office
2. If qualified, student receives accommodation letter from ODS
3. Student submits letter to instructor including types of accommodation needed
4. Instructor informs the learning designer of accommodation needed
5. Learning designer coordinates effort to implement accommodation
Penn State Learning Design Accessibility
Initiative
Penn State’s 12 Quality Assurance e-Learning
Design Standards
Developed through PSU Online Coordinating
Council
Learning Design Standards
OCAQIOnline Course Accessibility
Quality InitiativeInitiated July 2011
Charge
Identify accessibility best practices and strategies for online courses
• New University policy implemented August, 2011 - Policy AD-69
• Policy requires compliance with Web Content Accessibility Guidelines 2.0 (WCAG 2.0) conformance level AA
• Pages less than 2 years old must comply
• Older pages must be made accessible by unit-determined date, or by request for accommodation
University Policy
Source - http://guru.psu.edu/policies/AD69.html
Key Blockers to Fix • Image ALT Tags
• Page or Document Titles
• Headings and Sub Headings
• Link Text
• Table Headers and Captions
• Form Labels
• Contrast or Luminosity/Brightness
• Color Issues
• Fonts and Text Layout
• Text Reading Order
• Charts & Accessibility
• Video Captions and Audio Transcripts
Source - http://accessibility.psu.edu/
e-Learning Institute’s Learning Design
Approach
Focus on Quality of Design and Delivery
The Challenge
2000’s
Future
XLate 1990’sX ?
Course Content Course Communication
Content Separate from Communication
Published Content
Course Interface Faculty Content
Content Separate from Design
Media Separate from ContentPublic
Purchased
Private
ELMS: Content
Instructional Content Management
(ICMS)
Our SolutionsA Suite of Tools
ELMS: ELIMedia
Asset Media Management
(AMS)
ELMS: Studio
Collaborative Learning
Environment(CLE)
ELMS: Content
Instructional Content Management
(ICMS)
Our SolutionsA Suite of Tools
ELMS: ELIMedia
Asset Media Management
(AMS)
ELMS: Studio
Collaborative Learning
Environment(CLE)
CommunityModules
Learning DesignModules
CustomThemes
+ + +
PHP &MySQL
Outline Designer
Course Manager
An open source content management system customized by learning designers for course developers
ELMS: Content
Accessible Design
• Customize look and feel per course
• Implement global learning design standards
• Built to incorporate accessibility standards
Accessible Content• Implement stylesheets to
control content presentations
• Install module to assist in compliance review
• Validate or review content based on accessibility standards
• Our big debate! How much freedom do we give?
Open Distribution
https://drupal.org/project/elms
ELMS: Content
Instructional Content Management
(ICMS)
Our SolutionsA Suite of Tools
ELMS: ELIMedia
Asset Media Management
(AMS)
ELMS: Studio
Collaborative Learning
Environment(CLE)
Asset Management Needs
• Eliminate duplication of media assets
• Allow for reuse of digital assets
• Provide mechanism to embed media in courses with minimal effort
• Simplify workflow with copyright and transcription
• Ensure online courses meet copyright and compliance with regard to the use of media
ELMS: ELIMedia• Asset management system to store
media used in online courses which manages:
• images, video, audio, Flash, etc...
• copyright for media assets
• transcription and caption files with appropriate media assets
• Front-end interface for Flash Media Server
• Embed code for easy integration into courses
Asset Media Management
(AMS)
Embedding Media into Courses
Copy Embed Code
Paste Embed Code
Course Display
Benefits of ELIMedia• Assists with maintaining compliancy
• Copyright (TEACH Act, Creative Commons)
• Accessibility (closed captioning and transcript)
• Removed the need for learning designers and faculty to manage copyright and transcription within courses
• Tagging allows for ease of search and retrieval
• Ability to track use of materials in courses
Open Distribution
https://drupal.org/project/elmsmedia
Transcription ProcessEvolution
Manual Method
Partially Automated
2006 2011
Fully Automated
2012
Transcription ProcessEvolution
Manual Method
Partially Automated
2006 2011
Fully Automated
2012
Manual MethodDownload files from course
Burn files to disk
Mail to company for transcription
Company adds open captions
Company mails files back on disk
Upload files to course
39 Flash files26 hours of lecture
2+ week turn around
Identifying a Better Solution
• Accurate and reliable
• Rapid turnaround
• Affordable
• Volume
• Option for multiple formats
• Possible integration with ELIMedia
Solution!
Transcription ProcessEvolution
Manual Method
Partially Automated
2006 2011
Fully Automated
2012
Utilize ELIMedia to manage media assets and associated CC files
GoalPartially A
utomated
Step 1Upload file to ELIMedia
Partially Autom
ated
Step 2Upload file to 3PlayMedia
Partially Autom
ated
Step 3Monitor status of file on 3PlayMedia
Partially Autom
ated
Step 4Download CC file from 3PlayMedia
Partially Autom
ated
Step 5Upload CC file to ELIMedia
Partially Autom
ated
Transcription Process
Manual Method
Partially Automated
2006 2011
Fully Automated
2012
Utilize 3PlayMedia’s APIs to automate the transcription process from within ELIMedia
Goal Fully Autom
ated
Step 1Upload file to ELIMedia
Fully Autom
ated
Step 2Classify “Need” for transcription
Fully Autom
ated
Step 3Media specialist and learning designer
approve media
Fully Autom
ated
Step 4Learning designer submits files
for transcription
Fully Autom
ated
Step 5ELIMedia auto submits files to
3PlayMedia
Fully Autom
ated
Step 63PlayMedia processes files
Fully Autom
ated
ELMS:Media 3PlayMedia
=
Step 7Processed files auto download
CC and transcript files
Fully Autom
ated
Proven Results• 100% reliable (audit on 10 selected files)
• Number of files transcribed 571 (80hrs)
• 2-3 day turn around
• Cost $14,800
• Automated process with API
• Associate both CC and transcripts
• Projected time savings of 15 minutes per file or 12 hours per course
Media Asset AuditPhase 1
(Submitting existing files which have not been set for transcription)
Approve and transcribe media files that have NOT been transcribed
Goal
Step 1Classify Status to “Needs Transcription
(Need)”
Step 2Approve media assets for transcription
Step 3Classify Status to “Submit to 3PlayMedia for
Transcription (Submitted)”
Media Asset AuditPhase 2
(Auto Download of CC and Transcription Files)
Associate already transcribed files between 3PlayMedia and ELIMedia
Goal
Step 1Update approval status in ELIMedia
Associate ELIMedia NodeID with 3PlayMedia’s VideoID
Step 2
ELIMedia3PlayMedia
Step 3Change Status in ELIMedia to “Transcription
Being Processed (Processing)”
Anticipated Benefits1. Institute Design Process Improvement
a. Develop new process which requires ALL video’s to be transcribed (post pilot of course)
b. Streamline approval process
c. Influence practice at Penn State and beyond
2. Student Empowerment
a. Provide additional options for English as Second Language students
b. Personalize delivery by selecting from a range of formats (Interactive transcripts, transcript, CC)
Questions?
Keith D. Bailey, Ph.D Assistant Dean of Online Learning and Education Technology Penn State University – College of Arts and Architecture [email protected]
Penn State University
https://elimedia.psu.edu/ https://elms.psu.edu/
Resources
Josh Miller 3Play Media [email protected] Ph: (617) 764-5189 x102 Tole Khesin 3Play Media [email protected] Ph: (415) 298-1206
3Play Media
http://www.3playmedia.com Resources
Questions