video accessibility: penn state demonstrates its automated captioning solution

Video Accessibility: Penn State Demonstrates Its

Automated Captioning Solution July 13, 2012

Agenda

Captioning Background

Captioning Process

Beyond captions

Demos

Q&A

What Are Captions?

• Captions are text that is time-synchronized with the media

• Captions convey all spoken content as well as relevant sound effects

• Originated in the early 1980s from an FCC mandate for broadcast TV

What Are Captions?

Terminology

• Captioning vs. Transcription

What Are Captions?

Terminology

• Captioning vs. Transcription

• Captioning vs. Subtitling

What Are Captions?

Terminology

• Captioning vs. Transcription

• Captioning vs. Subtitling

• Closed Captioning vs. Open Captioning

What Are Captions?

Terminology

• Captioning vs. Transcription

• Captioning vs. Subtitling

• Closed Captioning vs. Open Captioning

• Post Production vs. Real-Time

Accessibility Laws

Section 508 “All training and informational video and multimedia productions must contain captions …”

Accessibility Laws

Section 504 “No individual, solely by reason of her or his disability…be denied the benefits of any program, service, or activity…”

Section 508 “All training and informational video and multimedia productions must contain captions …”

Accessibility Laws

21st Century Communications & Video Accessibility Act (CVAA) “Closed captioning on video programming delivered using internet protocol….”

Section 504 “No individual, solely by reason of her or his disability…be denied the benefits of any program, service, or activity…”

Section 508 “All training and informational video and multimedia productions must contain captions …”

Accessibility Laws

CVAA Update Expected timeline for publishers to implement the new captioning requirements

6 months: All prerecorded programming that is not edited for Internet distribution (Sept 30, 2012)

12 months: Live & near-live programming originally broadcast on television.

18 months: Prerecorded programming that is edited for Internet distribution.

24 months: Archival programming

Benefits

• Accessible for deaf and hard of hearing

• For ESL viewers

• Flexibility to view anywhere, such as noisy environments or offices

• Content becomes searchable, reusable

• SEO/discoverability

• Used as source for translation

Captions Formats

Common Caption Formats

SRT YouTube and other web players

DFXP Flash players

SCC iPods, iTunes, DVD encoding

SAMI Windows Media

QT QuickTime

STL DVD Studio Pro

CPT.XML Captionate

SBV YouTube

RT Real Media

WebVTT Emerging HTML5

Custom XML Custom formats

Custom Text Custom formats

SRT Example

Captioning Process

Video Platform Integrations

Upload files

• Secure over HTTP • FTP • Paste links • API • Import

Captioning Process

Captions Plugin

Interactive Plugins

Demo

• Examples of automated captioning workflows

• Searchable, interactive video libraries

Video AccessibilityPenn State University Demonstrates its

Captioning Solution

Dr. Keith D. BaileyAssistant Dean, Online Learning

and Education Technology& Director

College of Arts and Architecture

Tole KhesinVP of Marketing

3PlayMedia

Josh MillerVP of Business Development

3PlayMedia

About Penn State

24 Campus System + 1 Virtual Campus

Penn State Univ.Land Grant & State-related

System Breakdown

• University Park - Main Campus (13 Colleges)

• Commonwealth Campuses - (19 state-wide)

• Special Mission Campuses:

• Dickinson - Law

• Great Valley - Graduate

• Penn College of Tech - Technical

• Hershey - Medical

• World Campus - Virtual (Online only)

The e-Learning Institute

Visual Arts

Theater

Music LandscapeArchitecture

Integrative Arts

Art History

Architecture

E-LearningInstitute

MissionTo work with the disciplines represented in the College of

Arts and Architecture to become a leader in e-learning and instructional technology in

the Arts and Design

World Campus(Virtual Campus)

e-Learning Cooperative(24 Campuses)

UP

Penn State Delivery Options for Online Courses

The A&A Portfolio

General Education

31

MPS in Art Education

6

Digital Arts Certificate

8 *

MPS in GeoDesign

8**

Music Education

2

Number of Courses by Portfolio

* 3 Courses Count Toward GA** Courses in Development

UP Online WD OnlineWD OnlineUP & WD

OnlineWD Online

55 online courses

All academic units

12,000+ enrollments

e-Learning Organization

Director

Instructional Designers

Program Manager

InstructionalTechnologySpecialist

e-LearningSupportSpecialist

e-Learning Admin. Coordinator

Delivery

Design

Instructional MultimediaSpecialist

Sr. ID Faculty Fellows

Video Production Coordinator

Office of online non-Credit Continuing

Education

The Increasing Need for Accommodation in

Online Education

US Trend in Online Learning

0

1,750,000

3,500,000

5,250,000

7,000,000

2002 2003 2004 2005 2006 2007 2008 2009 2010

6,142,280

5,579,022

4,606,353

3,938,1113,488,381

3,180,050

2,329,7831,971,397

1,602,970

Source: Going the Distance: Online Education in the United States, 2011 by Babson Survey Research Group

Online Enrollments at PSU2011/12 Data

• 524,892 total enrollments (WD & UP)

• 9% (47,777) of course enrollments were fully online (WD & UP)

University Accommodation Requests

• 2011/12 Academic Year - 1,140 students registered with ODS

• 6 students needed either an interpreter or captioning in 2011/12 compared to 4 in 2010/11

• 5 blind student’s across the university including World Campus

WD Accommodation Requests• All Requests

• Fa10: 18 students enrolled in 52 unique courses

• Sp12: 37 students enrolled in 82 unique courses

• Blind

• Fa10: 0 students enrolled in 0 unique courses

• Sp12: 3 students enrolled in 6 unique courses

• Deaf or Hearing-impaired

• Fa10: 3 students enrolled in 11 unique courses

• Sp12: 9 students enrolled in 27 unique courses

Accommodation Process1. Student discloses request of accommodation to ODS

office

2. If qualified, student receives accommodation letter from ODS

3. Student submits letter to instructor including types of accommodation needed

4. Instructor informs the learning designer of accommodation needed

5. Learning designer coordinates effort to implement accommodation

Penn State Learning Design Accessibility

Initiative

Penn State’s 12 Quality Assurance e-Learning

Design Standards

Developed through PSU Online Coordinating

Council

Learning Design Standards

OCAQIOnline Course Accessibility

Quality InitiativeInitiated July 2011

Charge

Identify accessibility best practices and strategies for online courses

• New University policy implemented August, 2011 - Policy AD-69

• Policy requires compliance with Web Content Accessibility Guidelines 2.0 (WCAG 2.0) conformance level AA

• Pages less than 2 years old must comply

• Older pages must be made accessible by unit-determined date, or by request for accommodation

University Policy

Source - http://guru.psu.edu/policies/AD69.html

Key Blockers to Fix • Image ALT Tags

• Page or Document Titles

• Headings and Sub Headings

• Link Text

• Table Headers and Captions

• Form Labels

• Contrast or Luminosity/Brightness

• Color Issues

• Fonts and Text Layout

• Text Reading Order

• Charts & Accessibility

• Video Captions and Audio Transcripts

Source - http://accessibility.psu.edu/

e-Learning Institute’s Learning Design

Approach

Focus on Quality of Design and Delivery

The Challenge

2000’s

Future

XLate 1990’sX ?

Course Content Course Communication

Content Separate from Communication

Published Content

Course Interface Faculty Content

Content Separate from Design

Media Separate from ContentPublic

Purchased

Private

ELMS: Content

Instructional Content Management

(ICMS)

Our SolutionsA Suite of Tools

ELMS: ELIMedia

Asset Media Management

(AMS)

ELMS: Studio

Collaborative Learning

Environment(CLE)

ELMS: Content

Instructional Content Management

(ICMS)

Our SolutionsA Suite of Tools

ELMS: ELIMedia

Asset Media Management

(AMS)

ELMS: Studio

Collaborative Learning

Environment(CLE)

CommunityModules

Learning DesignModules

CustomThemes

+ + +

PHP &MySQL

Outline Designer

Course Manager

An open source content management system customized by learning designers for course developers

ELMS: Content

Accessible Design

• Customize look and feel per course

• Implement global learning design standards

• Built to incorporate accessibility standards

Accessible Content• Implement stylesheets to

control content presentations

• Install module to assist in compliance review

• Validate or review content based on accessibility standards

• Our big debate! How much freedom do we give?

Open Distribution

https://drupal.org/project/elms

ELMS: Content

Instructional Content Management

(ICMS)

Our SolutionsA Suite of Tools

ELMS: ELIMedia

Asset Media Management

(AMS)

ELMS: Studio

Collaborative Learning

Environment(CLE)

Asset Management Needs

• Eliminate duplication of media assets

• Allow for reuse of digital assets

• Provide mechanism to embed media in courses with minimal effort

• Simplify workflow with copyright and transcription

• Ensure online courses meet copyright and compliance with regard to the use of media

ELMS: ELIMedia• Asset management system to store

media used in online courses which manages:

• images, video, audio, Flash, etc...

• copyright for media assets

• transcription and caption files with appropriate media assets

• Front-end interface for Flash Media Server

• Embed code for easy integration into courses

Asset Media Management

(AMS)

Embedding Media into Courses

Copy Embed Code

Paste Embed Code

Course Display

Benefits of ELIMedia• Assists with maintaining compliancy

• Copyright (TEACH Act, Creative Commons)

• Accessibility (closed captioning and transcript)

• Removed the need for learning designers and faculty to manage copyright and transcription within courses

• Tagging allows for ease of search and retrieval

• Ability to track use of materials in courses

Open Distribution

https://drupal.org/project/elmsmedia

Transcription ProcessEvolution

Manual Method

Partially Automated

2006 2011

Fully Automated

2012

Transcription ProcessEvolution

Manual Method

Partially Automated

2006 2011

Fully Automated

2012

Manual MethodDownload files from course

Burn files to disk

Mail to company for transcription

Company adds open captions

Company mails files back on disk

Upload files to course

39 Flash files26 hours of lecture

2+ week turn around

Identifying a Better Solution

• Accurate and reliable

• Rapid turnaround

• Affordable

• Volume

• Option for multiple formats

• Possible integration with ELIMedia

Solution!

Transcription ProcessEvolution

Manual Method

Partially Automated

2006 2011

Fully Automated

2012

Utilize ELIMedia to manage media assets and associated CC files

GoalPartially A

utomated

Step 1Upload file to ELIMedia

Partially Autom

ated

Step 2Upload file to 3PlayMedia

Partially Autom

ated

Step 3Monitor status of file on 3PlayMedia

Partially Autom

ated

Step 4Download CC file from 3PlayMedia

Partially Autom

ated

Step 5Upload CC file to ELIMedia

Partially Autom

ated

Transcription Process

Manual Method

Partially Automated

2006 2011

Fully Automated

2012

Utilize 3PlayMedia’s APIs to automate the transcription process from within ELIMedia

Goal Fully Autom

ated

Step 1Upload file to ELIMedia

Fully Autom

ated

Step 2Classify “Need” for transcription

Fully Autom

ated

Step 3Media specialist and learning designer

approve media

Fully Autom

ated

Step 4Learning designer submits files

for transcription

Fully Autom

ated

Step 5ELIMedia auto submits files to

3PlayMedia

Fully Autom

ated

Step 63PlayMedia processes files

Fully Autom

ated

ELMS:Media 3PlayMedia

=

Step 7Processed files auto download

CC and transcript files

Fully Autom

ated

Proven Results• 100% reliable (audit on 10 selected files)

• Number of files transcribed 571 (80hrs)

• 2-3 day turn around

• Cost $14,800

• Automated process with API

• Associate both CC and transcripts

• Projected time savings of 15 minutes per file or 12 hours per course

Media Asset AuditPhase 1

(Submitting existing files which have not been set for transcription)

Approve and transcribe media files that have NOT been transcribed

Goal

Step 1Classify Status to “Needs Transcription

(Need)”

Step 2Approve media assets for transcription

Step 3Classify Status to “Submit to 3PlayMedia for

Transcription (Submitted)”

Media Asset AuditPhase 2

(Auto Download of CC and Transcription Files)

Associate already transcribed files between 3PlayMedia and ELIMedia

Goal

Step 1Update approval status in ELIMedia

Associate ELIMedia NodeID with 3PlayMedia’s VideoID

Step 2

ELIMedia3PlayMedia

Step 3Change Status in ELIMedia to “Transcription

Being Processed (Processing)”

Anticipated Benefits1. Institute Design Process Improvement

a. Develop new process which requires ALL video’s to be transcribed (post pilot of course)

b. Streamline approval process

c. Influence practice at Penn State and beyond

2. Student Empowerment

a. Provide additional options for English as Second Language students

b. Personalize delivery by selecting from a range of formats (Interactive transcripts, transcript, CC)

Questions?

Keith D. Bailey, Ph.D Assistant Dean of Online Learning and Education Technology Penn State University – College of Arts and Architecture kdb163@psu.edu

Penn State University

https://elimedia.psu.edu/ https://elms.psu.edu/

Resources

Josh Miller 3Play Media josh@3playmedia.com Ph: (617) 764-5189 x102 Tole Khesin 3Play Media tole@3playmedia.com Ph: (415) 298-1206

3Play Media

http://www.3playmedia.com Resources

Questions