using the webinar as a substitute for in-class security training fissea 2004 march 11, 2004 e. jane...
TRANSCRIPT
Using the Webinar as a Substitute for In-Class Security Training
FISSEA 2004
March 11, 2004
E. Jane Powanda
2
ITSC
Agenda
What is a webinarProducing a webinar- the ITSC experienceUsing the webinar in a training programFinal thoughts
3
ITSC
What is a Webinar
Synchronous Internet trainingGeographically dispersed participant learn
together with out leaving homeVisual information via the workstation browserVoice information via teleconference or voice
over IP
An online presentation featuring an expert in a particular field using a web based collaborative tool.
(ASTD – American Society for Training and Development)
4
ITSC
Developing and Delivering a Webinar - The ITSC Experience -
INFORMATION TECHNOLOGY SUPPORT CENTER
STATE OF MARYLANDACS COMMERCIAL SOLUTIONS
MITRETEK SYSTEMSUNIVERSITY OF MARYLAND
Sponsored by the US Department of Labor
Webinar Study
ITSCwww.itsc.state.md.us
6
ITSC
What is the ITSC
Information Technology Support Center
US Department of Labor
Grant Steering Committee
Representatives from states and USDOLState of Maryland
• Contracting Office
Mitretek Systems – Prime Contractor• Program management• Systems engineering• Systems Prototype and Pilot Development• Laboratories
University of Maryland • Training
ACS Commercial Solutions• Software development • Mainframe experience• Systems Integration
7
ITSC
Applying IT to State Workforce Agencies
U IES
TrainingLMI
Labor Exchange
SWA OPERATIONS
InternetCall Centers
One-Stop OfficesClient/Server
EDIVoice Response Units
Geographic Information Systems
Decision SupportImaging
TelecommunicationsProcess Workflow
Security
TECHNOLOGIES
8
ITSC
Webinar Feasibility Project
Determine the feasibility of delivering ITSC training via webinar
Determine acceptance of training method by state participants
Gain experience in developing an effective webinar using the Mshow webinar delivery tool
Limited to a single webinar production
Scope
9
ITSC
Organization of the ITSC Study Briefing
Basic requirementsState partner participation Participant evaluation resultsPlanning the webinarDeveloping the webinarDelivering the webinarWebinar CostsLessons learnedRecommendations
10
ITSC
Basic Requirements for a Webinar
3
1
2
Web Conferencing
Teleconferencing
Creative Instructor
Important messagewell prepared
4
11
ITSC
Features of Webinar Delivery ToolsApplication sharingGuided Internet toursDisplay PowerPoint presentationsAudience polling Chat feature for student/teacher interactionQuestion featurePresenters speak from multiple locationsRecord session for playback at future timeParticipant registration featuresNo special software required of participant
12
ITSC
Webinar Delivery Tools – Some ExamplesAspen Virtual Classroom Server 2.0 (Click2Learn) Centra Symposium (Centra Software)Communicast Event Center (Communicast)Communispace (Communispace)ePath Learning LIVE (ePath Learning Inc.)First Virtual (CUseeMe Networks Inc.)Gradepoint Live (Gradepoint Inc.)HorizonLive.com's HorizonLiv (HorizonLive)Hewlett-Packard's Virtual Classroom (Hewlett-Packard)iLearning's iLive (iLearning Inc.)iLinc (EDT Learning)Interwise Enterprise Communications Platform (ECP) (Interwise)Isoph Blue (Isoph Corporation)LearnerHall (Maxit)Lotus LearningSpace Collaboration Module (Lotus Software)Macromedia Breeze Live (Macromedia)MeritScholar Live (iictechnologies)Meeting Center (Genesys)Meetingplace (Latitude)Microsoft Office Live Meeting (Microsoft) (formerly Placeware)mShow (INtercall)One Touch Front Row (One Touch Knowledge Systems)PictureTalk (Pixion)iPresentation Podium (Presenter Inc.)Raindance Web Conferencing Pro (Raindance Communications)ROCKET Webclass (Eedo Knowledgeware)Siebel Distance Learning (Siebel Systems)Sykaro (Sykaro Inc.)vClass (Elluminate Inc.)Web Crossing's Campus Crossing (Web Crossing Inc.)WebEx Meeting Center with Live Training Extensions (WebEx Communications Inc.)Videum Conference Pro (NTSC and PAL) (Winnov L.P.)VS Webcasting (Virage Inc.)
13
ITSC
A View of a classroom – (WebEx tool)
14
ITSC
ITSC State Partner Participation
Provided input on good and bad features of webinars they attended in the past
Provided suggestions for webinar topicsVoiced preference for webinar lengthAttended ITSC webinar and assessed effectiveness
15
ITSC
Partner Comments on Webinars Attended in the Past was Helpful
Characteristics of a good webinar– Good technical quality– Moderator kept webinar on track– Question & answer session handled well– Wrap up was good
Characteristics of a bad webinar– Poor content or not what expected– Bad speakers or speakers not well organized– Too much marketing– Delays between screen and spoken part– Boring graphics
16
ITSC
Participants were Geographically Dispersed
17
ITSC
Participant Evaluation Results
Would recommend it to their colleagues Felt comfortable with the delivery method Easy to connect to the webinar using instructions provided Enough opportunity to participate in the class Material was useful and well presented The instructors were well organized Pace was good Length of presentation was good Some concerns with voice quality
18
ITSC
Participant Approval Ratings (would you attend another webinar? )
0
5
10
15
20
25
30
35
OneHour
ThreeHour
OneDay
ThreeDay
Attend awebinar
Key:
Approval ratings from 8 to 40
8 – All strongly disagree
40 – All strongly agree
Eight persons provided input
19
ITSC
I had planned only to note the presentation process but was pulled in by the presentation and am very excited about this technology! The presenters were well organized (maybe too much) and it appears that you had rehearsed most of this.
It allowed me access to a seminar/training environment without the travel and expense of that travel. The sound was very good and it allowed plenty of opportunity to participate.
It was much better than just a conference call. It seems like a valuable tool now that tight budgets have reduced travel budgets for face-to-face meetings
It comes across better if it sounds conversational, rather than obviously being read from text.
Its quick, fast and I’m at my desk.
Comments from Participants
There was static in the audio
I am a visual learner and had some trouble staying focused on a disembodied voice. It did get better as we went on, but I could not have lasted more than 1 hr!
20
ITSC
The ITSC Trial Webinar
The LobbyThe ToolsPolling the AudienceEvaluation form
21
ITSC
Welcome
Host: Jane Powanda
Presenters:
Ron Mains Tim Meier
. . .to the ITSC’s Inaugural Webinar on Speech Recognition in the State UI Agency Environment.
The Lobby
22
ITSC
The show will be starting shortly
The Lobby
23
ITSC
Tools - Engaging the Attendees is Key!!
24
ITSC
Polling the AudienceAre you currently using IVR for the first portion of
your Initial Claims script?
Yes
No
Results
25
ITSC
The Evaluation Form
26
ITSC
Planning the Webinar
Work with state partners– Select a topic– Determine length of webinar
Organize the ITSC webinar teamSelect webinar delivery toolResearch webinar techniques to determine how
to produce a good webinar
27
ITSC
Developing the Webinar
Take 15
Prepare Content
Learn to Use the Tools
Send Invitations
Review and Rehearse
Resolve Technical Issues
Prepare Evaluation Form
28
ITSC
Preparing the ContentTopic chosen based on interests and needs of
intended audience Goals for content
– Relevant, – Interesting – Timely and useful
Goals for presentation– 45 minutes in length– 15 minutes for introduction and Q & A session– Multiple presenters
Design slidesWrite script for presentation
29
ITSC
Learn to use the tools
Web training provided by MshowHelp from Mshow tech support
– Downloading plug-ins for conducting polls– Creating polling slides– How to tell when polling is complete– Navigating slide presentation– Controlling animation– Using the annotation tools
Self experimentation with the toolAt least five sessions with Mshow technical
support persons to resolve technical issues
30
ITSC
Delivering the Webinar
Leaders on-line at least one half hour before webinar
Greet attendees as they join the webinarStart on timeWelcome and give instructions for
technical assistance during the webinar Instruct attendees on use of tools and
plan for the rest of the webinarPass control between leadersConduct Q&ALog off and collect evaluation forms
31
ITSC
Webinar Production Costs
Webinar development– One time cost for webinar development– PowerPoint slide presentation development– Script development– Rehearsals with total cast
Delivery cost– Cost are incurred each time the webinar is
delivered– These costs are per individual– Costs are incurred for both trainers and
students
32
ITSC
Estimated Costs – Webinar Development
One time cost for each webinar hour developed $15,000– PowerPoint slide presentation development (40 hours)– Script development (40 hours)– Other (40 hours)
• Rehearsal• Review• Problem resolution• Evaluation form
Training for persons developing or leading a webinar ( 20 hours) $2500
Total fixed cost $17,500 per webinar hour
33
ITSC
Webinar Delivery Costs
Staff time for trainers– Two staff hours per trainer for one hour webinar delivery– Assuming 3 trainers, cost is $750 per webinar hour
Cost for Web conferencing and teleconferencing services– $.38/minute per person connected – Mshow connection– $.21/minute per person connected – teleconference– Approximately $36/hour per person for webinar connection
Note: The figures given for webinar delivery costs are based on “retail” cost. It is possible to negotiate better rates for webinar services or even to pay a flat rate for unlimited monthly service. This would significantly reduce the delivery cost per student hour.
34
ITSC
Cost Comparison: eighteen hour workshop – class size - 50
Classroom Webinar
Development $90,000 $180,000
Trainer (2) $3750 * 2 = $7500 $3000 * 2 = $6000
Class materials $750
Travel cost $50,000 0
Room and refreshments
$3,840 0
Connection cost 18/hr per student or trainer
0 $18,252
Total $154,090 $204,452
35
ITSC
Cost Comparison – 2nd class delivery of same material. Class size = 50
Classroom Webinar
Development 0 0
Trainer (2) $3750* 2 = $7500 $3000 * 2 = $6000
Class materials $750
Travel cost $50,000 0
Room and refreshments
$3,840 0
Connection cost 18/hr per student or trainer
0 $18,252
Total $62,590 $24,252
Economies of scale can be realized for the webinar option when it is presented multiple times, or the number of students is high
36
ITSC
Cost comparison: 3 hour seminar – class size is 50
Classroom Webinar
Development $15,000 $30,000
Trainer (2) $625*2=$1,250 $500 * 2 = $1,000
Class materials $125
Travel cost $30,000 0
Room and refreshments
$820 0
Connection cost 3/hr per student or trainer
0 $2,808
Total $46,995 $33,808
37
ITSC
Classroom Webinar
Development 0 0
Trainer (2) $625*2=$1,250 $500 * 2 = $1,000
Class materials $125
Travel cost $30,000 0
Room and refreshments
$820 0
Connection cost 3/hr per student or trainer
0 $2,808
Total $32,195 $3,808
Cost Comparison – 2nd class delivery of same material. Class size = 50
When travel is required for classes of short duration, the webinar delivery method provides significant cost savings
38
ITSC
Webinar Cost Conclusions
The webinar is cost effective for short meetings where out of town travel is required
The webinar is cost effective for long training sessions (18 hours over a three day period) where out of town travel is involved, when either of the following conditions is met– The class is delivered multiple times– The class is delivered to a large number of
students
Irregardless of cost, study participants indicated that they would not attend an 18 hour ITSC workshop webinar conducted over a three day period. They may attend a 3 hour session, and would attend a 1 hour session.
39
ITSC
Lessons Learned
Content is key to getting good results – present timely information
Scripting makes it easy for anyone to deliver a webinar
Spontaneity can be lost by adhering strictly to a script
Multiple speakers helps to add variety to the presentation
Speakers must work as a team
Webinar development and delivery takes
more time than expected
40
ITSC
More Lessons Learned
Audience participation is essentialChange visuals more frequently than for an in-
person presentation Ensure that slides are readableThe visual must be matched with the spoken partProblems with the technology can be expectedHave a backup computer in case one fails – one
will!
41
ITSC
More Lessons Learned
Speaker phones don’t work for presenters! Use individual telephone headsets for presentersSpeakers don’t need to be in the same roomAdjust headsets and volume to ensure consistent
voice quality among presentersGive instructions on how to get technical help at
beginning
42
ITSC
Still More Lessons LearnedUse a production manager
– Promotes consistent presentation development– Helps participants resolve technical problems during the
webinar– Collects questions for Q & A session
Providing online capability for completing the evaluation form increases the likelihood of getting feedback
Webinar delivery costs can be expensiveNegotiate good rates for Webcast service Use identical equipment for rehearsals and live
showTEST TEST TEST
43
ITSC
Using the Webinar in a Security Training Program
44
ITSC
Recommendations for Using the Webinar as a Replacement for Classroom Training
Schedule workshops over a two to four week period rather than over several days
Offer sessions independently rather than packaged as a complete workshop
Develop short seminars on timely security topics
Record the webinar for future playbackLimit class size to encourage student
participation Use guest speakers from within or
outside the organization
45
ITSC
Some Things Show Better Using a Webinar
Walk through a hack scenario– Screen shots difficult to see when
projected in a classroomDemonstrate the use of a program or tool
– Backup procedures– Vulnerability assessment tool– Security Self Assessment Tool
Show real vulnerabilities by surfing the web and viewing HTML code– Screen shot of code difficult to read
when projected in a classroom
46
ITSC
Webinar Training - Implications for Presenters
Better preparation necessary – students less forgiving of a teacher they cannot see
No long pauses in speechShort modules are bestFollow up activities enhance learningNeed to poll students for feedbackStudents need materials ahead of time
47
ITSC
Modifying Classroom Training Materials
Time Topic
9:00 – 10:15
Session 1
Threats, Vulnerabilities & Risk
“It happened Here” – Panel
Break
10:30 – 12:00
Session 2
Common Security Mistakes – Video
Introduction to Security Solutions
State Policy/ Incident Handling
People and Procedures
Lunch
1:00 – 2:30
Session 3
Technology Solutions
State Network Security Implementation
Scams, Fraud, and Spam
Break
2:45 – 4:00
Session 4
About Forensics
Physical and Personal Security
Security Awareness Training
Re-organize into six 45 minute webinars
48
ITSC
Time Topic
9:00 – 10:15
Session 1
Introduction
Security in the Application Lifecycle
Security Basics
Writing Security Requirements
Break
10:30 – 12:00
Session 2
Writing the Operational Security Plan
Web Programming Issues
Lunch
1:00 – 2:30
Session 3
Authentication Options
Assessing Security Risk
Closing Remarks and Questions
Modifying Classroom Training MaterialsSecurity Analyst Training
Re-organize into five one hour webinars
49
ITSC
Use Free or Inexpensive Security Webinars Offered by vendors, not for profit
associations and othersFree or pay per viewLive or RecordedEducational or marketingSome Examples
– Intrusion Detection Essentials - SANS Institute– Managing Security Incidents in the Enterprise -
Symantec– Dynamic Threat Protection - ISS– Securing .NET Applications from the Start –
Microsoft– Identity Management Strategies for HIPAA
Compliance - RSA Security
50
ITSC
Examples of Free Webinars
51
ITSC
Examples of Free Webinars
52
ITSC
Final Thoughts
The Webinar is a cost effective training alternative when:– Students are geographically dispersed– The webinar is well done– The webinar is short enough to hold
student interest – The webinar is recorded and used
multiple times
Webinars may not work in secure environments
Webinars just might work
