Join Together Advisory BoardJoin Together Advisory BoardEvaluation Team ReportEvaluation Team Report

Donna MertensDonna MertensKatrina BledsoeKatrina Bledsoe

Heidi HolmesHeidi HolmesPauline GinsburgPauline Ginsburg

ACE-DHH ConferenceACE-DHH ConferenceDenver, ColoradoDenver, Colorado February 2006February 2006

Join Together Evaluation TeamJoin Together Evaluation TeamObj 1.1 Obj 1.1 Tom and Tom and Karen and Karen and Heidi Heidi HolmesHolmes

Obj Obj 1.2/2.3 1.2/2.3 Shelly, Shelly, Maribeth, Maribeth, Liz & Liz & Karen & Karen & Katrina Katrina BledsoeBledsoe

Obj 2.1 Obj 2.1 Dave Nanci Dave Nanci & Pauline & Pauline GinsburgGinsburg

Obj 1.4 Kate Obj 1.4 Kate & Pamela; & Pamela; Obj 2.2 Obj 2.2 Susan & Susan & Brenda;Brenda;

Obj 1.3 Obj 1.3 Joyce & Joyce & Sharon & Sharon & KatrinaKatrina

Obj 2.4 John Obj 2.4 John Sandy AND Sandy AND Donna Donna MertensMertens

Yr 2 Evaluation Team Yr 2 Evaluation Team

John McLaughlin & John McLaughlin & Donna MertensDonna Mertens

Assessment SurveyAssessment Surveywww.Deafed.netwww.Deafed.net evaluationevaluationOn-going TTL On-going TTL consultationconsultationTTL SurveyTTL SurveyYear 2 report Year 2 report

WWW.DEAFED.netWWW.DEAFED.net

MethodsMethods Online surveyOnline survey Treasure Hunt (Heidi Holmes)Treasure Hunt (Heidi Holmes)

And the results are…And the results are…

What is your primary status in terms of What is your primary status in terms of deaf education? (results from deaf education? (results from

deafed.net survey)deafed.net survey)

0

5

10

15

20

25

30

35

Undergraduatestudent

PreK-12 teacher Faculty

Percent

How often do you visit How often do you visit www.deafed.net?www.deafed.net?

0

5

10

15

20

25

30

35

40

45

Almosteveryday

Aroundonce amonth

Not untiltoday

Percent

How often do you use the following How often do you use the following features of www.deafed.net? features of www.deafed.net?

0

5

10

15

20

25

30

35

40

45

post jobopportunities

for yourschoo...

postdocuments

coveringsubjects of i...

submit aresponse to

BulletinBoards

view streamedVirtual Topical

Seminars

searchscholarship

opportunitiesfor ...

change yourpassword

almost everyday once wk once mo few times yr not until today never

Most frequently used featuresMost frequently used features

Job searchJob search Post/search for documents of interestPost/search for documents of interest Read Bulletin Board entries; respond to Read Bulletin Board entries; respond to

BB threadsBB threads Visit Help and FAQ areasVisit Help and FAQ areas Search calendar of eventsSearch calendar of events Communication with team membersCommunication with team members

Rate the following features in terms of ease of useRate the following features in terms of ease of use

05

1015202530354045

Loginprocedure

Posting jobs Viewing VirtualTopical

Seminars

Best Better Average Improve Not used

Recommended ImprovementsRecommended Improvements ““Mostly very happy; items barely Mostly very happy; items barely

mentioned: accessing bulletin boards & mentioned: accessing bulletin boards & findings what I’m looking for”findings what I’m looking for”

““Quality of documents”Quality of documents” ““Remember my password; login Remember my password; login

frustration; internal links broken”frustration; internal links broken” ““Post choice entry; post documents”Post choice entry; post documents” ““Too much text; make it friendlier & more Too much text; make it friendlier & more

transparent – e.g., change ‘documents’ to transparent – e.g., change ‘documents’ to ‘Resources and suggestions for teacher’”‘Resources and suggestions for teacher’”

Best ExperiencesBest Experiences

““It is wonderful to have a one-stop point of It is wonderful to have a one-stop point of reference to refer people to. I feel like it is the reference to refer people to. I feel like it is the BEST place to go for anyone interested in deaf BEST place to go for anyone interested in deaf education. We've needed something like this for education. We've needed something like this for a long time. I'm proud of our collective work to a long time. I'm proud of our collective work to bring the site to fruition and continue to refine it.”bring the site to fruition and continue to refine it.”

““Finding other teachers of the deaf and making Finding other teachers of the deaf and making connections. It's a wonderful resource!!”connections. It's a wonderful resource!!”

““Working with Michelle Hoversten. She is always Working with Michelle Hoversten. She is always

positive, very helpful and personable.” positive, very helpful and personable.”

Year 2 ReportYear 2 Report

Reporting Form Changed by US Reporting Form Changed by US Department of EducationDepartment of Education

Survey of TTLs and Interviews with Project Survey of TTLs and Interviews with Project leadersleaders

Review of Review of www.deafed.netwww.deafed.net Project leaders and evaluator met for 2 Project leaders and evaluator met for 2

days to construct the first draft of the days to construct the first draft of the report – followed by electronic report – followed by electronic communicationscommunications

Report is now at www.deafed.netReport is now at www.deafed.net

1. Project Objective - Topical Team 1.1 Technology Infrastructure: Create an efficient collaborative network of consortium members (CM), institutes of higher education (IHE), State educational agencies (SEA) and local educational agencies (LEA) that results in empirical evidence regarding the impact of Web-based video conferencing (VC) to reform d/hh teacher preparation.

1.b. Performance MeasureMeasure

Type Quantitative Data 

Increase number of JT members who use Web-based video conferencing technology (WBVCT).

Project Target Actual Performance Data  

Raw Numb

er Ratio %

Raw Numbe

r Ratio %

 

25 /

42 /

170%  

1.c. Performance MeasureMeasure

Type Quantitative Data 

Increase the number of technology and software alternatives evaluated for a Virtual Professional Development School (VPDS).

Project Target Actual Performance Data  

Raw Numb

er Ratio %

Raw Numbe

r Ratio %

 

2 /

7 /

350%  

1.d. Performance MeasureMeasure

Type Quantitative Data

Increase the amount of technical assistance provided to the JT community.

Project Target Actual Performance Data

Raw Numb

er Ratio %

Raw Numbe

r Ratio %

500 /

1,120 /

224%

Year 2 report included Goals for Year 2 report included Goals for Year 3Year 3

Each TTL has established goals that include Each TTL has established goals that include dissemination and measurement of effects of dissemination and measurement of effects of grant related activitiesgrant related activities

Priorities established:Priorities established: Engagement with deaf community strengthenedEngagement with deaf community strengthened Video based products captionedVideo based products captioned Research teams supported by evaluation teamResearch teams supported by evaluation team

Quarterly reportsQuarterly reports

TTLs interviewed re: accomplishments, TTLs interviewed re: accomplishments, challenges, support needs, spin offs; Project challenges, support needs, spin offs; Project leadership interviewed.leadership interviewed.

Document reviews: Executive Advisory Board Document reviews: Executive Advisory Board and TTLs phone conference minutes; TTL and TTLs phone conference minutes; TTL postings to postings to www.deafed.netwww.deafed.net ; review of email ; review of email records re: cyber mentors and master teachers.records re: cyber mentors and master teachers.

Evaluation team supporting research of project Evaluation team supporting research of project teamsteams

Synergy Synergy

Teams are working togetherTeams are working together Year 3 represents synergy of teams Year 3 represents synergy of teams

toward achievement of overall toward achievement of overall Join Join TogetherTogether goals goals

Sustainability is a major issueSustainability is a major issue Any chance for voice recognition software Any chance for voice recognition software

to provide real time captioning for video to provide real time captioning for video conferences?conferences?