an aea mini workshop presented by james w. altschuld the ohio state university yi-fang leenational...
TRANSCRIPT
![Page 1: An AEA Mini Workshop presented by James W. Altschuld The Ohio State University Yi-Fang LeeNational Chi Nan University Jeff WhiteUniversity of Louisiana](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649ca25503460f9496165b/html5/thumbnails/1.jpg)
An AEA Mini Workshop presented by
James W. Altschuld The Ohio State UniversityYi-Fang Lee National Chi Nan UniversityJeff White University of Louisiana at
LafayetteHsin-Ling Hung University of North Dakota
Annual Meeting of the American Evaluation Association
November , 2010San Antonio, Texas
![Page 2: An AEA Mini Workshop presented by James W. Altschuld The Ohio State University Yi-Fang LeeNational Chi Nan University Jeff WhiteUniversity of Louisiana](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649ca25503460f9496165b/html5/thumbnails/2.jpg)
ObjectivesUnderstand Needs Assessment Learn where versions of surveys fit the pictureQuick overview of survey parameters in NAGet a hands-on feel for the processHave the opportunity to discuss/comment on the experienceHopefully to have some fun on your brief journey into the world of NA
Also to provide you with a glimpse into the Needs Assessment Kit (Altschuld, Eastmond, King, Kumar, Stevahn, and White, 2010)
![Page 3: An AEA Mini Workshop presented by James W. Altschuld The Ohio State University Yi-Fang LeeNational Chi Nan University Jeff WhiteUniversity of Louisiana](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649ca25503460f9496165b/html5/thumbnails/3.jpg)
Introduction (1 minute)Questions (3-5 minutes)Basic terms and concepts (8-10 minutes)Survey overview (15 -18 minutes)
Types and where they fit the processSamples of questions (scaled or otherwise)General analysis strategiesWording problems
Scenario overview, hands-on work, discussion, etc. (rest of time allotted for the session)
![Page 4: An AEA Mini Workshop presented by James W. Altschuld The Ohio State University Yi-Fang LeeNational Chi Nan University Jeff WhiteUniversity of Louisiana](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649ca25503460f9496165b/html5/thumbnails/4.jpg)
Questions for youHow many have done NAs?Have you used surveys in the process?For what purposes?Briefly describe the survey?How did you analyze the data?Overall success of the effort?Did you use other methods as well – what were they?Any other comments about what you did?
Terms/conceptsNeed
-definition with attention to use of words (need & needs) -not mixing solutions with needs-definitional problem immediately for wording survey items-examples of needs (see partial table from book 1)-types of needs (book 1)-levels of needs-Wow, issues at the outset
Needs assessment-three phase model (see schematic)-types of surveys and where they might fit-why you still might have to include solutions in survey despite above admonition
![Page 5: An AEA Mini Workshop presented by James W. Altschuld The Ohio State University Yi-Fang LeeNational Chi Nan University Jeff WhiteUniversity of Louisiana](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649ca25503460f9496165b/html5/thumbnails/5.jpg)
Need: the measurable discrepancy between “what is” or the present state of affairs in regard to the group and situation of interest and the “what should be” or desired state of affairs (Witkin & Altschuld, 1995).
Issues: measurable discrepancy is the key-needs not solutions (premature closure on solutions)-verb vs. noun concept (misuse of the word)-‘desired’, ‘likely to occur’, ‘ought to occur’, etc.-wish and want lists-many types of needs
![Page 6: An AEA Mini Workshop presented by James W. Altschuld The Ohio State University Yi-Fang LeeNational Chi Nan University Jeff WhiteUniversity of Louisiana](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649ca25503460f9496165b/html5/thumbnails/6.jpg)
NA is a systematic set of procedures undertaken for the purpose of setting needs-based priorities and making decisions about organizational improvement and allocation of resources (Witkin & Altschuld, 1995).
Issues-context for the NA-readiness for an assessment-NA is an organizational activity-political aspects to the activity-systems concept and how to think about it
Lots of subtle aspects of need and NAExamplesTypesWhy do it and how does it relate to evaluation
![Page 7: An AEA Mini Workshop presented by James W. Altschuld The Ohio State University Yi-Fang LeeNational Chi Nan University Jeff WhiteUniversity of Louisiana](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649ca25503460f9496165b/html5/thumbnails/7.jpg)
![Page 8: An AEA Mini Workshop presented by James W. Altschuld The Ohio State University Yi-Fang LeeNational Chi Nan University Jeff WhiteUniversity of Louisiana](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649ca25503460f9496165b/html5/thumbnails/8.jpg)
![Page 9: An AEA Mini Workshop presented by James W. Altschuld The Ohio State University Yi-Fang LeeNational Chi Nan University Jeff WhiteUniversity of Louisiana](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649ca25503460f9496165b/html5/thumbnails/9.jpg)
Source: from Needs Assessment Kit Ι, by J. W. Altschuld and D. D. Kumar , 2010, Thousand Oaks, CA: Sage.
![Page 10: An AEA Mini Workshop presented by James W. Altschuld The Ohio State University Yi-Fang LeeNational Chi Nan University Jeff WhiteUniversity of Louisiana](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649ca25503460f9496165b/html5/thumbnails/10.jpg)
![Page 11: An AEA Mini Workshop presented by James W. Altschuld The Ohio State University Yi-Fang LeeNational Chi Nan University Jeff WhiteUniversity of Louisiana](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649ca25503460f9496165b/html5/thumbnails/11.jpg)
![Page 12: An AEA Mini Workshop presented by James W. Altschuld The Ohio State University Yi-Fang LeeNational Chi Nan University Jeff WhiteUniversity of Louisiana](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649ca25503460f9496165b/html5/thumbnails/12.jpg)
Source: from Needs Assessment Kit Ι, by J. W. Altschuld and D. D. Kumar , 2010, Thousand Oaks, CA: Sage.
![Page 13: An AEA Mini Workshop presented by James W. Altschuld The Ohio State University Yi-Fang LeeNational Chi Nan University Jeff WhiteUniversity of Louisiana](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649ca25503460f9496165b/html5/thumbnails/13.jpg)
Source: from Needs Assessment Kit Ι, by J. W. Altschuld and D. D. Kumar , 2010, Thousand Oaks, CA: Sage.
![Page 14: An AEA Mini Workshop presented by James W. Altschuld The Ohio State University Yi-Fang LeeNational Chi Nan University Jeff WhiteUniversity of Louisiana](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649ca25503460f9496165b/html5/thumbnails/14.jpg)
SamplingLevel 1, 2, and/or 3Wording issues
Where in the processFor NAC?Phase 1, 2, 3
What type of needShort term vs long termMaintenanceCollaborativeOther
Double, triple scales or moreContent
BehaviorsAttitudes
Content (continued)Degree of achievement Satisfaction with servicesImportance/value of servicesMotivation to resolve problemsFrequency of useObservationsFeasibility of resolving problemsLiterature based contentImpediments to solutionsList goes on and on
FormattingScales (what type)Open-endedBars
Examples of Surveys but first
![Page 15: An AEA Mini Workshop presented by James W. Altschuld The Ohio State University Yi-Fang LeeNational Chi Nan University Jeff WhiteUniversity of Louisiana](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649ca25503460f9496165b/html5/thumbnails/15.jpg)
![Page 16: An AEA Mini Workshop presented by James W. Altschuld The Ohio State University Yi-Fang LeeNational Chi Nan University Jeff WhiteUniversity of Louisiana](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649ca25503460f9496165b/html5/thumbnails/16.jpg)
![Page 17: An AEA Mini Workshop presented by James W. Altschuld The Ohio State University Yi-Fang LeeNational Chi Nan University Jeff WhiteUniversity of Louisiana](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649ca25503460f9496165b/html5/thumbnails/17.jpg)
Table 3.1 Comparisons of Survey Usage for Organizing the NAC and for Conducting Needs Assessments
![Page 18: An AEA Mini Workshop presented by James W. Altschuld The Ohio State University Yi-Fang LeeNational Chi Nan University Jeff WhiteUniversity of Louisiana](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649ca25503460f9496165b/html5/thumbnails/18.jpg)
Table 3.1 (Continued)
![Page 19: An AEA Mini Workshop presented by James W. Altschuld The Ohio State University Yi-Fang LeeNational Chi Nan University Jeff WhiteUniversity of Louisiana](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649ca25503460f9496165b/html5/thumbnails/19.jpg)
Table 3.1 (Continued)
Source: from Needs Assessment Kit 2, by J. W. Altschuld and J. N. Eastmond, 2010, Thousand Oaks, CA: Sage.
![Page 20: An AEA Mini Workshop presented by James W. Altschuld The Ohio State University Yi-Fang LeeNational Chi Nan University Jeff WhiteUniversity of Louisiana](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649ca25503460f9496165b/html5/thumbnails/20.jpg)
Table 3.2 Four Basic Survey Formats for Kicking Off Initial NAC Discussions
Source: from Needs Assessment Kit 2, by J. W. Altschuld and J. N. Eastmond, 2010, Thousand Oaks, CA: Sage.
![Page 21: An AEA Mini Workshop presented by James W. Altschuld The Ohio State University Yi-Fang LeeNational Chi Nan University Jeff WhiteUniversity of Louisiana](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649ca25503460f9496165b/html5/thumbnails/21.jpg)
Table 3.5 Structure of the NAC Survey
![Page 22: An AEA Mini Workshop presented by James W. Altschuld The Ohio State University Yi-Fang LeeNational Chi Nan University Jeff WhiteUniversity of Louisiana](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649ca25503460f9496165b/html5/thumbnails/22.jpg)
Table 3.5 (continued)
Source: from Needs Assessment Kit 2, by J. W. Altschuld and J. N. Eastmond, 2010, Thousand Oaks, CA: Sage.
![Page 23: An AEA Mini Workshop presented by James W. Altschuld The Ohio State University Yi-Fang LeeNational Chi Nan University Jeff WhiteUniversity of Louisiana](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649ca25503460f9496165b/html5/thumbnails/23.jpg)
Humann (1997)
![Page 24: An AEA Mini Workshop presented by James W. Altschuld The Ohio State University Yi-Fang LeeNational Chi Nan University Jeff WhiteUniversity of Louisiana](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649ca25503460f9496165b/html5/thumbnails/24.jpg)
![Page 25: An AEA Mini Workshop presented by James W. Altschuld The Ohio State University Yi-Fang LeeNational Chi Nan University Jeff WhiteUniversity of Louisiana](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649ca25503460f9496165b/html5/thumbnails/25.jpg)
Example of First Student Survey
OSEA (2005)
![Page 26: An AEA Mini Workshop presented by James W. Altschuld The Ohio State University Yi-Fang LeeNational Chi Nan University Jeff WhiteUniversity of Louisiana](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649ca25503460f9496165b/html5/thumbnails/26.jpg)
Example of Follow-Up SurveyExample of Follow-Up Survey
Lee, Altschuld, & White (2007)
![Page 27: An AEA Mini Workshop presented by James W. Altschuld The Ohio State University Yi-Fang LeeNational Chi Nan University Jeff WhiteUniversity of Louisiana](https://reader035.vdocuments.us/reader035/viewer/2022062518/56649ca25503460f9496165b/html5/thumbnails/27.jpg)
Scenarios/orientationPretend that you are the needs
assessorIndividually and then collectively
What can a NAC tell you?QuestionsContentDiscussion focusing
Sketch out areas where they could give you guidance/input
So you need a survey for other groupsReview item writing rulesReview examples
Considerations for NA surveys
What content Levels 1, 2, and/or
3Relation to other
methodsUse of multiple
scalesImpedimentsOpen-ended
questions