field of dreams: if you build it, will they come? jamie ... · pdf filefield of dreams: if you...

Field of Dreams: If You Build it, Will They Come?Jamie Bell, Project Director, CAISE

Informal Science Education Association of TexasAnyplace, Anytime Science

Wimberley, Texas February 27, 2014

Images courtesy of ISE PI Meeting 2012 attendeesFrom left to right: Geoffrey Haines-Stiles; Mohini Patel Glanz, NWABR; Scot Osterweil; April Luehmann

Friday, May 16, 2014

Allegheny Accordion and Guitar Festival, Seven Springs PA circa 1966


Pittsburgh, PA 1970s


Field Trip “Explainer” 1985-1987, the Exploratorium


High School Explainer Program- 1987-1995


Espaço Ciência Viva, Rio de Janeiro, Brazil 1992


Centre of Learning, Petrosains: The Discovery Centre 2006-2009


American Chemical Society Congressional Briefing, April 2012


Jamie Bell, Trevor Nesbit, Kalie Sacco, Grace Troxel (Association of Science-Technology Centers)

John Falk (Oregon State University, Free-Choice Learning Program)

Kevin Crowley (University of Pittsburgh Center for Learning in Out-of-School Environments)

Kirsten Ellenbogen (Great Lakes Science Center)

Sue Ellen McCann (KQED Public Media)


• CAISE is located at the Association of Science-Technology Centers (ASTC)

• Over 485 science center members in 45 countries & every U.S. state (over 600 members total)

• In 2012, ASTC estimates that there were 93.4 million visits to science centers and museums worldwide


ISE Landscape, 2007-2008

The ISE Timelinetimeline.insci.org

• Provides a chronological overview of the rich history of informal

Figure 1. Two-dimensional representation of current ISE Landscape as a function of identification with informal education and public understanding of STEM. NOTE: Axes are qualitative scales representing “High” (H) to “Low” (L) importance. (Falk, et al., 2008)


h"p://&meline.informalscience.org/


https://east.exch029.serverdata.net/owa/redir.aspx?C=PDuAyRMlSECVo_t2R5SmlOF4NcuPBtEIOhvAA6_YzBpluc9LSBY9GusJTa4xx86QjQBk5BJNp2s.&URL=http://timeline.informalscience.org/

https://east.exch029.serverdata.net/owa/redir.aspx?C=PDuAyRMlSECVo_t2R5SmlOF4NcuPBtEIOhvAA6_YzBpluc9LSBY9GusJTa4xx86QjQBk5BJNp2s.&URL=http://timeline.informalscience.org/

caiseCatalyze, Connect,

Characterize, Disseminate

Broader Impacts/ISE

Practice-and- Research

Evaluation Capacity Building

informalscience.org

NSF AISL Portfolio

Citizen Science

Cyber & Gaming

Media (TV, Radio, Film)

Museums & science centers

Zoos Botanical Aquaria

Festivals/cafes, events

Youth & Community Programs

^CAISE major initiatives for 2012-2015^


CAISE convening on Practice-and-Research in Informal Science Education, January 2012


STEM Education & Funding in the United States


Results from the Program of International Student Assessment (PISA):

• In 2012, 22 education systems scored higher than the U.S. average on science (18 did in 2009)

• In 2012, 29 education systems scored higher than the U.S. average on math (23 did in 2009)

Source:http://www.npr.org/blogs/the two-way/2013/12/03/248329823/u-s-high-school-students-slide-in-math-reading-science


• PISA: In 2012, U.S. students scored slightly lower than average on math literacy, and close to average on science literacy, on PISA (1)

• NAEP: In 2011, the National Assessment of Educational Progress (NAEP) found that frequency of “hands-on science” activities for 8th graders was correlated with higher science proficiency scores (2)

• TIMSS: In 2011, students in the United States (as well as other countries) assessed by the Trends in International Mathematics and Science Study (TIMSS) were found to have higher science achievement when instruction was “engaging” (3)

Sources:(1) http://www.oecd.org/pisa/keyfindings/PISA-2012-results-US.pdf(2) http://nationsreportcard.gov/science_2011/(3) http://timss.bc.edu/timss2011/downloads/T11_IR_S_Executive_Summary.pdf


Findings from the 2011 Committee on Science, Technology, Engineering, and Math Education (CoSTEM) Report

Source:(1) The Federal Science, Technology, Engineering, and Mathematics (STEM) Education Portfolio: A report from the Federal Inventory of

STEM Education Fast-Track Action Committee. Committee on STEM Education at the National Science and Technology Council, December 2011, pp. 12.

(2) The Federal Science, Technology, Engineering, and Mathematics (STEM) Education Portfolio: A report from the Federal Inventory of STEM Education Fast-Track Action Committee. Committee on STEM Education at the National Science and Technology Council, December 2011, pp. 68

(1) (2)


Source: Association of Science-Technology Centers (ASTC) report on National Science Foundation: ISE/AISL Budget History

0

100.00

200.00

300.00

400.00

1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014

55.0047.8062.4064.2065.9065.7064.5063.9062.7062.8062.5062.5056.0056.0046.0046.00

278280273

322

261

227212216216

182207

177165

203186182

Mill

ions

of

dolla

rs

Fiscal YearESIE/DRL ISE/AISL

Program renamed from ISE to AISL

Over a 16-year period, the ISE/AISL budgets remained relatively consistent until a ~22% cut between FY 2012 and FY 2013. In January, the program was

restored to 50 million in FY 2014.


Federal STEM Consolidation

• Administration proposed a “consolidation” of federal STEM programs for FY 2014

• There was bipartisan disapproval of the consolidation in both chambers of Congress

• In January, Congress passed (and the President signed) an Appropriations bill for FY 2014 that did not include the consolidation

• On March 4th, President will announce FY 2015 budget request


Changes in the NSF AISL Program

• Solicitation for both FY 2014 and FY 2015

• New program types introduced: Research in Service to Practice & Innovations in Development

• Other program types: Pathways, Broad Implementation, & Conferences, Symposia and Workshops

• Common Guidelines for Education Research & Development introduced

Learn more at: http://informalscience.org/nsf-aisl


What’s/Where’s the Evidence?

Key Research & Reports in the Informal Learning Field


Falk, J., Randol, S., & Dierking, L. The Informal Science Education Landscape: A Preliminary Investigation. The Center for Advancement of Informal Science Education, 2008. Available at: http://www.informalscience.org/research/ic-000-000-002-020

Falk, J., Reinhard, E., Vernon, C., Bronnenkant, K., Deans, N., & Heimlich, J. Why Zoos and Aquariums Matter: Assessing the Impact of a Visit to a Zoo or Aquarium. Silver Spring, MD: 2008. Available at: http://www.aza.org/uploadedFiles/Education/why_zoos_matter.pdf

CAISE Inquiry Group Reports, 2008-2010. Available at: http://informalscience.org/about/about-caise/inquiry-group-reports


National Research Council. Learning Science in Informal Environments: People, Places, and Pursuits. Washington, DC: The National Academies Press, 2009. Available at: http://www.nap.edu/catalog.php?record_id=12190

National Research Council. Surrounded by Science: Learning Science in Informal Environments. Washington, DC: The National Academies Press, 2010. Available at: http://www.nap.edu/catalog.php?record_id=12614

Na&onal Research Council. Educa&on for Life and Work: Developing Transferable Knowledge and Skills in the 21st Century. Washington, DC: The Na&onal Academies Press, 2012.


http://www.nap.edu/catalog.php?record_id=12614




Maltese, A., & Tai, R. Eyeballs in the Fridge: Sources of early interest in science. International Journal of Science Education, 32(5), 2009. pp. 669-685. Abstract available at: http://informalscience.org/research/ic-000-000-008-558

Falk, J., & Dierking, L. The 95 Percent Solution. American Scientist, Vol. 98, November-December 2010. pp. 486-493. Available at:http://www.informalscience.org/documents/FalkandDierking95perc.pdf

Afterschool Alliance. Defining Youth Outcomes for STEM Learning in Afterschool. 2013. Available at: http://www.afterschoolalliance.org/STEM_Outcomes_2013.pdf


Game-Changers and the Assessment Predicament in Afterschool Science: http://informalscience.org/research/ic-000-000-007-604/Game-Changers_and_the_Assessment_Predicament_in_Afterschool_Science

Traphagen, K. & Traill, S. How Cross-Sector Collaborations are Advancing STEM Learning. Commissioned by the Noyce Foundation, February 2014. Available at: http://www.noycefdn.org/documents/STEM_ECOSYSTEMS_REPORT_140128.pdf


https://east.exch029.serverdata.net/owa/redir.aspx?C=8L5FRSxU-ECo7nv59oSqDmAxRvLLBtEIzAinb2hsSKJrM4VimBDBt_hW2QFuPWb6wih9T9jJo1g.&URL=http://informalscience.org/research/ic-000-000-007-604/Game-Changers_and_the_Assessment_Predicament_in_Afterschool_Science






What are We Measuring?

This Wordle represents constructs measured by six informal STEM education assessment projects.


Informal STEM Education Assessment Projects

• Advancing Technology Fluency (PI: Brigid Barron, Stanford University)

• Developing, Validating, and Implementing Situated Evaluation Instruments (DEVISE) (PI: Rick Bonney, Cornell University)

• Common Instrument (PI: Gil Noam, Harvard University)

• Framework for Observing and Categorizing Instructional Strategies (FOCIS) (PI: Robert Tai, University of Virginia)

• Science Learning Activation Lab (PI: Rena Dorph, University of California, Berkeley)

• SYNERGIES (PI: John Falk, Oregon State University

Learn more at:http://informalscience.org/perspectives/blog/updates-from-the-field-

meeting-on-assessment-in-informal-science-education


Find and contribute statements of evidence on the ISE Evidence Wiki.

Learn more at: http://informalscience.org/research/wiki


A guide for program and project leaders working with professional evaluators

Learn more at:http://informalscience.org/evaluation/evaluation-resources/pi-guide


InformalScience.org: a Resource Repository for the ISE Field


Learn more at: http://informalscience.org/about/informal-science

• Outgrowth of the Museum Learning Collaborative (1997-2002)

• Established in 2006 at UPCLOSE

• CAISE refunded in 2012 with a Web Infrastructure Initiative

• Redesigned and re-launched by CAISE in May 2013


• 3 main types of resources collected: Projects, Research, Evaluation

• Search is organized by metadata

• Ability to search InformalScience.org and the Informal Commons

• Perspectives: news, blog posts, newsletter

• Community: groups, calendar, member directory


Characteristics of InformalScience.org Membership


260

182

114 112

95

89

60

52

5141

312917Library Art museumHistory museumBotanical garden and/or arboretumNetworkPlanetariumChildren's museumNatural history museumNature or interpretive centerZoo or aquariumK-12College/universityScience-technology center/museum

N=515; data was self-reported or inferred from member organization. Members could choose multiple options.


52

88

171

Educational materials developerExhibit design/fabricationWeb software/design firm



60

31

17

12

Television station or organizationRadio station or organizationIndependent film or media producerOnline media producer



111

79

81

32

Evaluation groupIn-house evaluatorIndependent evaluatorResearch and evaluation organization



Characteristics of Informal Commons Content

As of February 14th, 2014:

• 8,193 records in the Informal Commons

• 4,139 project, evaluation, and research records in the Informal Commons

• 2,431 project, evaluation, and research records derived from InformalScience.org


Public educational programs

Media and technology

Exhibitions

Professional development, conferences, and networks

K-12 and Higher Education Programs

0 175 350 525 700

173

382

497

663

697

N=1,548; records can exist in multiple categories.


Exhibitions

Public Educational Programs

Professional development, conferences and networks


K-12 and Higher Education Programs

0 175 350 525 700

149

216

304

466

666

60

87

99

251

430

Research ProductsReference Materials



Exhibitions

Public educational programs


Professional development, conferences, and networks

K-12 and higher education programs

0 75 150 225 300

49

105

224

282

289

43

49

91

120

131

Research and evaluation instrumentsEvaluation reports



YOU can build & strengthen the field


How You Can Strengthen the Field

When you join InformalScience.org, you can…

Start and join interest groups

Find and share opportunities for

professional development &

funding

Search & contribute project, evaluation, &

research resources

Find collaborators in the member directory


Project Pages on InformalScience.org

• Submit project pages

• Link your profile to existing project pages

• Add related evaluation reports, research products, & images


Learn more…

Jamie Bell, Project Director & PI of [email protected]

InformalScience.org

Facebook.com/informalscience

@informalscience@jamiecaise


mailto:[email protected]

mailto:[email protected]

field of dreams: if you build it, will they come? jamie ... · pdf filefield of dreams: if you...

Documents