1 evaluating how an agency exercises foresight…. high-clockspeed technology-based trends* judith...
TRANSCRIPT
![Page 1: 1 EVALUATING HOW AN AGENCY EXERCISES FORESIGHT…. High-Clockspeed Technology-Based Trends* Judith A. Droitcour, Ph.D. U.S. Government Accountability Office](https://reader036.vdocuments.us/reader036/viewer/2022062717/56649e395503460f94b2ae46/html5/thumbnails/1.jpg)
1
EVALUATING HOW AN AGENCY EXERCISES FORESIGHT….
High-Clockspeed Technology-Based TrendsHigh-Clockspeed Technology-Based Trends**
Judith A. Droitcour, Ph.D.U.S. Government Accountability OfficeContact: [email protected]
Presented at Evaluation 2009Panel: Prospective Evaluation and Technology: New Developments and 21st Century ChallengesNovember 13, 2009
*Based in part on GAO, HIGHWAY SAFETY: Foresight Issues Challenge DOT’s Efforts to Assess and Respond to New Technology-Based Trends, October 2008 (GAO-09-56). The views expressed in this presentation do not necessarily reflect those of the U.S. Government Accountability Office.
![Page 2: 1 EVALUATING HOW AN AGENCY EXERCISES FORESIGHT…. High-Clockspeed Technology-Based Trends* Judith A. Droitcour, Ph.D. U.S. Government Accountability Office](https://reader036.vdocuments.us/reader036/viewer/2022062717/56649e395503460f94b2ae46/html5/thumbnails/2.jpg)
2
TECHNOLOGY-BASED TRENDS:TECHNOLOGY-BASED TRENDS: Key Phases -- Innovation Cycle
Phase 3
--benefit(s) at individual, societal level (e.g., economic)
--side effects (<= how used)
Phase 2
--commercialization--consumer adoption
--potentially varied uses of innovation
Phase 1
--research and development
--“validation” of new innovations
![Page 3: 1 EVALUATING HOW AN AGENCY EXERCISES FORESIGHT…. High-Clockspeed Technology-Based Trends* Judith A. Droitcour, Ph.D. U.S. Government Accountability Office](https://reader036.vdocuments.us/reader036/viewer/2022062717/56649e395503460f94b2ae46/html5/thumbnails/3.jpg)
3
TECHNOLOGY-BASED TRENDS TECHNOLOGY-BASED TRENDS CAN IMPACT AGENCY GOALSCAN IMPACT AGENCY GOALS
Phase 3
--benefit(s) at individual, societal level (e.g., economic)
-- side effects that negatively Impact safety goals
Phase 2
--commercialization--consumer adoption
--potentially varied uses of innovation
Phase 1
--research and development
--“validation” of new innovations
![Page 4: 1 EVALUATING HOW AN AGENCY EXERCISES FORESIGHT…. High-Clockspeed Technology-Based Trends* Judith A. Droitcour, Ph.D. U.S. Government Accountability Office](https://reader036.vdocuments.us/reader036/viewer/2022062717/56649e395503460f94b2ae46/html5/thumbnails/4.jpg)
4
PORTABLE ELECTRONIC DEVICES, PORTABLE ELECTRONIC DEVICES, LIKE CELL PHONESLIKE CELL PHONES
2. Consumer adoption,varied uses
3. Side-effects
1. New innovations
![Page 5: 1 EVALUATING HOW AN AGENCY EXERCISES FORESIGHT…. High-Clockspeed Technology-Based Trends* Judith A. Droitcour, Ph.D. U.S. Government Accountability Office](https://reader036.vdocuments.us/reader036/viewer/2022062717/56649e395503460f94b2ae46/html5/thumbnails/5.jpg)
5
SIDE EFFECT: IMPACTS DOT’s/ SIDE EFFECT: IMPACTS DOT’s/ NHTSA’S HIGHWAY SAFETY GOALNHTSA’S HIGHWAY SAFETY GOAL
![Page 6: 1 EVALUATING HOW AN AGENCY EXERCISES FORESIGHT…. High-Clockspeed Technology-Based Trends* Judith A. Droitcour, Ph.D. U.S. Government Accountability Office](https://reader036.vdocuments.us/reader036/viewer/2022062717/56649e395503460f94b2ae46/html5/thumbnails/6.jpg)
6
CLOCKSPEED:CLOCKSPEED: Can an agency keep pace with a fast-paced technology-based trend?(organizational clockspeed = rate at which an organization introduces new products, adopts new production processes, or reorganizes itself; Sources: Charles H. Fine, 1998; David W. Rejeski, 2003)
![Page 7: 1 EVALUATING HOW AN AGENCY EXERCISES FORESIGHT…. High-Clockspeed Technology-Based Trends* Judith A. Droitcour, Ph.D. U.S. Government Accountability Office](https://reader036.vdocuments.us/reader036/viewer/2022062717/56649e395503460f94b2ae46/html5/thumbnails/7.jpg)
7
STILL-EVOLVING INNOVATIONS:STILL-EVOLVING INNOVATIONS: e.g., visual component (experts don’t see tech. slowing down)
Source: Prof. Babak A. Parviz, University of Washington
![Page 8: 1 EVALUATING HOW AN AGENCY EXERCISES FORESIGHT…. High-Clockspeed Technology-Based Trends* Judith A. Droitcour, Ph.D. U.S. Government Accountability Office](https://reader036.vdocuments.us/reader036/viewer/2022062717/56649e395503460f94b2ae46/html5/thumbnails/8.jpg)
8
COMMERCIALIZATION, CONSUMER COMMERCIALIZATION, CONSUMER ADOPTION:ADOPTION: fast-evolving trend over the past decade
• dates of wide-availability• PDAs late 1990s• hands-free phones (no
wire to ear) ~ 2003• GPS and cameras on
phones ~ 2004
• newest cell phones• have streaming TV,
video-calling• have internet access• are replaced every 17
months
• text messages numbered• 14 million/mo. 2000• 18+billion/mo. 2006• 120+ billion/mo.
2009*
![Page 9: 1 EVALUATING HOW AN AGENCY EXERCISES FORESIGHT…. High-Clockspeed Technology-Based Trends* Judith A. Droitcour, Ph.D. U.S. Government Accountability Office](https://reader036.vdocuments.us/reader036/viewer/2022062717/56649e395503460f94b2ae46/html5/thumbnails/9.jpg)
9
COMBINING INNOVATIONS, USES, COMBINING INNOVATIONS, USES, SIDE EFFECTS:SIDE EFFECTS: road-phoning devices
![Page 10: 1 EVALUATING HOW AN AGENCY EXERCISES FORESIGHT…. High-Clockspeed Technology-Based Trends* Judith A. Droitcour, Ph.D. U.S. Government Accountability Office](https://reader036.vdocuments.us/reader036/viewer/2022062717/56649e395503460f94b2ae46/html5/thumbnails/10.jpg)
10
GAO EVALUATION (2008) When faced with an evolving trend that can affect key goals, agencies may “exercise foresight” by….
![Page 11: 1 EVALUATING HOW AN AGENCY EXERCISES FORESIGHT…. High-Clockspeed Technology-Based Trends* Judith A. Droitcour, Ph.D. U.S. Government Accountability Office](https://reader036.vdocuments.us/reader036/viewer/2022062717/56649e395503460f94b2ae46/html5/thumbnails/11.jpg)
11
1. DECIDING/RESPONDING:1. DECIDING/RESPONDING:Evidence-Governance Options Framework
![Page 12: 1 EVALUATING HOW AN AGENCY EXERCISES FORESIGHT…. High-Clockspeed Technology-Based Trends* Judith A. Droitcour, Ph.D. U.S. Government Accountability Office](https://reader036.vdocuments.us/reader036/viewer/2022062717/56649e395503460f94b2ae46/html5/thumbnails/12.jpg)
12
NHTSA: DECIDING/RESPONDINGNHTSA: DECIDING/RESPONDINGelectronic driver distractions--2008electronic driver distractions--2008
![Page 13: 1 EVALUATING HOW AN AGENCY EXERCISES FORESIGHT…. High-Clockspeed Technology-Based Trends* Judith A. Droitcour, Ph.D. U.S. Government Accountability Office](https://reader036.vdocuments.us/reader036/viewer/2022062717/56649e395503460f94b2ae46/html5/thumbnails/13.jpg)
13
2. DEVELOPING EVIDENCE2. DEVELOPING EVIDENCE: Criteria for selecting methods to assess impact of high-clockspeed trend
Technically adequate
Timely
Capable of being repeated over time (relatively frequently, i.e., non-costly)
…..as we found for NHTSA and new distractins, it can be difficult to meet all three
![Page 14: 1 EVALUATING HOW AN AGENCY EXERCISES FORESIGHT…. High-Clockspeed Technology-Based Trends* Judith A. Droitcour, Ph.D. U.S. Government Accountability Office](https://reader036.vdocuments.us/reader036/viewer/2022062717/56649e395503460f94b2ae46/html5/thumbnails/14.jpg)
14
3. COMMUNICATING3. COMMUNICATING
Two key attributes
Comprehensiveness re: relevant trends
Timeliness
….. as of 2008 DOT had not included new driver distractions in key reports to the Hill
![Page 15: 1 EVALUATING HOW AN AGENCY EXERCISES FORESIGHT…. High-Clockspeed Technology-Based Trends* Judith A. Droitcour, Ph.D. U.S. Government Accountability Office](https://reader036.vdocuments.us/reader036/viewer/2022062717/56649e395503460f94b2ae46/html5/thumbnails/15.jpg)
15
GAO’S RECOMMENDATIONS re: high-clockspeed trends affecting safety
1. deciding/respondinganticipatory risk management…*
or adaptive strategies, weigh old vs new, etc.
2. developing evidencepotentially, use newest technology
3. communicatingmore complete, timely
communications
![Page 16: 1 EVALUATING HOW AN AGENCY EXERCISES FORESIGHT…. High-Clockspeed Technology-Based Trends* Judith A. Droitcour, Ph.D. U.S. Government Accountability Office](https://reader036.vdocuments.us/reader036/viewer/2022062717/56649e395503460f94b2ae46/html5/thumbnails/16.jpg)
16
POSTSCRIPT: FALL 2009
deciding/respondingDOT took some key steps….re: banning
developing evidenceNHTSA developing new research plan
communicatingDOT’s driver distraction summit, included Hill and
other stakeholders
![Page 17: 1 EVALUATING HOW AN AGENCY EXERCISES FORESIGHT…. High-Clockspeed Technology-Based Trends* Judith A. Droitcour, Ph.D. U.S. Government Accountability Office](https://reader036.vdocuments.us/reader036/viewer/2022062717/56649e395503460f94b2ae46/html5/thumbnails/17.jpg)
17
THANK YOU
![Page 18: 1 EVALUATING HOW AN AGENCY EXERCISES FORESIGHT…. High-Clockspeed Technology-Based Trends* Judith A. Droitcour, Ph.D. U.S. Government Accountability Office](https://reader036.vdocuments.us/reader036/viewer/2022062717/56649e395503460f94b2ae46/html5/thumbnails/18.jpg)
18
2nd TECHNOLOGY-BASED TREND:TECHNOLOGY-BASED TREND: in-vehicle crash-avoidancecrash-avoidance tech’s
Phase 3
--benefit(s) at individual, societal level (e.g., life-saving)
--side effects (<= how used)
Phase 2
--commercialization--consumer adoption
--potentially varied uses of innovation
Phase 1
--research and development
--“validation” of new innovations
![Page 19: 1 EVALUATING HOW AN AGENCY EXERCISES FORESIGHT…. High-Clockspeed Technology-Based Trends* Judith A. Droitcour, Ph.D. U.S. Government Accountability Office](https://reader036.vdocuments.us/reader036/viewer/2022062717/56649e395503460f94b2ae46/html5/thumbnails/19.jpg)
19
DOT/NHTSA: IN-VEHICLE CRASH-AVOIDANCE TECHNOLOGIES
deciding/respondingexpand NCAP* program (include crash-avoidance
info’)
developing evidenceencountered difficulties getting highest level
evidence that is timely
communicatingconsiderable communication
*NCAP = New Car Assessment Program (earlier sole focus: crash-worthiness)
![Page 20: 1 EVALUATING HOW AN AGENCY EXERCISES FORESIGHT…. High-Clockspeed Technology-Based Trends* Judith A. Droitcour, Ph.D. U.S. Government Accountability Office](https://reader036.vdocuments.us/reader036/viewer/2022062717/56649e395503460f94b2ae46/html5/thumbnails/20.jpg)
20
FORESIGHT FRAMEWORK When faced with an evolving trend that can affect key goals, agencies may “exercise foresight” by….