Patty BroersResearch Coordination
Unit Chief
Evaluation and Performance Review
“The most serious mistakes are not being made because of wrong answers. The truly dangerous thing is asking the wrong question.” Peter Drucker
“One of the great mistakes is to judge policies and programs by their intentions than their results.” Milton Friedman
“True genius resides in the capacity for evaluation of uncertain, hazardous, and conflicting information.” Winston Churchill
Points to Ponder
Contract Research Organizational Structure
David LippertEngineer of Materials and Physical Research
Amy SchutzbachEngineer of Physical Research
Research Coordination UnitPatty Broers - Research Coordination Manager Tom Bukowski – Graduate Public Service
Intern (GPSI)
ICT Administrative Structure
Imad Al-QadiDirector
Leslie ElbleAssistant to the
Director
Sam CarpenterAssociate Director
Associate Director for Outreach
Associate Director for
Facilities
Jim MeisterResearch Eng.
Jeff KernResearch Eng.
Part Time Help
Deputy Director
Mary FriesOutreach
Dave KingFiscal/Admin
Support
Leslie MyrickTechnical Editor
Josh HoustonIT Support
Lori CarpenterCommunication
Coordinator
Outreach Coordinator
Quarterly reports IDOT approval of subcontractors IDOT approval of work plans/budgets before work
can begin Interim deliverables and final report Semi-annual evaluations – TRP/PI
Intergovernmental Agreement Requirements
Research Problem Statement
Semi-annual solicitation
Key Element: IDOT Sponsor/Champion
Key Element: Clearly Identify Benefit to IDOT
IDOT’s ICT Executive Committee Organizational Structure
Traffic/Roadside Public/Intermodal Transportation
Environment
TAG’sas appropriate
BMPR
Executive Committee Members – Directors of Offices/Divisions within IDOT, one member from FHWA, ICT Director
Structures and Bridges
Safety Planning Construction
Pavement & Materials
Determine research needs: Review and/or create problem statements Prioritize/recommend to executive committee Appoints technical review panel to oversee funded
research
Technical Advisory Group (TAG) Activities
Evaluate RFP submittals and select researcher Provide technical expertise Develop an implementation plan Communication Review quarterly progress reports Evaluation – semi-annual and close-out Champion implementation of research findings
when possible
Technical Research Panel (TRP) Activities
Required for each project Plan should identify:
Needs and benefits Primary panel members to oversee research Ad hoc members as project progresses needed to
promote implementation Interim deliverables Necessity for upper management close-out
Implementation Plan
Developing Evaluation Tools
RFP Evaluation
Oversight panel evaluates: Research team Proposal approach Strengths/
Weaknesses Equipment/Facilities
Project Dashboard
http://ict.illinois.edu/IDOTprojects.asp
Connected to web-based quarterly reports
Quarterly Report
Web-basedAutomatic
notificationsTRP chair
comments
Principal Investigator Evaluation
Deliverables, communication, and timeliness
“Needs Improvement” justification
PIs similarly evaluate TRP
Principal Investigator Evaluation of Oversight Panel
Panel Evaluation: Good
communication Clear objectives Timely report
review
Series of questions by e-mail Rate success of research (1–low to 5–high) Explain results expected and deliverables received If applicable, describe what was not accomplished Indicate implementation actions taken Improvements that could be made in the future regarding
similar research
Close-out Evaluation
Administrative Performance Evaluation
Evaluate: Timeliness Responsiveness Communication Problem resolution
Monthly meetings Minutes that include action items Key issues:
Project meeting issues Discuss semi-annual evaluations Budget concerns Investigator selection
Administrative Meetings
Abraham Lincoln Presidential Library and Museum
The Lincoln Family
Illinois Old Capitol Building