![Page 1: Evaluation and the budget - the role of SAIs -- Leonardo Albernaz, Brazil](https://reader031.vdocuments.us/reader031/viewer/2022030302/587cacc41a28ab356c8b6ca5/html5/thumbnails/1.jpg)
THE ROLE OF SUPREME AUDIT INSTITUTIONS - SAI
![Page 2: Evaluation and the budget - the role of SAIs -- Leonardo Albernaz, Brazil](https://reader031.vdocuments.us/reader031/viewer/2022030302/587cacc41a28ab356c8b6ca5/html5/thumbnails/2.jpg)
MANDATE: PERFORMANCE AUDIT
EFFICIENCY
EFFECTIVENESS
EQUITY
QUALITY
PERFORMANCE
And more...
![Page 3: Evaluation and the budget - the role of SAIs -- Leonardo Albernaz, Brazil](https://reader031.vdocuments.us/reader031/viewer/2022030302/587cacc41a28ab356c8b6ca5/html5/thumbnails/3.jpg)
POLICY EVALUATION: MAIN OUTPUT
SAI
Parliament
Government
INFORMATION Society
![Page 4: Evaluation and the budget - the role of SAIs -- Leonardo Albernaz, Brazil](https://reader031.vdocuments.us/reader031/viewer/2022030302/587cacc41a28ab356c8b6ca5/html5/thumbnails/4.jpg)
SAI AND POLICY EVALUATION
EFFICIENCY
EFFECTIVENESS
EQUITY
QUALITY
PERFORMANCE
Looking at... One policy... And the past.
![Page 5: Evaluation and the budget - the role of SAIs -- Leonardo Albernaz, Brazil](https://reader031.vdocuments.us/reader031/viewer/2022030302/587cacc41a28ab356c8b6ca5/html5/thumbnails/5.jpg)
SAI AND POLICY EVALUATION
OVERSIGHT INSIGHT FORESIGHT
PERFORMANCE
PERFORMANCE
PERFORMANCE DRIVERS
WHOLE-OF-GOVERNMENT APPROACH
![Page 6: Evaluation and the budget - the role of SAIs -- Leonardo Albernaz, Brazil](https://reader031.vdocuments.us/reader031/viewer/2022030302/587cacc41a28ab356c8b6ca5/html5/thumbnails/6.jpg)
![Page 7: Evaluation and the budget - the role of SAIs -- Leonardo Albernaz, Brazil](https://reader031.vdocuments.us/reader031/viewer/2022030302/587cacc41a28ab356c8b6ca5/html5/thumbnails/7.jpg)
A GOVERNMENT...
Applies billions of dollars in
programs to fight smoking
AT THE SAME TIME...
Applies billions of dollars in
subsidies to tobacco production
GOVERNANCE FAILURES
![Page 8: Evaluation and the budget - the role of SAIs -- Leonardo Albernaz, Brazil](https://reader031.vdocuments.us/reader031/viewer/2022030302/587cacc41a28ab356c8b6ca5/html5/thumbnails/8.jpg)
Each program may work really well...
And the global results still are not
the best.
Isolated assessments
are not enough
GOVERNANCE FAILURES
![Page 9: Evaluation and the budget - the role of SAIs -- Leonardo Albernaz, Brazil](https://reader031.vdocuments.us/reader031/viewer/2022030302/587cacc41a28ab356c8b6ca5/html5/thumbnails/9.jpg)
• Lack of Coherence
• Overlapping
• Shadow Spots (gaps)
GOVERNANCE FAILURES
![Page 10: Evaluation and the budget - the role of SAIs -- Leonardo Albernaz, Brazil](https://reader031.vdocuments.us/reader031/viewer/2022030302/587cacc41a28ab356c8b6ca5/html5/thumbnails/10.jpg)
• Lack of Coherence
• Overlapping
• Shadow Spots (gaps)
GOVERNANCE FAILURES
Isolated assessments
are not enough
![Page 11: Evaluation and the budget - the role of SAIs -- Leonardo Albernaz, Brazil](https://reader031.vdocuments.us/reader031/viewer/2022030302/587cacc41a28ab356c8b6ca5/html5/thumbnails/11.jpg)
Centre of Government
Resource Allocation
Regulatory
Policies
WHOLE-OF GOVERNMENT APPROACH
COHERENCE AND COORDINATION SAI
![Page 12: Evaluation and the budget - the role of SAIs -- Leonardo Albernaz, Brazil](https://reader031.vdocuments.us/reader031/viewer/2022030302/587cacc41a28ab356c8b6ca5/html5/thumbnails/12.jpg)
![Page 13: Evaluation and the budget - the role of SAIs -- Leonardo Albernaz, Brazil](https://reader031.vdocuments.us/reader031/viewer/2022030302/587cacc41a28ab356c8b6ca5/html5/thumbnails/13.jpg)
GOVERNANÇA EM POLÍTICAS PÚBLICAS
1. Institutionalization
2. Plans and Goals
3. Social Openness and Participation
4. Resources and Organizational Capacity
5. Coherence and Coordination
6. Monitoring and Evaluation
7. Risk Management / Internal Control
8. Accountability
THE STRUCTURAL COMPONENTS
![Page 14: Evaluation and the budget - the role of SAIs -- Leonardo Albernaz, Brazil](https://reader031.vdocuments.us/reader031/viewer/2022030302/587cacc41a28ab356c8b6ca5/html5/thumbnails/14.jpg)
![Page 15: Evaluation and the budget - the role of SAIs -- Leonardo Albernaz, Brazil](https://reader031.vdocuments.us/reader031/viewer/2022030302/587cacc41a28ab356c8b6ca5/html5/thumbnails/15.jpg)
![Page 16: Evaluation and the budget - the role of SAIs -- Leonardo Albernaz, Brazil](https://reader031.vdocuments.us/reader031/viewer/2022030302/587cacc41a28ab356c8b6ca5/html5/thumbnails/16.jpg)
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
Unstructured Incipient Intermediate Refined Advanced
4% 7%
85%
4%
iSA-Gov: MATURITY INDEX SYSTEMS OF MONITORING & EVALUATION
Assessment Demands
Evaluative Knowledge Generation
Organizational Learning Capacity
Use of Evaluative Knowledge
![Page 17: Evaluation and the budget - the role of SAIs -- Leonardo Albernaz, Brazil](https://reader031.vdocuments.us/reader031/viewer/2022030302/587cacc41a28ab356c8b6ca5/html5/thumbnails/17.jpg)
9
26
16
8 6
Early Stage Intermediate Basic Enhanced Advanced
ASSESSING THE MATURITY LEVEL RISK MANAGEMENT OF 65 PUBLIC AGENCIES
Environment
Processes
Partnerships
Results
![Page 18: Evaluation and the budget - the role of SAIs -- Leonardo Albernaz, Brazil](https://reader031.vdocuments.us/reader031/viewer/2022030302/587cacc41a28ab356c8b6ca5/html5/thumbnails/18.jpg)
9% 13%
19% 27% 7%
7%
7%
8% 33% 31%
27%
19%
36% 34% 30%
22% 16% 16% 17%
24%
0%
10%
20%
30%
40%
50%
60%
49% 51% 53% 54%
N=7770
nonexistent insufficient initiated intermediary enhanced
Leadership Strategy Control
iGG – GENERAL GOVERNANCE INDEX Assessing Leadership, Strategy and Control
IGGs
![Page 19: Evaluation and the budget - the role of SAIs -- Leonardo Albernaz, Brazil](https://reader031.vdocuments.us/reader031/viewer/2022030302/587cacc41a28ab356c8b6ca5/html5/thumbnails/19.jpg)
Improve dialogue capacity
Develop shared diagnosis and solutions
Stimulate innovation
Adopt systemic approaches
Enhance Public Governance
CHALLENGES
![Page 20: Evaluation and the budget - the role of SAIs -- Leonardo Albernaz, Brazil](https://reader031.vdocuments.us/reader031/viewer/2022030302/587cacc41a28ab356c8b6ca5/html5/thumbnails/20.jpg)