open data for development
TRANSCRIPT
![Page 1: Open data for development](https://reader033.vdocuments.us/reader033/viewer/2022060118/558b2a01d8b42a36268b478c/html5/thumbnails/1.jpg)
United Nations Development Programme
Open Data
Marc LepageKnowledge & Innovation advisor,UNDP regional center for Africa
![Page 2: Open data for development](https://reader033.vdocuments.us/reader033/viewer/2022060118/558b2a01d8b42a36268b478c/html5/thumbnails/2.jpg)
2
Agenda
• What is open data?• Benefits of open data• Open data for …
–Government–Aid efficiency–Development–Crisis information management
• Challenges• What next?
![Page 3: Open data for development](https://reader033.vdocuments.us/reader033/viewer/2022060118/558b2a01d8b42a36268b478c/html5/thumbnails/3.jpg)
3
definition
open data is “data that can be freely used, reused and redistributed by anyone – subject only, at most, to the requirement to attribute and sharealike”.
![Page 4: Open data for development](https://reader033.vdocuments.us/reader033/viewer/2022060118/558b2a01d8b42a36268b478c/html5/thumbnails/4.jpg)
4
Open data is..
•data freely available
Open
•data easy to use and re-use
Accessible
•data easy to find
Searchable
![Page 5: Open data for development](https://reader033.vdocuments.us/reader033/viewer/2022060118/558b2a01d8b42a36268b478c/html5/thumbnails/5.jpg)
5
Open data formats• 1 star: Available on the web (whatever
format) but with an open licence, to be Open Data
• 2 stars: Available as machine-readable structured data (e.g. excel instead of image scan of a table)
• 3 stars: as (2) plus non-proprietary format (e.g. CSV instead of excel)
• 4 stars: All the above plus, Use open standards from W3C (RDF and SPARQL) to identify things, so that people can point at your stuff
• 5 stars: All the above, plus: Link your data to other people’s data to provide context
![Page 6: Open data for development](https://reader033.vdocuments.us/reader033/viewer/2022060118/558b2a01d8b42a36268b478c/html5/thumbnails/6.jpg)
6
Benefits of open data
• Part of a broader move, including new Access to Information Policy
• Builds on global Open Data initiatives• Aim is to stimulate use of development data to
help solve development problems:
–economic benefits (growth and job creation),
–improved public services and –more transparent and accountable government
![Page 7: Open data for development](https://reader033.vdocuments.us/reader033/viewer/2022060118/558b2a01d8b42a36268b478c/html5/thumbnails/7.jpg)
7
What it (typically) looks like
Before… After…
Subscriptions Free!
Custom query tool
New website, downloads, API
Restrictions on use Minimal restrictions on use
English +Spanish, French, Arabic, Chinese
Not searchable Searchable
Scattered datasets Data catalog
![Page 8: Open data for development](https://reader033.vdocuments.us/reader033/viewer/2022060118/558b2a01d8b42a36268b478c/html5/thumbnails/8.jpg)
8
Common terms of use
• Users are encouraged to use the data.
–extract, download, and make copies
–Share with third parties. • Attribution • No Endorsement• No Association• No Warranties
![Page 9: Open data for development](https://reader033.vdocuments.us/reader033/viewer/2022060118/558b2a01d8b42a36268b478c/html5/thumbnails/9.jpg)
9
Open data value chain
![Page 10: Open data for development](https://reader033.vdocuments.us/reader033/viewer/2022060118/558b2a01d8b42a36268b478c/html5/thumbnails/10.jpg)
10
Open data variations
There are several flavors of open data, for instance open government data helps to make data held by governments accessible to both applications and end-users.
![Page 11: Open data for development](https://reader033.vdocuments.us/reader033/viewer/2022060118/558b2a01d8b42a36268b478c/html5/thumbnails/11.jpg)
11
Open data for Government
Major examples of open government data include transport data (which has given cities like New York applications to show fastest routes on any day etc) and finance data (giving citizens visibility into how their money is spent).
![Page 12: Open data for development](https://reader033.vdocuments.us/reader033/viewer/2022060118/558b2a01d8b42a36268b478c/html5/thumbnails/12.jpg)
12
Open data for Government (con’t)
1. Government should do the least possible and act as a
Facilitator – Build a platform and let others add to it
2. Engage entrepreneurs in developing applications using
government data through workshops and forums
3. Develop Application Programme Interface (API) to support
web developers for your data
4. When more people are working on the data, innovation
happens
![Page 13: Open data for development](https://reader033.vdocuments.us/reader033/viewer/2022060118/558b2a01d8b42a36268b478c/html5/thumbnails/13.jpg)
13
Citizen Government dynamics
1. Citizens are becoming data producers as well as data
consumers.
2. Citizens are changing the political landscape by being more
involved in the decision making process
3. Citizens are engaging other citizens to act through social
networking tools
![Page 16: Open data for development](https://reader033.vdocuments.us/reader033/viewer/2022060118/558b2a01d8b42a36268b478c/html5/thumbnails/16.jpg)
16
Open data for development
• A client government wants to download and use HDR data into internal systems
–In real time
–Inexpensively
–Without significant human overheads
• An NGO in Botswana wants to follow UNDP’s project portfolio in democratic governance
• A researcher wants to combine UNDP’s HRD data with data from a country’s planning commission to analyze trends
![Page 17: Open data for development](https://reader033.vdocuments.us/reader033/viewer/2022060118/558b2a01d8b42a36268b478c/html5/thumbnails/17.jpg)
17
Open data for development (con’t)
• A blogger wants to substantiate the opinion in her blog with data based charts (that update in real time) from the UNDP’s project database
• A UNDP staff member answers questions about UNDPs commitment to transparency
• An independent application developer in Georgia wants to create a mobile application that tracks the flow of donor money to monitor election and help local civil society access the grants (case study here)
![Page 18: Open data for development](https://reader033.vdocuments.us/reader033/viewer/2022060118/558b2a01d8b42a36268b478c/html5/thumbnails/18.jpg)
18
Open Data @ USAID
![Page 19: Open data for development](https://reader033.vdocuments.us/reader033/viewer/2022060118/558b2a01d8b42a36268b478c/html5/thumbnails/19.jpg)
19
![Page 20: Open data for development](https://reader033.vdocuments.us/reader033/viewer/2022060118/558b2a01d8b42a36268b478c/html5/thumbnails/20.jpg)
20
Open Data @ World Bank
![Page 21: Open data for development](https://reader033.vdocuments.us/reader033/viewer/2022060118/558b2a01d8b42a36268b478c/html5/thumbnails/21.jpg)
21
![Page 22: Open data for development](https://reader033.vdocuments.us/reader033/viewer/2022060118/558b2a01d8b42a36268b478c/html5/thumbnails/22.jpg)
22
![Page 23: Open data for development](https://reader033.vdocuments.us/reader033/viewer/2022060118/558b2a01d8b42a36268b478c/html5/thumbnails/23.jpg)
23
![Page 24: Open data for development](https://reader033.vdocuments.us/reader033/viewer/2022060118/558b2a01d8b42a36268b478c/html5/thumbnails/24.jpg)
24
Open data @ UNDP
![Page 25: Open data for development](https://reader033.vdocuments.us/reader033/viewer/2022060118/558b2a01d8b42a36268b478c/html5/thumbnails/25.jpg)
25
![Page 26: Open data for development](https://reader033.vdocuments.us/reader033/viewer/2022060118/558b2a01d8b42a36268b478c/html5/thumbnails/26.jpg)
26
IATI & UNDP: promotes efficiency and re-use: Worst of all Worlds
![Page 27: Open data for development](https://reader033.vdocuments.us/reader033/viewer/2022060118/558b2a01d8b42a36268b478c/html5/thumbnails/27.jpg)
27
IATI and UNDP: Promotes efficiency and re-use: Publish once, use often
![Page 28: Open data for development](https://reader033.vdocuments.us/reader033/viewer/2022060118/558b2a01d8b42a36268b478c/html5/thumbnails/28.jpg)
28
How open data is used for dev
![Page 29: Open data for development](https://reader033.vdocuments.us/reader033/viewer/2022060118/558b2a01d8b42a36268b478c/html5/thumbnails/29.jpg)
29
High frequency price data
![Page 30: Open data for development](https://reader033.vdocuments.us/reader033/viewer/2022060118/558b2a01d8b42a36268b478c/html5/thumbnails/30.jpg)
30
Open Data for crisis information management
![Page 31: Open data for development](https://reader033.vdocuments.us/reader033/viewer/2022060118/558b2a01d8b42a36268b478c/html5/thumbnails/31.jpg)
31
Syria
![Page 32: Open data for development](https://reader033.vdocuments.us/reader033/viewer/2022060118/558b2a01d8b42a36268b478c/html5/thumbnails/32.jpg)
32
The open data revolution
![Page 33: Open data for development](https://reader033.vdocuments.us/reader033/viewer/2022060118/558b2a01d8b42a36268b478c/html5/thumbnails/33.jpg)
33
Haïti
![Page 34: Open data for development](https://reader033.vdocuments.us/reader033/viewer/2022060118/558b2a01d8b42a36268b478c/html5/thumbnails/34.jpg)
34
Haiti open data portal
![Page 35: Open data for development](https://reader033.vdocuments.us/reader033/viewer/2022060118/558b2a01d8b42a36268b478c/html5/thumbnails/35.jpg)
35
Humanitarian eXchange Language
![Page 36: Open data for development](https://reader033.vdocuments.us/reader033/viewer/2022060118/558b2a01d8b42a36268b478c/html5/thumbnails/36.jpg)
36
Humanitarian dataset
![Page 37: Open data for development](https://reader033.vdocuments.us/reader033/viewer/2022060118/558b2a01d8b42a36268b478c/html5/thumbnails/37.jpg)
37
Open data challenges
Lack of overall strategy
The “Top Down” approach / culture
Cultural barriers
Legislation gap
Context gap
![Page 38: Open data for development](https://reader033.vdocuments.us/reader033/viewer/2022060118/558b2a01d8b42a36268b478c/html5/thumbnails/38.jpg)
38
What does it take to get started?
• Suggested approach: pilot under 3 criteria
–Low cost (under $1000/month)–Fast–Low effort
• 2 options:
a) custom development, piggybacking on the HDR’s API
b) open data platform
![Page 39: Open data for development](https://reader033.vdocuments.us/reader033/viewer/2022060118/558b2a01d8b42a36268b478c/html5/thumbnails/39.jpg)
39
Suggested approach
• Start with one data set we feel comfortable with
• Test with stakeholders• Confirm features/functions/scalability• Learn from the experience• Identify more potential data sets• Continue evaluating other options
(custom/platform)• Get ready for a larger launch
![Page 40: Open data for development](https://reader033.vdocuments.us/reader033/viewer/2022060118/558b2a01d8b42a36268b478c/html5/thumbnails/40.jpg)
40
Scope of the pilot
• The pilot will only include one data set• (If needed) the pilot will include some basic design work
required to make the pilot site attractive and user-friendly• The pilot can be live within a week of final approval to
proceed• The pilot should ideally run for no more than 2-3 months
• One of the goals of the pilot will be to understand what additional features/tools must be bundled with the service to maximize the value of the service to clients
• The pilot will also help the team understand the technical parameters required to fully launch the service
• The pilot will also consider what communication/community approaches will be most effective during the larger launch
40
![Page 41: Open data for development](https://reader033.vdocuments.us/reader033/viewer/2022060118/558b2a01d8b42a36268b478c/html5/thumbnails/41.jpg)
41
Outcomes of the pilot
• OUTCOMES
– Establish the governance processes and structures to support the larger launch
– Resolve security, legal, data confidentiality, and other issues before the larger launch
– Gain client/other stakeholder buy-in for the service
– Establish the full bouquet of services that should be bundled with the final product
– Work through a variety of ‘what’s in it for me’ client scenarios
– Select a platform for the final launch
![Page 42: Open data for development](https://reader033.vdocuments.us/reader033/viewer/2022060118/558b2a01d8b42a36268b478c/html5/thumbnails/42.jpg)
42
Pilot approach – open data as the basis for services
42
Open Data
UNDP application
s
Mobile application
s
3rd party applications
Manual upload
Publish API
Community Visualization
Analytics Filters/roll-ups
UNDP
DATA
Downloads
GIS
API
User interface
In scope (pilot)
![Page 43: Open data for development](https://reader033.vdocuments.us/reader033/viewer/2022060118/558b2a01d8b42a36268b478c/html5/thumbnails/43.jpg)
43
Potential issues/next steps
ISSUES STEPS
Who is going to take the lead? KIC group to assist & offer for pilot
What data can be included in this service (immediately, and in the long term)
KIC group to consult internally
What impact will the initiative have on our client relationships? Are there any pre-launch steps we need to take
This will depend on the data sets we start with
Can all open data services at UNDP be consolidated through the API that is being developed for HDR?
HRD team and KIC group to consult
What security clearances are required to launch this service Depends on the data set identified. Could be none. Double check with legal dept
Who should manage the service? Which parts of UNDP should be involved
KIC group
What data management steps do we need to take to support the data requirements of the initiative (catalog, metadata, quality, more)
Pilot will clarify
Are there disclosure/copyright issues we should take into account? Depending on data sets. Consult with legal
What about the quality of our data? Pilot will shed light into the possibility of feedback channel to get quality control from users
Is there a resource constraint in terms of dealing with queries once the data is released?
Use the pilot to get insights
![Page 44: Open data for development](https://reader033.vdocuments.us/reader033/viewer/2022060118/558b2a01d8b42a36268b478c/html5/thumbnails/44.jpg)
44
This is just the beginning…….
Availability of data Accessibility Use of data Engage /
change
![Page 46: Open data for development](https://reader033.vdocuments.us/reader033/viewer/2022060118/558b2a01d8b42a36268b478c/html5/thumbnails/46.jpg)
46
Sources
• http://www.od4d.org• http://openforchange.info• http://www.slideshare.net/yajitha• Open data group on Teamworks• Mark Cardwell, open data evangelist at UNDP• Giuilio Quaggiotto, all things innovation at UNDP