open data ireland public meeting
DESCRIPTION
Presentation from the Open Data Ireland Public Meeting, 8th September 2014 http://opendatairl.eventbrite.com/TRANSCRIPT
Open Data Ireland
Deirdre Lee Richard Cyganiak@deirdrelee @cygri
8th September 2014
2
Agenda
1. Introduction & Summary of the Reports (D. Lee) 25 mins
2. Presentation of the Portal (R. Cyganiak) 15 mins
3. Clarifications/Questions/AOB (All) Open
3
What is Open Data?
OKF’s Open Definition :
A piece of data or content is open if anyone is free to use, reuse, and redistribute it — subject only, at most, to the requirement to attribute and/or share-alike.
http://opendefinition.org/
Public Service Domains
5
Typical Open Data Questions
• How many passengers use public transport each year?
• What are the pollution levels in my city?
• Which planning applications are under consideration in my area?
• How does the budgeted expenditure of a department compare with actual spending?
6
https://www.epa.ie/pubs/reports/water/bathing/thequalityofbathingwaterinireland2012.htmlhttp://gis.epa.ie/GetData/Download
7
Impact of Open Data
• Political:o government transparency
o government efficiency
• Social:o environmental sustainability
o social inclusion
• Economic:o economic growth
o entrepreneurial activity
Davies, T., Perini, F. & Alonso, J.M., 2013. Researching the Emerging Impacts of Open Data: ODDC Conceptual Framework
Economic Value of Open Data
• Open Data, not big data, will be driver for growth, ingenuity and innovation in the UK economy. (Deloitte Analytics, 2012).
• $1.5 billion: US National Weather Service supporting a private weather industry per year. (CapGemini 2014)
• €32 Billion: Estimated direct impact of Open Data in 2010 on the EU27, annual growth rate of 7%. (Vickery 2011)
• €140 billion: Estimated aggregate direct and indirect impact across EU27 (Vickery 2011)
• $3 trillion: Estimated annual economic potential across seven domains. (McKinsey 2013)
Open Government Data in Europe and Beyond
9Copyright 2014 FUJITSU LABORATORIES LTD.
Reusing Public Sector Information: The PSI Directive 2013/37/EU
• Introduces a right to reuse
• Covers also libraries, museums and archives
• Invites Member states to make more documents available in machine-readable and open formats
• Protects personal data
12
Irish Data CataloguesTitle URL
AIRO Datastore http://www.airo.ie/airo-datastore
Data.cso.ie http://data.cso.ie
Databank of the D/F http://databank.finance.gov.ie/
Databank of the D/PER http://databank.per.gov.ie/
Dublinked Open Data Portal http://www.dublinked.ie/
EPA GeoPortal http://gis.epa.ie
EPA Secure Archive For Environmental
Research Data (SAFER)http://erc.epa.ie/safer/
Fingal Open Data Portal http://data.fingal.ie/
GeoPortal.ie https://www.geoportal.ie/
Interactive Web Data Delivery System https://jetstream.gsi.ie/iwdds/index.htmlIrish Social Science Data Archive (ISSDA) http://www.ucd.ie/issda/data/
Irish Spatial Data Exchange http://catalogue.isde.ie/
Marine Data Online http://data.marine.ie/
Open Data Ireland Community Portal http://data.opendata.ie/
StatCentral http://statcentral.ie/
The Health Well http://www.thehealthwell.info/
14
Problems:
• Not enough data
• No standardised approach
• Low-quality data
• Not associated with an open license
• In many cases not machine-readable
• Duplication of work
• No central guidance
15
Open Data In Ireland
Summary of Reports
17
Insight Open Data Ireland Support Project
Best Practice Handbook
Data Audit Report
Open Data Platform (alpha)
Evaluation Framework
Open Data Publication Handbook
Roadmap
18
Methodology
Literature review
Desktop research
Interviews with representatives from Irish public bodies
Focus-group with representatives from the start-up community
Attendance of tech meet-ups
Invitation for feedback from wider Open Data community
19
Open Data Ireland Objectives (Roadmap)
• Short-term Objectives (1 year)Release high-quality Open Data that is timely, comprehensive, and accurate.Develop links with civil society organisations, the business community and citizens.…
• Medium-term Objectives (2 years)Work to increase Open Data literacy. Develop a cross-sector data infrastructure ensuring data interoperability.…
• Long-term Objectives (3 years)Establish an expectation that all government data be published openly by default.…
20
Open Data Best Practice Handbook
Looked at International Best Practice
Looked at Current Irish Practice
Made Recommendations
21
Open Data Ecosystem Elements
22
Open Data Board
(governance, support, oversight, advisory, evangelism)
Steering & Implementation Group
(steering, implementation, awareness & capacity building, evaluation)
Open Data Officer/Team (DPER)
(portal, administrative, funding)
Open Data Roadmap
Governance
23
Open Data = Open License
• The Open License:
o Should allow derivatives
o Should allow commercial use
o May require attribution
o May require share-alike
• Creative Commons
Licensing
24
The rights of the individual to privacy must be protected
Usage of personal data, even aggregated usage, should be transparent to the individual
For the publication of aggregated, statistical data, use standardised statistical methods
Do not use data privacy as an excuse not to publish Open Data if there are no data privacy concerns.
Data Privacy
25
What data does your PSB manage?
Is there any justification not to publish data as Open Data?
(Open by Default)
Data Audit
26
Data Audit ReportG8 Open Data Charter Category
Companies
Crime and Justice
Earth Observation
Education
Energy and Environment
Finance and contracts
Geospatial
Global Development
Government Accountability and
Democracy
Health
Science and Research
Social Mobility and Welfare
Statistics
Transport and Infrastructure
Web crawl of public sector websites
• XLS,CSV, XML, KML, RDF, SHP, etc.
• Keywords
Review of relevant existing data catalogues
Searches for specific high-value datasets
27
High-value information is information that can be:
used to increase agency accountability and
responsiveness;
improve public knowledge of the agency and its
operations;
further the core mission of the agency;
create economic opportunity; or
respond to need and demand as identified through
public consultation
(U.S. Office of Management and Budget, 2009)
Dataset Selection
28
Key Datasets
• National map data
• Postcode data
• Company data
• Demographic data
• Public expenditure data
• Transport data
• Road network data
• Energy and environment data
• Election data
29
Sale of UK Postcode Address File:“This takes an immediate but narrow view of the value of such datasets. PAF should have been retained as a public data set, as a national asset. The sale of the PAF with the Royal mail was a mistake. Public access to public sector data must never be sold or given away again”(The Public Administration Select Committee (PASC), 2014)
Danish address data, available free from 2002:Cost EUR 2 million Direct financial benefits for 2005-2009 EUR 62 million
Worth investigation into total/partial release of Irish address, postcode and map data as Open Data
Address & Map Data
30
• Data formats
• Metadata
• Data standards
• Unique Identifiers
High Quality Data
32
• Bulk data
• APIs
Data Access
http://dublinked.com/datastore/datasets/dataset-300.php
33
Data catalogues
data.gov.ie
Data Discovery
34
Supporting Public Bodies
35
Recommendations for PSBs
• Follow best-practices for publishing Open Data, as set out in Handbook
• Designate a person/team who is responsible for Open Data
• Create an Open Data strategy for your public body, including high-value datasets, goals and a timeframe.
• When publishing a high-value dataset as Open Data, assess the complete data lifecycle (e.g. collection, recording, storage, publication, archiving) in terms of potential data sharing, not only data usage for a particular purpose.
• Participate in Open Data training sessions.• Ensure the public body is represented on Open Data
governance boards.• Communicate suggestions or challenges to Open Data
governance boards.
36
Open Data Publication Handbook
Step-by-Step Guide to Open Data Publishing (for public bodies)
1. Carry out a Data Audit
2. Select what Data to Publish
3. Ensure Data Protection Laws are Adhered to
4. Associate Data with an Open License
5. Publish Data as 3- to 5-star Open Data
6. Associate Data with Standardised Metadata
7. Use Data Standards
8. Use Unique Identifiers
9. Provide Access to the Data
10. Publish Data on the National Open Data Portal, data.gov.ie
37
38
• Demand-driven release of data
• Feedback on data published
• Hold consultations
• Use social media
• Hold hackathons / Innovation-days
• Engage with existing groups
• Run competitions
• Run tutorials
• Evangelism
• Internal promotion
• Use traditional media
Engaging Data Users
39
Community Forming
40
Encouraging Economic Reuse
Geospatial Information industry in Ireland generated sales or output valued at €117.5 million in 2012,
Ordnance Survey of Ireland. (2014). Assessment of the Economic Value of
the Geospatial Information Industry in Ireland (p. 86).
Open Data Compasshttp://www.opendata500.com/
41
Evaluation
Implementation
Impact
Readiness
42
Open Data Platform (alpha)
http://data.gov.ie
43
Roadmap
Objectives
• Short-term (1 yr)• Medium-term (2
yrs)• Long-term (3 yrs)
Recommendations
• Based on Open Data Ecosystem Elements
Actions• Timeframe
(start/end)• Responsible Party
44
Open Data Ireland Next Steps
1. Determine Open Data Officer/Team
2. Create ODB and SIG
3. Public consultation on Roadmap
4. Improve data.gov.ie continuously & iteratively
5. Publish more high-value and high-quality datasets.
6. Engage with stakeholders from general public,
business, civil society, public-sector and academia.
7. Widen the Open Data community
8. Evaluate progress and impact
Richard Cyganiak
Presentation of the Portal and Portal Next Steps
46
data.gov.ie: What’s listed?
1. 175 statistical datasets from the StatCentral catalogo Focus on official statistics
o Includes datasets published by 30 different organisations
o Curated by CSO
2. 209 geospatial datasets from the ISDE catalogo Focus on geospatial data, built in the context of Inspire
o Includes datasets published by five different organisations
o Curated by Marine Institute
3. 34 additional datasetso Focus on G8 high-value sectors and other prominent
datasets
47
data.gov.ie: What’s not listed?
• Datasets that are not on the Web already
• Datasets that are not machine-readable
• Datasets that need to be licensed for a fee
• Organisations other than central government and state bodieso Local government
o State-owned companies
o Academic and cultural organisations
With some exceptions!
48
Open Data Ireland Next Steps
1. Determine Open Data Officer/Team
2. Create ODB and SIG
3. Public consultation on Roadmap
4. Improve data.gov.ie continuously & iteratively
5. Publish more high-value and high-quality datasets.
6. Engage with stakeholders from general public,
business, civil society, public-sector and academia.
7. Widen the Open Data community
8. Evaluate progress and impact