open data - where can it take us?
DESCRIPTION
Open Data presentation at iQuest's Inaugural National Public Sector IT Leaders Forum in Dublin, Irelandhttp://www.psitleaders.ie/TRANSCRIPT
Copyright 2011 Digital Enterprise Research Institute. All rights reserved.
Enabling Networked Knowledge
Deirdre Lee
Digital Enterprise Research Institute (DERI),
NUI Galway
Enabling Networked Knowledge
Promotional art for Batman #608 (Oct.
2002, second printing)
Pencils by Jim Lee and inks by Scott
Williams
Enabling Networked Knowledge
“In God we trust. Everyone else bring data”
Mayor Mike Bloomberg, New York City
“My administration is committed to creating an
unprecedented level of in Government.
Openness will strengthen our and promote
and in Government”
President Obama, US
"This revolution in government will make it
easier than ever before for the public to make
between providers, and hold government to
account for the of key public services.”
Prime Minister David Cameron, UK
Enabling Networked Knowledge
nyopendata.socrata.com
924 datasets
data.gov
4409 datasets
data.gov.uk
>8200 datasets
data.worldbank.org
data.nytimes.com
data.enel.com
Enabling Networked Knowledge
Enabling Networked Knowledge
Enabling Networked Knowledge
Fingal Open
Data launched
18-hour Open
Data Challenge
First workshop
of National
Cross Industry
Working Group
on Open Data
Dublinked
launched
First Irish Open
Data Week
opendata.ie
launched
Open Data
Google Group
ie.ckan.net
launched
data-gov.ie
launched
Apps4Fingal
deadline
Enabling Networked Knowledge
: data that can be freely used, reused
and redistributed by anyone.*
: data and information produced
or commissioned by government or government
controlled entities.*
Not sensitive or private information but core public
data on transport, infrastructure, education, health,
crime, environment, etc.
*Open Knowledge Foundation (OKF) http://opengovernmentdata.org/what/
Enabling Networked Knowledge
Resources:
oil, gas, skilled workforce,
infrastructure, etc.
Data is also a valuable
resource!
A by-product of day-to-day
governance
Enabling Networked Knowledge
Agency Agency Agency
Governing Body 1
2
3
Enabling Networked Knowledge
Freedom of Information request handling
Internal reporting
Service indicators submission
Queries from neighbouring agencies
Queries from the public or media
Requests for Open Data
Enabling Networked Knowledge
Enabling Networked Knowledge
Enabling Networked Knowledge
Providing easy access to public data can encourage:
comments, feedback, critique, insights,
recommendations, queries....
Two-way discussion
Enables government to respond to real-time needs
of citizens
Enabling Networked Knowledge
Depends on datasets…
To highlight deficiencies, mistakes and inaccuracies
within government?
To rebuild trust between citizens and government,
identify room for improvement,
encourage new solutions, and
remove inefficiencies.
Enabling Networked Knowledge
Enabling Networked Knowledge
Have a simple page on your website
Use an open community data catalogue
The Data Hub (
Irish CKAN (
Set up catalogue using own software
Data.fingal.ie
Dublinked.ie
Set up catalogue using Open Source software
Data.gov.uk
Berlin Open Data
Use a national Irish data catalogue
Enabling Networked Knowledge
Enabling Networked Knowledge
http://lab.linkeddata.deri.ie/2010/star-scheme-by-example/
Enabling Networked Knowledge
★
Web
Wide access
Google can index it
People can find it themselves
Open License
Regulates reuse of data
Helps maintain provenance
Strengthens business reuse
Enabling Networked Knowledge
★ ★
Machine-readable
Enabling Networked Knowledge
★ ★ ★
Freedom of how to process, analyse and visualise
data
Proprietary:
Word, Excel, PDF
Non-proprietary:
CSV, XML, JSON, Microdata, RDF
Enabling Networked Knowledge
CSV – Comma-Separated Values
More open (and simpler) alternative to Excel format
Can be opened in and exported from Excel, Google
Spreadsheets, Google Refine, …
KML – Keyhole Markup Language
Simple format for presenting geographic data
Can be opened in Google Maps
RSS – Really Simple Syndication
Notifications of updates of any kind
Can be opened in RSS readers and many email clients
Enabling Networked Knowledge
XML – Extensible Markup Language
W3C (World Wide Web Consortium) standard, 1997
established, reliable, ubiquitous
JSON – Javascript Object Notation
IETF (Internet Engineering Task Force) standard, 2006
great for web APIs
very simple; very fashionable right now
RDF – Resource Description Framework
W3C standard, 2004
great for data integration
steeper learning curve
Enabling Networked Knowledge
★ ★ ★ ★
Unique identifiers enable others to point to the
data.
<http://www.deri.ie/about/team/member/Deirdre_Lee>
<http://lab.linkeddata.deri.ie/2010/star-scheme-by-
example/gtd-4.html#forecast20101113>
Enabling Networked Knowledge
★ ★ ★ ★ ★
http://lod-cloud.net
Enabling Networked Knowledge
Enabling Networked Knowledge
Enabling Networked Knowledge
Agency Agency Agency
Governing Body
Enabling Networked Knowledge
Agency Agency Agency
Governing Body Common standards
Enabling Networked Knowledge
Title
Description
Category
License
Quality
Format(s)
Granularity
Format
Time Period
....
Enabling Networked Knowledge
http://vmsgov03.deri.ie:8080/data-cube-searcher/about.html
Enabling Networked Knowledge
Org:BlanchardstownHospital hosp:childrensWard
Org:hospital
Org:hasOrgType
hosp:hasWard
Org:hospital
Org:StJamesHospital
Org:hasOrgType
hosp:hasWard
hosp:cardiacWard
Enabling Networked Knowledge
Massive Industry Adoption
Enabling Networked Knowledge
Develop a domain model
Populate your data model
Design URIs
Build pages
Apply layout and decor CSS
Test and iterate
Mike Atherton, ‘Beyond the Polar Bear’
http://www.slideshare.net/reduxd/beyond-the-polar-bear
Enabling Networked Knowledge
Modular for publishing
standard Open Data, based on Open Source
components.
Deployment
On-site
Hosted service (in the cloud)
Enabling Networked Knowledge
Enabling Networked Knowledge
Mailing List
http://groups.google.com/group/open-data-ireland
Workspace
http://workspace.opendata.ie
Open Data Publishing Pipeline (ODPP)
http://publishing-pipeline.com