hey, it's the people's data! the global emergence of the open data movement tom johnson...
TRANSCRIPT
Hey, it's THE PEOPLE'S data! The global emergence
of the Open Data Movement
Tom JohnsonManaging Director
Institute for Analytic JournalismSanta Fe, NM
2
Presented at the Santa Fe Complex5 Oct. 2011
Slides may be found athttp://opendatanm.pbworks.com
It's the people's data by J. T. Johnson is licensed under a Creative Commons Attribution-NonCommercial-NoDerivs
3
Cause for optimism?
• "All agencies should adopt a presumption in favor of disclosure."
• "We must operate state government in an open and transparent manner."
4
• "All agencies should adopt a presumption in favor of disclosure."
Barack Obama. "Freedom of Information Act: MEMORANDUM FOR THE HEADS OF EXECUTIVE
DEPARTMENTS AND AGENCIES."
• "We must operate state government in an open and transparent manner.“
Susana Martinez. "Ensuring Transparency and Ethics in Our Government."
5
Tonight’s Objectives
• Part of the SFX series "What's happening now?“
• Brief interested citizens and journos on potential for citizen control of our data
• Test the water to see if others in SFe might be interested in building a "Get our data" project
6
Objectives - "It's The People's data."• Basic Process:
Data In Analysis Info Out• Facilitate transparency, participation,
collaboration, economic development • Create greater efficiency and utility for public
administrators • Create a culture in government and public
administration that assumes The People's Data will be quickly online in its original file format.
• Educate citizens on how to identify, retrieve, analyze and present data
7
Backstory & Assumptions
• It IS the people's data• Changing Functions of gov't.• Fight against the "data huggers"
• An informed electorate is better than uninformed
• Full political spectrum can agree on importance of data (if not interpretation)
• The technology is relatively easy; changing the culture is hard
• Supply analytic tools if possible, i.e. sort and array, GIS, visual stats
8
Assumptions
• Default: Post all gov't data in original file format as soon as possible• Make as easy to download in original format as
possible
• Yes, there are/will be privacy issues• But start with “put the data up”• Then ask, “OK, is there going to be
anything here that encroaches on an individual’s privacy?”
9
Why timely?
• “The Big Bundle” examination of NM voter rolls• Clean up registered voter list• 64k “questionable” voters on roles• Outcome always determined by methodology
• Santa Fe Public Schools performance data"Zero Sum: School district 'erased' low achievers to improve data"
• PRC expense report data• PRC activates gas-card alerts
10
Open Data Movement is NOT about…
• technology alone or• building a portal or• transparency for the sake of transparency.
11
Greater benefits of open data…
• Increased internal government efficiency and effectiveness
• Increased citizen participation and inclusion with more services closer to people’s needs
• More services to people because of increased base of more potential service providers
• New businesses/jobs for application and service developers
• Synergies between government, public administration and civil society organizations
• New uses of open data spur innovation and development in the CIT sector
13
About Moscow city administration opendata plans
• “I would like to lauch public discussion here in Russia about city data openness and to civil oversight over city administration activities.So could you help me please with information about similar city projects around the world ? I know that there are Toronto, Chicago, Berlin and dozen other city opendata projects.If you know about any city level opendata portal, could you tell me about:> - how long time it takes to create it and to make it public?
15
International
• from: Ann Frisch [email protected]: Wed, Sep 21, 2011 at 2:33 PMsubject: Re: [open-government] open-government Digest, Vol 19, Issue 28mailing list: open-government.lists.okfn.org
“I would like to get together with Open Data members from South Sudan, Philippines and South Caucasus region to what is being done in those areas in terms of open data.”
16
Open Government Data Camp 2011
http://ogdcamp.org/cfp/What: The world's biggest open data event to date. * When: 20-21st October, with satellite events from 17-26th October * Where: Warsaw, Poland * Web: http://www.ogdcamp.org * Hashtag: #ogdcamp
•The camp has 4 key objectives: * Build consensus – around core open data principles and values * Build community – expand and strengthen international open data community * Share ideas – on the future of open data and how we can do things better * Make things – from starting projects, to making plans, to writing code
17
Open Government Data Camp 2011
http://ogdcamp.org/cfp/What: The world's biggest open data event to date. * When: 20-21st October, with satellite events from 17-26th October * Where: Warsaw, Poland * Web: http://www.ogdcamp.org * Hashtag: #ogdcamp
•The camp has 4 key objectives: * Build consensus – around core open data principles and values * Build community – expand and strengthen international open
data community * Share ideas – on the future of open data and how we can do things better * Make things – from starting projects, to making plans, to writing code
18
Culture “hacks”
20
Hacks and Hackers around the world
23
What’s the process? Where’s the data?
Data In Analysis Info Out
24
• TWC International Open Government Dataset Catalog (IOGDChttp://logd.tw.rpi.edu/demo/international_dataset_catalog_search
25
Open Data Showroom - http://opendata-showroom.org/
San Francisco: Data Sharing Among City Departments and Agencies
3030
32
San Antonio Payment Register
32
34
Data search and retrieval
• What is the law?• NM Foundation for Open Government• Records Retention Schedules and Their
Use• NM Statute 1.13.30 authority of state
records administrator• May be policies unique to
agency/department
• NM “Inspection of Public Records Act”• FOG: http://nmfog.org/Recent_Changes_to_IPRA.aspx
35
Retention of local gov’t records
• New Mexico - Local Government Records Retention and Disposition Scheduleshttp://www.nmcpr.state.nm.us/nmac/_title01/T01C019.htm
36
Retention of NM state gov’t records
• Administrative Records for state agencieshttp://www.nmcpr.state.nm.us/nmac/_title01/T01C015.htm
• Executive recordshttp://www.nmcpr.state.nm.us/nmac/_title01/T01C018.htm
• Legislative recordshttp://www.nmcpr.state.nm.us/nmac/_title01/T01C016.htm
• Judicial recordshttp://www.nmcpr.state.nm.us/nmac/_title01/T01C017.htm
• 1 NMAC 3.2.50.1, Destruction of Public Recordshttp://www.nmcpr.state.nm.us/nmac/parts/title01/01.013.0030.htm
37
Data search and retrieval
• What is the document?• Origins?
• Who created? When? Why? How?• Verification? Who? When? Why?
• File type(s)• Analysis often limited by PDF files; • Always seek document/data in its original file
format• Strive to get the “metadata” of the
document/data
• If spreadsheet or database, request “code sheet” or “database schema”
39
New, major function for government in the Digital Age
40
Next steps?
• Remember: Data InAnalysisInfoOut• Room for all skilled and yet-to-be skilled• Scaleable local to state
1.Create “jump station” database of all NM “records custodians” for all levels of government
2.Build catalog of gov’t agencies/depts. data1.State and local library initiatives to submit
their data?
41
Next steps?
• Anyone interested in OpenData-NM?• Fill out info card• Recruit others
• Visit “rough sketch” wiki – o p e n d a t a n m . p b w o r k s . c o m
• Make suggestions• Step up to develop/manage a pertinent
project
Hey, it's THE PEOPLE'S data! The global emergence
of the Open Data Movement
Tom JohnsonManaging Director
Institute for Analytic JournalismSanta Fe, NM
t o m @ j t j o h n s o n . c o m
Slides may be found athttp://opendatanm.pbworks.com
42