how to get open data into the hands of activists
DESCRIPTION
Talk given at GotoCon Aarhus, 2013. http://bit.ly/1bumPB4TRANSCRIPT
![Page 1: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/1.jpg)
HOW TO GET OPEN DATA IN THE HANDS OF ACTIVISTS
Aslam Khan@aslamkhn
![Page 2: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/2.jpg)
Open DataActivism
Aslam Khan / @aslamkhn
![Page 3: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/3.jpg)
1977School Protest
8y
1985State of
Emergency
16
Detention without trial
198617
198819
Worker & Student Pressure
1993Brink of Civil War
23
Activist by defaultif you lived on the receiving end of apartheid in South Africa
![Page 4: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/4.jpg)
196923 years 1992
22born
Would data have been valuable to me - in both eras?
21 yearsnow
2013
I want to believe so
but
I'm not sure
![Page 5: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/5.jpg)
This is Cape Town, South Africa
Khayelitsha
![Page 6: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/6.jpg)
This is Khayelitsha, Cape TownIt means New Home in isiXhosa
![Page 7: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/7.jpg)
![Page 8: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/8.jpg)
satellite dish
![Page 9: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/9.jpg)
chemical toiletditto
ditto
There is (almost) no bulk sewage
![Page 10: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/10.jpg)
source: ewn.co.za
People protestedusing the most shocking means imaginable
![Page 11: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/11.jpg)
More Importantly...
Why did nearly 4 million residents of Cape Town not know about this issue?
How wide spread is this problem?
Why did we let this degrade into a battle for political points?
![Page 12: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/12.jpg)
because it was just noisy people(perception!)
![Page 13: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/13.jpg)
Khayelitsha
29 sq.km400,00 people
Look at the data behind the protestThis touches the mind first, then the heart (a little)
all figures are approximate
13.7k people/sq.km
2000 people share eleven flush toilets
Everyone in Denmark will live into about 400 sq.km not 43k sq.km
![Page 14: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/14.jpg)
Durbanville
27 sq.km55,000 people
2,000 people/sq.km
1 flush toilet per house4 people per flush toilet
Khayelitsha
29 sq.km400,00 people
13.7k people/sq.km
180 people per flush toilet
25km
Facts stick when it touches heartsmake it concrete and tangible so that it appeals to everyone, not just the disenfranchised
On average, Khayelitsha toilets are used
every 8 minutes so that each person
can use a flush toilet once a day
![Page 15: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/15.jpg)
Wikipedia
Report of the Khayelitsha 'Mshengu' Toilet Social Audit
Open Data for Africa
Statistics South Africa
Where did I find these facts?There is data available, but it is scattered, and not all open data
various news web sites
![Page 16: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/16.jpg)
What would we do differentlyif we had access to data?
![Page 17: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/17.jpg)
Offering data to social activists has little value
We need to distill data into facts that are simple, precise and easily understood
that appeals to hearts and minds
![Page 18: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/18.jpg)
common knowledge
Social activists need to share
we need tools to access discoveries and distribute widely
open data
Digital activists need to discover
we need tools to discover facts in data and publish discoveries
freedom to distributefreedom to discover
![Page 19: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/19.jpg)
open data
freedom to discover
frictionless sharing of data setsability to "mix-in" and explore varied data sets
location independence of data sets
What tools do digital activists need?Digital activists do not need campaign tools
![Page 20: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/20.jpg)
software freedoms
freedom to execute and modifyfreedom to distribute
freedom to share changes
Pre-requisitesNormally codified in licenses
data freedoms
free to access, reuse, redistributeavailable as a wholemachine readable
![Page 21: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/21.jpg)
open data
freedom to discover
frictionless sharing of data setsability to "mix-in" and explore varied data sets
location independence of data sets
What tools do digital activists need?Digital activists do not need campaign tools
![Page 22: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/22.jpg)
Frictionless Data Sharing
open datastandards based Lowest common denominator
standards allow for richly adorned data sets
simplest machine readable formats are anemic
The constraint is meta data
Must provide metadata early
When/How do we get metadata?
![Page 23: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/23.jpg)
Concept Meta Data
definition
variablesclassification
context
semantics
domain
![Page 24: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/24.jpg)
Can we compare poverty between countries?
Why metadata is the biggest constraintmostly because of changes in context and time
US Census Bureau UNESCO
World Bank WHO
multiple definitions of poverty threshold
South Africaadjustment for Sub-Sahara and
medium income economies
povertymetadata
![Page 25: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/25.jpg)
poverty
Can we compare poverty between countries?
No metadata, No analysis
metadata
It's difficult to compare because the metadata is different for each country
BUT without metadata it is impossible
![Page 26: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/26.jpg)
HIGH barrier to get in
HIGH cost of conformance
The problem with a strict standard formatThe problem with any standard is that compliance is a choice
But the cost of metadata remains, regardless of compliance
![Page 27: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/27.jpg)
Frictionless Data SharingI doubt we can ever remove the cost of metadata completely
open datasimplest extensible
format for metadata
simplest machine readable format for data
Open Knowledge Foundation'sData Package Standard is a step in the right direction
http://data.okfn.org/standards/data-package
JSON for metadata+
CSV for tabular data
![Page 28: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/28.jpg)
open data
freedom to discover
frictionless sharing of data setsability to "mix-in" and explore varied data sets
location independence of data sets
What tools do digital activists need?Digital activists do not need campaign tools
![Page 29: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/29.jpg)
Why do we need data exploration tools?
LOW barrier to get in
Cost of computation (analysis)
What is the effort to get knowledge out?
constraint shifts
(frictionless data sharing)
![Page 30: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/30.jpg)
Why do we need to compose data sets?because that is where the interesting and relevant facts lurk
When is per capita income interesting?
Correlation between infant mortality and per capita income?
… between parent to child HIV infections and per capita income?
Digital activists are in the business of data science - not campaigning
![Page 31: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/31.jpg)
What do we need for discovering facts?
Split into individual columns and compose columns ad-lib
treat every column as a data set
&Find all other occurrences of a
single valueremove all duplications in every column and join on “value”
then look for trendsif we make the above easy
then the cost is mental effort
I DON’T KNOWSet-based? Graph-based? something else?
how?!?
![Page 32: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/32.jpg)
Is there such a data discovery tool?
QlikView
fails freedom pre-requisites
http://www.qlikview.com/
![Page 33: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/33.jpg)
open data
freedom to discover
frictionless sharing of data setsability to "mix-in" and explore varied data sets
location independence of data sets
What tools do digital activists need?Digital activists do not need campaign tools
![Page 34: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/34.jpg)
“Peer-to-peer software, if we could make it work, would seem to give the best of both worlds:
the freedom to modify how a program functions on ourlocal computers as well as the ability to share and collaborate with others across the Internet.
Why do we need location independence?for the same reason that bit torrent is popular
-- Aaron SwartzA Programable Web: An Unfinished Work
http://www.morganclaypool.com/doi/abs/10.2200/S00481ED1V01Y201302WBE005
![Page 35: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/35.jpg)
The attraction of peer to peerbut I think we need a more research to make this work
we get location independence for free
the publisher is relieved of the burden to share
distribution is the responsibility of those that want it
![Page 36: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/36.jpg)
To turn Open Data into Common Knowledgeso that we can spend our effort almost exclusively on the mental (analysis) battle
simple data format
extensible meta data format
lower the cost of participation
compose into new data sets
compute power to discover
lower the cost of discovery
peer to peer distribution lower the cost of sharing
![Page 37: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/37.jpg)
common knowledge
freedom to distribute
knowledge close at handability to reach people
ability to receive feedback
What tools do social activists need?Social activists also need tools for campaigning
![Page 38: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/38.jpg)
Reminderthis applies regardless of scale - from few to thousands to millions of people
activism is a call for a gathering of people
to exert pressure for
(social, political, environmental, economic)
change
![Page 39: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/39.jpg)
Most commonly...
to stop exploitation
to alleviate under-development
under-development is the result of unfair agreements for access to resources
(in other words)
![Page 40: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/40.jpg)
Activism is an effort to ...
…establish new relationships.
A balancing via fair and equal agreements
![Page 41: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/41.jpg)
common knowledge
freedom to distribute
knowledge close at handability to reach people
ability to receive feedback
What tools do social activists need?Social activists also need tools for campaigning
![Page 42: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/42.jpg)
federated wikis is an interesting development
How can we make knowledge accessible?overlaps with location independence for digital activists
https://github.com/WardCunningham/Smallest-Federated-Wiki
Wiki is centralised with many editors
Federated wiki belongs to a single person
Sharing is achieved between wikis
![Page 43: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/43.jpg)
common knowledge
freedom to distribute
knowledge close at handability to reach people
ability to receive feedback
What tools do social activists need?Social activists also need tools for campaigning
![Page 44: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/44.jpg)
How can we reach people?this is not about about twitter and social media
Awareness is the first stage of involvement for activists
NOT shotgun marketing
Very specific and targeted messages
It can be private too!
lots of marketing strategy involved
![Page 45: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/45.jpg)
common knowledge
freedom to distribute
knowledge close at handability to reach people
ability to receive feedback
What tools do social activists need?Social activists also need tools for campaigning
![Page 46: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/46.jpg)
How can we receive feedback?this starts overlapping with campaign tools quite quickly
The channel you reach out is not necessarily the channel for feedback
about shifting people through various stages from being aware to organiser
![Page 47: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/47.jpg)
Open Data is NOT the end gameit is just a pre-requisite for us to carve out new social relationships
frictionless data sets
makes it easier to
to compose new data sets at will
discover new facts
so that we can
that can be shared
independent of where it is located
can distribute it
so that social activists
it becomes common knowledge
and eventually
![Page 48: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/48.jpg)
fight against corruption
How much is being siphoned off?What is the money trail?At what cost to our people?
call for economic boycott
Why must we sacrifice for freedom?
What pressure will our sacrifice have on the ruling white minority?
Common knowledge is valuableIt is valuable to any person that values living together
1992
![Page 49: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/49.jpg)
How soon before Open Data is used for exploitation instead of good?
Ideologically speaking...This is important in the bigger picture of digital activism
What are the consequences if we consider data as a “natural” resource?
In the internet of things privacy is the next freedom.
![Page 50: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/50.jpg)
“Magic machine cannot matchHuman being human beingAfrican idea -- make the future clear
They are the scatterlings of AfricaEach uprooted one
On the road to PhelamangaBeneath the copper sun
And for the scatterlings of AfricaThe journey has begun
-- Johnny CleggScatterlings of Africa
*
*The place at the end of lies. It is the place beyond our imagination where ultimate truth prevails.
![Page 51: How to get open data into the hands of activists](https://reader034.vdocuments.us/reader034/viewer/2022051314/556446e7d8b42ad6268b490e/html5/thumbnails/51.jpg)
Common Knowledge
Activism
Aslam Khan / @aslamkhn