graphconnect europe 2016 - how the icij used neo4j to unravel the panama papers - mar cabra

33
Leaks, journalism & graphs How ICIJ Used Neo4j to Unravel the Panama Papers Mar Cabra Editor, Data & Research Unit The International Consortium of Investigative Journalists (ICIJ) @cabralens | @ICIJorg icij.org

Upload: neo4j-the-fastest-and-most-scalable-native-graph-database

Post on 08-Jan-2017

1.656 views

Category:

Technology


0 download

TRANSCRIPT

Page 1: GraphConnect Europe 2016 - How the ICIJ Used Neo4j to Unravel the Panama Papers - Mar Cabra

Leaks, journalism & graphsHow ICIJ Used Neo4j to

Unravel the Panama Papers Mar Cabra

Editor, Data & Research UnitThe International Consortium of Investigative Journalists (ICIJ)

@cabralens | @ICIJorgicij.org

Page 2: GraphConnect Europe 2016 - How the ICIJ Used Neo4j to Unravel the Panama Papers - Mar Cabra

Almost 200 journalistsBased in 65 countries

“Our aim is to bring journalists from different countries together in teams - eliminating rivalry and promoting collaboration.

Together, we aim to be theworld’s best cross-border investigative team.”

icij.org/about

Page 3: GraphConnect Europe 2016 - How the ICIJ Used Neo4j to Unravel the Panama Papers - Mar Cabra

You may remember us from...

Page 5: GraphConnect Europe 2016 - How the ICIJ Used Neo4j to Unravel the Panama Papers - Mar Cabra
Page 6: GraphConnect Europe 2016 - How the ICIJ Used Neo4j to Unravel the Panama Papers - Mar Cabra
Page 7: GraphConnect Europe 2016 - How the ICIJ Used Neo4j to Unravel the Panama Papers - Mar Cabra

+370 journalists+100 media organizations

76 countries

Page 8: GraphConnect Europe 2016 - How the ICIJ Used Neo4j to Unravel the Panama Papers - Mar Cabra
Page 9: GraphConnect Europe 2016 - How the ICIJ Used Neo4j to Unravel the Panama Papers - Mar Cabra
Page 10: GraphConnect Europe 2016 - How the ICIJ Used Neo4j to Unravel the Panama Papers - Mar Cabra
Page 11: GraphConnect Europe 2016 - How the ICIJ Used Neo4j to Unravel the Panama Papers - Mar Cabra
Page 12: GraphConnect Europe 2016 - How the ICIJ Used Neo4j to Unravel the Panama Papers - Mar Cabra
Page 13: GraphConnect Europe 2016 - How the ICIJ Used Neo4j to Unravel the Panama Papers - Mar Cabra
Page 14: GraphConnect Europe 2016 - How the ICIJ Used Neo4j to Unravel the Panama Papers - Mar Cabra

Nearly one in 10 of the 31,000 tax haven companies that own British property are linked to Mossack Fonseca

Page 15: GraphConnect Europe 2016 - How the ICIJ Used Neo4j to Unravel the Panama Papers - Mar Cabra

#panamapapers

Page 16: GraphConnect Europe 2016 - How the ICIJ Used Neo4j to Unravel the Panama Papers - Mar Cabra
Page 18: GraphConnect Europe 2016 - How the ICIJ Used Neo4j to Unravel the Panama Papers - Mar Cabra

INSIDE THE 2.6 TB

Page 19: GraphConnect Europe 2016 - How the ICIJ Used Neo4j to Unravel the Panama Papers - Mar Cabra

Redis queue

35 x g2.xlarge Amazon instances with Ubuntu + Tesseract + Extract

Page 20: GraphConnect Europe 2016 - How the ICIJ Used Neo4j to Unravel the Panama Papers - Mar Cabra

Lucene syntax queries with proximity matching!

400 users

Page 21: GraphConnect Europe 2016 - How the ICIJ Used Neo4j to Unravel the Panama Papers - Mar Cabra
Page 22: GraphConnect Europe 2016 - How the ICIJ Used Neo4j to Unravel the Panama Papers - Mar Cabra

INSIDE THE 2.6 TB

Page 23: GraphConnect Europe 2016 - How the ICIJ Used Neo4j to Unravel the Panama Papers - Mar Cabra

offshoreleaks.icij.org

Page 24: GraphConnect Europe 2016 - How the ICIJ Used Neo4j to Unravel the Panama Papers - Mar Cabra
Page 26: GraphConnect Europe 2016 - How the ICIJ Used Neo4j to Unravel the Panama Papers - Mar Cabra
Page 27: GraphConnect Europe 2016 - How the ICIJ Used Neo4j to Unravel the Panama Papers - Mar Cabra
Page 28: GraphConnect Europe 2016 - How the ICIJ Used Neo4j to Unravel the Panama Papers - Mar Cabra

MAGIC!!

● 950,000 nodes, 1.2 million edges (4GB)

Small, I know!!

● Find shortest path

Wow!

● Fuzzy searching● Public widgets● API

Page 29: GraphConnect Europe 2016 - How the ICIJ Used Neo4j to Unravel the Panama Papers - Mar Cabra
Page 31: GraphConnect Europe 2016 - How the ICIJ Used Neo4j to Unravel the Panama Papers - Mar Cabra

HELP US OUT SOME?

Page 32: GraphConnect Europe 2016 - How the ICIJ Used Neo4j to Unravel the Panama Papers - Mar Cabra
Page 33: GraphConnect Europe 2016 - How the ICIJ Used Neo4j to Unravel the Panama Papers - Mar Cabra

THE END…or is it?

Mar [email protected] | @cabralens

icij.org/supportbit.ly/icijgraphconnect2016