data journalism developer studio 2012lx overview

8/3/2019 Data Journalism Developer Studio 2012LX Overview

http://slidepdf.com/reader/full/data-journalism-developer-studio-2012lx-overview 1/76



Data Journalism Developer Studio 2012LX

Overview

I Keep Six Honest Serving MenI Keep Six Honest Serving Men

I keep six honest serving-men (They taught me all I knew);

Their names are What and Why and When

And How and Where and Who.

http://c2.com/cgi/wiki?SixHonestServingMen


http://find/




Overview

Why A Data Journalism Developer Studio?Hint: journalists today work in a world dominated by two trends

Real-time many-to-many communications platformsLarge sets of complex data with stories waiting to be toldCommunications of the ACM, October 2011: "ComputationalJournalism"

http://cacm.acm.org/magazines/2011/10/131400-computational-journalism/fulltext




http://find/




Overview

Real-time Many-to-Many Communications Platforms

Hundreds of millions of Twitter accounts almost everywhere in

the worldMillions of active Twitter usersComplex patterns of interactions around people, places andevents

Intricate and changing connection patterns between peoplePeople break and discuss the news in real time on Twitter.

http://find/




Overview

Who Is It For?Hint: the next generation of journalists

Data journalism hackers and their friendsJournalism students – high school, community college andbeyondFreelance journalists, researchers, reporters, editors, publishers

http://find/




Overview

Why 100 Percent Open Source?

Open source software is robustOpen source software is low cost

http://find/




Overview

RobustnessProven technologies in wide use.

Crafted by highly-motivated self-regulated communities of expertsSecurity aws, functionality defects and performance issues arerapidly found and xedPeer review process yields software that is usually moreefficient than commercial counterparts

http://find/




Overview

Low Cost

The software in the Data Journalism Developer Studio is freelydownloadable without legal restrictionsFunctionality that would cost thousands of dollars incommercial licenses is available for the cost of a download

li l S di 2012

http://find/




Overview

Links

Data Journalism Developer Studio Users Google Group

Support Data Journalism Developer Studio On FundryDownload Data Journalism Developer Studio 2012LX FromSUSE GalleryData Journalism Developer Studo 2012LX On Github

Borasky Research Journal

D t J li D l St di 2012LX

https://groups.google.com/group/data-journalism-developer-studio-users?hl=en

https://fundry.com/project/19-data-journalism-developer-studio

http://j.mp/DJDS2012LX


https://github.com/znmeb/Data-Journalism-Developer-Studio-2.0

http://borasky-research.net/about-data-journalism-developer-studio-pricing-survey/

http://borasky-research.net/about-data-journalism-developer-studio-pricing-survey/

https://github.com/znmeb/Data-Journalism-Developer-Studio-2.0



https://fundry.com/project/19-data-journalism-developer-studio


http://find/




References

Recommended Reading

’Facts are Sacred: The power of data (Guardian Shorts)’ bySimon Rogers

’Multimedia Journalism: A Practical Guide’ by Andy Bull’R Through Excel’ by Richard M. Heiberger’Crafting Digital Media’ by Daniel James’ggplot2: Elegant Graphics for Data Analysis (Use R)’ by

Hadley Wickham’Interactive and Dynamic Graphics for Data Analysis’ byDianne Cook


http://www.amazon.com/gp/product/B006PI9PQG?ie=UTF8&tag=boraskyresear-20&linkCode=shr&camp=213733&creative=393177&creativeASIN=B006PI9PQG


http://www.amazon.com/gp/product/B003FC9QNC?ie=UTF8&tag=boraskyresear-20&linkCode=shr&camp=213733&creative=393177&creativeASIN=B003FC9QNC

http://www.amazon.com/gp/product/B003VYBPH4?ie=UTF8&tag=boraskyresear-20&linkCode=shr&camp=213733&creative=393177&creativeASIN=B003VYBPH4

http://www.amazon.com/gp/product/B003U890V4?ie=UTF8&tag=boraskyresear-20&linkCode=shr&camp=213733&creative=393177&creativeASIN=B003U890V4

http://www.amazon.com/gp/product/B0041KLFRW?ie=UTF8&tag=boraskyresear-20&linkCode=shr&camp=213733&creative=393177&creativeASIN=B0041KLFRW


http://www.amazon.com/gp/product/B00192UM2O?ie=UTF8&tag=boraskyresear-20&linkCode=shr&camp=213733&creative=393177&creativeASIN=B00192UM2O






http://www.amazon.com/gp/product/B003U890V4?ie=UTF8&tag=boraskyresear-20&linkCode=shr&camp=213733&creative=393177&creativeASIN=B003U890V4

http://www.amazon.com/gp/product/B003VYBPH4?ie=UTF8&tag=boraskyresear-20&linkCode=shr&camp=213733&creative=393177&creativeASIN=B003VYBPH4

http://www.amazon.com/gp/product/B003FC9QNC?ie=UTF8&tag=boraskyresear-20&linkCode=shr&camp=213733&creative=393177&creativeASIN=B003FC9QNC



http://find/




References

Recommended Reading - Advanced

Finance: ’Asset Price Dynamics, Volatility, and Prediction’ byStephen J. Taylor

Geospatial: ’Applied Spatial Data Analysis with R (Use R!)’ byRoger BivandNatural Language Processing: ’Natural Language Processingwith Python’ by Steven Bird

Machine Learning: ’The Elements of Statistical Learning’ byJerome FriedmanWeb Data Mining: ’Web Data Mining’ by Bing Liu


http://www.amazon.com/gp/product/B004QOB424?ie=UTF8&tag=boraskyresear-20&linkCode=shr&camp=213733&creative=393177&creativeASIN=B004QOB424


http://www.amazon.com/gp/product/0387781706?ie=UTF8&tag=boraskyresear-20&linkCode=shr&camp=213733&creative=393185&creativeASIN=0387781706




http://www.amazon.com/gp/product/B00475AS2E?ie=UTF8&tag=boraskyresear-20&linkCode=shr&camp=213733&creative=393177&creativeASIN=B00475AS2E


http://www.amazon.com/gp/product/B000SEPGWK?ie=UTF8&tag=boraskyresear-20&linkCode=shr&camp=213733&creative=393177&creativeASIN=B000SEPGWK

http://www.amazon.com/gp/product/B000SEPGWK?ie=UTF8&tag=boraskyresear-20&linkCode=shr&camp=213733&creative=393177&creativeASIN=B000SEPGWK









http://find/




The Rest of the Story

I Keep Six Honest Serving MenI Keep Six Honest Serving Men

I keep six honest serving-men (They taught me all I knew);

Their names are What and Why and When

And How and Where and Who.




http://find/





The Rest of the StoryDid you know there was more?

I send them over land and sea,I send them east and west;

But after they have worked for me,

I give them all a rest.


http://find/






I let them rest from nine till ve,

For I am busy then,

As well as breakfast, lunch, and tea,

For they are hungry men;


http://find/



p



But different folk have different views:

I know a person small -

She keeps ten million serving-men,

Who get no rest at all!


http://find/



p



She sends ’em abroad on her own affairs.

From the second she opens her eyes -

One million Hows, two million Wheres,

And seven million Whys!


http://find/



A Virtual Unboxing on Windows 7

Host System Requirements

64-bit Intel / AMD compatibleTwo or more cores4 GB of RAM64-bit operating system

Windows 7 or lateropenSUSE Linux 12.1 or laterFedora 16 or laterUbuntu 11.10 or later


http://find/




Step 0: Join Data Journalism Developer Studio Users Google Group! https://groups.google.com/group/data-journalism-developer-studio-users?hl=en




http://find/




Step 1: Download and Install Oracle VM VirtualBox®https://www.virtualbox.org/


https://www.virtualbox.org/

https://www.virtualbox.org/

http://find/




Step 2: Download and Install 7-Ziphttp://www.7-zip.org/


http://www.7-zip.org/

http://www.7-zip.org/

http://find/




Step 3: Sign up for SUSE Galleryhttp://susestudio.com/browse


http://susestudio.com/browse

http://susestudio.com/browse

http://find/




Step 4: Download the Appliancehttp://j.mp/DJDS2012LX


A i l b i i d



http://find/




Step 5a: Open in 7-Zip and Remove Gzip CompressionSelect appliance and press “Enter.”


A Vi t l U b i Wi d 7

http://find/




Step 5b: Extract Tar ArchiveSelect appliance and press “Enter” again.



http://find/




Step 5c: Appliance UnpackedDrag appliance folder to desktop and close 7-Zip.



http://find/




Step 6a: Open Appliance FolderRight-click on “ovf” le and select “Open with”



http://find/




Step 6b: Open With Oracle VM VirtualBox Manager



http://find/




Step 6c: Appliance Import WizardPress “Import.”



http://find/



g

Step 6c: Import SuccessfulSelect the “vm” appliance and press the green “Start” arrow.



http://find/



g

Step 7a: First Login as “studio”Press “Enter.”



http://find/



Step 7b: Enter Original “studio” PasswordFrom the page where you downloaded the appliance: http://j.mp/DJDS2012LX .






http://find/



Step 7c: Change “studio” Password“Old” password is the one you got from the gallery page.



http://find/



Step 7d: Choose a New PasswordEasy for you to remember, impossible for others to guess, enter same password twice.



http://find/



Step 7e: Re-enter New PasswordThis must match the one you just entered.



http://find/



Data Journalism Developer Studio 2012LX DesktopPress the swift-shaped “Start” button in the lower left corner.



http://find/



Step 8a: Change “root” Password“Start -> System Tools -> XTerm” to open XTerm window

Data Journalism Developer Studio 2012LXA Virtual Unboxing on Windows 7

http://find/



Step 8b: Blank XTerm WindowEnter codes in next slide.

http://find/



Step 9a: Set and Sync Clock“Start” -> “System” -> “Administration” -> “YaST”


http://find/



Step 9b: Enter New “root” PasswordThis is the one you created in the XTerm


http://find/



Step 9c: Single-Click “Date and Time”


http://find/



Step 9d: Choose Time Zone and Press “Change”Note: if the time looks wrong, toggle “Hardware Clock Set To UTC” rst!


http://find/



Step 9e: Select “Synchronize With NTP Server” and “Run

NTP As Daemon”


http://find/



Step 9f: Press “Accept”


http://find/



Step 9g: Press “OK”


http://find/



Step 10a: Install Guest Additions“Devices” -> “Install Guest Additions” - use right-hand “Ctrl” key to release mouse.


http://find/



Step 10b: Open in File ManagerPress “OK.”


http://find/



Step 10c: Open Current Folder in Terminal“Tools” -> “Open Current Folder In Terminal”


http://find/



Step 10d: “sudo ./VBoxLinuxAdditions.run”Shortcut: “sudo ./VB<tab>Lin<tab><enter>

http://find/



Step 11a: Press red “Power Switch” (lower right corner)Then press “Shutdown.”


http://find/



Step 11b: Press “Snapshots” ButtonThen press the “Camera” icon to take a snapshot.


http://find/



Step 11c: Fill in the Form and Press “OK”


http://find/



Step 11e: Snaphot CompletedYou can close VirtualBox Manager now.

Data Journalism Developer Studio 2012LXUpdating the Software

http://find/



Why Update Software?

People nd and x bugs, especially security vulnerabilitiesPeople add features.


http://find/



The Update IconYou’ll see the red star with the “!” in the lower right corner if there are updates. Press it.


http://find/



A Typical Update Session - Screen 1The session you get will depend on what updates there are!


http://find/



Update Screen 2 – After Pressing “Install Update”Press “Continue.”


http://find/



Authentication RequiredEnter the new “root” password and press “Authenticate”.


http://find/



Log Out and Back InYou won’t always get this, and sometimes it will ask you to reboot. Do whatever it tellsyou.

Data Journalism Developer Studio 2012LXSoftware in the Appliance

http://find/



Base Appliance

The openSUSE 12.1 Linux operating systemThe Firefox BrowserThe The R Project for Statistical ComputingThe RStudio Integrated Development EnvironmentThe R Commander GUI

The Node.js Network Application Development Framework


http://software.opensuse.org/121/en

http://www.mozilla.com/en-US/firefox/firefox.html

http://www.r-project.org/

http://rstudio.org/

http://socserv.mcmaster.ca/jfox/Misc/Rcmdr/

http://nodejs.org/

http://nodejs.org/

http://socserv.mcmaster.ca/jfox/Misc/Rcmdr/

http://rstudio.org/

http://www.r-project.org/

http://www.mozilla.com/en-US/firefox/firefox.html

http://software.opensuse.org/121/en

http://find/



Base Appliance Media Creation

The Sigil WYSIWYG eBook EditorThe Maqetta WYSIWYG HTML5 User Interface AuthoringToolThe Calibre eBook Library Manager


http://code.google.com/p/sigil/

http://maqetta.org/

http://maqetta.org/

http://calibre-ebook.com/

http://calibre-ebook.com/

http://maqetta.org/

http://maqetta.org/

http://code.google.com/p/sigil/

http://find/



Base Appliance Internet Data Collection Libraries

Perl, Python and Ruby Scripting LanguagesGoogle Reneand Google Tesseract OCR Optical Character

Recognition EnginePerl Net::Twitter API InterfacePerl WWW::Mechanize Web Mining ToolsPerl AnyEvent::Twitter::Stream Streaming API Interface

The PostgreSQL Advanced Open Source DatabaseThe SQLite3 Open Source Database


http://www.perl.org/

http://www.python.org/

http://www.ruby-lang.org/en/

http://code.google.com/p/google-refine/

http://code.google.com/p/tesseract-ocr/


http://search.cpan.org/~mmims/Net-Twitter-3.14002/lib/Net/Twitter.pod

http://search.cpan.org/~petdance/WWW-Mechanize-1.66/lib/WWW/Mechanize.pm

http://search.cpan.org/~miyagawa/AnyEvent-Twitter-Stream-0.20/lib/AnyEvent/Twitter/Stream.pm

http://www.postgresql.org/

http://www.sqlite.org/

http://www.sqlite.org/

http://www.postgresql.org/

http://search.cpan.org/~miyagawa/AnyEvent-Twitter-Stream-0.20/lib/AnyEvent/Twitter/Stream.pm

http://search.cpan.org/~petdance/WWW-Mechanize-1.66/lib/WWW/Mechanize.pm

http://search.cpan.org/~mmims/Net-Twitter-3.14002/lib/Net/Twitter.pod



http://code.google.com/p/google-refine/

http://www.ruby-lang.org/en/

http://www.python.org/

http://www.perl.org/

http://find/



Base Appliance R Library Packages

Textir Sentiment Analysis and Topic Modelingtm Text Mining Package

Email pluginSentiment analysis pluginWeb mining plugin

GGPlot2 Publication-Quality Graphics

googleVis Google Visualization API Interface


http://cran.r-project.org/web/packages/textir/index.html

http://cran.r-project.org/web/packages/tm/index.html

http://cran.r-project.org/web/packages/ggplot2/index.html

http://cran.r-project.org/web/packages/googleVis/index.html

http://cran.r-project.org/web/packages/googleVis/index.html

http://cran.r-project.org/web/packages/ggplot2/index.html

http://cran.r-project.org/web/packages/tm/index.html

http://cran.r-project.org/web/packages/textir/index.html

http://find/



The Data Journalism Developer Studio Is Modular

The base appliance provides developer-level tools for buildingdesktop or server applicationsThe base appliance provides a browser-based desktop interfaceto cloud-based collaboration suitesAdd-on installation scripts provide end-user desktop andadvanced specialized analysis tools


http://find/



Add-On Productivity Suite Options

Semantic DesktopEvolution Email, Address Book and CalendaringMozilla Thunderbird Email ClientTracker Semantic Data Storage / Indexing / SearchR Language rrdf and SPARQL Library Packages

The LibreOffice Productivity SuiteVoIP and Messaging

Ekiga Voice and Video ConferencingEmpathy Instant Messaging


http://projects.gnome.org/evolution/

http://www.mozilla.org/projects/thunderbird/

http://projects.gnome.org/tracker/

http://cran.cnr.berkeley.edu/web/packages/rrdf/index.html

http://cran.cnr.berkeley.edu/web/packages/SPARQL/index.html

http://www.libreoffice.org/

http://ekiga.org/

http://live.gnome.org/Empathy

http://live.gnome.org/Empathy

http://ekiga.org/

http://www.libreoffice.org/

http://cran.cnr.berkeley.edu/web/packages/SPARQL/index.html

http://cran.cnr.berkeley.edu/web/packages/rrdf/index.html

http://projects.gnome.org/tracker/

http://www.mozilla.org/projects/thunderbird/

http://projects.gnome.org/evolution/

http://find/



Add-On Data Journalism Tools

Digital media creation and editingData collection, management and analysisNumerical data / visualization / explorationFinancial and economic analysisGeospatial / mapping

Natural language processing, machine learning and text mining


Software in the Appliance

http://find/



Add-On Digital Media Creation / Editing / Production

Blender 3D Content Creation SuiteThe GIMP GNU Image Manipulation ProgramScribus Open Source Desktop PublishingInkscape Vector Graphics EditorAudacity Free Audio Editor and Recorder

PiTiVi Video Editor



dd l l l

http://www.blender.org/

http://www.gimp.org/

http://www.scribus.net/

http://inkscape.org/

http://audacity.sourceforge.net/

http://www.pitivi.org/

http://www.pitivi.org/

http://audacity.sourceforge.net/

http://inkscape.org/

http://www.scribus.net/

http://www.gimp.org/

http://www.blender.org/

http://find/



Add-On Numerical Data Visualization / Exploration /

Presentation

GGobi Exploration / Visualization SystemMondrian Interactive Statistical Visualization SystemRattle: Gnome Cross Platform GUI for Data Mining using RSciViews-R GUI



Add O Fi i l d E i A l i

http://ggobi.org/

http://rosuda.org/mondrian/

http://rattle.togaware.com/

http://sciviews.org/SciViews-R/index.html

http://sciviews.org/SciViews-R/index.html

http://rattle.togaware.com/

http://rosuda.org/mondrian/

http://ggobi.org/

http://find/



Add-On Financial and Economic Analysis

QuantLib free/open-source library for quantitative nanceR Empirical Finance Task ViewR Computational Econometrics Task ViewR Time Series Analysis Task View



Add O G i l / M i

http://quantlib.org/index.shtml

http://cran.cnr.berkeley.edu/web/views/Finance.html

http://cran.cnr.berkeley.edu/web/views/Econometrics.html

http://cran.cnr.berkeley.edu/web/views/TimeSeries.html

http://cran.cnr.berkeley.edu/web/views/TimeSeries.html

http://cran.cnr.berkeley.edu/web/views/Econometrics.html

http://cran.cnr.berkeley.edu/web/views/Finance.html

http://quantlib.org/index.shtml

http://find/



Add-On Geospatial / Mapping

PostGIS Geospatial Information System / DatabaseGRASS Geospatial Information SystemGDAL Geospatial Data Abstraction LibraryPROJ.4 Cartographic Projections LibraryR Spatial Data Analysis Task ViewBARD (Better Automated ReDistricting)



Add O N t l L P i / T t Mi i

http://postgis.refractions.net/

http://grass.fbk.eu/

http://www.gdal.org/

http://trac.osgeo.org/proj/

http://cran.cnr.berkeley.edu/web/views/Spatial.html

http://sourceforge.net/projects/bard/

http://sourceforge.net/projects/bard/

http://cran.cnr.berkeley.edu/web/views/Spatial.html

http://trac.osgeo.org/proj/

http://www.gdal.org/

http://grass.fbk.eu/

http://postgis.refractions.net/

http://find/



Add-On Natural Language Processing / Text Mining

WordNet English Lexical Database

Python Natural Language ToolkitMALLET MAchine Learning for LanguagE ToolkitR Natural Language Processing Task ViewR Machine Learning Task View



S i l N t k A l i

http://wordnet.princeton.edu/

http://www.nltk.org/

http://mallet.cs.umass.edu/

http://cran.cnr.berkeley.edu/web/views/NaturalLanguageProcessing.html

http://cran.cnr.berkeley.edu/web/views/MachineLearning.html

http://cran.cnr.berkeley.edu/web/views/MachineLearning.html

http://cran.cnr.berkeley.edu/web/views/NaturalLanguageProcessing.html

http://mallet.cs.umass.edu/

http://www.nltk.org/

http://wordnet.princeton.edu/

http://find/



Social Network Analysis

Python NetworkX Network Analysis and Visualization PackageStatnet tools for analysis, simulation and visualization of network data



Add On Server Construction Frameworks

http://networkx.lanl.gov/

http://statnet.org/

http://statnet.org/

http://statnet.org/

http://statnet.org/

http://networkx.lanl.gov/

http://find/



Add-On Server Construction Frameworks

NoSQL Databases

CouchDBMongoDBRedisRiak

Django

http://couchdb.apache.org/

http://www.mongodb.org/

http://redis.io/

http://basho.com/products/riak-overview/

https://www.djangoproject.com/

https://www.djangoproject.com/

http://basho.com/products/riak-overview/

http://redis.io/

http://www.mongodb.org/

http://couchdb.apache.org/

http://find/

data journalism developer studio 2012lx overview

Documents