The FR2 Story- or -

What happens when you find some data to love

Bob Burbach@peregrinator

criticaljuncture.org@critjunc

Sunlight Labs ContestApps 4 America 2

Sunlight Labs ContestCriteria: Data.gov Transparency Permanence Design/Visualization

Apps 4 America 2

Download bulk full text XML & mods files each day and break into relational schema with full text indexed by Sphinx

Scan for references to the FR, CFR, US Code, etc (allows for deep linking and citation analysis)

Extract locations & spider Regulations.gov to link to comment page

GovPulse.us

Continued to work on GovPulse.us and were contacted by the Office of Federal Register

Federal Register 75th Anniversary was July 26th, 2010

Began work in late April / early May

Working 2 days/wk and nights and weekends for 3 months.

Federal Register 2.0

Typical government development cycles: Code releases every 6 months Most features spec’d out in advance Hosted in house

This project couldn’t be done this way and have any hope of being done by the 75th Anniversary

Working with the OFR

Trust had been established with GovPulse.us

Federal Register 2.0 dev cycle: Continuous release cycles Spec refined in continually Modern web technologies Ruby, HTML 5 Open source, modern server architecture

Working with the OFR

Entire code base is open source

Hosted on Amazon

User site feedback integrated into site

Cross government site integration

Fundamental Change

Launch July 26 from the Rotunda of the National Archives

Launch

This is a story of finding a dataset and giving it love.

Bring modern web techniques to the table but do it in a respectful, professional manner. explain what it does (non-technical) and why it's better than the alternative (you have to know the alternative) why they solve a particular problem

Why this worked

Find a dataset you think is important document it expose it in a new way

Sunlight Labs Gems/API’s

Federal Register 2.0 Add links in text to scientific documents Help us extract gems

What to hack on

Bob Burbach@peregrinator

criticaljuncture.org@critjunc