agile development at infochimps

13
Big Data Made Easy

Upload: infochimps-a-csc-big-data-business

Post on 15-Jun-2015

883 views

Category:

Technology


0 download

DESCRIPTION

Originally presented by Nathan Eliot as an Ignite talk at Devopsdays Austin (April 3, 2012) and again at Agile Austin (June 12, 2012). Ties to Nathan's Infochimps blog post, This is How We Do It: http://blog.infochimps.com/2012/05/18/how-we-do-it/

TRANSCRIPT

Page 1: Agile Development at Infochimps

Big Data Made Easy

Page 2: Agile Development at Infochimps

We use a lot of new-tech tools

Page 3: Agile Development at Infochimps

We’ve written a lot of new tech tools

IronfanChef specialization for Big Data in the cloud

WonderdogHadoop interface for ElasticSearch

WukongRuby library for Hadoop

SwineherdWorkflow engine for Hadoop jobs

Page 4: Agile Development at Infochimps

But it’s not about the technology…

… it’s about the culture

Page 5: Agile Development at Infochimps

Hiring Process

Page 6: Agile Development at Infochimps

Management Structure

Flat: I regularly talk with C-level folks

Open: Everyone has well-understood roles

Fair: Leadership leads, not orders about

Understanding: Problems are addressed, not blamed

Page 7: Agile Development at Infochimps

Employee Support

Fully stocked kitchen

Daily group lunches

Employee joy fund and voting

Company outings, both impromptu and formal

Some fun and games, too

Page 8: Agile Development at Infochimps

Employee Development

Employee’s focus is largely self-directed

Lack of experience is (almost) never a determining factor

Common language for problems and frustration

Make employees awesomely valuable, and totally uninterested in leaving

Page 9: Agile Development at Infochimps

Technical Culture

Good ideas can come from anyone

Fail forward, not roll-back

Repeatability is your friend

Automate out of boredom or fear, not efficiency

Failure from audacity is better than failure from inaction

Page 10: Agile Development at Infochimps

Infrastructure Choices

More assumed access for developers

Small, decoupled, late-binding wherever possible

Build anew, rather than repurpose an old

Actively pull unused code and data from production

Page 11: Agile Development at Infochimps

Beyond DevOps

NoOps +1: everyone technically does part of Ops, it’s just my specialty

AllOps: product & marketing can help Ops, and vise versa

It’s all about removing barriers to being awesome, everywhere

Page 12: Agile Development at Infochimps

What’s next?

How do we handle the impedance mismatch between our model and our clients’ models?

What do we do as the company grows beyond the size of the monkeysphere?

How should we tackle user segmentation and security as we build our Platform out?

Page 13: Agile Development at Infochimps

Contact Us – We’re Hiring!

855-DATA-FUN

infochimps.com/careers

[email protected]