big data applied, data warehouse institute st. louis december 2013 speech

30
Big Data Applied David Strom 314 277 7832 STL TDWI December 2013

Upload: david-strom

Post on 18-Nov-2014

543 views

Category:

Technology


3 download

DESCRIPTION

This is a speech that I gave to the Data Warehouse Institute St. Louis chapter in December 2013

TRANSCRIPT

Page 1: Big Data Applied, Data Warehouse Institute St. Louis December 2013 speech

Big Data Applied

David Strom314 277 7832

STL TDWI December 2013

Page 2: Big Data Applied, Data Warehouse Institute St. Louis December 2013 speech

Agenda

• Vendor landscape, users, skills• Mapping apps• Real world examples• Some lessons learned

Page 3: Big Data Applied, Data Warehouse Institute St. Louis December 2013 speech
Page 4: Big Data Applied, Data Warehouse Institute St. Louis December 2013 speech
Page 5: Big Data Applied, Data Warehouse Institute St. Louis December 2013 speech
Page 6: Big Data Applied, Data Warehouse Institute St. Louis December 2013 speech

Three skills for big data analysts

• Strategic data planning. Understand how data is the new raw material for any modern business.

• Analytical skills. Reporters have always been smart about asking the right questions, but now they have to dig through the data too.

• Technology skills. Embrace the technology and make it a key part of your reporting skill set.

Page 7: Big Data Applied, Data Warehouse Institute St. Louis December 2013 speech
Page 8: Big Data Applied, Data Warehouse Institute St. Louis December 2013 speech
Page 9: Big Data Applied, Data Warehouse Institute St. Louis December 2013 speech
Page 10: Big Data Applied, Data Warehouse Institute St. Louis December 2013 speech
Page 11: Big Data Applied, Data Warehouse Institute St. Louis December 2013 speech
Page 12: Big Data Applied, Data Warehouse Institute St. Louis December 2013 speech
Page 13: Big Data Applied, Data Warehouse Institute St. Louis December 2013 speech
Page 14: Big Data Applied, Data Warehouse Institute St. Louis December 2013 speech
Page 15: Big Data Applied, Data Warehouse Institute St. Louis December 2013 speech
Page 16: Big Data Applied, Data Warehouse Institute St. Louis December 2013 speech
Page 17: Big Data Applied, Data Warehouse Institute St. Louis December 2013 speech
Page 18: Big Data Applied, Data Warehouse Institute St. Louis December 2013 speech
Page 19: Big Data Applied, Data Warehouse Institute St. Louis December 2013 speech
Page 20: Big Data Applied, Data Warehouse Institute St. Louis December 2013 speech

Riot Games Current BI Stack

• Honu: Streaming log collection and event processing pipeline

• Platfora: BI analysis and visualization• Oozie: Workflow job scheduler• Hive: Data warehouse and queries• Chef: Code deployment and configuration management• GitHub: Versioning and tracking of programs• Jenkins: Build system management• Eureka: Service discovery process

Page 21: Big Data Applied, Data Warehouse Institute St. Louis December 2013 speech
Page 22: Big Data Applied, Data Warehouse Institute St. Louis December 2013 speech
Page 23: Big Data Applied, Data Warehouse Institute St. Louis December 2013 speech
Page 24: Big Data Applied, Data Warehouse Institute St. Louis December 2013 speech
Page 25: Big Data Applied, Data Warehouse Institute St. Louis December 2013 speech

Lessons learned

Page 26: Big Data Applied, Data Warehouse Institute St. Louis December 2013 speech

Don’t be religious!

Page 27: Big Data Applied, Data Warehouse Institute St. Louis December 2013 speech
Page 28: Big Data Applied, Data Warehouse Institute St. Louis December 2013 speech

Use maps!

Page 29: Big Data Applied, Data Warehouse Institute St. Louis December 2013 speech

Local Big Data Meetups

Page 30: Big Data Applied, Data Warehouse Institute St. Louis December 2013 speech

Stay in touch

• Copies of this presentation: http://slideshare.net/davidstrom

• My blog: http://strominator.com• Follow me on Twitter: @dstrom• Old school: [email protected]

http://strominator.com 30