Engineering Big Data with Hadoop

Download Engineering Big Data with Hadoop

Post on 11-Aug-2014

1.050 views

Category:

Data & Analytics

32 download

DESCRIPTION

This presentation explains about Introduction of BIG DATA with HADOOP.

TRANSCRIPT

Disclaimer: Some of the Images and content have been taken from multiple online sources and this presentation is intended only for knowledge sharing but not for any commercial business intention HIGH VOLUME HIGH VELOCITY HIGH VARIETY Source: http://www.emc.com/leadership/digital-universe/iview/index.htm Bing ingests > 7 petabyte a month The Twitter community generates over 1 terabyte of tweets every day Cisco predicts that by 2013 annual internet traffic flowing will reach 667 exabytes Source: http://www.emc.com/collateral/about/news/idc-emc-digital-universe-2011-infographic.pdf Source: http://www.emc.com/collateral/about/news/idc-emc-digital-universe-2011-infographic.pdf Source: http://cloudtimes.org/2013/06/25/hadoop-as-a-service-market-growing/ How does an Elephant Sneak up on you? Chukwa Sqoop Zookeeper Pig HBase Avno Mahout Flume WhirrMap Reduce Engine Hama Hive Hadoop Distributed File System Hadoop Common Source: http://indoos.wordpress.com/2010/08/16/hadoop-ecosystem-world-map/ Distribute data initially Let processors / nodes work on local data Minimize data transfer over network Replicate data multiple times for increased availability Write applications at a high level Programmers should not have to worry about network programming, temporal dependencies, low level infrastructure, etc Minimize talking between nodes (share-nothing) HADOOP: 30,000 FEETVIEW BIGDATA&ANALYTICS Case Studies checkout our video on Plot no 63/A, 1st Floor, Road No 13, Film Nagar, Jubilee Hills, Hyderabad-500033 For Individuals (+91) 9502334561/62 For Corporates (+91) 9618 483 483 Facebook: www.facebook.com/insofe Slide share: www.slideshare.net/INSOFE International School of Engineering