big data analytics with hadoop 40 hour course€¦ · overview learning objectives understanding...

BIG DATA ANALYTICS WITH HADOOP 40 Hour Course

1

OVERVIEW

Learning Objectives

Understanding Big Data

Understanding various types of data that can be stored in Hadoop

Setting up and Configuring Hadoop in

Pseduo Distributed Mode

Distributed Mode

Understanding how Big Data & Hadoop fit in the current environment and infrastructure

WWW.WISDOMSPROUTS.COM 2

Work with Map Reduce programs

Code the Ecosystem projects

Performing Data Analytics using PIG & HIVE

Understand and work on real time use cases

Implementing a Hadoop project

Working on live/real life project on big data analytics using Hadoop eco-system

And Much More..


COURSE HIGHLIGHTS

Detailed explanation of every topic with real world example. Examples include both Industry based as well as based on day to day activities.

Labs, Assignments and Test for every topic. Labs would be performed on Virtual Machine which will be shared with you.

Project A real use case based project will be assigned with proper documentation and all required files.

.


COURSE FEES

Simple fee structure. No hidden costs.

25,000 INR

20,000 INR


Support

Anytime during the Course duration and even after the course completion, you can post your queries through mail on [email protected] and we will get back to you within 24 hours


CONTENT PROVIDED

A Hadoop Reference guide having all the topics covered in the sessions.

Lab Manual with all Labs covered.

Exercise Manual with some assignments.

Question Bank.

Government Recognised Certificate


MODULE 1

Introduction to Big Data

8

INTRODUCTION TO BIG DATA ANALYTICS

Big Data what?

It’s characteristics.

Some facts and figures

Importance of Big Data

Need of understanding and analyzing Big Data.

Basics of Data Analytics

Problems with existing systems.


MODULE 2

Introduction to Hadoop

10

INTRODUCTION TO HADOOP

What is Hadoop Architecture

Hadoop Job Process

File Anatomy Read Operations

Write Operations

Useful Configurations core-site.xml

hdfs-site.xml

mapred-site.xml


HDFS ( HADOOP DISTRIBUTED FILE SYSTEM )

Significance of HDFS in Hadoop

HDFS Features

Daemons of Hadoop and functionalities NameNode

DataNode

JobTracker

TaskTracker

Secondary NameNode


Data Storage in HDFS Blocks

Heartbeats

Data Replication

Accessing HDFS CLI (Command Line Interface) Unix and Hadoop Commands

Java Based Approach


MAP REDUCE

Introduction to MapReduce MapReduce Architecture

MapReduce Programming Model

MapReduce Algorithm and Phases

Basic MapReduce Program Driver Code

Mapper Code

Reducer Code


LABS

Configuring a pseudo distributed Hadoop Cluster.

Working with HDFS command line options.

Running a Word Count program.


MODULE 3

Hadoop Ecosystem

16

HADOOP ECOSYSTEM

Hadoop Ecosystem What is ecosystem

Different ecosystem projects

Sqoop

Hive

Pig

Flume

Ambari

Hue


Revision Test

25 questions

20 minutes


LABS

Import data using Sqoop and query it using Hive.

Configuring a Flume agent.

Mini Project Using all Ecosystem projects on one sample weblogs data set


MODULE 4

Brief Walk with HDFS and MapReduce

20

DEEPER DIVE

Advanced HDFS Secondary NameNode

Federation

High Availability

Advanced MapReduce Demo of Precedence levels

Partioners

Combiners


MODULE 5

Hadoop Administration

22

HADOOP ADMINISTRATION

Cluster Planning Understanding hardware and software requirements of a Hadoop cluster

Different modes of operation of Hadoop

Precedence levels

Some dos and don’ts


LABS

Hive Creating different types of tables

Executing different queries

Pig Working with different data types

Modes of execution

Running some pig application driven commands

Sqoop Import

Export


MODULE 6

Data Visualization

25

DATA VISUALIZATION

Working with Hadoop ODBC Connector.

Data Visualization using Excel. Exporting Hive data

Creating graphs and interactive charts for your hive data.

Analysing hive data using power view in excel.


MODULE 7

Use Cases Project Work

27

PROJECT

Twitter Use Case Why do companies use twitter data

How to analyze twitter data

How to

Create Twitter API

Load Some tweets into HDFS

Query twitter logs.

Revision Test

50 questions

30 minutes


HOPE TO SEE ON-BOARD SOON….

29

big data analytics with hadoop 40 hour course€¦ · overview learning objectives understanding...

Documents