big data hadoop customize training course - a2z it consulting inc · 2019-03-03 · big data hadoop...

7
A2Z IT Consulting Inc. Toronto, Mississauga ON 41 Spring Hill Road ME USA www.a2zitconsultinginc.com Big Data Hadoop Customize Training Course Onsite Corporate/Individual Training A2Z IT is a fast-growing professional training provider that is offering classroom and online training in over 20 most sought-after tools and technologies. We have a learner base in Canada and USA. We help organizations to maximize the impact of our trainings by customizing the curriculum to make sure we cover the topics relevant to your group. We help fast learn the skills within days where it you can start applying the new tools as soon as possible. Key Features of A2Z IT Training: Instructor Led Classroom Training/ Online/Self study Prerequisites: You don’t need any specific knowledge to learn Bigdata Hadoop. A basic knowledge of data warehouse knowledge can help Course includes: This course will include extensive hands-on activities to re-enforce the skills and knowledge attained. Big data Hadoop Course Content HADOOP INSTALLATION VM LINK HADOOP SINGLE NODE INSTALLATION INTRODUCTION OF HADOOP HADOOP USE CASES HADOOP INTRODUCTION HOW MAP REDUCE WORKS HDFS (hadoop distributed file system) AGGREGATING DATA HOW TO CODE MAP REDUCE JOIN HADOOP ECO SYSTEM SQOOP HIVE PIG HADOOP - PROJECT WORK

Upload: others

Post on 20-May-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Big Data Hadoop Customize Training Course - A2Z IT Consulting Inc · 2019-03-03 · Big Data Hadoop Customize Training Course Onsite Corporate/Individual Training A2Z IT is a fast-growing

A2ZITConsultingInc.Toronto,MississaugaON41SpringHillRoadMEUSA www.a2zitconsultinginc.com

BigDataHadoopCustomizeTrainingCourseOnsiteCorporate/IndividualTraining

A2ZITisafast-growingprofessionaltrainingproviderthatisofferingclassroomandonlinetraininginover20mostsought-aftertoolsandtechnologies.WehavealearnerbaseinCanadaandUSA.Wehelporganizationstomaximizetheimpactofourtrainingsbycustomizingthecurriculumtomakesurewecoverthetopicsrelevanttoyourgroup.Wehelpfastlearntheskillswithindayswhereityoucanstartapplyingthenewtoolsassoonaspossible.

KeyFeaturesofA2ZITTraining:

• InstructorLedClassroomTraining/Online/Selfstudy

Prerequisites:Youdon’tneedanyspecificknowledgetolearnBigdataHadoop.Abasicknowledgeofdatawarehouseknowledgecanhelp

Courseincludes:Thiscoursewillincludeextensivehands-onactivitiestore-enforcetheskillsandknowledgeattained.

BigdataHadoopCourseContentHADOOPINSTALLATIONVMLINK

HADOOPSINGLENODEINSTALLATION

INTRODUCTIONOFHADOOP

HADOOPUSECASES

HADOOPINTRODUCTION

HOWMAPREDUCEWORKS

HDFS(hadoopdistributedfilesystem)

AGGREGATINGDATA

HOWTOCODEMAPREDUCE

JOIN

HADOOPECOSYSTEM

SQOOP

HIVE

PIG

HADOOP-PROJECTWORK

Page 2: Big Data Hadoop Customize Training Course - A2Z IT Consulting Inc · 2019-03-03 · Big Data Hadoop Customize Training Course Onsite Corporate/Individual Training A2Z IT is a fast-growing

A2ZITConsultingInc.Toronto,MississaugaON41SpringHillRoadMEUSA www.a2zitconsultinginc.com

MINIPROJECT–WORKINGWITHMAPREDUCE,HIVE,SQOOP

MAPREDUCE

INTRODUCTIONTOHDFS

INTRODUCTIONTOMAPREDUCE

INTRODUCTIONTOMAPREDUCE

WRITINGMAPREDUCEPROGRAMMEONHADOOPFRAMEWORK

DATAINTENSIVEINFORMATIONPROCESSING

HOWTOAGGREGATETHEDATA

PROBLEMSOLVINGWITHMAPREDUCE

MULTIPLEINPUTFORMATS

GRAPHPROBLEMSOLVING

MAPPER&REDUCER

MAPSIDEJOIN

REDUCEJOINS

MAPREDUCE-PROJECT,ASSIGNMENT

SQOOPIMPORT,EXPORTDATA

INVERTEDINDEXING

ENDTOENDMAPREDUCEYARNPOC

ASSIGNMENT–MAPREDUCE

MAPREDUCE

HIVE

WHATISTHEREQUIREMENTOFHIVE

INTRODUCTIONTOHIVE

HIVEINTERFACE

PARTITIONINHIVE

INDEXINGINHIVE

HIVEPREVIOUSVERSION

RELATIONALDATAANALYSISWITHHIVE

HIVEMANAGEMENT,OPTIMIZATIONANDEXTENDINGHIVE

HIVEINDEXES,VIEWS,FUNCTIONS,OPTIMIZINGQUERIES

HIVE-PROJECT,ASSIGNMENT

PROJECT–PARTITIONINGTABLES

Page 3: Big Data Hadoop Customize Training Course - A2Z IT Consulting Inc · 2019-03-03 · Big Data Hadoop Customize Training Course Onsite Corporate/Individual Training A2Z IT is a fast-growing

A2ZITConsultingInc.Toronto,MississaugaON41SpringHillRoadMEUSA www.a2zitconsultinginc.com

ASSIGNMENT–HIVE

PIG

INTRODUCTIONTOPIG

WORKINGWITHPIG

OPERATORORSYNTAX

WORDCOUNTPROGRAMINPIG

WEATHERDATAANALYSISUSINGPIG

WEBLOGANALYSIS

USERDEFINEDFUNCTIONINPIG

DIAGNOSTICOPERATORINPIG

JSONWITHPIG

PIGINSTALLATIONCOMMAND

PIG-ASSIGNMENT

ASSIGNMENT–PIG

HBASE

PROJECTWORK-ETLPOC

PROJECTWORK–CONNECTINGPENTAHOWITHHADOOPECO-SYSTEM

IMPALAANDAVRO

INTRODUCTIONTOIMPALAANDMETADATACACHING

IMPALAMODELING

IMPALATABLES

IMPALAPARTITIONING

IMPALAANDAVROFILEFORMAT

SQOOPINGDATAINAVROFORMATANDUSINGITINIMPALA

IMPALA-PROJECT,ASSIGNMENT

USINGCOMPRESSION

HADOOPECOSYSTEM

SPARK

SPARKINTRODUCTION

SPARKCORECONCEPTS

Page 4: Big Data Hadoop Customize Training Course - A2Z IT Consulting Inc · 2019-03-03 · Big Data Hadoop Customize Training Course Onsite Corporate/Individual Training A2Z IT is a fast-growing

A2ZITConsultingInc.Toronto,MississaugaON41SpringHillRoadMEUSA www.a2zitconsultinginc.com

SPARKINSTALLATION

SPARKENVIRONMENT

SPARKASSIGNMENT

OOZIE/FLUME/ZOOKEEPER/SQOOP

OOZIE

ZOOKEEPER

FLUME

SQOOP

OOZIE/FLUME/ZOOKEEPER/HUEPREVIOUSVERSION

OOZIE–INSTALLATIONANDHANDSONEXERCISES

ADVANCECONCEPTSINFLUME

DEEPDIVEINZOOKEEPER

DEEPDIVEINHUE

OOZIE/FLUME/ZOOKEEPER/HUE-ASSIGNMENT

FLUME,OOZIE,ZOOKEEPER,HUEASSIGNMENT

OOZIE/FLUME/ZOOKEEPER/HUEQUIZ

HADOOPADMINISTRATION

HDFSPARAMETERS

ADMINISTRATIONANDMAINTENANCE

DISTRIBUTIONMODE

KERBEROS

HADOOPADMINPREVIOUSVERSION

HADOOPADMINISTRATIONANDMAINTENANCE

HADOOPMONITORINGANDTROUBLESHOOTING

HADOOPJOBSCHEDULING

HADOOPJOBSCHEDULING–CONT.

HADOOPADMIN-PROJECTWORK

PROJECTWORK–MULTINODECLUSTERSETUP

HADOOPTESTING

BIGDATATESTING

SECURITYTESTING

SYSTEMTESTING

Page 5: Big Data Hadoop Customize Training Course - A2Z IT Consulting Inc · 2019-03-03 · Big Data Hadoop Customize Training Course Onsite Corporate/Individual Training A2Z IT is a fast-growing

A2ZITConsultingInc.Toronto,MississaugaON41SpringHillRoadMEUSA www.a2zitconsultinginc.com

ROLESANDRESPONSBILITIESOFHADOOPTESTER

HDFSTESTPLAN

HADOOPTESTINGTECHNIQUES

INSTALLINGQUERYSURGE

CREATINGCOLUMNLEVELCOMPARISON

CREATINGTABLELEVELCOMPARISON,ROWCOUNTCOMPARISONANDSCHEDULING

HADOOPTESTING-PROJECT,ASSIGNMENT

HADOOPTESTINGPROJECT1

HADOOPTESTINGUSINGMRPROJECT2

ASSIGNMENT–HADOOPTESTING

PROJECTWORK,ASSIGNMENT

HADOOP–BIGDATASETSTOPRACTICE

HADOOP–ASSIGNMENT

HADOOPMAJORPROJECT

HADOOPARCHITECT

HIVEUDF

Tableau-BIBusinessIntelligenceToolForHadoopCourseContentFiltering,Sorting&Grouping-Filtering,SortingandGroupingarefundamentalconceptswhenworkingwithandanalyzingdata.WewillbrieflyreviewthesetopicsastheyapplytoTableau

• Advancedoptionsforfilteringandhiding

• Thevarioustypesoffiltersandhowandwheneachexecutesinsequence

• Datasecurityconsiderationsofspecificfilters

• Specificrecommendationsonhowtouse,ornottouse,variousfilteroptions

• Understandingyourmanyoptionsfororderingandgroupingyourdata:Sort,Groups,Bins,Sets

• Thevarioustypesofsetsandusecasesforeach

• Understandinghowtheseoptionsinter-relate

WorkingwithData–IntheFundamentalsclass,weacceptedthedataforwhatitis!(withabasicoverviewofblendingandjoiningdataandworkingwiththedataengine).IntheAdvancedclass,wewillunderstandthedifferencebetweenjoiningandblendingdata,andwhenweshoulddoeach.Wewillalsoconsidertheimplicationsofworkingwithlargedatasets,andconsideroptionsforwhenandhowtoworkwithextractsandthedataengine.Wewillalsoinvestigatebestpracticesin“sharing”datasourcesforTableauServerusers.

• WorkingwiththeDataEngine/Extractsandschedulingextractupdates

• WorkingwithCustomSQL

Page 6: Big Data Hadoop Customize Training Course - A2Z IT Consulting Inc · 2019-03-03 · Big Data Hadoop Customize Training Course Onsite Corporate/Individual Training A2Z IT is a fast-growing

A2ZITConsultingInc.Toronto,MississaugaON41SpringHillRoadMEUSA www.a2zitconsultinginc.com

• AddingtoContext

• SwitchingtoDirectConnection

• BuildingmetadataviasharedDataSourceconnections

• Performanceconsideringandworkingwithbigdata

WorkingwithCalculatedDataandStatistics–IntheFundamentalsClass,wewereintroducedtosomebasiccalculations:basicstringandarithmeticcalculationsandratiosandquicktablecalculations.IntheAdvancedclass,wewillextendthoseconceptstounderstandtheintricaciesofmanipulatingdatawithinTableau

• AQuickReviewofBasicCalculations! ArithmeticCalculations

! StringManipulation

! DateCalculations! QuickTableCalculations! CustomAggregations

! CustomCalculatedFields

! LogicandConditionalCalculations! ConditionalFilters

• AdvancedTableCalculations! UnderstandingPartioningandAddressing! Differencesbetweenvisuallayoutofdataandresultsoftablecalculations! Approachesforunderstandingwhatishappeningintablecalculations! CalculateonResultsofTableCalculations! ComplexCalculations

! DifferencefromAverage

! SecondaryTableCalculations

• UnderstandingwhereCalculationsOccur

• Statistics! Reference/TrendLines! StatisticalCalculations! SummaryStats

! CohortAnalysis! MovingAverages

o Fromafixedpoint

o Inarollingwindow

• WorkingwithDatesandTimes

! ContinuousversusDiscreteDates

Page 7: Big Data Hadoop Customize Training Course - A2Z IT Consulting Inc · 2019-03-03 · Big Data Hadoop Customize Training Course Onsite Corporate/Individual Training A2Z IT is a fast-growing

A2ZITConsultingInc.Toronto,MississaugaON41SpringHillRoadMEUSA www.a2zitconsultinginc.com

! DatesandTimes

! ReferenceDates

BuildingAdvancedChartTypesandVisualizations/Tips&Tricks–ThistopiccovershowtocreatesomeofthecharttypesandvisualizationsthatmaybelessobviousinTableau.Italsocoverssomeofthemorecommontips&tricks/techniquesthatweusetoassistcustomersinsolvingsomeoftheirmorecomplexproblems.

• ParetoChart

• SparkLine

• HorizonChart

BestPracticesinFormattingandVisualizing

• FormattingTips

! Highlighting! Labeling! Legends

• IntroductiontoVisualizationBestPractices

BuildingBetterDashboards–IntheFundamentalscourses,welearnedhowwecancombineseveralworksheetsinadashboardandpublishthattotheweb.IntheAdvancedcourse,wewilllearnhowtobuildeffectiveandinteractiveapplicationsviadashboarding.

• GuidedAnalytics! CascadingFilters! Highlighting! QuickfilterOptions! URLActions

Overview–WorkingwithTableauServer–InTableauFundamentals,wesawthatwecoulduseTableauServerasamechanismtoshareourvisualizationsanddashboards.Nowwewilldiginabitdeeper.

• PublishingtoTableauServer–Overviewofpublishing,scheduling&securityoptions

• TableauServerUsage–InteractingwithPublishedVisualizations

WrapUpActivities

• Summaryofwhatwehavelearned

• Advancedactivitiestopulltogetherandsolidifytheconcepts

WheretogetFurtherAssistance

• Forums

• Whitepapers&Books

• FurtherTrainingOfferings&ProfessionalServices

• TechnicalSupport