2011 international symposium on intelligence information processing and trusted computing huanggang...
DESCRIPTION
Analyzes the Hadoop architecture and MapReduce Working principle How to write Mapper and Reducer classes, and how to use the object 3TRANSCRIPT
![Page 1: 2011 International Symposium on Intelligence Information Processing and Trusted Computing Huanggang Normal University Hubei, China Gaizhen Yang Speaker](https://reader036.vdocuments.us/reader036/viewer/2022062907/5a4d1b757f8b9ab0599b6f06/html5/thumbnails/1.jpg)
2011 International Symposium on Intelligence Information Processing and Trusted ComputingHuanggang Normal University Hubei, ChinaGaizhen Yang
The Application of MapReduce in the Cloud Computing
Speaker : Kun-Hsiang, Chang
1
![Page 2: 2011 International Symposium on Intelligence Information Processing and Trusted Computing Huanggang Normal University Hubei, China Gaizhen Yang Speaker](https://reader036.vdocuments.us/reader036/viewer/2022062907/5a4d1b757f8b9ab0599b6f06/html5/thumbnails/2.jpg)
• Abstract• Hadoop• MapReduce• MapReduce Programmed To Perform Task
2
Outline
![Page 3: 2011 International Symposium on Intelligence Information Processing and Trusted Computing Huanggang Normal University Hubei, China Gaizhen Yang Speaker](https://reader036.vdocuments.us/reader036/viewer/2022062907/5a4d1b757f8b9ab0599b6f06/html5/thumbnails/3.jpg)
Analyzes the Hadoop architecture and MapReduce Working principle
How to write Mapper and Reducer classes, and how to use the object
3
Abstract
![Page 4: 2011 International Symposium on Intelligence Information Processing and Trusted Computing Huanggang Normal University Hubei, China Gaizhen Yang Speaker](https://reader036.vdocuments.us/reader036/viewer/2022062907/5a4d1b757f8b9ab0599b6f06/html5/thumbnails/4.jpg)
NameNode
DataNode
Client
4
Hadoop-HDFS
![Page 5: 2011 International Symposium on Intelligence Information Processing and Trusted Computing Huanggang Normal University Hubei, China Gaizhen Yang Speaker](https://reader036.vdocuments.us/reader036/viewer/2022062907/5a4d1b757f8b9ab0599b6f06/html5/thumbnails/5.jpg)
5
Hadoop-MapReduce
![Page 6: 2011 International Symposium on Intelligence Information Processing and Trusted Computing Huanggang Normal University Hubei, China Gaizhen Yang Speaker](https://reader036.vdocuments.us/reader036/viewer/2022062907/5a4d1b757f8b9ab0599b6f06/html5/thumbnails/6.jpg)
6
MapReduce
![Page 7: 2011 International Symposium on Intelligence Information Processing and Trusted Computing Huanggang Normal University Hubei, China Gaizhen Yang Speaker](https://reader036.vdocuments.us/reader036/viewer/2022062907/5a4d1b757f8b9ab0599b6f06/html5/thumbnails/7.jpg)
MapReduce programs can be run in three modes:
Standalone Mode
Pseudo-distributed Mode
Fully-distributed Mode
7
MapReduce
![Page 8: 2011 International Symposium on Intelligence Information Processing and Trusted Computing Huanggang Normal University Hubei, China Gaizhen Yang Speaker](https://reader036.vdocuments.us/reader036/viewer/2022062907/5a4d1b757f8b9ab0599b6f06/html5/thumbnails/8.jpg)
Inputs division and dispatch
task configuration
task executive
Create customized Mapper and Reducer
8
MapReduce Programmed To Perform Task
![Page 9: 2011 International Symposium on Intelligence Information Processing and Trusted Computing Huanggang Normal University Hubei, China Gaizhen Yang Speaker](https://reader036.vdocuments.us/reader036/viewer/2022062907/5a4d1b757f8b9ab0599b6f06/html5/thumbnails/9.jpg)
Speaker : Kun-Hsiang, Chang
End…
9