dell poweredge c5220: hadoop mapreduce performance

13

A PRINCIPLED TECHNOLOGIES TEST REPORT Commissioned by Dell Inc.; April 2012 DELL POWEREDGE C5220: HADOOP MAPREDUCE PERFORMANCE Every year, the amount of data that businesses must process grows enormously. The ability to sort, filter, and analyze this data is becoming more and more vital to many businesses in analyzing their customers and their market segment. Additionally, businesses need an infrastructure that is powerful and flexible, but also compact and scale-friendly. The Dell PowerEdge C5220 server is an ideal solution to pair with Apache Hadoop, a powerful multi-node data analysis application. With the PowerEdge C5220, organizations can scale out to their data processing requirements and successfully handle these ever-increasing data volumes, finding new value in their big data. To test the Hadoop performance capabilities of the Dell PowerEdge C5220, we configured eight Dell PowerEdge C5220 servers into a Hadoop cluster and ran the MapReduce benchmark (mrbench) on the platform. We found that eight Dell PowerEdge C5220 servers, all contained within the single shared infrastructure design of the Dell PowerEdge C5000 chassis, could run our mrbench tests of varying sizes, map processes, and reduce processes, in times averaging just 15.9 to 25.6 seconds, making this platform ideal for scale -out data-analysis application workloads.

Upload: principled-technologies

Post on 04-Jun-2018

235 views

Category:

Documents

0 download

Report

Download

Embed Size (px):

TRANSCRIPT

Page 1: Dell PowerEdge C5220: Hadoop MapReduce performance

8/13/2019 Dell PowerEdge C5220: Hadoop MapReduce performance

http://slidepdf.com/reader/full/dell-poweredge-c5220-hadoop-mapreduce-performance 1/13

Page 2: Dell PowerEdge C5220: Hadoop MapReduce performance

8/13/2019 Dell PowerEdge C5220: Hadoop MapReduce performance

http://slidepdf.com/reader/full/dell-poweredge-c5220-hadoop-mapreduce-performance 2/13

Page 3: Dell PowerEdge C5220: Hadoop MapReduce performance

8/13/2019 Dell PowerEdge C5220: Hadoop MapReduce performance

http://slidepdf.com/reader/full/dell-poweredge-c5220-hadoop-mapreduce-performance 3/13

Page 4: Dell PowerEdge C5220: Hadoop MapReduce performance

8/13/2019 Dell PowerEdge C5220: Hadoop MapReduce performance

http://slidepdf.com/reader/full/dell-poweredge-c5220-hadoop-mapreduce-performance 4/13

http://www.dell.com/us/enterprise/p/poweredge-cloud-servers

Page 5: Dell PowerEdge C5220: Hadoop MapReduce performance

8/13/2019 Dell PowerEdge C5220: Hadoop MapReduce performance

http://slidepdf.com/reader/full/dell-poweredge-c5220-hadoop-mapreduce-performance 5/13

Page 6: Dell PowerEdge C5220: Hadoop MapReduce performance

8/13/2019 Dell PowerEdge C5220: Hadoop MapReduce performance

http://slidepdf.com/reader/full/dell-poweredge-c5220-hadoop-mapreduce-performance 6/13

Page 7: Dell PowerEdge C5220: Hadoop MapReduce performance

8/13/2019 Dell PowerEdge C5220: Hadoop MapReduce performance

http://slidepdf.com/reader/full/dell-poweredge-c5220-hadoop-mapreduce-performance 7/13

Page 8: Dell PowerEdge C5220: Hadoop MapReduce performance

8/13/2019 Dell PowerEdge C5220: Hadoop MapReduce performance

http://slidepdf.com/reader/full/dell-poweredge-c5220-hadoop-mapreduce-performance 8/13

Page 9: Dell PowerEdge C5220: Hadoop MapReduce performance

8/13/2019 Dell PowerEdge C5220: Hadoop MapReduce performance

http://slidepdf.com/reader/full/dell-poweredge-c5220-hadoop-mapreduce-performance 9/13

Page 10: Dell PowerEdge C5220: Hadoop MapReduce performance

8/13/2019 Dell PowerEdge C5220: Hadoop MapReduce performance

http://slidepdf.com/reader/full/dell-poweredge-c5220-hadoop-mapreduce-performance 10/13

Page 11: Dell PowerEdge C5220: Hadoop MapReduce performance

8/13/2019 Dell PowerEdge C5220: Hadoop MapReduce performance

http://slidepdf.com/reader/full/dell-poweredge-c5220-hadoop-mapreduce-performance 11/13

Page 12: Dell PowerEdge C5220: Hadoop MapReduce performance

8/13/2019 Dell PowerEdge C5220: Hadoop MapReduce performance

http://slidepdf.com/reader/full/dell-poweredge-c5220-hadoop-mapreduce-performance 12/13

Page 13: Dell PowerEdge C5220: Hadoop MapReduce performance

8/13/2019 Dell PowerEdge C5220: Hadoop MapReduce performance

http://slidepdf.com/reader/full/dell-poweredge-c5220-hadoop-mapreduce-performance 13/13

Dell PowerEdge R620 · Dell PowerEdge R620 Οδηγός "Τα Πρώτα Βήματα" Author: Dell Inc. Subject: Setup Guide2 Keywords: Servers, Storage and Networking#PowerEdge#poweredge

Dell PowerEdge C5220: Hadoop performance · distribution to generate 10GB of test data and to sort it using an eight-node Hadoop cluster consisting of Dell PowerEdge C5220 servers

DELL POWEREDGE SERVER COMPARISON CHART Rack ......PowerEdge T20 PowerEdge T110 II PowerEdge T130 PowerEdge T320 PowerEdge T330 Poweredge T430 Poweredge T630 Competitors N/A x3100 M5,

poweredge 1000eRelease

PowerEdge M620 Systems (For Dell PowerEdge VRTXcdn.cnetcontent.com/ef/19/ef19ed54-5a45-4c99-ab35-c6f7c821f48c.pdf · Dell PowerEdge M620 Systems (For Dell PowerEdge VRTX Enclosure)

Dell EMC PowerEdge Installation, Management and Diagnostics EMC PowerEdge... · PowerEdge Associates level certification for PowerEdge servers. • This course assists you to successfully

Dell PowerEdge M1000e Technical Guidei.dell.com/.../poweredge-m1000e_technical_guide.pdf6 PowerEdge M1000e Technical Guide Key technologies The PowerEdge M1000e is designed to help

EE324 DISTRIBUTED SYSTEMS FALL 2015 MapReduce. Overview 2 MapReduce

Dell EMC PowerEdge R640 Technical Specificationstopics-cdn.dell.com/pdf/poweredge-r640_reference-guide2_en-us.pdf · Dell EMC PowerEdge R640 system overview The Dell EMC PowerEdge

Pipelined-MapReduce an Improved MapReduce

DCS PowerEdge C Systems Management Overview PowerEdge C Product Group

Dell EMC PowerEdge MX Networking Architecture Guide...12 Dell EMC PowerEdge MX Networking Architecture Guide 1.2.1 Dell EMC PowerEdge MX9002m management module The Dell EMC PowerEdge

MapReduce & Hadoop IIcslui/CMSC5702/mapreduce_hadoop2.pdf · MapReduce & Hadoop II ... MapReduce & Hadoop MapReduce Recap ... example, the combiners aggregate term counts across the

Data Management in Large-Scale Distributed Systems - MapReduce … · Introduction to MapReduce The Hadoop Eco-System HDFS Hadoop MapReduce 4. MapReduce at Google Publication The

FlexBoot Release Notes - mellanox.com Dell PowerEdge R730xd 13G 2.3.4 DELL Dell PowerEdge R630 13G 2.3.4 DELL Dell PowerEdge R640 14G 0.3.6 DELL Dell PowerEdge C6320p 1.1.3 Quanta

Dell PowerEdge Servers Portfolio Guide · Dell PowerEdge Servers Portfolio Guide. Dell ™ PowerEdge ™ Servers

Dell EMC PowerEdge T440 Technical Guidei.dell.com/.../Documents/Dell-EMC-PowerEdge-T440-Technical-Guide.pdf · Dell EMC PowerEdge T440 The Dell EMC PowerEdge T440 tower server is

PowerEdge C5220 Operating Systems and Technical ... · – BIOS version 2.0.1 or later – BMC version 1.13 or later – Backplane firmware 1.0.9 or later NOTE: PowerEdge C5220 systems

PowerEdge M1000e

Dell PowerEdge C5220: Hadoop performance

MapReduce-MPI Library Users Manualmapreduce.sandia.gov/doc/Manual.pdf · MapReduce-MPI WWW Site - MapReduce-MPI Documentation What is a MapReduce? The canonical example of a MapReduce

Dell PowerEdge M630 Owner's Manual · 2018-12-20 · Dell PowerEdge M630 overview The Dell PowerEdge M630 is a half-height blade supported on the PowerEdge M1000e and PowerEdge VRTX

MapReduce and Hadoop File Systemnsrit.edu.in/admin/img/cms/10096mapreduce.pdf · The Outline Introduction to MapReduce From CS Foundation to MapReduce MapReduce programming model

PowerEdge FX Architecture - Blades Made Simple€¦ · PowerEdge RAID Controllers ..... 26 7 Networking and PCIe ... PowerEdge FX architecture acoustics..... 33. 5 PowerEdge FX Architecture

Dell PowerEdge R820 - enterasource.com · PowerEdge servers. Dell PowerEdge R820 PowerEdge R820 • Up to 48 DIMMs • PCIe Gen3-enabled expansion slots • Choice of network fabric

Dell PowerEdge Portfolio · 2020. 7. 29. · Dell PowerEdge Portfolio 5 Dell PowerEdge rack servers PowerEdge R320 Enterprise-class, one-socket, 1U rack-mount server with balanced

Hadoop/MapReduce - 123seminarsonly.comHadoop MapReduce • MapReduce is a programming model and software framework first developed by Google (Google’s MapReduce paper submitted in

Dell PowerEdge Portfolioi.dell.com/.../dell-poweredge-portfolio-guide.pdfDell PowerEdge Portfolio 2 Dell™ PowerEdge™ servers are built to support the work that IT organizations