an introduction to apache bigtop

Download An introduction to Apache Bigtop

If you can't read please download the document

Upload: semtech-solutions-ltd

Post on 16-Apr-2017

2.352 views

Category:

Technology


0 download

TRANSCRIPT

Apache Bigtop

What is it ?

What is it for ?

Automated Testing

Platforms

Dependencies

[email protected]

Apache Bigtop What is it ?

For testing Hadoop and related tools

For test development

Uses Jenkins continuous integration

Based on Cloudera's CDH

BigTop for Hadoop is equivalent to a Linux release

i.e. Ubuntu, Fedora, CentOS

Use it for deploying the Hadoop stack

Guarantees version inter-operability within the stack

[email protected]

Apache Bigtop What is it for ?

It is for testing Hadoop at a number of levels

Packaging

Platform

Runtime

Upgrades

Integration testing

Validation !

[email protected]

Automation Methodology An Example

[email protected]

Apache Bigtop Platforms

Platforms supported

Ubuntu 10.10

CentOS 5/6

Fedora 18

Mageia 1

openSUSE 12.2

[email protected]

Apache Bigtop Dependencies

The following tools are required

Java JDK 1.6 Apache Ant

Apache Maven wget

tar git

subversion gcc

gcc-c++ make

fuse protobuf-compiler

autoconf automake

libtool sharutils

asciidoc xmlto

[email protected]

Apache Bigtop The Players

Who has bought into the use of Bigtop ?

Canonical

Cloudera

Ebay

EMC

Hortonworks

Illumos

Intel

Trendmicro

WANdisco

[email protected]

Light Humour

A bit of humour ........

[email protected]

Contact Us

Feel free to contact us at

www.semtech-solutions.co.nz

[email protected]

We offer IT project consultancy

We are happy to hear about your problems

You can just pay for those hours that you need

To solve your problems