dell crowbar wiki

Changes effective 9/14/2012: Applies to Crowbar 1.5+ & Crowbar 2.x Deployment

The Crowbar Dev Tool is a git overlay that helps manage Crowbar releases, barclamp integration, and gated checkins to the Crowbar

source base.

This page documents how to use the dev tool to build the Crowbar ISO. For more detailed documentation specifically on how to use the

tool for regular development, see README.dev-and-workflow in the main crowbar git repository.

If you are planning to write code for Crowbar core or develop a barclamp, we highly recommend you follow the following steps to create

your build server. If you are NOT planning to edit Crowbar then include the ‐‐no‐github flag or follow the read-only Build-Crowbar.ISO

instructions.

Tip: Want to watch it on video? http://youtu.be/vIQLK4MXcqg

A GitHub account (https://github.com/). They are free for personal open source use.

A 40GB Ubuntu 12.04 server (VM is ok) is recommended for this process!

It is important to use the dev tool for managing branches & releases because it:

takes care of synchronization with all the barclamps

builds nested tags with the release information

A copy of CentOS 6.2 install DVD from bittorrent or your favortie CentOS mirror.

This install DVD will need to go in $ISO_LIBRARY (usually $HOME/.crowbar-build-cache/iso) or can be accessed using a host

share

A copy of your target Crowbar OS.

This page uses Ubuntu 12.04 server x64 iso as the example

sudo sed ‐ie "s/%admin ALL=(ALL) ALL/%admin ALL=(ALL) NOPASSWD: ALL/g" /etc/sudoers

note: this will allow passwordless sudo for users in the admin group. The build process performs some high level kung-fu, some

of which requires root access. if running as non-root, you'll be prompted for password unless you setup Passwordless SUDO

permissions for your user.

if the above does not work, using your username instead of 'crowbar', try

echo 'crowbar ALL=(ALL) NOPASSWD: ALL' >/etc/sudoers.d/crowbar; chmod 400 /etc/sudoers.d/crowbar

Alternatively run the build as root.

spinemjayspinemjay

Home Pages Wiki History Git Access

dellcloudedge / crowbarforked from crowbar/crowbar

BLIC

CodeCode NetworkNetwork Pull Requests Pull Requests WikiWiki GraphsGraphs00

New Page Edit Page Page History

Pre-requisites:

Build Steps:

ExploreExplore GistGist BlogBlog HelpHelp

Watch Star 6 Fork 219

Dev tool build · dellcloudedge/crowbar Wiki https://github.com/dellcloudedge/crowbar/wiki/Dev-tool-build

1 of 3 6/8/2013 6:51 AM

note: use sudo as instructed. Do not use the Dev tool as root!

If you don't want to use HTTPS, then make sure that your build server's public key is registered with your Github account1.

sudo apt‐get update2.

sudo apt‐get install git rpm ruby rubygems1.8 curl build‐essential debootstrap mkisofs binutils3.

sudo gem install json net‐http‐digest_auth4.

git clone https://github.com/crowbar/crowbar.git5.

cd ~/crowbar directory6.

./dev setup

You can ignore warnings: "ulimit: open files: cannot modify limit: Invalid argument"1.

this will create personal github forks for you of all the Crowbar modules. If you don't have a Github login, or you don't care about

pushing changes back upstream, you can run ./dev setup ‐‐no‐github

2.

7.

optional, if this is a new system, set your user information as directed

git config --global user.name "Your Name"1.

git config --global user.email [email protected].

8.

./dev fetch9.

./build_sledgehammer.sh

this builds the "discovery image" called Sledgehammer.1.

this step take a long time. It helps if you've pre-fetched the CentOS ISO (see Build-Crowbar.ISO)2.

It does not change often and does not need to be repeated once it has been built.3.

10.

sudo ln -s /usr/share/debootstrap/scripts/gutsy /usr/share/debootstrap/scripts/precise

note: This is required only if: You're building for 12.04 on a 11.04 or 11.10 machine, since those versions don't know how to build

Precise

1.

11.

Make sure you have the right ISOs in ~/.crowbar‐build‐cache/iso directory

For Ubuntu, you should have http://releases.ubuntu.com/12.04/ubuntu-12.04.1-server-amd64.iso

cd ~/.crowbar‐build‐cache/iso1.

wget http://releases.ubuntu.com/12.04/ubuntu‐12.04.1‐server‐amd64.iso2.

1.

12.

./dev switch development

you can see all the releases with ./dev releases1.

choices trunk (default, trunk), 1.2 = fledermaus, 1.3 Cloudera = elefante2.

13.

./dev checkout master

you can see all the branches with git branch -a1.

choices are master (default, trunk), openstack‐os‐build (OpenStack), cloudera‐os‐build (Hadoop)2.

different branches represent different "distros" which combine different sets of barclamps (e.g. openstack, hadoop)3.

14.

./dev build ‐‐os ubuntu‐12.04 ‐‐update‐cache

The parameter --update-cache will create your Build Cache at this time, thus the first run will download from the internet what it

needs. This takes time and can be skipped for later builds. Dev Tool will tell you if your cache is need to be updated

1.

you can add --release development --branch master if you did not switch or checkout2.

15.

If you are using VMware Worktation (or similar) then these extra tips will help you improve your build experience

Tips:

VMware tools are not working on Ubuntu 12.04 at this time (5.5.2012) so use 11.10

To save space on your VM, you can use ISOs that are local to your host

create a shared file location (e.g.: c:\isos) mounted to "isos"

vi ~/.build‐crowbar.conf

add a reference to ISO_LIBRARY=/mnt/hgfs/isos

To make it easier to build VMs from the build ISO, have the build save it directory to your host's drive

Special Notes for Using a Build VM


2 of 3 6/8/2013 6:51 AM

create a shared file location (e.g.: c:\temp\crowbar) mounted to "crowbar"

vi ~/.build‐crowbar.conf

add a reference to ISO_DEST=/mnt/hgfs/crowbar

If you only want barclamps for import (Utils\Import) then you should use the "--no-iso" flag with the build command. Note that you must still

provide an operating system!

You can find the tars in ~/.crowbar-build-cache/ubuntu-12.04/build/dell/barclamps where the OS will match the one that you choose to

target.

See Packaging-Barclamps about building individual barclamps.

We recommend you consult the ./dev command line help, and also README.dev-and-workflow in the crowbar repository.

./dev backup

makes a copy into your personal forks (if you did not have any, you do now!)1.

1.

./dev fetch

fetches changes from remote repositories, but does not make any local changes.1.

2.

./dev sync

Merges changes fetched with ./dev fetch into your local branches.1.

3.

commit your code

git add1.

git commit2.

4.

./dev is_clean5.

./dev pull-requests-prep

it will give you instructions on next steps to automatically submit a push request on ALL impacted barclamps1.

6.

A Crowbar build contains the packages (e.g. deb,rpm,gem etc) that will be used to install your cloud. To avoid having to download the

Internet on every build, the Crowbar build system maintains a local cache in ~/.crowbar-build-cache by default. Additionally, Crowbar

utilizes a customized LiveCD image, SledgeHammer. You can build that too (sources on github), but it changes very infrequently - so

you're better of snatching it from somewhere.

Last edited by cloudedge, 5 months ago

Building Barclamp TARs only

Coding Steps

Build your cache

GitHubGitHub

About usAbout us

BlogBlog

Contact & supportContact & support

GitHub EnterpriseGitHub Enterprise

Site statusSite status

ApplicationsApplications

GitHub for MacGitHub for Mac

GitHub for WindowsGitHub for Windows

GitHub for EclipseGitHub for Eclipse

GitHub mobile appsGitHub mobile apps

ServicesServices

Gauges: Web analyticsGauges: Web analytics

Speaker Deck: PresentationsSpeaker Deck: Presentations

Gist: Code snippetsGist: Code snippets

Job boardJob board

DocumentationDocumentation

GitHub HelpGitHub Help

Developer APIDeveloper API

GitHub Flavored MarkdownGitHub Flavored Markdown

GitHub PagesGitHub Pages

MoreMore

TrainingTraining

Students & teachersStudents & teachers

The ShopThe Shop

Plans & pricingPlans & pricing

The OctodexThe Octodex

© 2013 © 2013 GitHubGitHub, Inc. All rights reserved., Inc. All rights reserved.Terms of ServiceTerms of Service PrivacyPrivacy SecuritySecurity


3 of 3 6/8/2013 6:51 AM

dell crowbar wiki

Documents