drbd pasya heartbeat1

8/12/2019 drbd pasya heartbeat1

1/25

cloud-b-lab Anil Kumar

Open Nebula 3.4.1

Setup a HIGH-AVAILABILITY environment u in! "buntu 1#.$4% &'S(L% )*B)an+ Heartbeat

OpenNebula VM : Windows XP

IN),

Requirements ...................................................................................................................................... 3Preparing Replication Servers: ........................................................................................ 3

Install DRBD: ......................................................................................................... 4Additional N S !on"iguration ............................................................................... #Install And !on"igure $eart%eat: ............................................................................ #

Prepare &penNe%ula rontend and Node ........................................................................ '!&N I()RIN( &neServer ................................................................................. *INS+A,, and !&N I()R- &penNe%ula in &neServer. ..................................... /Prepare &penNe%ula Node 0&ne12 ost ............................................................. 5!&N I()RIN( one12 ost ................................................................................ 4AD2INS+RIN( &penNe%ula : ............................................................................. 4

!reating a 6indo7s 8P 12 ............................................................................................................ 9+esting ig$ Availa%ilit;< .............................................................................................. 54

By

ANIL KUMAR

[email protected]

www.cloud-b-lab.com

www.cloud-b-lab.co.in

Chennai and Tri andrum ! India

!loud.%.la%=>o$o.com of 5?
mailto:[email protected]://www.cloud-b-lab.com/http://www.cloud-b-lab.co.in/mailto:[email protected]:[email protected]://www.cloud-b-lab.com/http://www.cloud-b-lab.co.in/mailto:[email protected]


2/25


Friends, this tutorial teaches you to setup a OpenNebula 3.4.1 HIGH-A AI!A"I!I#$ en%iron&ent but 'ith &ini&u& hard'are resources and so&e easysteps.

"#i$h a ailabili%y& refers to the practice of (eepin) online resourcesa%ailable throu)h node failure or syste& &aintenance.

I a& usin) *ust + # enabled Intel eon er%ers and a nor&al Intel dualcore indo's / laptop 'ith +G" 0a& for ha%in) re&ote sessions and phereclient.

y 2!, 0" and Heartbeat pac(a)es already a%ailable 'ith buntu 1+.54 'illbe used, so that installation and setup 'ill be a bit easy.

No', let us ha%e a %ie' at ho' a co&pleted setup 'ould loo( li(e6

A' a ca'e()*enNebula 'er er +older " /var/lib/one & i' made hi$hly a ailable.

#hat &eans folder /var/lib/one 'ill be &ade a%ailable bet'een replicationser%er 1 and ser%er+. a&e folder 'ill be e7posed out usin) s NF share sothat OpenNebula front end and OpenNebula Node to)ether can share it.

Requirements

,. A08 er%er 6 A # 8nabled ser%er &achine

. OpenNebula Node 6 A # 8nabled &achine

. A indo's9!inu7 !aptop9 es(top 'ith phere :lient , putty etc

!loud.%.la%=>o$o.com 5 of 5?
mailto:[email protected]:[email protected]


3/25


Preparing Replication Servers:

,. Install A08 8 98 i

. :reate 3 and install buntu 1+.54 ;4 bit ser%er in all 3 s

. + buntu s 'ill be used to setup our replication en%iron&ent.

/. 1 buntu 'ill be prepared as OpenNebula Front end.

0. urin) buntu installation, once you set the host na&e and select eth5as /ri&ary n9', 'hile H:/ process runs, press cancel button, 'hich'ill enable you to enter I/ address ,net&as(, )ate'ay &anually.

1. All &s to ha%e at least 1G" 0A

2. 3M-,

Hostname Server1

IP et ! 1"#$1%&$1$"'

(atewa) 1"#$1%&$1$1

*omain+*NS , ample$com + 1"#$1%&$1$1

H** Partitionin.

Partition-1 1!! M/ - e t0 - /oot - +dev+sda1

Partition-# (/ - et 0 2 3oot - +dev+sda

Partition-0 1 (/ 2 Swap - +dev+sda%

Partition-' #!! M/ - e t0 - NO MO4N5 -+dev+sda6 7or *3*/ Metadata

Partition- %! (/ - e t 0 - NO MO4N5 -+dev+sda& 7or *3*/ *858

4sername localadmin

8dditional p9. Openss server

3M-

Hostname Server#

IP et ! 1"#$1%&$1$"6

(atewa) 1"#$1%&$1$1

*omain+*NS , ample$com + 1"#$1%&$1$1

H** Partitionin.

Partition-1 1!! M/ - e t0 - /oot - +dev+sda1

Partition-# (/ - et 0 2 3oot - +dev+sda

Partition-0 1 (/ 2 Swap - +dev+sda%

Par ti tion-' #!! M/ - e t0 - NO MO4N5 -+dev+sda6 7or *3*/ Metadata

Par ti tion- %! (/ - e t 0 - NO MO4N5 -+dev+sda& 7or *3*/ *858

4sername localadmin

8dditional p9. Openss server

VM-0Hostname OneServer

IP et ! 1"#$1%&$1$#!!



4/25


5/25


rate 1"50al-extents 2#60

4 on server1

device /dev/drbd"0disk /dev/sda!0 *ata partition on server 1

address 192.1 !.1.97866!!0 ) address on server 1 meta-disk /dev/sda6:";0 5etadata for *+ * on server 1

4 on server2 device /dev/drbd"0

disk /dev/sda!0 *ata partition on server 2 address 192.1 !.1.96866!!0 ) address on server 2 meta-disk /dev/sda6:";0 5etadata for *+ * on server 1 2 44

h< in Server 1&2 : load the *+ * kernel module

modprobe drbd

i< in Server 1&2 : create a drbd meta disk. Before that we need to zerosize the /dev/sd7 partition in both servers

dd if


6/25


A++itional N S /on0i!uration

&< in Server 1&2 : 5ake /var/lib/nfs folder information same in both theservers, so that if sever1 goes down server2 will behave identical toserver1

mkdir /var/lib/one

n< In 5er er , alone (

mount -t ext> /dev/drbd" /var/lib/one

mv /var/lib/nfs/ /var/lib/one

ln -s /var/lib/one/nfs/ /var/lib/nfs

umount /var/lib/one

o< In 5er er alone (

rm -fr /var/lib/nfs/

ln -s /var/lib/one/nfs/ /var/lib/nfs

In tall An+ /on0i!ure eartbeat2eart%eat is ver; "le i%le and po7er"ul. A eart%eat setup can $ave %asic active@passive clusters 7it$ t7o

mem%ersG 7$ere t$e active server is providing t$e services and t$e passive server is 7aiting totaJe over i" necessar;.

p( ?eartbeat will be installed in Server1&2. t monitors the other serverconstantl'. @or example, if server1 goes down, heartbeat on server2detects this and makes server2 take over. heartbeat also starts andstops the A@B server on both server1 and server2. )t also provides A@Bas a virtual service via the ) address 192.1 !.1.167 so that theopenAebula server and node$s( see onl' one A@B server.

n Server1&2

apt-get install heartbeat

?< )reate confi*(ration files for +eartBeat C n Server 1&2

18 etc/heartbeat/ha.cf

lo)facility local5(eepali%e +deadti&e 15bcast eth5

node ser%er1 ser%er+28 /etc/heartbeat/authke's change D+E F3E%G)H?%F% FBBGI+*J with asimple passsword4

auth 33 &d@ 08/!A:8B I#HBAB/A O0 C



7/25


>8 /etc/heartbeat/haresources8 elow line remains same in both Berver1and Berver2

server1 ) addr88192.1 !.1.167/27/eth" drbddisk88r" @iles'stem88/dev/drbd"88/var/lib/one88ext> nfs-kernel-server

r< n Server 1&2 : 5ake /etc/heartbeat/authke's should be readable byroot

ch&od ;55 9etc9heartbeat9auth(eys

s< n Server 1&2 : start *+ * and heartbeat on server1 and server28

sudo ser%ice drbd start

sudo ser%ice heartbeat start

t< #est it 'ith ifconfi)6 $ou 'ill see a ne' eth565 in er%er 1 'ith I/as 1D+.1;E.1.1 4

5er er, (root ser%er16 ifconfi)eth5 !in( encap68thernet H addr 5565c6+D6c56;D6b inet addr61D+.1;E.1.D4 "cast61D+.1;E.1.+@@ as(6+@@.+@@.+@@.5 inet; addr6 feE566+5c6+Dff6fec56;Db 9;4 cope6!in(. ............ eth565 !in( encap68thernet H addr 5565c6+D6c56;D6b inet addr61D+.1;E.1.1 4 "cast61D+.1;E.1.+@@ as(6+@@.+@@.+@@.5 / "0OA :A # 0 NNING !#I:A # # 61@55 etric61

lo !in( encap6!ocal !oopbac( inet addr61+ .5.5.1 as(6+@@.5.5.5 J....

5er er (root ser%er+6 ifconfi)eth5 !in( encap68thernet H addr 5565c6+D6fD6;@6b5 inet addr61D+.1;E.1.D3 "cast61D+.1;E.1.+@@ as(6+@@.+@@.+@@.5 J...............

lo !in( encap6!ocal !oopbac( inet addr61+ .5.5.1 as(6+@@.5.5.5 J................

u< #est it 'ith df -h 6 $ou 'ill see 9de%9drbd5 ;4G E.+G @+G 14K 9%ar9lib9one , only iner%er 1

5er er, (root ser%er16 df -hFilesyste& i>e sed A%ail seK ounted on9de%9sda@ 4.;G 1.+G 3.3G + K 9ude% +3E 4.5L +3E 1K 9de%t&pfs DD +@+L DD 1K 9runnone @.5 4.5L @.5 1K 9run9loc(none +4; 5 +4; 5K 9run9sh&9de%9sda1 D+ 35 @ 3@K 9boot9de%9drbd5 ;4G E.+G @+G 14K 9%ar9lib9one

5er er (root ser%er+6 df -hFilesyste& i>e sed A%ail seK ounted on9de%9sda@ 4.;G 1.1G 3.3G +@K 9ude% +3E 4.5L +3E 1K 9de%t&pfs DD +@+L DD 1K 9runnone @.5 4.5L @.5 1K 9run9loc(none +4; 5 +4; 5K 9run9sh&9de%9sda1 D+ 35 @ 3@K 9boot

%< Good, Heartbeat setup is done. e 'ill continue further 'ith Heartbeat ,once 'e ha%e OpenNebula front end and Node ready.

Prepare OpenNebula Frontend and Node

,. etup a brid)e in One er%er6 Install brid)e-utils usin) belo' co&&and

sudo apt get install %ridge utils

!loud.%.la%=>o$o.com # of 5?


8/25


. 8dit M9etc9net'or(9interfaces file to add a Mbrid)e . 0eplace thecontents as )i%en in Table 3M-T and re'%ar% ne%wor:in$

Sample net or etup 0or V&Ho t

5able VM-5#:L +$e loop%acJ net7orJ inter"aceauto loi"ace lo inet loop%acJ

L +$e primar; net7orJ inter"aceauto et$/i"ace et$/ inet manualauto %r/i"ace %r/ inet static address *5. 9'. .5// netmasJ 5??.5??.5??./ net7orJ *5. 9'. ./ %roadcast *5. 9'. .5?? gate7a; *5. 9'. . L dns M options are implemented %; t$e resolvcon" pacJageG i" installed dns searc$ e ample.com %ridge ports et$/ %ridge "d *

%ridge $ello 5 %ridge ma age 5 %ridge stp o""

sudo 9etc9init.d9net'or(in) restart

9etc9resol%.conf

na&eser%er 1D+.1;E.1.1search 'estel.co&

/ON IG"*ING OneServer

Note6 either 'or( directly on the ser%er console or connect to OneHostusin) H if you ha%e a third &achine 'ith putty or any other HclientP

,. :reate a folder Q9%ar9libQ if doesnRt e7istP and create a )roup na&edQonead&inQ

sudo mJdir p @var@li%@

sudo groupadd g //// oneadmin

. :reate a user Qonead&inQ , add user to )roup Qonead&inQ and ha%e9%ar9lib9one as ho&e folder.

sudo useradd u //// m oneadmin d @var@li%@one s @%in@%as$ g oneadmin

. etup pass'ord for Qonead&inQ and &a(e onead&in o'ner of Q9%ar9lib9oneQ

sudo pass7d oneadmin

sudo c$o7n R oneadmin:oneadmin @var@li%@one

/. #est by lo))in) as user Qonead&inQ and e7it

su l oneadmin

!loud.%.la%=>o$o.com ' of 5?


9/25


e it

0. Install Net'or( file er%er NF P

sudo apt get install n"s Jernel server

1. 8dit 9etc9fstab and &ount the folder 9%ar9lib9one 'ith1D+.1;E.1.1 469%ar9lib9one.

*5. 9'. . #4:@var@li%@one @var@li%@one n"s r7Gvers 3 / /

2. No' 9%ar9lib9one of oneser%er 'ill be &apped to1D+.1;E.1.1 469%ar9lib9one. #hat &eans 'hat e%er you create 'ithin9%ar9lib9one resides inside the replication ser%er and not locally.

4. 8dit 9etc9e7ports and add the follo'in) line to &a(e folder9%ar9lib9one9 1D+.1;E.1.D@ is of OpenNebula node P

9%ar9lib9one1D+.1;E.1.D@Sr',sync,noBsubtreeBchec(,noBrootBs?uash,anonuidT15555,anon)idT15555cd openne%ula 3.4. @

. "efore installin) OpenNebula, install all pre-re?uisite pac(a)es

!loud.%.la%=>o$o.com * of 5?


10/25


sudo apt get install li%curl3 li%m;sqlclient ' li%ru%; .' li%sqlite3 ru%; li%sqlite3 ru%; .' li% mlrpc c3 dev li% mlrpc core c3 m;sqlcommon ru%; ru%; .'sudo apt get install li% ml5 dev li%m;sqlclient dev li%m;sql dev li%sqlite3 ru%; li%e pat devsudo apt get install li%c9 li%gcc li%m;sqlclient ' li%pass7ord ru%; li%sequel ru%; li%sqlite3 / li%ssl/.*.' li%stdc 9 li% ml5sudo apt get install ru%; ru%;gems li%m;sql ru%; li%sqlite3 ru%; li%ama>onec5 ru%;sudo apt get install li%sqlite3 dev li% mlrpc c3 dev g ru%; li%openssl ru%; li%ssl dev ru%; devsudo apt get install li% ml5 dev li%m;sqlclient dev li%m;sql dev li%sqlite3 ru%; li%e pat dev

sudo apt get install raJe ru%;gems li% ml parser ru%; .' li% slt dev genisoimage sconssudo gem install noJogiri raJe mlparser sudo apt get install m;sql server 0 set t$e pass7ord 7$en asJed. I normall; give m;greatsecret< as t$e p7dcon>i.ure MASBl: Cre>er below screen s ot in case o> an) doubtDm;sql uroot pm;greatsecret!R-A+- )S-R ConeadminC=Clocal$ostC ID-N+I I-D BQ ConeadminC!R-A+- DA+ABAS- openne%ula(RAN+ A,, PRI1I,-(-S &N openne%ula.M +& ConeadminC ID-N+I I-D BQ ConeadminCquit

;)ou ma) dra. corners to e pando$o.com 5 of 5?


13/25


*5. 9'. .5// oneserver.7estell.com oneserver *5. 9'. .*? onevm$ost.7estell.com onevm$ost

/ON IG"*ING oneV&Ho t Be"ore con"iguring one12 ost c$ecJ i" ;ou are a%le to ping &ne12 ost and t$e gate7a; No7 tr; to ping *5. 9'. . G *5. 9'. .*# "rom one12 ost Also c$ecJ t$e internet connectivit; in 12 ost %; pinging www u"untu com

Install MNF co&&on to enable access to the folder Q9%ar9lib9oneQ ofOne Host. if run as Monead&in . First add onead&in to O80 fileP

sudo apt get updatesudo apt get install n"s common

-dit @etc@"sta% and add an N S entr; "or @var@li%@one. Qou 7ill %e using t$e N S s$are "rom replication Server *5. 9'. . #4:@var@li%@one @var@li%@one n"s r7Gvers 3 / /

create "older structure @var@li%@one in 12 ost and mount it as per T"sta%T entr;

sudo mJdir p @var@li%@one!reate user ToneadminT G groud oneadmin as ;ou did in Tone ostT

sudo groupadd g //// oneadminsudo useradd u //// g oneadmin m oneadmin s @%in@%as$sudo usermod d @var@li%@oneoneadminsudo usermod a ( oneadminGroot oneadminsudo pass7d oneadminsudo c$o7n oneadmin:oneadmin @var@li%@onesudo mount @var@li%@onemount

Note: Qou s$ould see t$e %elo7 line*5. 9'. . #4:@var@li%@one on @var@li%@one t;pe n"s Er7Gvers 4Gaddr *5. 9'. . #4F

Install K12 $;pervisor 0it 7ill taJe around 5 minutes or less %ased on ;our internet speed

sudo apt get install qemu Jvm li%virt %in u%untu vm %uilder %ridge utils ru%;!ib%irt needs to %e con"igured to ena%le users o" group ToneadminT to manage t$e 1ms and to allo71N! connections. -dit T@etc@li%virt@li%virtd.con"T and maJe t$e "ollo7ing t7o c$anges

uni socJ group ToneadminTESearc$ "or string uni socJ


14/25


A)&INST*ING OpenNebula 2

one$ost create onevm$ost im im Jvm vm vmm Jvm net dumm;

oneadmin=onevm$ost:O one$ost list ID NA2- !,)S+-R R12 +!P) !P) A!P) +2-2 2-2 A2-2 S+A+ / onevm$ost 5 '// #*9 9// #.?( 9.#( ?.?( on

once you re)ister a Host chec( the #A# fla). It should display Mon .

$ou &ay need to debu) lo) files if alue M8rr is display for #A#.

Note 6:o&&on cause of M8rr fla) 'ill be either pass'ord less connection to One Host islost or Host is not a%ailable to OneHost.

Hint6 Uust type onehost and press enter to )et all a%ailable para&eters.

:o&&and Monehost top 'ill display the output of Monehost list continuously.

In case o" an; errors Yust c$ecJ O@[email protected]

No7 letCs create a cluster named clustero$o.com 5 of 5?


22/25


sNe7Name n &S+NA2-Set oS$ell !reate&%Yect ET6S!ript.s$ellTFs!!S T K,2_SQS+-2_!urrent!ontrolSet_Ts+cpipParamsRegPat$ s!!S ^ TServices_+cpip_Parameters_Tn &S+NA2- 6script.ArgumentsE/FsNe7Name n &S+NA2-Set oS$ell !reate&%Yect ET6S!ript.s$ellTF

s!!S T K,2_SQS+-2_!urrent!ontrolSet_Ts+cpipParamsRegPat$ s!!S ^ TServices_+cpip_Parameters_Ts!ompNameRegPat$ s!!S ^ T!ontrol_!omputerName_T6it$ oS$ell.RegDelete s+cpipParamsRegPat$ ^ T ostnameT.RegDelete s+cpipParamsRegPat$ ^ TN1 ostnameT.Reg6rite s!ompNameRegPat$ ^ T!omputerName_!omputerNameTG sNe7Name.Reg6rite s!ompNameRegPat$ ^ TActive!omputerName_!omputerNameTG sNe7Name.Reg6rite s+cpipParamsRegPat$ ^ T ostnameTG sNe7Name.Reg6rite s+cpipParamsRegPat$ ^ TN1 ostnameTG sNe7Name-nd 6it$ C oS$ellrem Dim o%YS$ellrem Set o%YS$ell 6Script.!reate&%YectET6Script.S$ellTFrem o%YS$ell.Run T!:_6IND&6S_s;stem35_s$utdo7n.e e r t /T

Instantiate t$e 12 using onetemplate commandonetemplate instantiate /

2onitor t$e progress o" 12 creation using onevm top commandonevm top ID )S-R (R&)P NA2- S+A+ !P) 2-2 &S+NA2- +I2- 5 oneadmin oneadmin one 5 runn / /K onevm$ost /d //:/#

Note:I alread; $ad 5 1ms created in %et7een. ence t$e num%er is 5

(et t$e IP address and P&R+ o" t$e Running 12oneadmin=onevm$ost:O onevm s$o7 5 b grep IP IP P)B,I! T *5. 9'. . ? TG IP T *5. 9'. . ? TGoneadmin=onevm$ost:O onevm s$o7 5 b grep P&R+ P&R+ T?*/5TG

+est %; pinging t$e IP *5. 9'. . ? . It 7ill Ping. I" it does not PingG !$ecJ t$roug$ 1N! console t$at 7$et$er;ou $ave disa%led t$e 6indo7s ire7all. Disa%le it.

!onnect to 6indo7s instance t$roug$ Remote desJtop.!$ecJ to see i" t$e IP address is set to *5. 9'. . ? and $ostname is c$anged to 6in8P 5.+$atCs it. Qou $ave success"ull; created a 6indo7s 12 and set t$e IP address and $ostname as passed %;&penNe%ula !&N+-8+ section.



23/25


No7 lets continue 7it$ eat%eat @ ig$ Availa%ilit;

Testing Hig !"ailabilit#$

,etCs create a ne7 12. 6indo7s image "ile %eing quite %ig 5 (B it 7ill taJe some time during t$e prologsession. 6$ile PR&,&( is on 7e 7ill induce a AI,)R- S+A+- G %; stopping t$e $eart%eat in Server G t$ePR&,&( process s$ould continue 7it$ no $indrance "rom Server 5. Also t$e currentl; running 12 instances$ould continue normall;

,etCs "irst c$ecJ "rom 7$ic$ one is t$e Active Server no7G using d" $< commandroot server1:Q d> -

iles;stem Si>e )sed Avail )se 2ounted on@dev@sda? 4.9( .5( 3.3( 5# @udev 53'2 4./K 53'2 @devtmp"s **2 5?5K **2 @runnone ?./2 4./K ?./2 @run@locJ none 5492 / 5492 / @run@s$m@dev@sda *52 3/2 ?#2 3? @%oot@dev@dr%d/ 94( '.5( ?5( 4 @var@li%@one

root server#:Q d> -iles;stem Si>e )sed Avail )se 2ounted on

@dev@sda? 4.9( . ( 3.3( 5? @udev 53'2 4./K 53'2 @devtmp"s **2 5?5K **2 @runnone ?./2 4./K ?./2 @run@locJ none 5492 / 5492 / @run@s$m@dev@sda *52 3/2 ?#2 3? @%oot

SoG Server is active no7.

!reate a ne7 12

onetemplate instantiate /

&nce 12 enters prolog< stateG Yust stop $eart%eat in Server .root server1:Q service eartbeat stopStopping ig$ Availa%ilit; services: Done.



24/25


root server#:Q d> -iles;stem Si>e )sed Avail )se 2ounted on

@dev@sda? 4.9( . ( 3.3( 5? @udev 53'2 4./K 53'2 @devtmp"s **2 5?5K **2 @runnone ?./2 4./K ?./2 @run@locJ none 5492 / 5492 / @run@s$m@dev@sda *52 3/2 ?#2 3? @%oot

@dev@dr%d/ 94( /( ?/( # @var@li%@one

&nce 7e stopped t$e $eat%eat in Server G Server 5 %ecame Active instantl; and PR&,&( state continued.

+$e e isting 12 is also running "ine. ,og "ile is running "ine....

!$ecJ i" DRBD also c$anges t$e PRI2ARQ and S-!&NDARQ accordingl;



25/25


A"ter some timeG letCs reverse t$e proccessG no7 stop $eart%eat in Server 5 and se 7$at $appens. Server %ecameActive and 12 3 also entered in to running state. 6e are a%le to connect to t$e 6indo7s instance.

5 at s it$ I> )ou li9ed t is tutorial Rust put a comment to cloud$b$lab o o$com

!loud.%.la%=>o$o.com 5? of 5?

drbd pasya heartbeat1

Documents