vmware vmotion inter data center workload mobility
Post on 04-Apr-2018
229 Views
Preview:
TRANSCRIPT
-
7/29/2019 VMware vMotion Inter Data Center Workload Mobility
1/35
IMPLEMENTATION GUIDE
Cpig 2013, Junip Nws, Inc.
INter Data CeNter WorkloaD
MobIlIty WIth VMWare
aug Junip Nws s mpd pvid ccu inmin in is guid, Junip Nws ds n wn gun ccuc
inmin pvidd in. tid p pduc dscipins nd d cnic dis pvidd in is dcumn inmin pupss n nd suc
pducs n suppd Junip Nws. a inmin pvidd in is guid is pvidd s is, wi us, nd wiu wn n ind, i
xpssd impid su. Junip Nws nd is suppis discim wnis d is guid nd inmin cnind in,
w xpssd impid su incuding, wiu imiin, s mcnii, nss picu pups nd nniningmn, ising
m cus ding, usg, d pcic.
-
7/29/2019 VMware vMotion Inter Data Center Workload Mobility
2/35
2 Cpig 2013, Junip Nws, Inc.
IMPLEMENTATION GUIDE - Inter Data Center Workload Mobility with VMware
Table of ContentsInducin . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3
Scp . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3
Dsign Cnsidins . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
Disnc nd lnc . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
l2 Dmin Cnsidins . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
Cngsin Pin . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
aniv appcs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
VMw vMin . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
Nw Impicins . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
Minining S tic Fws . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .7
Impmnin ovviw. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
M vMin . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
opimizing tic Fws a Migin . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11
Impmnin . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
QFX3600-QFX003 in DC1 Cniguin . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13
eX4200-VC in DC2 Cniguin . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14
MX960-MX13 in DC1 Cniguin . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
MX960-MX14 in DC1 Cniguin . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .19
Vidin . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3 0
Vidin Using vCn Cin appicin . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34
Summ . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
au Junip Nws . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
List of FiguresFigu 1: Minimum quid nws. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
Figu 2: rdundn viu nd psic nw cnncivi dsign . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
Figu 3: t-i ic w . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
Figu 4: t-i ic w wiin sm psic s . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
Figu 5: tic w m vMin . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
Figu 6: tic w duing m vMin . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
Figu 7: tic w m vMin . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .10
Figu 8: D cn wd mii, nw cniguin . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
Figu 9: Ping ic m cin sv . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34
Figu 10: tim nd succss vMin vn . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
-
7/29/2019 VMware vMotion Inter Data Center Workload Mobility
3/35
Cpig 2013, Junip Nws, Inc. 3
IMPLEMENTATION GUIDE - Inter Data Center Workload Mobility with VMware
IntroductionImpmning sv viuizin sus in ig uiizin nd ducd cpi xpndiu n psic svs.
Sv viuizin scs sv ping ssm m sv dw, wing psic sucs
sd mng mn viu svs viu mcins (VMs). t sic us cning, suspnding, nd miging
iv VMs mng cus psic ss n nw ppicins ui n p s us incuding
ppicins mig VMs sd n suc viii.
VM migin cng ws igin dsignd ccmmd cus svs cd n c .
hwv, dvncmns in nwing cng nw w svs wiin sing cus cd css ni d cn, in n djcn uiding css ci.
Scopetis dcumn psns dsign cnsidins nd cniguins sv nd viuizin dminiss, scui
nd nw dminiss, nd dsigns nd cics w wn xnd i VM suc cuss nd s
cs in d cn ( igin dsign pups) nd mig m ddiin d cns. VMw vSp
incuding is vMin uncin, is dminn p in enpis x86 sv viuizin m. Junip s usd
is pduc vi nw dsign. t cncps discussd cn s ppid sv viuizin
pducs m IbM, Mics, Ciix, nd s.
Us Css
enpiss vging iv wd migin in sv ws. Sm us css incud:
Optimizing resource utilization. t ms cmmn us cs is pimizing suc uiizin wiin sing d cn
t sv sns is:
- I VM quis m cmpu sucs n pvidd sv, i cn migd n sv in cus
wi vi sucs mig nnpiiizd VMs m m sucs ndd.
- I w svs cn sv sucs quid ppicins in cus, VMs cn migd sm
gup svs. Suing dwn xcss svs svs pw nd cing css.
- I cnic sv pms ccu i sv is ug in minnnc pupss, VMs cn
migd n sv.
Campus migration. VMs migd m n d cn n suc cnsumpin pupss. tis scni
is simi v us cs u insd cus siding in n d cn, i is disiud v s disnc
(muip ims mis) din uidings wiin gnizin. tpic, cmpus wn wns
cn nw nd s cn v ndwid nd nc sucs cn. bcus n n
ingss nd gss pin xiss in nw xn fc, pm u pimizin is n imiing c
VM migin cmpd d cns spd g ggpic disnc nd v i wn
cnncins muip svic pvids nd Inn. Hybrid cloud. t migin VMs wn piv d cns nd piv puic cud svic is cd id
cud ppc ( cud using). Wds in VMs us m npis d cn svic pvids
d cn wn xcd vi sucs in i igin d cn. tis niv ws w spci
pjcs wi g, unpdic wds. tpic, npis ms cnc wi svic pvid nd
is p fc nd pssi VPN i fc mus isd m Inn.
Disaster avoidance. adminiss cn nndisupiv mig mcins n d cn nu
diss sis, pvning ss d nd pin im. I diss is xpcd, suc s sv sm, n
dminis cn mig VMs cup d cn wi si pin. t d s, dminiss mus sv
ndwid n ig-ndwid, w-nc in nd fc wn iv migin ss. I is difcu sim
w muc ndwid is quid nd w ng migin cn cus uss upding VMs cnsn, nd
iv migin mus cninu snding VM s upds. I is xpnsiv v ndwid vi jus in cs i
is ndd, s n si nd ss xpnsiv niv is impmn cup pn suing dwn VMs, cping, nd
sing. tis ppc ducs ndwid VMs n ping nd im quid ns m.
D m VMs cn cd up s p scdud pn.
Follow the sun. Mving uss sucs (VMs) n dvngus cin s wd pgsss cn w
suc css. Wds nsd m d cn d cn sd n im d.
-
7/29/2019 VMware vMotion Inter Data Center Workload Mobility
4/35
4 Cpig 2013, Junip Nws, Inc.
IMPLEMENTATION GUIDE - Inter Data Center Workload Mobility with VMware
Design Considerations
Distance and Latencylw nc is quimn cusing VMs cus snsiivi dcs iu
in ssm. In vMin vn, nc is s impn cus vMin migin pcss is c
cmmunicins sm quis sncnizin mm pgs wn w VMs. t sncnizin
nsus mvd VM ss in xc sm s nd im s wn inii VM sppd. as disnc
incss, s ds nc wn s w VMs, cusing ducd civ ndwid. I VM cnn civ
pis cnwdgmns, i cnn nsmi is s, nd mm sncnizin cnn ccu. VMw impss minimum 250 Mps n ugpu vMin nd mximum 5-ms nc in sndd vsin, wi 10
ms nc vsins using M vMin u. VMw cmmnds mximum 5 ms nc nd
200 m disnc wn uss nd viuizd ppicins.
t w min cs c nc in d cn nws nd incnncins ppgin d (cusd
disnc) nd pcssing d. Siizin d is ss impn cus siz nd mun ndwid
quid in s us css. ecnic mnipuin pc cuss pcssing d, s n swicing, uing,
iwing, d ncing cuss d. Ms ps ds msud in micscnds (s, wic is 1/1000
miiscnd). t ppgin d is uncin spd ig, nd cnsviv sim d v
i pics is ppxim 5 s p m. on w dcip d udg 5 ms is disnc
nc msud pu s ppgin d. t ppgin d v i wi 5-ms udg is 1,000 m. F
und-ip pcs, divid w g 5-ms und-ip im (rtt) 500 m.
Pcssing d is uniqu c nw nd vis dvic sd n sw, dw, uncins, us, nd
g cng. yu cn ssum wing quimns: 5 20 s p swic; 20 100 micscndsp u; nd 20 300 s p iw. a u um ss minimum w swics, sing u nd n
iw p d cn quid. In ws cs scni nd n wing unidicin p, pcssing d
s 80 s in swic d, 200 s in u d, nd 600 s in iw d. bidicin, is s 1760-s
d 5,000-s d udg, ving ppxim 3,000 s u 600-m w ppgin d, 300
m idicin.
ts igus d n incud pc siz, siizin d, nd quuing d. I is s ssum disnc
w 300 m pvids s nc g, cus i ws m dvics in p wic cus u
pcssing ds. In ddiin, sv dvics mig impmnd in sw, wic diin incus ig
pcssing ds. an pin n is disnc i u vs is n n dic in wn
w pins. oining disnc cicui vs is impn. Din sg vnds sncnizd
sg suins n cmmnd disncs w 100 m.
L2 Domain Considerations
Scing n l2 dminxnding ggpic disncpic incnncing d cns, incss num dvics wiin dmin. t dmin is si suscpi miscnigud, micius cnigud,
u dvics. t cng cmmn usd pvid g-sc l2 laN xnsin (VPlS) incuds mcnisms
-imi is p ic ds css MaN WaN. Micius cnigud dvics cn dcd nd
d inusin pvnin ssms (IPS) nd iw svics.
Congestion PointWn ing d cn cicu, ndwid cngsin pin is MaN WaN dg DCI
(D Cn Incnnc), cus is is ms xpnsiv in in nw. I is impn v css
svic (CS) nd nsu impn nc- nd ndwid-snsiiv ic is svicd in
pdic nd i mnn. yu nd nsu vMin ic s ig pii n gnic ic. I
dminiss d n piiiz ic, ddiin d mig c vMin. tis p d is cd quuing
d nd ccus c pin in nw w cngsin xiss.
Alternative Approaches
t wing niv mds mig m nds wiu quiing iv wd migin.
Routed Live Migration
as n niv l2 sc, u cn us n l3 iv migin, wic mn pvis vnds supp, suc s
Mics, kVM, nd Ciix. tis md ws dminiss cng IP nd MaC ddsss nd us Dnmic hs
Cniguin Pc/Dmin Nm Ssm (DhCP/DNS) upds c quic cngs. Impmnins cn
s us sssin unning p xising sssins iv, i quid.
-
7/29/2019 VMware vMotion Inter Data Center Workload Mobility
5/35
Cpig 2013, Junip Nws, Inc. 5
IMPLEMENTATION GUIDE - Inter Data Center Workload Mobility with VMware
Cold Migration
Miging VMs iv nd minining sssins cs cmpxi in nw, s pvius discussd. I iv
migin is n quimn, cd migin is gd pin. Wi cd migin, VMs su dwn, mvd, nd
sd. Mn gnizins ind is is n xcn w s w wi g ms.
VM Migration Using Load Balancing
adminiss cn c cn nw VM in scnd d cn, nd nw ic is n wdd nw
VM ug d ncing. t igin VM sps ping wn ic s n dd. tis is cmmn
nd w-sisd md scing ic ds n v cin IP sicins. hwv, i ds nspciic mv iv sv wi iv sssins m n cin n.
VMware vMotiont impmnin dscid in is dcumn uss VMw vMin pvid iv wd migin. liv
migin is n cpiiis cusd uss swic viuizin. liv migin ns mn
usu ppicins, suc s Disiud rsuc Scdu (DrS), Disiud Pw Mngmn (DPM), nd Fu
tnc. vMin nss unning cnns VMs mm n s. t vMin cmpnn
vSp vsin 5 ds wing:
1. Cs sdw VM n dsinin s.
2. Pcs cs n VMs mm.
3. Cpis mm pgs m suc VM s dsinin VM s.
4. Cpis mm pgs v cngd duing is cp.
5. Cninus is pcss iiv uni sd is m w n mm pgs v n nsd.
6. Sps (quiscs) suc VM.
7. Cpis s VMs CPU, vid, nw, dis, nd sg.
8. Cpis in mm pg cngs, nd sums pin n dsinin ss VM.
9. Snds vs addss rsuin Pc (arP) nw nsu ic is wdd is cin
vi dsinin s VM.
tw ddiin pins w ning :
vMin is n is ig-viii mcnism. vSp s u cd hig aviii cn s VMs
sd n VM s ius ug n ddiin pduc cd Si rcv Mng (SrM).
vMin is dsignd mig VM nd is cun xcuin s m n s n. Fm nw
pspciv, u wn minin civ sssins wn VM nd ss n nw, s w s ini
suc VMs IP nd mdi ccss cn (MaC) ddsss n dsinin ss.W s cn divd m nw nd sg quimns m vMin pcss? as VM xcuin
s is ing cpid, psic ss mus cnncd sm nw nd nw mus v
suicin ndwid ns is mm s. t nc mus minim s s sncnizin cn
ccu. I is insuicin ndwid muc nc, mm s sncnizin ds n ccu, nd
vMin is. In vSp vsin 5, minimum supp ndwid quid is 250 Mps, nd nc is 5 ms.
In ddiin, vSp vsin 5 s ig icnsing u cd M vMin. tis u ws nc
quimn xndd 10 ms. VMw cs minimum u cncun vMins p 1G vMin nw
nd ig p 10G vMin nw. bsd n 250 Mps vi ndwid, wic is minimum quimn p
vMin, u cncun iv vMins in 1G nw cnsum is 1G ndwid.
an quimn is VM nd psic ss mus v ccss sm sg cin.
Pmnc quimns cn divd m s cnncivi quimns. Pmnc quimns dpnd n
p wd VM is unning. a w sv s din quimns cmpd wi n -mi sv
ds sv. t, m mm sncnizin pspciv nd sg ccss pin pspciv, csv p cs din dmnds n nw.
-
7/29/2019 VMware vMotion Inter Data Center Workload Mobility
6/35
6 Cpig 2013, Junip Nws, Inc.
IMPLEMENTATION GUIDE - Inter Data Center Workload Mobility with VMware
Network ImplicationsFm nw pspciv, quimn cncning vMin, cning, nd suspnding VMs is suc nd
dsinin VM sm. t VMs sm viuizd nw ccisics, unss mnu scipd
cng n cnd VMs. F miging VMs, dsinin VM s sm viu MaC nd IP ddsss s
suc VM wn migd. t, wn miging mcins, dminiss mus v sm simi
viu nwing (vSwic) nd psic nwing (swicing, IP ddssing, nd uing) cmpnns in pc
nsu cnncivi dvics cmmunic wi migd VM. Figu 1 sws minimum quid
nws wn using VMw vMin.
Figure 1: Minimum required networks
Figu 1 sws c VM pic cnncs puic nw. Using d ncing, c s vSwic cn
cnnc muip psic ins, i dundnc x ndwid. VMw cmmnds sp, psic
nw VMn mngmn (cnncin vCn) p eSXi s, nd sp nw vMin p
eSXi s. I is cmmn pcic v dundn ddiin cnncins puic pducin ic. I is
i six psic cnncins m psic s wi VMs m usd, i n m. VMw is cp
sgmning s nws n ss ins using p gups VlaNs.
VMw nd pvis pms us cnsuc cd vSwic, wic ns cmmunicin wn
VMs n s wiu using psic nw. a vSwic ss psic ps wn gus VMs,
mngmn ps, sd sg nws, nd vMin Fu tnc ps. VMs cnnc swics using
vNICs, nd ic usid s vss vSwic. Muip vSwics cn usd wiin psic s nsu isin. t vSwics in VMws sic icnsing m i simp nd d n un mn pcs, suc
s Spnning t Pc (StP), u d impmn wding us nsu ic is n pd dd
unncssi n vSwics using p gups nd VlaNs.
Figu 2 sws dundn viu nd psic nw cnncivi dsign in wic mngmn nd sg
svics cnnc eSXi s nd VMs cnnc nw.
Public Network
ManagementNetwork
Live Migration
Network
VM VM VM VM VM VM VM VM VM VM VM VM
-
7/29/2019 VMware vMotion Inter Data Center Workload Mobility
7/35
Cpig 2013, Junip Nws, Inc. 7
IMPLEMENTATION GUIDE - Inter Data Center Workload Mobility with VMware
Figure 2: Redundant virtual and physical network connectivity design
t vMin pcss nd vSwic v wing nw quimns:
l2 cnncins wn ss n vMin nw
Sm l2 puic d nw psn in d cns nsu nw sssins n inupd
Sd sg (picd in MaN vid DCI usg)
VlaN uning sv i muip VlaNs p p xis
Sm p gups nd VlaNs vMin-cp svs in n eSXi cus
Wn nw cngs md, cnguin sv, vSwic, swics, nd us
lss n 510 ms nc (ss nc is ; dminisic nc is s)
Minimum 250 Mps ndwid in p vMin (m ndwid is )
Nw iii nd dundnc
Maintaining State or Trac FlowsWn miging VMs wi vMin, dminiss mus cnsid dsinin s VM ssums
ccisics suc VM, nd IP nd MaC ddsss mv nw cin in nw. I cincuss VM si m n su svic dvic (d nc iw) n, i is i
nw dvic wi n cgniz nw sssin s ppicins unning n VM nd c s nw
cmmunicins, s dsignd d. tis cuss ppicin s sssin nd, s su, sws s
nn-smss VM mv.
t vid is, w impmn dsign cs xising sssins ug igin su svic dvic,
suing in nn-pim ic uing nd ndwid usg DCI. adminiss cn us n dsigns
minin sssin s wn su svic dvics suc VMs s nd dsinin VMs s.
tpic, cusing svs is n pin.
Cusing is n cng pic ws in laN nvinmns wi dvics cd nx c
. Using cusd su dvics in WaN nvinmn mig n pim mig c simi pms
cmpd vMin. In ddiin, cusd su dvics v ndwid nd nc quimns, wic mig
n cmpi wi vMin quimns.
QFX Seriesor EX Series
QFX Seriesor EX Series
QFX Seriesor EX Series
QFX Seriesor EX Series
ESXi Host
Server VM
Service VM(Network Virtualization,
Load Balancing, NAT, Security)
Serviced VM
vMotion/FTVMK NICInterface
ESXi HostManagement
VMK NICInterface
vSwitchesor Port Groups
PhysicalPorts
IP StorageVMK NICInterface
Virtual NICs
VirtualizedNon-Virtualized
-
7/29/2019 VMware vMotion Inter Data Center Workload Mobility
8/35
8 Cpig 2013, Junip Nws, Inc.
IMPLEMENTATION GUIDE - Inter Data Center Workload Mobility with VMware
Implementation OverviewWn miging VMs wn ss, i is pu mp cmmunicin ws wn ppicins vs
nw. tis mpping ids in undsnding pni cmmunicin pms nd w spciic cniguins
cn nsu vMin vn ccus succssu nd cmmunicin ws minind.
Figu 3 sws xn ic iving m usid d cn diin -i ppicin nd
pcssd ic xiing. ec VM sids n sp psic eSXi s. tis ic w ds n incud d
ncs pni muip ppicins nd ds svs mig quid pvid d
pcssing cin ning w i.
Figure 3: Three-tier trac ow
Wn miging individu VMs, i is impn pn ucm. Is sm ic w civ? Wi sm VMs
sid in n d cn nd s in n, spiing sing IP ddss ng? a ddiin
su dvics, suc s d ncs nd iws cn disup ic w? Is suicin ndwid
svic ic wn VMs i sid in din d cns? D ppicin cmmunicins wn
VMs v sic nc quimns? t ic w dpicd in Figu 4 ds n incud su ss mig cd in p.
Figure 4: Three-tier trac ow within the same physical host
t ic w in Figus 3 nd 4 simi, xcp Figu 4 sws ppicin VMs sid n sm
sv. hw wi ic w cng wn miging n VMs u s n d cn?
appicins v din sucus cmpd wi s swn in Figus 3 nd 4. appicins d n nd v
sun, VlaN, d cn n xn cin. adminiss sud s cnsid w ccmmd s
ppicins nd i ic ws wn pnning mig VMs wn d cns.
Metro vMotionFigus 5 ug 7 sw ic ws mniic ppicin ppicin uncins sid in n VM. I
ppicin ws pd u in sm w -i ppicin, mn m ws wud cisscss
d cns. ld ncs nd uncins n dpicd, u mig quid in pic ppicin
nw c w.
Mn did ic ws invv m cmpnns n jus simp -i ppicin. Mn din
ppicin nd ds svs mig nd cmmunic wi c diving n nsw
cin. In ddiin, d ncs nd iws mig xis wn c ppicin i. ts ws s qui
cnsidin wn nzing M vMin nd dpndncis s ps ic ws mig wn.
Trac Flow
FW FWLANLAN LAN LAN LAN LANWeb
VM
App
VM
DB
VM
App
VM
Web
VM
Trac Flow
LAN LANFW FWVirtual
Switch
Web
VM
App
VM
DB
VM
App
VM
Web
VM
Virtual
Switch
Virtual
Switch
Virtual
Switch
Virtual
Switch
Virtual
Switch
Workload-to-workload trac flows over virtual connections within the same server
-
7/29/2019 VMware vMotion Inter Data Center Workload Mobility
9/35
Cpig 2013, Junip Nws, Inc. 9
IMPLEMENTATION GUIDE - Inter Data Center Workload Mobility with VMware
Figure 5: Trac ow beore metro vMotion
Figure 6: Trac ow during metro vMotion
RemoteClientRouter
MX Series
OutsideClient for
ConnectionTesting
DC2 PEMX Series
SRX SeriesCluster
Client trac to VM
vCenter trac to ESXi host
Storage trac to VM/ESXi
DC1 PEMX Series
DATA CENTER 2DATA CENTER 1
QFX Series
vCenter
SRX SeriesCluster
ESXi Hostwith vGW
ESXi Hostwith vGW
Single VPLS all VLANsor Multiple VPLS forload-balancing and
trac separation
MC LAG, LAG andVirtual Chassis
technologies used toimprove performance
and reliability
NIC teaming to alternateswitches for production and
vMotion VLANs. Multiple linkseach for production, storageand vMotion/management
AggregationSwitch
EX SeriesVirtualChassis
EX SeriesVirtualChassis
RemoteClientRouter
MX Series
OutsideClient for
ConnectionTesting
DC2 PEMX Series
SRX SeriesCluster
DC1 PEMX Series
DATA CENTER 2DATA CENTER 1
QFXSeries
vCenter
SRX SeriesCluster
ESXi Hostwith vGW
ESXi Hostwith vGW
Client trac to VM
vCenter trac to ESXi host
Storage trac to VM/ESXi
vMotion trac ESXi host to host
Single VPLS all VLANsor Multiple VPLS forload-balancing and
trac separation
MC LAG, LAG andVirtual Chassis
technologies used toimprove performance
and reliability
NIC teaming to alternateswitches for production and
vMotion VLANs. Multiple linkseach for production, storageand vMotion/management
AggregationSwitch
EX SeriesVirtualChassis
EX SeriesVirtualChassis
-
7/29/2019 VMware vMotion Inter Data Center Workload Mobility
10/35
10 Cpig 2013, Junip Nws, Inc.
IMPLEMENTATION GUIDE - Inter Data Center Workload Mobility with VMware
Figu 7 sws vMin migin, ic cninus w css d cn incnnc. In is
simp mniic ppicin cs, ic pns incud:
1. rd-dsd wexn cin sv nw cd in DC2
2. Gn-dd wvCn mngmn sv in DC2 vSp eSXi s in DC1
3. ong-sid wSg in DC2 eSXi s in DC1
4. bc (sid) wvCn mngmn sv in DC1 vSp eSki s in DC2
ts ws pmic cus d incss ug DCI, wic is ms xpnsiv nd cngsd
pin n nw. ts ws w ss ndwid vi xising ppicins nd migin
ic. Du nc incud, ppicin mig pm p cus sg nd cin cd
u w m VM. Mv, is issu is mgniid cus m cmpnns sid in -i g
ppicin.
Miging iv svs wn d cns -- wi minining xising ppicin ws is smims nwn s
ipinning mn c.
Figure 7: Trac ow aer metro vMotion
AggregationSwitch
EX SeriesVirtualChassis
EX SeriesVirtualChassis
DC2 PEMX Series
SRX SeriesCluster
Client trac to VM
vCenter trac to ESXi host
Storage trac to VM/ESXi
vMotion trac ESXi host to host
DATA CENTER 2DATA CENTER 1
vCenter
SRX SeriesCluster
ESXi Hostwith vGW ESXi Hostwith vGW
Single VPLS all VLANs
or Multiple VPLS forload-balancing and
trac separation
MC LAG, LAG andVirtual Chassis
technologies used toimprove performance
and reliability
NIC teaming to alternateswitches for production and
vMotion VLANs. Multiple linkseach for production, storageand vMotion/management
RemoteClientRouter
MX Series
OutsideClient for
ConnectionTesting
DC1 PEMX Series
QFXSeries
-
7/29/2019 VMware vMotion Inter Data Center Workload Mobility
11/35
Cpig 2013, Junip Nws, Inc. 1
IMPLEMENTATION GUIDE - Inter Data Center Workload Mobility with VMware
Optimizing Trac Flows Aer Migrationtis scin viws mds pimizing ic ws VM migin ccus wn d cns.
Red Trac Flow Solution
as swn in Figu 5, d ic ws m xn cin sv in DC1. tis ic w is n
ms diicu ws minin nd pimiz cus i pic vss ug su dvics, suc s iws
nd d ncs. I is s diicu pvid m dic p scnd d cn cus IP ddssing.
IP ddssing is n dsignd pii mii wn din cins. t usid wd, is
n w c svug n IP ddss. tpic, n IP ddss is discvd using DNS. aug uingupds cn md quic, d n ncssi cnvg s pid s VM cn mv m n cin
n. t cngv im m suc VM dsinin VM cn in suscnds. In-d-cn
ic cn si svd uni uing cng ccus in IP nw. Wn miging VMs n sm VlaN
sun, nw dminiss mus cnsid w VMs n sun mig jus w m. I VMs
n migd s cniguus gup c IP ddsss, dminiss cn gmn sun. Fgmnd
suns cus uing upds ss i ccp xn unmus ssms, unss
-gggd d us.
Snding u upds wi sm pix sizs (gmnd) is ccp in csd nw nvinmn cus
dminiss cn cn sun pix siz in uing upd. In Inn nvinmn, svic pvids incu
imiins n sun siz n ccp uing upd minin sii u s. addiin
sun u pixs mn ddiin u cngs, wic cnsum m mm nd CPU nd d g
suc quimns nd pni insii. tpic, /24 is sms pix siz ccpd ds Inn
svic pvids. a sing IP ddss pix usd pic VM is /32. Inn uing s d n ccp sm
ddss ngs mv und, suc s s usd sing VMs sm gups VMs (und 255 IP ddsss).
Pix siz issus cn miigd pviding us cn gggd up /24 pix ping pvid.
Cnging uing s pvids md pimizing ingss ccss. t cmmn w cnging gss
ccss is wi is-p uing pc suc s Viu ru rdundnc Pc (VrrP), wic ws n
pimizd cic nw xi in c d cn s ppsd ic cssing DCI xi nw.
Black Trac Flow
t gn ic w cn impvd i i mving vCn mngmn sv dping cusd
mngmn sv in scnd d cn. tis suin is s ppic svs inc wi
VM. bsd n p ic nd cmmunicin quimns, dminiss cn ng simi sv in
scnd d cn mv sv s p gup scnd d cn, nsuing cmmunicin
duing mvs.
Orange Trac Flow
t suin ng sg ic w s w pssi mds. on pin is impmn sgpicin wn d cns. Mn sg vnds d v ingd i suins spciic wi
VMw n sm nsiins.
an pin is us VMw svMin (Sg vMin), wic ws dminiss mig VMs sg
cin m n mcin n mving ni d s. t dinc is in picin. a d is
nsd, nd n ssm simp ms incmn upds d cngs m si sg.
tis md ducs v DCI in usg. a d is nsd nc i VMs vMin
vn. t, v DCI usg mus ccu duing svMin pcss mv d nc. In ddiin, p
pmnc ccus du nc wn VM nd sg wi cd in din d cns.
tis cniqu vids signiicn invsmn in ig-nd, sncnus sg picin ssm u mig n
sui VMs wi g d ss.
-
7/29/2019 VMware vMotion Inter Data Center Workload Mobility
12/35
12 Cpig 2013, Junip Nws, Inc.
IMPLEMENTATION GUIDE - Inter Data Center Workload Mobility with VMware
ImplementationFigu 8 iuss nw cniguin usd s in-d-cn VMw vMin. tw svs cd
in D Cn 1 (DC1), nd n sv is cd in D Cn 2 (DC2). t vCn sv s sids in DC1 nd
mngs svs in eSXi DrS cus. a svs us equlgic iSCSI sg in DC1. a svs
nd sg us sm VlaN ning l2 cmmunicin.
In DC1, n ccss i cnsising QFX3600 is swicing. a cmind c-gggin i cnsiss w
eX82s in VC cniguin dundnc nd p vidnc. t d cn dg s w MX960s using VPlS
muiming nd MC-laG dundnc.
In DC2, n ccss i eX42s in VC cniguin dundnc nd p vidnc is swicing. a
cmind c-gggin i cnsiss w MX480s in VC cniguin dundnc nd p vidnc. t
d cn dg s w MX80s using VPlS muiming nd MC-laG dundnc. t sv nd sg VlaN
is und wn ccss nd c-gggin s using 802.1Q in c d cn nd und css d
cns using VPlS d cn WaN dg.
Figure 8: Data center workload mobility, network confguration
t m quimns psnd in dsign scin, dminiss sud c i l2 cnncin m
DC1 DC2 uning VlaNs m vSwics n eSXi ss in DC1 eSXi s in DC2. t VlaNs
mus nd nd und n tp rc (tor) swics in cins nd und css VlPScnncin d cn dg. W us dundn ins, in gggin gup (laG), Muicssis laG (MC-laG),
MPlS, nd VPlS muiming nsu iii l2-und VlaN. t VlaN w cs un (usd
VMw eSXi cus) is VLAN1101.
NOTE: I u qui ddiin VlaNs sp ic vMin ic, mngmn ic, ic, s
spciic VlaNs mus und in sm mnn.
Using Figu 8 s nc, eSXi s incs insd in VLAN 1101 nd und d cn
dg in d cns.
vCenter172.28.113.27
xe-50/0/18 xe-50/0/19
ge-0/0/22
ge-210.1.11.180
ge-2ge-3 10.1.11.195
ge-0/0/17
xe-0/0/10
xe-0/0/15
xe-0/0/12 xe-0/0/13
Eth0.1Eth1.0
Eth0.0
10.1.11.191
Eth1.110.1.11.190
ge=0/0/18
DATA CENTER 1
MX960WAN Edge
VPLS PE
QFX3500QFX 003
172.28.114.167
EX8208EX 037
172.28.114.128
MX960MX 13
172.28.114.50
EX8216EX 038
172.28.114.128
xe-0/0/14 xe-0/0/21
WM-DC1-Vidclone-172.28.113.201,10.1.11.194
DSL-DC1-172.28.113.201, 10.1.11.217DSL-DC2-172.28.113.202, 10.1.11.218
Storage Array (iSCSI)172.28.113.90
10.1.11.192DC1-GRP-1
EX8200Core
MX960MX 14
172.28.114.52
MC-LAG
DATA CENTER 2
MX80WAN EdgeVPLS PEMX80
MX 24
172.28.114.131
MX80MX 23
172.28.114.130
MX480MX 07
172.28.114.132
EX4200Virtual Chassis10.13.97.161
MX480MX 020
172.28.114.134
ge-0/0/12
xe-2/1/0
xe-3/1/0
xe-2/1/1
xe-1/1/1
xe-1/1/0
10.1.11.18110.1.11.150
Win28K-Srv 1-10.1.11.211, 10.13.99.109WM-VM2-710-10.1.11.212, 10.13.99.81
10.1.11.186
Storage Array (iSCSI)Srv121
10.13.99.10310.1.11.179
DC2-GRP-2
Srv123ESXi1-R71010.13.99.102
ge 4
MC-LAG
MX480 Virtual Chassis Core
172.28.113.133
MPLS Core
P-Routers
-
7/29/2019 VMware vMotion Inter Data Center Workload Mobility
13/35
Cpig 2013, Junip Nws, Inc. 13
IMPLEMENTATION GUIDE - Inter Data Center Workload Mobility with VMware
QFX3600-QFX003 in DC1 Confgurationtis xmp cnigus VlaN ccss nd un ps n QFX ccss swic. a incs qui ccss
ddd VlaN. I u us muip VlaNs (n d, n vMin, n mngmn, c,), mus
s ddd nd und. tis xmp cnins sing VlaN.
vlans {
VR1-vlan1101 {
vlan-id 1101;interface {
xe-0/0/21.0;
xe-0/0/14.0;
xe-0/0/15.0;
xe-0/0/10.0;
xe-0/0/12.0;
xe-0/0/13.0;
ge-0/0/17.0;
ge-0/0/18.0;
ge-0/0/22.0;
}
l3-interface vlan.1101;
}
}
tuns cnigud n upins in wing cd snipp. I muip VlaNs quid m c ccss in
eSXi s, p md ggd ccss sud s ddd s incs.
interfaces {
xe-0/0/14 {
unit 0 {
family ethernet-switching {
port-mode trunk;
}
}
}
xe-0/0/21 {unit 0 {
family ethernet-switching {
port-mode trunk;
}
}
}
-
7/29/2019 VMware vMotion Inter Data Center Workload Mobility
14/35
14 Cpig 2013, Junip Nws, Inc.
IMPLEMENTATION GUIDE - Inter Data Center Workload Mobility with VMware
EX4200-VC in DC2 Confgurationtis xmp cnigus VlaN ccss nd un ps n eX VC ccss swic. a incs qui ccss
ddd VlaN. I u us muip VlaNs (n d, n vMin, n mngmn, nd s n),
mus s ddd nd und. tis xmp cnins sing VlaN.
vlans {
VR1-vlan1101 {
vlan-id 1101;interface {
ge-0/0/9.0;
ge-0/0/12.0;
xe-2/1/1.0;
xe-2/1/0.0;
xe-1/1/0.0;
xe-1/1/1.0;
}
l3-interface vlan.1101;
}
}
tuns cnigud n upins in wing cd snipp. I muip VlaNs quid m c ccss in
eSXi s, p md ggd ccss sud s ddd s incs.
interfaces {
xe-2/1/1 {
unit 0 {
family ethernet-switching {
port-mode trunk;
}
}
}
I gggd en (laG) incs usd m ndwid dundnc, mus ddd VlaN
nd v p-md un nd n m.
-
7/29/2019 VMware vMotion Inter Data Center Workload Mobility
15/35
Cpig 2013, Junip Nws, Inc. 15
IMPLEMENTATION GUIDE - Inter Data Center Workload Mobility with VMware
MX960-MX13 in DC1 Confgurationt wing cniguin sws d cn pvid dg us nd l2 sc wn d
cns. tis cniguin quis sv sps: Cnigu laN-sid incs un VlaNs; cnigu
cn incs MPlS, rSVP signing -swicd ps (lSPs), nd lSPs w ic
cid wn w pvid dg us; nd cnigu VPlS using sp uing insncs, Muipc
bGP (MP-bGP), nd picis.
Interaces Confguration
xe-1/0/0 {
description CONNECTED-TO-EX8208;
gigether-options {
802.3ad {
ae3;
backup;
}
}
}
xe-1/1/0 {
description CONNECTED-TO-EX8216;
gigether-options {
802.3ad {
ae3;primary;
}
}
}
xe-10/0/0 {
description Connected to EX8200-VC via MC-LAG-1;
gigether-options {
802.3ad ae1;
}
}
xe-10/1/0 {
description Connected to EX8200-VC via MC-LAG-2;
gigether-options {
802.3ad ae2;
}
}
xe-10/2/0 {
description CONNECTED-TO-MX960-52-ICL-TRAFFIC;
gigether-options {
802.3ad ae5;
}
}
xe-10/3/0 {
description CONNECTED-TO-MX960-52-ICL-TRAFFIC;
gigether-options {
802.3ad ae5;
}
}
interfaces {
ge-11/2/0 {
description CONNECTED-TO-PE2-52-ICCP-TRAFFIC;
unit 0 {
family inet {
address 10.11.12.2/30;
}
}
}
-
7/29/2019 VMware vMotion Inter Data Center Workload Mobility
16/35
16 Cpig 2013, Junip Nws, Inc.
IMPLEMENTATION GUIDE - Inter Data Center Workload Mobility with VMware
MC-LAG Confguration or LAN
protocols {
iccp {
local-ip-addr 10.11.12.2;
peer 10.11.12.1 {
redundancy-group-id-list 1;
liveness-detection {
minimum-interval 100;
multiplier 3;
detection-time {
threshold 500;
}
}
}
}
lacp {
ppm centralized;
}
}
interfaces {
ae1 {
description Connecting to EX8200 MC-LAG-1;
exible-vlan-tagging;
encapsulation vlan-vpls;
aggregated-ether-options {
lacp {
active;
periodic fast;
system-id 00:00:00:00:00:50;
admin-key 123;
}
mc-ae {
mc-ae-id 101;
redundancy-group 1;chassis-id 0;
mode active-standby;
status-control active;
}
}
unit 1101 {
encapsulation vlan-vpls;
vlan-id 1101;
family vpls;
}
unit 1102 {
encapsulation vlan-vpls;
vlan-id 1102;
family vpls;}
unit 1103 {
encapsulation vlan-vpls;
vlan-id 1103;
family vpls;
}
unit 1201 {
-
7/29/2019 VMware vMotion Inter Data Center Workload Mobility
17/35
Cpig 2013, Junip Nws, Inc. 17
IMPLEMENTATION GUIDE - Inter Data Center Workload Mobility with VMware
encapsulation vlan-vpls;
vlan-id 1201;
family vpls;
}
unit 1202 {
encapsulation vlan-vpls;
vlan-id 1202;
family vpls;}
unit 1203 {
encapsulation vlan-vpls;
vlan-id 1203;
family vpls;
}
}
Backbone Routing and MPLS Confguration
protocols {
rsvp {
interface xe-1/0/0.0;interface ge-11/0/1.0;
ospf {
traic-engineering;
area 0.0.0.0 {
interface all {
}
}
}
mpls {
label-switched-path DC1.PE1-DC2.PE1 {
to 11.1.1.31;
fast-reroute;
}
label-switched-path DC1.PE1-DC2.PE2 {to 11.1.1.130;
fast-reroute;
}
label-switched-path Campus-PE1 {
to 10.10.10.65;
fast-reroute;
}
label-switched-path Campus-PE2 {
to 10.10.10.69;
fast-reroute;
}
interface xe-1/0/0.0;
interface ge-11/0/1.0;
-
7/29/2019 VMware vMotion Inter Data Center Workload Mobility
18/35
18 Cpig 2013, Junip Nws, Inc.
IMPLEMENTATION GUIDE - Inter Data Center Workload Mobility with VMware
VPLS Confguration
routing-options {
nonstop-routing;
}
router-id 10.10.10.50;
autonomous-system 500;
protocols {
bgp {
group DC-1 {
type internal;
local-address 10.10.10.50;
}
family l2vpn {
signaling;
}
peer-as 500;
local-as 500;
neighbor 11.1.1.31;
neighbor 10.10.10.52;
neighbor 11.1.1.130;
}
}
DC-VR-1 {
instance-type vpls;
vlan-id all;
interface ae1.1101;
interface ae1.1102;
interface ae1.1103;
interface ae1.1201;
interface ae1.1202;
interface ae1.1203;
route-distinguisher 1:50;
vrf-target target:900:1000;
protocols {
vpls {site-range 8;
no-tunnel-services;
site DC1-1 {
site-identifer 1;
multi-homing;
site-preference primary;
interface ae1.1101;
interface ae1.1102;
interface ae1.1103;
interface ae1.1203;
interface ae1.1202;
interface ae1.1201;
}
}}
}
-
7/29/2019 VMware vMotion Inter Data Center Workload Mobility
19/35
Cpig 2013, Junip Nws, Inc. 19
IMPLEMENTATION GUIDE - Inter Data Center Workload Mobility with VMware
MX960-MX14 in DC1 Confgurationt wing cniguin sws d cn pvid dg us nd l2 sc wn d
cns. tis cniguin quis sv sps: Cnigu laN-sid incs un VlaNs; cnigu
cn incs MPlS, rSVP signing lSPs, nd lSPs w ic cid wn w
pvid dg us; nd cnigu VPlS using sp uing insncs, MP-bGP, nd picis.
Interaces Confguration
interfaces {xe-1/0/0 {
description CONNECTED-TO-EX8216-AE5;
gigether-options {
802.3ad {
ae3;
primary;
}
}
}
xe-1/1/0 {
description CONNECTED-TO-EX8208-AE5;
gigether-options {
802.3ad {
ae3;backup;
}
}
}
xe-9/0/0 {
description CONNECTED-TO-P4-122;
mtu 2000;
unit 0 {
family inet {
address 10.3.10.41/30;
}
family iso;
family mpls;
}
}
xe-9/1/0 {
description CONNECTED-TO-P2-72;
mtu 2000;
unit 0 {
family inet {
address 10.3.10.45/30;
}
family iso;
family mpls;
}
}
xe-10/0/0 {
description Connected to EX8200-VC via MC-LAG-1;
gigether-options {
802.3ad ae1;
}
}
xe-10/1/0 {
description Connected to EX8200-VC via MC-LAG-2;
-
7/29/2019 VMware vMotion Inter Data Center Workload Mobility
20/35
20 Cpig 2013, Junip Nws, Inc.
IMPLEMENTATION GUIDE - Inter Data Center Workload Mobility with VMware
gigether-options {
802.3ad ae2;
}
}
xe-10/2/0 {
description CONNECTED-TO-MX960-50-ICL-TRAFFIC;
gigether-options {
802.3ad ae5;}
}
xe-10/3/0 {
description CONNECTED-TO-MX960-50-ICL-TRAFFIC;
gigether-options {
802.3ad ae5;
}
}
ge-11/2/0 {
description CONNECTED-TO-PE1-50-ICCP-TRAFFIC;
unit 0 {
family inet {
address 10.11.12.1/30;
}}
}
MC-LAG LAN Confguration
protocols {
iccp {
local-ip-addr 10.11.12.1;
peer 10.11.12.2 {
redundancy-group-id-list 1;
liveness-detection {
minimum-interval 100;
multiplier 3;
detection-time {
threshold 500;
}
}
}
}
lacp {
ppm centralized;
}
}
interfaces {
ae1 {
description Connecting to EX8200 MC-LAG-1;
exible-vlan-tagging;
encapsulation vlan-vpls;
aggregated-ether-options {
lacp {
active;
periodic fast;
system-id 00:00:00:00:00:50;
admin-key 123;
}
-
7/29/2019 VMware vMotion Inter Data Center Workload Mobility
21/35
Cpig 2013, Junip Nws, Inc. 2
IMPLEMENTATION GUIDE - Inter Data Center Workload Mobility with VMware
mc-ae {
mc-ae-id 101;
redundancy-group 1;
chassis-id 1;
mode active-standby;
status-control standby;
}
}unit 1101 {
encapsulation vlan-vpls;
vlan-id 1101;
family vpls;
}
unit 1102 {
encapsulation vlan-vpls;
vlan-id 1102;
family vpls;
}
unit 1103 {
encapsulation vlan-vpls;
vlan-id 1103;
family vpls;}
unit 1201 {
encapsulation vlan-vpls;
vlan-id 1201;
family vpls;
}
unit 1202 {
encapsulation vlan-vpls;
vlan-id 1202;
family vpls;
}
unit 1203 {
encapsulation vlan-vpls;
vlan-id 1203;family vpls;
}
}
Backbone Routing and MPLS Confguration
protocols {
rsvp {
interface xe-1/0/0.0;
interface all;
}
ospf {
traic-engineering;area 0.0.0.0 {
interface all;
}
}
mpls {
path-mtu;
label-switched-path DC1.PE2-DC2.PE1 {
to 11.1.1.31;
-
7/29/2019 VMware vMotion Inter Data Center Workload Mobility
22/35
22 Cpig 2013, Junip Nws, Inc.
IMPLEMENTATION GUIDE - Inter Data Center Workload Mobility with VMware
}
label-switched-path DC1.PE2-DC2.PE2 {
to 11.1.1.130;
}
interface xe-1/0/0.0;
interface ge-11/0/0.0;
interface all;
VPLS Confguration
routing-options {
nonstop-routing;
}
router-id 10.10.10.52;
autonomous-system 500;
}
protocols {
bgp {
group DC-1 {
type internal;
local-address 10.10.10.52;family l2vpn {
signaling;
}
peer-as 500;
local-as 500;
neighbor 11.1.1.31;
neighbor 11.1.1.130;
neighbor 10.10.10.50;
}
}
routing-instances {
DC-VR-1 {
instance-type vpls;
vlan-id all;interface ae1.1101;
interface ae1.1102;
interface ae1.1103;
route-distinguisher 1:52;
vrf-target target:900:1000;
protocols {
vpls {
site-range 8;
no-tunnel-services;
site DC1-1 {
site-identifer 1;
multi-homing;
site-preference backup;
interface ae1.1101;
interface ae1.1102;
interface ae1.1103;
}
}
}
}
-
7/29/2019 VMware vMotion Inter Data Center Workload Mobility
23/35
Cpig 2013, Junip Nws, Inc. 23
IMPLEMENTATION GUIDE - Inter Data Center Workload Mobility with VMware
MX80-MX23 in DC2 Interace Confguration
interfaces {
xe-0/0/0 {
description CONNECTED-TO-MX480-134;
gigether-options {
802.3ad ae1;
}
}
xe-0/0/1 {
description CONNECTED-TO-P1-71;
mtu 2000;
unit 0 {
family inet {
address 10.3.10.49/30;
}
family iso;
family mpls;
}
}
xe-0/0/2 {
description CONNECTED-TO-MX480-132;
gigether-options {
802.3ad ae2;
}
}
ge-1/0/0 {
description CONNECTED-TO-PE1-131;
gigether-options {
802.3ad ae0;
}
}
ge-1/0/1 {
description CONNECTED-TO-PE1-131;
disable;
gigether-options {802.3ad ae0;
}
}
ae0 {
description Connecting MX80 Multichassis LAG;
aggregated-ether-options {
lacp {
active;
periodic fast;
}
}
unit 0 {
family inet {
address 10.4.10.14/30;}
}
}
-
7/29/2019 VMware vMotion Inter Data Center Workload Mobility
24/35
24 Cpig 2013, Junip Nws, Inc.
IMPLEMENTATION GUIDE - Inter Data Center Workload Mobility with VMware
MC-LAG LAN Confguration
protocols {
iccp {
local-ip-addr 10.4.10.14;
peer 10.4.10.13 {
redundancy-group-id-list 1;
liveness-detection {
minimum-interval 100;
multiplier 3;
}
}
}
}
interfaces {
ae2 {
description Connecting to MX480 MC-LAG-2-132;
exible-vlan-tagging;
encapsulation vlan-vpls;
aggregated-ether-options {
lacp {
active;
periodic fast;
system-id 00:00:00:00:00:31;
admin-key 123;
}
mc-ae {
mc-ae-id 132;
redundancy-group 1;
chassis-id 1;
mode active-standby;
status-control standby;
}
}
unit 1101 {encapsulation vlan-vpls;
vlan-id 1101;
family vpls;
}
unit 1102 {
encapsulation vlan-vpls;
vlan-id 1102;
family vpls;
}
unit 1103 {
encapsulation vlan-vpls;
vlan-id 1103;
family vpls;
}unit 1201 {
encapsulation vlan-vpls;
vlan-id 1201;
family vpls;
}
unit 1202 {
-
7/29/2019 VMware vMotion Inter Data Center Workload Mobility
25/35
Cpig 2013, Junip Nws, Inc. 25
IMPLEMENTATION GUIDE - Inter Data Center Workload Mobility with VMware
encapsulation vlan-vpls;
vlan-id 1202;
family vpls;
}
unit 1203 {
encapsulation vlan-vpls;
vlan-id 1203;
family vpls;}
}
Backbone Routing and MPLS Confguration
protocols {
rsvp {
interface all;
}
mpls {
label-switched-path DC2.PE2-DC1.PE1 {
to 10.10.10.50;
}label-switched-path DC2.PE2-DC1.PE2 {
to 10.10.10.52;
}
interface all;
}
ospf {
traic-engineering;
area 0.0.0.0 {
interface lo0.0 {
passive;
}
interface all;
interface fxp0.0 {
disable;}
}
}
VPLS Confguration
routing-options {
router-id 11.1.1.130;
autonomous-system 500;
}
protocols {
bgp {group DC-2 {
type internal;
local-address 11.1.1.130;
family inet {
unicast;
any;
}
family inet-vpn {
unicast;
-
7/29/2019 VMware vMotion Inter Data Center Workload Mobility
26/35
26 Cpig 2013, Junip Nws, Inc.
IMPLEMENTATION GUIDE - Inter Data Center Workload Mobility with VMware
any;
}
family l2vpn {
signaling;
}
peer-as 500;
local-as 500;
neighbor 10.10.10.50;neighbor 10.10.10.52;
neighbor 11.1.1.31;
}
}
routing-instances {
DC-VR-1 {
instance-type vpls;
vlan-id all;
interface ae2.1101;
interface ae2.1102;
interface ae2.1103;
interface ae2.1201;
interface ae2.1202;interface ae2.1203;
route-distinguisher 1:130;
vrf-target target:900:1000;
protocols {
vpls {
site-range 8;
no-tunnel-services;
site DC2-1 {
site-identifer 3;
multi-homing;
site-preference backup;
interface ae2.1101;
interface ae2.1102;
interface ae2.1103;interface ae2.1203;
interface ae2.1202;
interface ae2.1201;
}
}
}
}
MX80-MX24 in DC2 Interace Confguration
interfaces {
xe-0/0/0 {
description CONNECTED-TO-MX480-132;gigether-options {
802.3ad ae1;
}
}
xe-0/0/1 {
description CONNECTED-TO-P3-92;
mtu 2000;
unit 0 {
-
7/29/2019 VMware vMotion Inter Data Center Workload Mobility
27/35
Cpig 2013, Junip Nws, Inc. 27
IMPLEMENTATION GUIDE - Inter Data Center Workload Mobility with VMware
family inet {
address 10.3.10.53/30;
}
family iso;
family mpls;
}
}
xe-0/0/2 {description CONNECTED-TO-MX480-134;
gigether-options {
802.3ad ae2;
}
}
xe-0/0/3 {
description CONNECTED-TO-MX80-130-ICC-TRAFFIC;
unit 0 {
family inet {
address 10.3.10.57/30;
}
}
}
ge-1/0/0 {description CONNECTED-TO-PE2-130;
gigether-options {
802.3ad ae0;
}
}
ge-1/0/2 {
description CONNECTED-TO-PE2-130;
gigether-options {
802.3ad ae0;
}
}
ae0 {
description Connecting MX80 Multichassis LAG;
aggregated-ether-options {lacp {
active;
periodic fast;
}
}
unit 0 {
family inet {
address 10.4.10.13/30;
}
}
}
MC-LAG LAN Confguration
protocols {
iccp {
local-ip-addr 10.4.10.13;
peer 10.4.10.14 {
redundancy-group-id-list 1;
liveness-detection {
minimum-interval 50;
-
7/29/2019 VMware vMotion Inter Data Center Workload Mobility
28/35
28 Cpig 2013, Junip Nws, Inc.
IMPLEMENTATION GUIDE - Inter Data Center Workload Mobility with VMware
multiplier 3;
}
}
}
}
interfaces {
ae2 {
description Connecting to MX480 MC-LAG-2;exible-vlan-tagging;
encapsulation vlan-vpls;
aggregated-ether-options {
lacp {
active;
periodic fast;
system-id 00:00:00:00:00:31;
admin-key 123;
}
mc-ae {
mc-ae-id 132;
redundancy-group 1;
chassis-id 0;
mode active-standby;status-control active;
}
}
unit 1101 {
encapsulation vlan-vpls;
vlan-id 1101;
family vpls;
}
unit 1102 {
encapsulation vlan-vpls;
vlan-id 1102;
family vpls;
}
unit 1103 {encapsulation vlan-vpls;
vlan-id 1103;
family vpls;
}
unit 1201 {
encapsulation vlan-vpls;
vlan-id 1201;
family vpls;
}
unit 1202 {
encapsulation vlan-vpls;
vlan-id 1202;
family vpls;
}
unit 1203 {
encapsulation vlan-vpls;
vlan-id 1203;
family vpls;
}
}
-
7/29/2019 VMware vMotion Inter Data Center Workload Mobility
29/35
Cpig 2013, Junip Nws, Inc. 29
IMPLEMENTATION GUIDE - Inter Data Center Workload Mobility with VMware
Backbone Routing and MPLS Confguration
rsvp {
interface all;
}
mpls {
label-switched-path DC2.PE1-DC1.PE1 {
to 10.10.10.50;
}
label-switched-path DC2.PE1-DC1.PE2 {
to 10.10.10.52;
}
interface all;
}
ospf {
traic-engineering;
area 0.0.0.0 {
interface lo0.0 {
passive;
}
interface fxp0.0 {
disable;
}
interface all;
}
}
protocols {
VPLS Confguration
router-id 11.1.1.31;
autonomous-system 500;
}
protocols {
bgp {
group DC-2 {
type internal;
local-address 11.1.1.31;
family inet {
any;
}
family inet-vpn {
unicast;
any;
}
family l2vpn {
signaling;
}
peer-as 500;
local-as 500;
routing-options {
neighbor 10.10.10.50;
neighbor 10.10.10.52;
neighbor 11.1.1.130;
}
}
-
7/29/2019 VMware vMotion Inter Data Center Workload Mobility
30/35
30 Cpig 2013, Junip Nws, Inc.
IMPLEMENTATION GUIDE - Inter Data Center Workload Mobility with VMware
routing-instances {
DC-VR-1 {
instance-type vpls;
vlan-id all;
interface ae2.1101;
interface ae2.1102;
interface ae2.1103;
interface ae2.1201;interface ae2.1202;
interface ae2.1203;
route-distinguisher 1:131;
vrf-target target:900:1000;
protocols {
vpls {
site-range 8;
no-tunnel-services;
site DC2-1 {
site-identifer 3;
multi-homing;
site-preference primary;
interface ae2.1101;
interface ae2.1102;interface ae2.1103;
interface ae2.1201;
interface ae2.1202;
interface ae2.1203;
}
}
}
}
Validationt wing cmmnds vid MPlS cniguin, min m dvics in DC1. F vi, DC2 is n
swn. Vidin succssu mv m vCn VMw mngmn cns is s swn. t wing
vidin sws MPlS nd rSVP in DC1.
MX960-MX14 in DC1
root@MX960-DC-1-52> show mpls lsp
Ingress LSP: 2 sessions
To From State Rt P ActivePath LSPname
11.1.1.31 10.10.10.52 Up 0 * DC1.PE2-DC2.PE1
11.1.1.130 10.10.10.52 Up 0 * DC1.PE2-DC2.PE2
Total 2 displayed, Up 2, Down 0
Egress LSP: 2 sessions
To From State Rt Style Labelin Labelout LSPname
10.10.10.52 11.1.1.130 Up 0 1 FF 3 - DC2.PE2-DC1.PE2
10.10.10.52 11.1.1.31 Up 0 1 FF 3 - DC2.PE1-DC1.PE2Total 2 displayed, Up 2, Down 0
Transit LSP: 0 sessions
Total 0 displayed, Up 0, Down 0
-
7/29/2019 VMware vMotion Inter Data Center Workload Mobility
31/35
Cpig 2013, Junip Nws, Inc. 3
IMPLEMENTATION GUIDE - Inter Data Center Workload Mobility with VMware
root@MX960-DC-1-52> show rsvp session
Ingress RSVP: 2 sessions
To From State Rt Style Labelin Labelout LSPname
11.1.1.31 10.10.10.52 Up 0 1 FF - 299776 DC1.PE2-DC2.PE1
11.1.1.130 10.10.10.52 Up 0 1 FF - 299840 DC1.PE2-DC2.PE2
Total 2 displayed, Up 2, Down 0
Egress RSVP: 2 sessionsTo From State Rt Style Labelin Labelout LSPname
10.10.10.52 11.1.1.130 Up 0 1 FF 3 - DC2.PE2-DC1.PE2
10.10.10.52 11.1.1.31 Up 0 1 FF 3 - DC2.PE1-DC1.PE2
Total 2 displayed, Up 2, Down 0
Transit RSVP: 0 sessions
Total 0 displayed, Up 0, Down 0
MX960-MX13 in DC1
root@MX960-DC-1-50> show mpls lsp
Ingress LSP: 2 sessions
To From State Rt P ActivePath LSPname11.1.1.31 10.10.10.50 Up 0 * DC1.PE1-DC2.PE1
11.1.1.130 10.10.10.50 Up 0 * DC1.PE1-DC2.PE2
Total 2 displayed, Up 2, Down 0
Egress LSP: 2 sessions
To From State Rt Style Labelin Labelout LSPname
10.10.10.50 11.1.1.130 Up 0 1 FF 3 - DC2.PE2-DC1.PE1
10.10.10.50 11.1.1.31 Up 0 1 FF 3 - DC2.PE1-DC1.PE1
Total 2 displayed, Up 2, Down 0
Transit LSP: 0 sessions
Total 0 displayed, Up 0, Down 0
root@MX960-DC-1-50> show rsvp session
Ingress RSVP: 2 sessions
To From State Rt Style Labelin Labelout LSPname
11.1.1.31 10.10.10.50 Up 0 1 FF - 299792 DC1.PE1-DC2.PE1
11.1.1.130 10.10.10.50 Up 0 1 FF - 299808 DC1.PE1-DC2.PE2
Total 2 displayed, Up 2, Down 0
Egress RSVP: 2 sessions
To From State Rt Style Labelin Labelout LSPname
10.10.10.50 11.1.1.130 Up 0 1 FF 3 - DC2.PE2-DC1.PE1
10.10.10.50 11.1.1.31 Up 0 1 FF 3 - DC2.PE1-DC1.PE1
Total 2 displayed, Up 2, Down 0
Transit RSVP: 0 sessions
Total 0 displayed, Up 0, Down
-
7/29/2019 VMware vMotion Inter Data Center Workload Mobility
32/35
32 Cpig 2013, Junip Nws, Inc.
IMPLEMENTATION GUIDE - Inter Data Center Workload Mobility with VMware
MX960-MX13 in DC1
tis cmmnd sws ICCP sus in DC1.
root@MX960-DC-1-50> show iccp brief
Redundancy Group Information for peer 10.11.12.1
TCP Connection : Established
Liveliness Detection : Up
Redundancy Group ID Status
1 Up
Client Application: lacpd
Redundancy Group IDs Joined: 1
Client Application: l2ald_iccpd_client
Redundancy Group IDs Joined: None
Client Application: MCSNOOPD
Redundancy Group IDs Joined: None
MX960-MX14 in DC1
root@MX960-DC-1-52> show iccp brief
Redundancy Group Information for peer 10.11.12.2
TCP Connection : Established
Liveliness Detection : Up
Redundancy Group ID Status
1 Up
Client Application: lacpd
Redundancy Group IDs Joined: 1
Client Application: l2ald_iccpd_client
Redundancy Group IDs Joined: None
Client Application: MCSNOOPD
Redundancy Group IDs Joined: None
t wing vidin sws MC-laG incs in up s nd unning DC1.
root@MX960-DC-1-50> show interfaces mc-ae
Member Link : ae1
Current State Machines State: mcae active state
Local Status : active
Local State : up
Peer Status : standby
Peer State : up
Logical Interface : ae1.1101
root@MX960-DC-1-52> show interfaces mc-ae
Member Link : ae1
Current State Machines State: mcae standby state
Local Status : standby
Local State : up
Peer Status : active
Peer State : up
Logical Interface : ae1.1101
-
7/29/2019 VMware vMotion Inter Data Center Workload Mobility
33/35
Cpig 2013, Junip Nws, Inc. 33
IMPLEMENTATION GUIDE - Inter Data Center Workload Mobility with VMware
MX960-MX13 in DC1
t wing vidin sws VPlS cnncin is up nd unning in DC1 nd DC2.
root@MX960-DC-1-50> show vpls connections
Instance: DC-VR-1
Local site: DC1-1 (1)
connection-site Type St Time last up # Up trans
1 rmt RN3 rmt Up Aug 15 15:09:08 2011 1
Remote PE: 11.1.1.31, Negotiated control-word: No
Incoming label: 262147, Outgoing label: 262145
Local interface: lsi.1049088, Status: Up, Encapsulation: VPLS
Description: Intf - vpls DC-VR-1 local site 1 remote site 3
MX960-MX14 in DC1
root@MX960-DC-1-52> show vpls connections
Layer-2 VPN connections:
Instance: DC-VR-1
Local site: DC1-1 (1)
connection-site Type St Time last up # Up trans1 rmt LN
3 rmt LN
root@MX80-DC-2-130> show vpls connections
Layer-2 VPN connections:
Instance: DC-VR-1
Local site: DC2-1 (3)
connection-site Type St Time last up # Up trans
1 rmt LN
3 rmt LN
MX80-MX24 in DC2
root@MX80-DC-2-131> show vpls connections
Layer-2 VPN connections:
Instance: DC-VR-1
Local site: DC2-1 (3)
connection-site Type St Time last up # Up trans
1 rmt Up Aug 15 20:41:06 2011 1
Remote PE: 10.10.10.50, Negotiated control-word: No
Incoming label: 262145, Outgoing label: 262147
Local interface: lsi.1049088, Status: Up, Encapsulation: VPLS
Description: Intf - vpls DC-VR-1 local site 3 remote site 1
3 rmt RN
-
7/29/2019 VMware vMotion Inter Data Center Workload Mobility
34/35
34 Cpig 2013, Junip Nws, Inc.
IMPLEMENTATION GUIDE - Inter Data Center Workload Mobility with VMware
MX80-MX23 in DC2
root@MX80-DC-2-131> show vpls connections
Layer-2 VPN connections:
Instance: DC-VR-1
Local site: DC2-1 (3)
connection-site Type St Time last up # Up trans
1 rmt Up Aug 15 20:41:06 2011 1
Remote PE: 10.10.10.50, Negotiated control-word: No
Incoming label: 262145, Outgoing label: 262147
Local interface: lsi.1049088, Status: Up, Encapsulation: VPLS
Description: Intf - vpls DC-VR-1 local site 3 remote site 1
3 rmt RN
Validation Using the vCenter Client ApplicationUsing vCn Cin ppicin, wing scn cpus sw VM migin. Figu 9 sws ping
ic m cin sv cing 512 ms rtt duing iv migin sv. t g rtt is wn
VM is sppd n n sv nd sd n scnd.
Figure 9: Ping trac rom client to server
-
7/29/2019 VMware vMotion Inter Data Center Workload Mobility
35/35
IMPLEMENTATION GUIDE - Inter Data Center Workload Mobility with VMware
Cpig 2013 Junip Nws, Inc. a igs s vd. Junip Nws, Junip Nws g, Juns,
NScn, nd ScnoS gisd dms Junip Nws, Inc. in Unid Ss nd
cunis. a dms, svic ms, gisd ms, gisd s vic ms pp
i spciv wns. Junip Nws ssums n spnsiii n inccucis in is dcumn. Junip
APAC and EMEA Headquarters
Junip Nws Innin b.V.
bing avnu 240
1119 PZ Scip-rij
amsdm, t Nnds
Pn: 31.0.207.125.700
Fx: 31.0.207.125.701
Corporate and Sales Headquarters
Junip Nws, Inc.
1194 N Mid avnu
Sunnv, Ca 94089 USa
Pn: 888.JUNIPer (888.586.4737)
408.745.2000
Fx: 408.745.2100
www.juniper.net
t pucs Junip Nws suins,
ps cnc u Junip Nws
psniv 1-866-298-6428 uizd s.
Figu 10 sws im nd succss vMin vn in rcn ts pn.
Figure 10: Time and success o the vMotion event
SummaryNw dminiss cn civ in-d-cn wd mii dping cminin VMw nd
Junip Nws dvics. VMw pvids mii suin, nd Junip pvids ig-pmnc, ig
i d cn laN nd d cn WaN xpinc. Wn pnning mig wds, i is ciic xmin
usinss cs, cus css nd pnning quimns cn xpnsiv nd cmpicd. as psnd in
Cmpus nd Cd Migin scnis, d cn migin iv wds cn ccmpisd wiu
impmning cmpicd is-p-spnd nd u-pimizin cniqus. o scnis pssi;
wv, qui impmning pcs s s nd , incsing cmpxi nd
ducing iii cnncd d cns. Wn dsigning u wd mii suin, i is impn
xmin css, disnc, nd nc in u nvinmn nd vu dpndncis u sv
ppicin ws v n c nd nw.
About Juniper NetworksJunip Nws is in usinss nw innvin. Fm dvics d cns, m cnsums cud
pvids, Junip Nws divs sw, siicn nd ssms nsm xpinc nd cnmics
nwing. t cmpn svs cusms nd pns wdwid. addiin inmin cn und
www.juniper.net.
http://www.juniper.net/http://www.juniper.net/
top related