vdcf monitoring
TRANSCRIPT
-
7/29/2019 VDCF Monitoring
1/44
JomaSoft GmbHFalkensteinstr. 54a
9000 St. GallenSwitzerland
VDCF - Virtal Data!enter Clod Framework
for t"e Solaris#$
%&eratin' S(stem
$onitorin'
Version ).0*5. %!tober *0+,
Co&(ri'"t *005-*0+, JomaSoft GmbH
ll ri'"ts reser/ed.
[email protected] VDCF - Monitoring 3.0 1 / 44
-
7/29/2019 VDCF Monitoring
2/44
JomaSoft GmbHFalkensteinstr. 54a
9000 St. GallenSwitzerland
Table of Contents1 Introduction.................................................................................................................................................... 4
1.1!"r!i"#................................................................................................................................................ 41.$%ard#ar" Monitoring.............................................................................................................................. 4
1.$.1&'arming................................................................................................................................................. .......... 41.$.$ (")uir"m"nts...................................................................................................................................................4
1.3%igh &!ai'a*i'it+ ,%& Monitoring............................................................................................................1.3.1 Compon"nts.....................................................................................................................................................1.3.$ od" fai'ur" d"t"ction......................................................................................................................................1.3.3 od" !acuation s")u"nc".............................................................................................................................1.3.4 (")uir"m"nts...................................................................................................................................................2
1.4("sourc" Monitoring.............................................................................................................................. 1.4.1 (")uir"m"nts...................................................................................................................................................
1.p"rating +st"m , Monitoring........................................................................................................51.VDCF Dash*oard #"* app'ication.........................................................................................................5
$ Insta''ation.................................................................................................................................................... 10$.16r"r")uisit"s........................................................................................................................................ 10
$.$Insta''ation............................................................................................................................................ 103 Configuration............................................................................................................................................... 11
3.17ranting 8s"r &cc"ss.......................................................................................................................... 113.$Customi9ing Monitoring "Mai'..............................................................................................................11
3.$.1&'arming................................................................................................................................................ ......... 11
3.3Customi9ing %ard#ar" Monitoring.......................................................................................................1$3.3.1 Ch"c: Int"r!a'.................................................................................................................................................1$3.3.$&'arming................................................................................................................................................ ......... 1$
3.4Customi9ing %igh &!ai'a*i'it+ ,%& Monitoring.....................................................................................133.4.1 ;""p &'i!" Int"r!a'..........................................................................................................................................133.4.$
-
7/29/2019 VDCF Monitoring
3/44
JomaSoft GmbHFalkensteinstr. 54a
9000 St. GallenSwitzerland
4.4.$ 8sag" Co''"ctor..............................................................................................................................................$4.4.3 8sag" &ggr"gator..........................................................................................................................................$4.4.4 Disa*'" r"sourc" monitoring..........................................................................................................................$54.4. 8pdat" od" data manua''+...........................................................................................................................$5
4.4. ho# r"sourc" consumption data..................................................................................................................304. Monitoring...................................................................................................................................... 3$
4..1 na*'ing / Disa*'ing........................................................................................................................................3$4..$ Ch"c: od" manua''+....................................................................................................................................3$4..3 Indi!idua' #arning thr"sho'd for fi'"s+st"ms datas"ts and s#ap usag".......................................................334..4 Indi!idua' ?=arg"t 6ath Count? for a nod".......................................................................................................334.. Disp'a+ Fi'"s+st"m usag"...............................................................................................................................344.. Disp'a+ Datas"t usag"...................................................................................................................................34..2 Disp'a+
-
7/29/2019 VDCF Monitoring
4/44
JomaSoft GmbHFalkensteinstr. 54a
9000 St. GallenSwitzerland
1 Introduction
=his docum"ntation d"scri*"s th" Monitoring f"atur"s of th" Virtua' Datac"nt"r C'oud Fram"#or: ,VDCFfor th" o'aris p"rating +st"m and "Ap'ains ho# to us" this f"atur"s.
See these documents for more information about the related VDCF products:
VDCF Administration Guide for information a*out VDCF usag"
1.1 Overview
VDCF Monitoring is a VDCF nt"rpris" "At"nsion a!ai'a*'" to VDCF tandard/nt"rpris"/%& custom"rs.
=his "At"nsion consists of fi!" s"parat" compon"ntsB
- %ard#ar" Monitoring ,h#mon to d"t"ct hard#ar" fai'ur"s- ("sourc" Monitoring ,rcmon to co''"ct and disp'a+ r"sourc" usag" of g'o*a' and 'oca' o'aris 9on"s- %igh &!ai'a*i'it+ ,%& Monitoring ,hamon to automatica''+ fai'o!"r if a data c"nt"r or s"r!"r fai's- p"rating +st"m Monitoring ,osmon to "na*'" a'"rts #h"n fi'"s+st"ms datas"ts s#ap MF s"r!ic"s and dis: paths r"ach critica' r"sourc" usag" or stat"- VDCF Dash*oard #"* app'ication
-
7/29/2019 VDCF Monitoring
5/44
JomaSoft GmbHFalkensteinstr. 54a
9000 St. GallenSwitzerland
1.3 High Availability HA! Monitoring
=h" VDCF %igh &!ai'a*i'it+ f"atur" is us"d to monitor th" h"a'th of od"s. If a fai'"d od" is disco!"r"dth" od" ma+ *" stopp"d and/or th" od" "!acuation 'ogic is ca''"d to fai'o!"r a'' !"r!"rs to oth"rod"s. =his "!acuation is *as"d on r"sourc" usag" information to a!oid o!"r'oading th" r"mainingod"s.
=his so'ution is position"d *"t#""n manua' fai'o!"r initiat"d *+ a +st"m &dministrator and a fu''-f"atur"dfai'o!"r so'ution using C'ust"r soft#ar". =his VDCF %& f"atur" is a*'" to hand'" th" t+pica' od" fai'ur"s'i:" *oot dis: issu"s n"t#or: outag"s p'atform "rrors 'i:" C68 m"mor+ pro*'"ms or po#"r supp'+fai'ur"s. =h" goa' is to :""p this so'ution as simp'" and usa*'" as possi*'" th"r"for" it do"sn?t r")uir"c'ust"r int"rconn"cts *"t#""n th" od"s and it do"sn?t ch"c: and hand'" issu"s #ith & conn"ctions'i:" a C'ust"r soft#ar" do"s.
1.3.1 "om#onents
=h" %& monitor is *ui't from s"!"ra' compon"ntsB
ach od" participating has a da"mon ,MF s"r!ic" !dcf:""pa'i!" insta''"d that ca''s p"riodica''+ intoth" manag"m"nt s"r!"r. =h"s" :""p-a'i!" m"ssag"s ar" stor"d #ithin th"/var/opt/jomasoft/vdcf/keepalive dir"ctor+.
=h" s"cond compon"nt is th" monitoring da"mon ,hamon#atchd on th" VDCF manag"m"nt s"r!"r.=his da"mon consists of t#o proc"ss"s. n" ,hamonmonitord is us"d to monitor for :""p-a'i!"m"ssag"s at th" int"r!a' of %&M;6&>IVI=(V&> s"conds from a'' participating od"s. =h"s"cond proc"ss ,hamonch"c:d is us"d to ch"c: and act upon a fai'"d od" #as d"t"ct"d.
1.3.2 $ode %ailure detection
& od" is consid"r"d as fai'"d if th" fo''o#ing ru'"s ar" m""t- no :""p-a'i!" m"ssag"s ar" r"c"i!"d #ithin th" d"fin"d thr"sho'd (HAMON_KEEP_ALIVE_ACION_HOL!" - a ssh conn"ction from VDCF to th" od" fai's- od"?s s+st"m contro''"r / conso'" do"s not r"spond or od" is at th" ; prompt or po#"r"d off
&n optiona' n"t#or: pro*ing ru'" ma+ *" acti!at"d *+ s"tting HAMON_CHECK_NE#O$K_P$O%E&'tr)e*If th" od" s+st"m contro''"r is not r"acha*'" th" r"ason ma+ *" n"t#or:-r"'at"d or th" od" has nopo#"r at a''. If this s"tting is tru" VDCF tri"s to conn"ct to configur"d int"rm"diat" n"t#or: ")uipm"nt. Ifth" n"t#or: ")uipm"nt is r"acha*'" VDCF consid"rs its n"t#or: conn"ction as good and th"r"for th"od"s as fai'"d.
For mor" d"tai's a*out this fai'ur" d"t"ction consu't th" &pp"ndiA 4.1 od" fai'ur" d"t"ction d"tai's.
as"d on th" d"scription a*o!" th" VDCF %& monitor is a*'" to d"t"ct th" fo''o#ing fai'ur"sB- comp'"t" hard#ar" fai'ur" of th" od"- accid"nta''+ shutdo#n of od" *+ a +st"m &dministrator- fai'ur" of n"t#or: int"rfac"s of th" od"
=h" fo''o#ing fai'ur"s ar" d"t"ct"d if n"t#or: pro*ing is acti!at"d and prop"r configur"dB- comp'"t" po#"r-fai'ur" of th" od" ,s+st"m contro''"r not r"acha*'"- comp'"t" data c"nt"r fai'ur" as 'ong as th" n"t#or: is sti'' r"acha*'" ,d"p"nds on configuration
=h" fo''o#ing fai'ur"s ar" $O&d"t"ct"dB- fai'ur" or config issu"s of & compon"nts- comp'"t" data c"nt"r fai'ur" if th" n"t#or: is aff"ct"d ,d"p"nds on configuration
- accid"nta''+ n"t#or: int"rfac" miss configuration *+ a +st"m &dministrator
For s"tting up and to configur" +our %& "n!ironm"nt consu'ting s"r!ic"s from Eomaoft ar" a!ai'a*'".
[email protected] VDCF - Monitoring 3.0 / 44
-
7/29/2019 VDCF Monitoring
6/44
JomaSoft GmbHFalkensteinstr. 54a
9000 St. GallenSwitzerland
1.3.3 $ode 'vacuation sequence
If od" !acuation is configur"d a'' !"r!"rs of a fau't"d od" ar" "!acuat"d ,fai'"d o!"r to oth"r acti!"od"s in th" sam" comput"poo'. =h" proc"dur" to d"t"ct th" possi*'" targ"t od"s 'oo:s as fo''o#sB
1. For "ach !"r!"r #" g"t a 'ist of candidat" od"s ,using vserver ,c s-o. cadidates.$. as"d on th" r"sourc" usag" data r"port"d from r"sourc" monitoring #" s"'"ct a possi*'" targ"t od"
for "ach !"r!"r.3. "caus" th" sourc" od" isn?t r"acha*'" an+mor" #" do a !s"r!"r d"tach forc".4. =h"n #" tr+ to attach and *oot th" !"r!"r on th" n"# od".. If attach has fai'"d #" tr+ th" sam" proc"dur" on th" n"At possi*'" targ"t od" unti' a'' !"r!"rs ar""!acuat"d or no mor" targ"t od"s ar" '"ft.
8pgrad" on attach is support"d *+ s"tting th" !a'u" HAMON_EVAC0AE_0P1$A!E to tru" in th"
customi9".cfg fi'".
=h" s")u"nc" of th" !"r!"r migration is ord"r"d *+ th" !"r!"r cat"gor+ and/or priorit+. ""configuration it"ms for mor" d"tai's.
=h" fo''o#ing pictur" i''ustrat"s th" migrations if th" M000 in Data C"nt"r 1 fai's.
=h" od" !acuation can *" start"d manua''+ using th" command ode ,c evac)ate.
[email protected] VDCF - Monitoring 3.0 / 44
-
7/29/2019 VDCF Monitoring
7/44
JomaSoft GmbHFalkensteinstr. 54a
9000 St. GallenSwitzerland
1.3.( Requirements
&s th" %& monitor is monitoring th" conso'" and is tr+ing to shutdo#n a fai'"d od" through th" s+st"mcontro''"r it?s r")uir"d to configur" a ?conso'"? for "ach od" #ithin VDCF.
=h" od" "!acuation 'ogic is *as"d on r"sourc" information from ("sourc" Monitoring.&cti!at"d VDCF ("sourc" Monitoring on a'' participating od"s is th"r"for" r")uir"d.
[email protected] VDCF - Monitoring 3.0 2 / 44
-
7/29/2019 VDCF Monitoring
8/44
JomaSoft GmbHFalkensteinstr. 54a
9000 St. GallenSwitzerland
1.( Resource Monitoring
("sourc" Monitoring ma+ *" "na*'"d ,and disa*'"d indi!idua''+ for "ach od". & usag" co''"ctor s"r!ic"is th"n start"d on th" od". =his s"r!ic" is r"cording th" r"sourc" usag" ,C68 and m"mor+ of th" od"and a'' insta''"d !"r!"rs. 6"riodica''+ "ach od" is pushing th" r"cord"d data onto th" VDCFManag"m"nt "r!"r.
& cron jo* ca''"d ?8sag" Data Co''"ctor? on th" Manag"m"nt "r!"r is importing th" co''"ct"d datap"riodica''+ into th" VDCF data*as".
& s"cond cron jo* ?8sag" Data &ggr"gator? is us"d to g"n"rat" aggr"gat"d r"sourc" information.=h" aggr"gat"d data can *" disp'a+"d on a dai'+ #"":'+ month'+ or +"ar'+ *as".
& third cron jo* is start"d / stopp"d tog"th"r #ith th" ?8sag" Data Co''"ctor? cron jo*. =his cron jo* is"!a'uating th" curr"nt a!"rag" r"sourc" usag" of od"s and !"r!"rs in th" 'ast $4 hours.
=his information ma+ *" us"d 'at"r *+ th" %& monitor od" "!acuation f"atur".
1.(.1 Requirements
=h" VDCF ("sourc" Monitoring imp'"m"ntation is *as"d on o'aris 10 /02 ,8pdat" 4 f"atur"s. =o us"this f"atur" th" targ"t od"s must run o'aris 10 /02 or 'at"r. It is support"d to us" an o'd"r o'aris 10("'"as" ,8pdat"1$3 #ith ;"rn"' 6atch 1$0011-14 ,sparc or 1$001$-14 ,i3 or 'at"r.
[email protected] VDCF - Monitoring 3.0 / 44
-
7/29/2019 VDCF Monitoring
9/44
JomaSoft GmbHFalkensteinstr. 54a
9000 St. GallenSwitzerland
1.) O#erating *ystem O*! Monitoring
$ew since +,"- Monitoring 2.2
8sing th" Monitoring +ou can monitor th" fi'"s+st"m usag" of !"r!"rs. =his Monitoring can *""na*'"d/disa*'"d g'o*a''+ on th" VDCF manag"m"nt s"r!"r. + "na*'ing th" Monitor a cron jo* for8s"r root is add"d.
If th" fi'"s+st"m usag" "Ac""ds th" d"fin"d
-
7/29/2019 VDCF Monitoring
10/44
JomaSoft GmbHFalkensteinstr. 54a
9000 St. GallenSwitzerland
2 Installation
2.1 0rerequisites
=h" E!dcf-monitor pac:ag" r")uir"s th" fo''o#ing VDCF pac:ag"s to *" insta''"d on th"VDCF Manag"m"nt "r!"rB- E!dcf-*as" 2.0.0 or 'at"r
2.2 Installation
a sparc p'atform
cd 2do.load,dir3pk4add ,d */5&vdcf,moitor_2versio3_sparc*pk4
* i3 p'atform
cd 2do.load,dir3pk4add ,d */5&vdcf,moitor_2versio3_i678*pk4
[email protected] VDCF - Monitoring 3.0 10 / 44
-
7/29/2019 VDCF Monitoring
11/44
JomaSoft GmbHFalkensteinstr. 54a
9000 St. GallenSwitzerland
3 "on%iguration
3.1 ranting ser Access
=h" VDCF Monitoring pac:ag" introduc"s thr"" n"# (&C 6rofi'"sB- VDCF h#monitor Modu'"G for th" %ard#ar" and ("sourc" Monitoring- VDCF hamonitor Modu'"G for th" %& Monitoring and- VDCF osmonitor Modu'"G for th" Monitoring f"atur".
&ssign th"s" (&C profi'"s to +our admin us"rs.
3.2 "ustomiing Monitoring eMail
3.2.1 Alarming
=h" %ard#ar" Monitoring and Monitoring ar" a*'" to s"nd "-Mai's if a %ard#ar" fau't is d"t"ct"d or a Monitor thr"sho'd is r"ach"d.
=o "na*'" this f"atur" +ou ha!" to s"t th" fo''o#ing !aria*'"s in VDCF?s customi9".cfgB
e9port H#MON_EVEN'tr)ee9port O&MON_EVEN'tr)ee9port MONIO$_EVEN_EMAIL_LI&':)ser;
-
7/29/2019 VDCF Monitoring
12/44
JomaSoft GmbHFalkensteinstr. 54a
9000 St. GallenSwitzerland
3.3 "ustomiing Hardware Monitoring
3.3.1 "hec4 Interval
+ d"fau't th" %ard#ar" Monitoring cronjo* is "A"cut"d onc" an hour to ch"c: th" stat" of a'' od"s.
Hou ma+ disp'a+ th" curr"nt s"tting #ith this commandB
@ -.mo ,c stat)s Cetral Moitor Compoet &tat)s H# Moitor eaBled
Cetral Moitor Compoet imespec CrotaB timespec for H# Moitor ;D
V!C? Cofi4)ratio VariaBles H#MON_EVEN tr)e MONIO$_EVEN_EMAIL_?$OM s)pport
-
7/29/2019 VDCF Monitoring
13/44
JomaSoft GmbHFalkensteinstr. 54a
9000 St. GallenSwitzerland
3.( "ustomiing High Availability HA! Monitoring
3.(.1 5ee# Alive Interval
&t "ach %&M;6&>IVI=(V&> ,d"fau'tB 0 s"conds th" od" is posting a :""p-a'i!"m"ssag" to th" Manag"m"nt "r!"r.
3.(.2 6arning &hreshold
&ft"r a num*"r of missing :""p-a'i!" m"ssag"s ,%&M;6&>IVD ,d"fau't 10 an"-Mai' is s"nt if r")u"st"d. D"fin" +our "-Mai' addr"ss"s as fo''o#sB
e9port HAMON_EVEN_EMAIL_LI&':)ser;IV&C=I=%>D ,d"fau't $0 int"r!a'sno :""p-a'i!" m"ssag" has *""n post"d.
Hou ma+ disp'a+ th" curr"nt s"tting #ith th" status commandB
@ -amo ,c stat)s HA Moitor Iformatio Iterval 8Fs #ari4 -res-old ;F Actio -res-old >F #atc- !aemo disaBled
V!C? Cofi4)ratio VariaBles MONIO$_EVEN_EMAIL_?$OM s)pport
-
7/29/2019 VDCF Monitoring
14/44
JomaSoft GmbHFalkensteinstr. 54a
9000 St. GallenSwitzerland
3.(. v*erver target detection
First of a'' +ou ha!" to cat"gori9"/prioriti9" +our !"r!"r using th" vserver ,c modif=command.Hou ma+ us" cat"gori"s to id"ntif+ important or '"ss important !"r!"rs and th" priorit+ to ord"r #ithin acat"gor+. !"r!"rs #ith 6riorit+ 1 ar" "!acuat"d first th"n 6riorit+ $ ...
=h"n customi9" th" "!acuation !aria*'"s in +our customi9".cfg.8s" VI(=8&>V&C8&=IC&=7(H(D( to id"ntif+ th" most important cat"gori"s to *"migrat"d first. Id"ntif+ cat"gori"s #hich +ou don?t #ant to "!acuat" at a'' inVI(=8&>V&C8&=II7(C&=7(I.
+ d"fau't C68har" r"sourc" d"finitions ar"n?t us"d for targ"t od" d"t"ction. "t th"DV&C8&=I8C68%&( to ?tru"? to "na*'" a ch"c: if th" targ"t od" has "noughfr"" C68har"s a!ai'a*'".
3.(.7 v*erver shutdown on target $odes
$ew since +,"- Monitoring 2.
Hour targ"t od"s ma+ not ha!" "nough fr"" r"sourc"s for th" "!acuat"d !"r!"rs. In such"n!ironm"nts +ou can d"fin"d th" Cat"gori"s for '"ss important !"r!"rs #hich VDCF can shutdo#n tofr"" r"sourc"s. =h" !"r!"rs ar" shutdo#n on'+ #h"n r")uir"d and ord"r"d *+ th" !"r!"r 6riorit+.
D"fin" th" Cat"gori"s in VI(=8&>V&C8&=I%8=D
-
7/29/2019 VDCF Monitoring
15/44
JomaSoft GmbHFalkensteinstr. 54a
9000 St. GallenSwitzerland
3.(.9 Other recommended settings
=h" fo''o#ing ar" r"comm"nd"d s"ttings. 6'"as" s"t th"s" in th" customi9".cfg fi'"B
e9port HAMON_EVEN_EMAIL_LI&':)ser;
-
7/29/2019 VDCF Monitoring
16/44
JomaSoft GmbHFalkensteinstr. 54a
9000 St. GallenSwitzerland
3.) "ustomiing Resource Monitoring
Hou ma+ customi9" som" asp"cts of th" r"sourc" monitoring *+ o!"r#riting this VDCF !aria*'"s using th"customi9".cfg.
3.).1 sage interval
DD :
e9port MONIO$_A11$_INE$VAL':F 8 :e9port C0$$EN_$E&_0&A1E_0P!AE_INE$VAL':F >6 :
If r"sourc" monitoring #as a'r"ad+ "na*'"d *"for" +ou ha!" to r"-"na*'" th" cron jo*s using t"ese!ommands. ?#"e *4" a/era'e !ron @ob is !ontrolled to'et"er wit" t"e !olle!tor !ron @obA2
@ rcmo ,c disaBle a44re4ator@ rcmo ,c eaBle a44re4ator
@ rcmo ,c disaBle collector@ rcmo ,c eaBle collector
[email protected] VDCF - Monitoring 3.0 1 / 44
-
7/29/2019 VDCF Monitoring
17/44
JomaSoft GmbHFalkensteinstr. 54a
9000 St. GallenSwitzerland
3. "ustomiing O* Monitoring
3..1 "hec4 Interval
+ d"fau't th" Monitoring cronjo* is "A"cut"d onc" an hour to ch"c: th" usag" and stat"s offi'"s+st"ms datas"ts s#ap usag" and MF s"r!ic"s.
Hou ma+ disp'a+ th" curr"nt s"tting #ith this commandB
@ osmo ,c stat)s Cetral Moitor Compoet &tat)s O& Moitor eaBled
Cetral Moitor Compoet imespec CrotaB timespec for O& Moitor 6F
V!C? Cofi4)ratio VariaBles O&MON_EVEN tr)e MONIO$_EVEN_EMAIL_?$OM s)pport
-
7/29/2019 VDCF Monitoring
18/44
JomaSoft GmbHFalkensteinstr. 54a
9000 St. GallenSwitzerland
3..3 Alarming
=h" Monitor #i'' s"nd V(I7G to th" MK6>=&=FI=(=
- MF "r!ic"s r"ach a critica' stat" ,d"grad"d or maint"nanc"
- M6AI dis:s fai' to r"ach th" d"fin"d =arg"t 6ath Count
3..( O* *ecurity "om#liance benchmar4s
o'aris 11.3 inc'ud"s 3 pr"d"fin"d standard *"nchmar:s ?*as"'in"? ?r"comm"nd"d? and ?pci-dss?.VDCF d"'i!"rs additiona' tai'orings nam"d ?d"fau't? and ?cdom? *oth *as"d on th" ?*as"'in"? *"nchmar:.=h"s" tai'orings ar" stor"d in this configuration dir"ctor+B
@ ls ,l /var/opt/jomasoft/vdcf/cof/compliace/*tailor,r.,r,,r,, ; root root ;6; &ep ;; ;D6; cdom*tailor,r.,r,,r,, ; root root ;6>; &ep ;; ;D6; defa)lt*tailor
Custom"rs can d"fin" additiona' *"nchmar:s *+ cop+ing and modif+ing th" tai'or fi'"s.For s+st"m indi!idua' *"nchmar:s th" fi'"s can *" nam"d Lvserver3*tailoror Lode3*tailor.
3..) O* *ecurity hardening #ro%iles
8s" th" ?nod" -c hard"n h"'p? command to g"t a 'ist of a!ai'a*'" hard"ning ru'"s and th" a!ai'a*'"
hard"ning profi'"s. Hou can cr"at" +our o#n hard"ning profi'"s matching +our s"curit+ guid"'in"s.
=h" hard"ning profi'"s must *" stor"d inB
@ ls ,l /var/opt/jomasoft/vdcf/cof/compliace/*-ardei4,r.,r,,r,, ; root ot-er D7 Oct >6 ;>> Baselie*-ardei4
[email protected] VDCF - Monitoring 3.0 1 / 44
-
7/29/2019 VDCF Monitoring
19/44
JomaSoft GmbHFalkensteinstr. 54a
9000 St. GallenSwitzerland
3.7 "ustomiing +,"- ,ashboard web a##lication
3.7.1 Initial setu#
VDCF dash*oard is a p+thon *as"d #"* app'ication. Int"grat"d into +our &pach" http $.$ s"r!"r.=o s"tup th" &pach" "r!"r config +ou ha!" to run this command onc"B
/opt/jomasoft/vdcf/mods/set)p/set)p_4)i ,p 2apac-e -ttps port3 Creati4 self,si4ed est Certificate QCofi4)ri4 apac-e .eB server QApac-e restarted s)ccessf)ll=* V!C? das-Board is read= o t-is 0$L-ttps//=o)rserver6
=h" #"* app'ication r")uir"s us"r auth"ntication. 8s"rs ar" auth"nticat"d against th"ir 'oca' o'aris 8s"r
&ccount. For s"curit+ r"asons th" #"* app'ication is running >-"na*'"d.
&he setu# scri#t con%igures A#ache with a sel%:signed test server certi%icate; 0lease re#lace it by avalid server certi%icate. &he certi%icate is con%igured in this a#ache %ile/>*>/cof*d/vdcf_dja4o_-ttpd_>>*cof&&LCertificate?ile /var/opt/jomasoft/vdcf/cof/apac-e,cert/das-Board*crt&&LCertificateKe=?ile /var/opt/jomasoft/vdcf/cof/apac-e,cert/das-Board*ke=
3.7.2 +,"- user %or the web a##lication
=h" #"* app'ication is using th" r"ad-on'+ !dcf us"r vdcf4)ito acc"ss th" VDCF r"positor+.
8sing th" VDCF !poo' command +ou can d"fin" #hat data +ou #ant to sho# to !dcfgui us"r and i.".disp'a+ in th" VDCF dash*oard.
3.7.3 -irewall Rules
If +our s+st"m "n!ironm"nt contains fir"#a''s +ou ma+ ha!" to add a fir"#a'' ru'" to acc"ss th" #"*s"r!"ron th" VDCF manag"m"nt "r!"rB
VDCFManag"m"nt "r!"r
Dir"ction ro#s"r C'i"nt Comm"nt
-
7/29/2019 VDCF Monitoring
20/44
JomaSoft GmbHFalkensteinstr. 54a
9000 St. GallenSwitzerland
( sage
(.1 Hardware Monitoring
na*'ing / Disa*'ing
=h" hard#ar" monitoring f"atur" can *" "na*'"d/disa*'"d g'o*a''+.
@ -.mo ,c eaBle@ -.mo ,c disaBle
8s" th" status command to disp'a+ th" curr"nt stat" of hard#ar" monitoringB
@ -.mo ,c stat)s
Cetral Moitor Compoet &tat)s H# Moitor eaBled
Cetral Moitor Compoet imespec CrotaB timespec for H# Moitor ;D
V!C? Cofi4)ratio VariaBles H#MON_EVEN tr)e MONIO$_EVEN_EMAIL_?$OM s)pportocator >D as "ith"r on or offB
@ -.mo ,c s-o._locator ode'2ode ame3Locator led is O??
=urns th" 'ocator >D onB
@ -.mo ,c set_locator ode'2ode ame3
=urns th" 'ocator >D offB
@ -.mo ,c clear_locator ode'2ode ame3
[email protected] VDCF - Monitoring 3.0 $0 / 44
-
7/29/2019 VDCF Monitoring
21/44
JomaSoft GmbHFalkensteinstr. 54a
9000 St. GallenSwitzerland
(.1.3 ,is#lay Hardware state
8sing th" sho# op"ration an o!"r!i"# a*out a'' od"s is disp'a+"d.
@ -.mo ,c s-o.
C)rret Hard.are &tateNode Model Cosole &oft &tate H# &tate Last C-a4e Last 0pdate Mo**sFFF6 &0N#&),?ire,;FFF ALOMCM P#$,O?? OK >F;6,F,>> >F;6,F,>> ONsFF> O$CL&PA$C,,; ILOM O&,$0N OK >F;>,F8,F >F;6,F,>6 ON
8sing th" od" attri*ut" and/or !"r*os" f'ag th" stat" histor+ and d"tai's from th" s+st"m contro''"r issho#n.
@ -.mo ,c s-o. ode'sFFF6
C)rret Hard.are &tateNode Model Cosole &oft &tate H# &tate Last C-a4e Last 0pdate Mo**sFFF6 &0N#&),?ire,;FFF ALOMCM P#$,O?? OK >F;6,F,>> >F;6,F,>> ON
&tate C-a4e Histor= Node &oft &tate H# &tate Evet !ate sFFF6 O&,$0N OK >F;F,F7,;7 FJ;DF; sFFF6 P#$,O?? OK >F;F,FD,>D ;;DF>
@ -.mo ,c s-o. ode'sFFF6 verBose
C)rret Hard.are &tate
Node Model Cosole &oft &tate H# &tate Last C-a4e Last 0pdate Mo**sFFF6 &0N#&),?ire,;FFF ALOMCM P#$,O?? OK >F;6,F,>> >F;6,F,>> ON
&tate C-a4e Histor= Node &oft &tate H# &tate Evet !ate sFFF6 O&,$0N OK >F;F,F7,;7 FJ;DF; sFFF6 P#$,O?? OK >F;F,FD,>D ;;DF>
&=stem Locator &tat)s Locator led is O??
&=stem &pecific &tat)s Iformatios
''''''''''''''' Evirometal &tat)s '''''''''''''''
,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,
&=stem emperat)res (emperat)res i Celsi)s"
,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,
&esor &tat)s emp Lo.Hard Lo.&oft Lo.#ar Hi4-#ar Hi4-&oft Hi4-Hard
,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,
M%/_AM% OK > ,;F ,D F D DF DD
M%/CMPF/_CO$E OK F ,;F ,D F 7D JF JD
M%/CMPF/_%CO$E OK 6J ,;F ,D F 7D JF JD
M%/IO%/_CO$E OK 6 ,;F ,D F JD ;FF ;FD
,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,
&=stem Idicator &tat)s ,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,
&G&/LOCAE &G&/&E$VICE &G&/AC
O?? O?? ON
[email protected] VDCF - Monitoring 3.0 $1 / 44
-
7/29/2019 VDCF Monitoring
22/44
JomaSoft GmbHFalkensteinstr. 54a
9000 St. GallenSwitzerland
,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,
,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,
?as (&peeds $evol)tio Per Mi)te"
,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,
&esor &tat)s &peed #ar Lo.
,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,
?F/?F OK J;88 >>F ;J>F
?F/?; OK 78 >>F ;J>F
?F/?> OK 7J8 >>F ;J>F
?F/?6 OK 7J8 >>F ;J>F
,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,
Volta4e sesors (i Volts"
,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,
&esor &tat)s Volta4e Lo.&oft Lo.#ar Hi4-#ar Hi4-&oft
,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,
M%/V_VCO$E OK ;*6> ;*>F ;*> ;*68 ;*6J
M%/V_VMEM OK ;*7 ;*8J ;*> ;*7 ;*JF
M%/V_V OK F*7 F*7 F*78 F*J6 F*JD
M%/V_S;V> OK ;*;7 ;*FJ ;*;; ;*>7 ;*6F
M%/V_S;VD OK ;*7 ;*68 ;*6J ;*8F ;*86
M%/V_S>VD OK >*DF >*> >*6> >*8 >*>
M%/V_S6V6 OK 6*>J 6*F8 6*;F 6*J 6*D6
M%/V_SDV OK *JJ *DD *8D D*6D D*D
M%/V_S;>V OK ;>*;7 ;F*J> ;;*;8 ;>*7 ;6*F7
M%/V_S6V6&%G OK 6*6; 6*;6 6*;8 6*D6 6*DJ
,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,
&=stem Load (i amps"
,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,
&esor &tat)s Load #ar &-)tdo.
,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, M%/I_VCO$E OK >6*68F 7F*FFF 77*FFF
M%/I_VMEM OK 8*>F 8F*FFF 88*FFF
,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,
,,,,,,,,,,,,,,,,,,,,,,
C)rret sesors
,,,,,,,,,,,,,,,,,,,,,,
&esor &tat)s
,,,,,,,,,,,,,,,,,,,,,,
M%/%A/V_%A OK
,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,
Po.er &)pplies ,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,
&)ppl= &tat)s 0derspeed Overtemp Overvolt 0dervolt Overc)rret
,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,
P&F OK O?? O?? O?? O?? O??
Last PO& r) #E! A01 ;7 FDD>>F >F;F
PO& stat)s Passed all devices
No fail)res fo)d i &=stem
[email protected] VDCF - Monitoring 3.0 $$ / 44
-
7/29/2019 VDCF Monitoring
23/44
JomaSoft GmbHFalkensteinstr. 54a
9000 St. GallenSwitzerland
(.1.( "lear hardware state history
& histor+ r"cord is g"n"rat"d for "!"r+ hard#ar" stat" chang" disco!"r"d *+ th"p"riodica' ,or manua''+ initiat"d s+st"m ch"c:.
=o c'"ar a'' histor+ r"cords of a od"B
@ -.mo ,c clear_-istor= ode'2ode ame3
[email protected] VDCF - Monitoring 3.0 $3 / 44
-
7/29/2019 VDCF Monitoring
24/44
JomaSoft GmbHFalkensteinstr. 54a
9000 St. GallenSwitzerland
(.2 *erver 0ower sage
$ew since +,"- Monitoring 2.
=h" actua' 8sag" ,ogfi'"B@ tail ,f /var/opt/jomasoft/vdcf/lo4/-.mo_po.er*lo4
;8FJ>F;8 ;;> LO1 Po.er0sa4e c-a4e discovered for ode sFF> old )sa4e 6; #atts e. )sa4e 6; #atts
;8FJ>F;8 ;;>D LO1 Po.er0sa4e c-a4e discovered for ode sFFFJ old )sa4e >;6 #atts e. )sa4e F #atts
;8FJ>F;8 ;;> LO1 Po.er0sa4e c-a4e discovered for ode sFF;6 old )sa4e 8> #atts e. )sa4e 8D #atts
[email protected] VDCF - Monitoring 3.0 $4 / 44
-
7/29/2019 VDCF Monitoring
25/44
JomaSoft GmbHFalkensteinstr. 54a
9000 St. GallenSwitzerland
(.3 High Availability HA! Monitoring
(.3.1 'nabling ? ,isabling
=h" %& monitoring f"atur" can *" "na*'"d/disa*'"d g'o*a''+.
@ -amo ,c eaBle daemo@ -amo ,c disaBle daemo
=h"n "ach participating od" has to *" "na*'"d tooB
@ -amo ,c eaBle ode'2ode ame3@ -amo ,c disaBle ode'2ode ame3
6'"as" notic" that on'+ non-c'ust"r od"s ma+ *" "na*'"d for %& monitoring.
#o dis&la( t"e stats of H monitorin' se t"is !ommand2
@ -amo ,c stat)s
HA Moitor Iformatio Iterval 8Fs #ari4 -res-old ;F Actio -res-old >F #atc- !aemo disaBled
V!C? Cofi4)ratio VariaBles MONIO$_EVEN_EMAIL_?$OM s)pport
-
7/29/2019 VDCF Monitoring
26/44
JomaSoft GmbHFalkensteinstr. 54a
9000 St. GallenSwitzerland
(.3.2 ,is#lay $ode *tate
8sing th" sho# op"ration an o!"r!i"# a*out a'' od"s is disp'a+"d.
@ -amo ,c s-o.
Node Mo &tate Ops &tate !ate !etailssFFF6 ON P$O%IN1 >F;;,F>,;8 ;867 ormal operatiosFFFJ ON P$O%IN1 >F;;,F>,;8 ;86>6 ormal operatiosFF;F ON P$O%IN1 >F;;,F>,;8 ;867;J ormal operatiosFFF ?A0L , >F;;,F>,;8 ;8D>> cosole did ot respod /ot po.ered off
ach od" has a Mon,itoring tat" #hich is inf'u"nc"d *+ th" +st"m &dministrator using hamonop"rations and *+ th" VDCF %& monitor.
=h" fo''o#ing diagram "Ap'ains th" possi*'" stat"s and actionsB
[email protected] VDCF - Monitoring 3.0 $ / 44
-
7/29/2019 VDCF Monitoring
27/44
JomaSoft GmbHFalkensteinstr. 54a
9000 St. GallenSwitzerland
(.3.3 *us#ending $odes
=o a!oid unn"c"ssar+ fai'o!"rs it is r")uir"d to susp"nd th" od" from Monitoring if Maint"nanc" is don"on th" od". usp"nd th" od" *"for" +ou shutdo#n th" od" for "Aamp'" to add mor" M"mor+.
@ -amo ,c s)sped ode'sFFF6HA moitor s)speded o Node sFFF6
@ -amo ,c s-o. ode'sFFF6 Node Mo &tate Ops &tate !ate !etailssFFF6 &0&P , >F;;,F>,;8 ;8D;J ,
@ -amo ,c res)me ode'sFFF6HA moitor res)med for Node sFFF6
@ -amo ,c s-o. ode'sFFF6 Node Mo &tate Ops &tate !ate !etailssFFF6 ON P$O%IN1 >F;;,F>,;8 ;8D66 ormal operatio
(.3.( -allbac4 a%ter 'vacuation
8sing th" VDCF r"comm"nd"d s"ttings if a od" fai's th" !"r!"rs ar" "!acuat"d and th" od" is s"tto stat" I&C=IV. =his is don" to a!oid usag" of that od" for n"# !"r!"rs.
Hou *oot th" od" #h"n th" issu"s that caus"d th" od" to fai' ar" so'!"d =h" %& Monitoring is th"nr"-acti!at"d automatica''+. =o us" th" od" for !"r!"rs again +ou n""d to acti!at" th" od" againB
@ ode ,c activate ame'm=ode
=h" !"r!"rs ar" = automatica''+ migrat"d *ac: to th" od". Hou n""d to migrat" th" !"r!"rsmanua''+ *ac: to +our od" using th" migrat" op"ration.
@ vserver ,c mi4rate ame'm=vserver ode'm=ode s-)tdo.
[email protected] VDCF - Monitoring 3.0 $2 / 44
-
7/29/2019 VDCF Monitoring
28/44
JomaSoft GmbHFalkensteinstr. 54a
9000 St. GallenSwitzerland
(.( Resource Monitoring
(.(.1 'nable resource monitoring
=h" r"cording of r"sourc" usag" information ma+ *" acti!at"d indi!idua''+ for "ach od". + "na*'ing aod" a usag"co''"ct s"r!ic" is start"d on th" od". &ft"r th" d"fin"d int"r!a',MONIO$_ONE_0&A1E_INE$VAL" a usag" r"cord is sa!"d 'oca''+ on th" od". &ft"r a d"fin"dnum*"r of r"cords ,MONIO$_ONE_0&A1E_!ELIVE$G" ar" sa!"d th" usag"co''"ct s"r!ic" transf"rsth" data to th" VDCF manag"m"nt s"r!"r.
=o "na*'" usag" co''"ction on od"s us" this commandB
@ rcmo ,c eaBle ode'2ode ame3 R ode all
=o disp'a+ th" status of r"sourc" monitoring for a'' od"s us" this commandB
@ rcmo ,c stat)s ode Cetral Moitor Compoet &tat)s 0sa4e !ata Collector eaBled 0sa4e !ata >- avera4e eaBled 0sa4e !ata A44re4atio eaBled
Node Moitor Compoet &tat)s 0sa4e !ata Collectio o sFFF> eaBled 0sa4e !ata Collectio o sFFF6 eaBled
(.(.2 sage "ollector
=h" usag" data transf"rr"d from th" od"s is import"d p"riodica''+ into th" VDCF r"positor+ using th"?8sag" Data Co''"ctor? cron jo*.
Hou "na*'" this co''"ctor usingB
@ rcmo ,c eaBle collector
B"en enablin' t"e !olle!tor a frt"er !ron @ob is enabled2 #"e sa'e Data *4" a/era'e !ron @ob is asmmar( fn!tion to !al!late t"e a/era'e resor!e sa'e of all odes and /Ser/ers in t"e last *4 "ors.
#o dis&la( t"at a/era'e data se t"e rcmo ,c s)mmar= !ommand.
(.(.3 sage Aggregator
=o a!oid using up too much spac" on th" VDCF manag"m"nt s"r!"r VDCF off"rs a ?8sag" Data&ggr"gation?. =his cron jo* aggr"gat"s o'd data.
@ rcmo ,c eaBle a44re4ator
8sag" r"cords o'd"r than a #"": ar" aggr"gat"d to a r"cord p"r hour.
8sag" r"cords o'd"r than a month ar" aggr"gat"d to a r"cord p"r da+.
[email protected] VDCF - Monitoring 3.0 $ / 44
-
7/29/2019 VDCF Monitoring
29/44
JomaSoft GmbHFalkensteinstr. 54a
9000 St. GallenSwitzerland
(.(.( ,isable resource monitoring
am" proc"dur" as for "na*'ing th" r"sourc" monitoring compon"nts
Disa*'" co''"ction on od"sB
@ rcmo ,c disaBle ode'2ode ame3 R ode all
Disa*'" 8sag" Data Co''"ctorB
@ rcmo ,c disaBle collector
Disa*'" 8sag" Data &ggr"gationB
@ rcmo ,c disaBle a44re4ator
(.(.) #date $ode data manually
Hou ma+ r")u"st an updat" of th" data*as" #ith th" n"#"st usag" data a!ai'a*'".
=his command r"starts th" usag" co''"ctor s"r!ic" on th" od" and transf"rs *ac: th" curr"nt usag" datafi'" to th" VDCF manag"m"nt s"r!"r. Fo''o#"d *+ an import into th" VDCF r"positor+.
@ rcmo ,c )pdate ode'2ode ame3 R ode all
[email protected] VDCF - Monitoring 3.0 $5 / 44
-
7/29/2019 VDCF Monitoring
30/44
JomaSoft GmbHFalkensteinstr. 54a
9000 St. GallenSwitzerland
(.(. *how resource consum#tion data
=o sho# th" co''"ct"d usag" information for a !"r!"r or a od" us" th" sho# op"ration.
rcmo ,c s-o. cp) R memor= R memor=_e9teded -o)rl= R dail= R mot-l= R =earl= server'2server ame3 verBose
4T_total R 4Tt
rcmo ,c s-o. cp) R memor= R memor=_e9teded from'2time,spec3 server'2server ame3 to'2time,spec3
a44r'2a44r,spec3 verBose 4T_total R 4Tt
For "Ap'anation of th" command f'ags and output p'"as" s"" manpag" ?rcmon -% sho#? for d"tai'"dinformation. om" "Aamp'"sB
=h" fo''o#ing command 'ists th" a!ai'a*'" C68 usag" information of th" 'ast hour #ith no furth"raggr"gationB
@ rcmo ,c s-o. server'sF;7F cp) -o)rl=
,,,,,,,,,, Pool ,,,,,,,,,, ,,, Cp)&-r ,, ,,, Cp)&=s ,, ,,, Cp)0sr ,,
,,, Cp)All ,, ,, Cp)&All ,,
!ateime I!/=pe Ma9 C)r All Mi /Av4 /Ma9 Mi /Av4 /Ma9 Mi /Av4 /Ma9Mi /Av4 /Ma9 Mi /Av4 /Ma9 Name
>F;F,F7,>8 ;77;7 6F/priv ;D > 7*6U , ;FFU , , F*FU , , F*FU ,
, F*FU , , F*FU , sF;7F
>F;F,F7,>8 ;7J;J 6F/priv ;D > 7*6U , ;FFU , , F*FU , , F*FU ,
, F*FU , , F*FU , sF;7F
...
=his command 'ists a od"s m"mor+ consumption during th" 'ast month. It inc'ud"s summ"d up r"sourc"!a'u"s of th" g'o*a' and th" non g'o*a' 9on"sB
@ rcmo ,c s-o. server'sFFF6 memor= mot-l= 4Tt
,,,, $amot ,,,,, ,,,, $amKer ,,,, ,,,, $am?ree ,,,, ,,,, $am0se ,,,,,,,,, $am0til ,,,, ,,,,, Vm0se ,,,,, ,,,,, Vm0til ,,,,
!ateime Mi / Av4 / Ma9 Mi / Av4 / Ma9 Mi / Av4 / Ma9 Mi / Av4 / Ma9
Mi / Av4 / Ma9 Mi / Av4 / Ma9 Mi / Av4 / Ma9 Name
>F;F,F,>8 >6DJF , ;J>FM , , ;8>DM , , >M , , DDM ,
, >U , , 68M , , ;7U , sFFF6
>F;F,F,> >6DJ68 , ;J>FM , , ;8>7M , , >6M , , D8M ,
, >U , , 68M , , ;7U , sFFF6
***
[email protected] VDCF - Monitoring 3.0 30 / 44
-
7/29/2019 VDCF Monitoring
31/44
JomaSoft GmbHFalkensteinstr. 54a
9000 St. GallenSwitzerland
=h" fo''o#ing command 'ists th" us"d m"mor+ r"sourc"s of a !"r!"r of th" 'ast hoursB
@ rcmo ,c s-o. server'sF;7F memor= from':,D -o)rs: a44r'-o)r
,,,, $amKer ,,,, ,,,, $am0se ,,,,, ,,,, $am0til ,,,, ,,,,, Vm0se ,,,,,
,,,,, Vm0til ,,,,
!ateime Mi / Av4 / Ma9 Mi / Av4 / Ma9 Mi / Av4 / Ma9 Mi / Av4 / Ma9
Mi / Av4 / Ma9 Name
>F;F,F7,>8 ;DJD; ;8;M ;8;M ;8;DM , 7M , , ;>U , , >M ,
>*FU >*FU >*FU sF;7F
>F;F,F7,>8 ;DDJ6 ;8;M ;8;DM ;8;DM , 7M , , ;>U , , >M ,
>*FU >*FU >*FU sF;7F
>F;F,F7,>8 ;8DJ>6 ;8;DM ;8;DM ;8;8M 7M 7M 7M ;>U ;>U ;>U , >M ,
>*FU >*FU >*FU sF;7F
>F;F,F7,>8 ;DJ6J ;8;DM ;8;8M ;8;7M 7M JM DDM ;>U ;>U ;U >M 6M JM
>*FU >*FU >*6U sF;7F
>F;F,F7,>8 ;7DJ>D ;8;M ;8;M ;8;7M JM JM JM ;>U ;>U ;>U , >M ,, >*FU , sF;7F
>F;F,F7,>8 ;JF ;8;M ;8;7M ;8;7M , JM , , ;>U , , >M ,
, >*FU , sF;7F
8s" this summar+ op"ration to disp'a+ th" a!"rag" r"sourc" usag" data of th" 'ast $4 hours.("su'ts ma+ *" ord"r"d *+ ram cpu or s"r!"r nam" in asc"nding or d"sc"nding ord"r.D"fau't ord"ring is ram d"sc"ndingB
@ rcmo ,c s)mmar= sortke='cp)
>- reso)rce )sa4e avera4e ordered B= cp)/desc
Node otal $AM ?ree $AM otal CP0 ?ree CP0 Last0pdate Commet
sFFF6 87 F (D*>U" 7FF JD (JJ*U" >F;;,;F,;; >6FF>7 &ol ;;
sFFF8 >F7 ;6D (8*8U" 8D7 8;> (J6*FU" >F;;,;>,F8 >6FF>F &ol ;F
sFFFJ ;F> 8;D (8F*;U" ;J6 ;77 (J*U" >F;;,;>,F8 >6FF; %akF;
v&erver 0sed $AM 0sed CP0 CP0 Pool Last0pdate Commet
vF;F >D ; F >F;;,;;,6F >6FF66 E9kl IP im AccessNet
vF;FF DF ; F >F;;,;>,F >6FF;J ?& v&erver
vF;F; DF ; F >F;;,;>,F8 >6FF>F o !iskset
vF;F6 DF ; F >F;;,;>,F8 >6FF>; Virt)al &erver vF;F6
vF;FD DF ; F >F;;,;>,F8 >6FF>6 )fs to Tfs
vF;F8 DF ; F >F;;,;>,F8 >6FF>8 V!C? oe
=h" data sho#n for fr"" ram and fr"" cpu ar" r"duc"d *+ a p"rc"ntag" r"s"r!"d for th" g'o*a' 9on",od". =his r"s"r!"d p"rc"ntag" of th" tota' ram/cpu can *" configur"d using th"s" fram"#or:!aria*'"sB
, Miim)m $AM re)ired/reserved for NO!E i U
e9port $E&O0$CE_NO!E_$AM_MIN';F
, Miim)m CP0 re)ired/reserved for NO!E i U
e9port $E&O0$CE_NO!E_CP0_MIN'F
=h" data of th" summar+ op"ration is a'so us"d *+ th" od" "!acuation f"atur". =h" configur"dp"rc"ntag" is us"d to pr"!"nt o!"r'oading a od" #ith to man+ !"r!"rs.
[email protected] VDCF - Monitoring 3.0 31 / 44
-
7/29/2019 VDCF Monitoring
32/44
JomaSoft GmbHFalkensteinstr. 54a
9000 St. GallenSwitzerland
(.) O* Monitoring
tarting #ith V"rsion 3.0 th" Monitor can *" us"d to monitor- !"r!"r fi'"s+st"ms- MF "r!ic"s- Datas"t for od" and !"r!"r ,inc'uding 'oca' 9fs rpoo's- od" D 7,;7 ;,D
V!C? Cofi4)ratio VariaBles O&MON_EVEN tr)e MONIO$_EVEN_EMAIL_?$OM laB
-
7/29/2019 VDCF Monitoring
33/44
JomaSoft GmbHFalkensteinstr. 54a
9000 St. GallenSwitzerland
(.).3 Individual warning threshold %or %ilesystems@ datasets and swa# usage
Hou can s"t an indi!idua' thr"sho'd for a sp"cific fi'"s+st"m datas"t or nod" s#ap.
=o updat" th" thr"sho'd for a fi'"s+st"m issu" th" fo''o#ing commandB
@ osmo ,c modif=_fs vserver'2vserver3 mo)tpoit'2mo)tpoit3 .arover'2percet3
=o updat" th" thr"sho'd for a datas"t issu" th" fo''o#ing commandB
@ osmo ,c modif=_dataset server'2server ame3 dataset'2dataset3 .arover'2percet3
=o updat" th" thr"sho'd for th" s#ap usag" issu" th" fo''o#ing commandB
@ osmo ,c modif=_s.ap ode'2ode ame3 .arover'2percet3
=o r"mo!" an indi!idua' thr"sho'd us" th" ?r"mo!"#arn? f'agB
@ osmo ,c modif=_fs vserver'2vserver3 mo)tpoit'2mo)tpoit3 remove_.ar
@ osmo ,c modif=_dataset server'2server ame3 dataset'2dataset3 remove_.ar
@ osmo ,c modif=_s.ap ode'2ode ame3 remove_.ar
(.).( Individual >&arget 0ath "ount> %or a node
+ d"fau't th" ?=arg"t 6ath Count? is *as"d on th" tota' configur"d path ,'ist"d *+ mpathadm or from th"
!aria*'" DI;DF&8>=6&=%C8=.Hou can s"t an indi!idua' ?=arg"t 6ath Count? for a sp"cific or a'' >8s assign"d to a nod".
=o updat" th" ?=arg"t 6ath Count? for on" >8 assign"d to a nod" issu" th" fo''o#ing commandB
@ osmo ,c modif=_disk ode'2ode ame3 tar4etco)t'2tar4et pat- co)t3 4)ids'24)idlist3
=o updat" th" ?=arg"t 6ath Count? for a'' >8s assign"d to a nod" issu" th" fo''o#ing commandB
@ osmo ,c modif=_disk ode'2ode ame3 tar4etco)t'2tar4et pat- co)t3 all
[email protected] VDCF - Monitoring 3.0 33 / 44
-
7/29/2019 VDCF Monitoring
34/44
JomaSoft GmbHFalkensteinstr. 54a
9000 St. GallenSwitzerland
(.).) ,is#lay -ilesystem usage
=h" fi'"s+st"m usag" is disp'a+"d on th" !s"r!"r sho# d"tai' command and a 'ist of a'' critica' fi'"s+st"mscan *" disp'a+"d using th" ?osmon -c sho#fs? command.
@ osmo ,c s-o._fs
?iles=stems .it- )sa4e over .ar t-res-old
Node v&erver !ataset Mo)tpoit T$oot =pe &iTe/M% 0sed .ar,over
4FFD; vF;D; vF;D;_root /Toes/vF;D; =es Tfs 2)defied3 ;FFU 7FU (defa)lt"
4FF7F vF;8F vF;8F_root /Toes/vF;8F =es Tfs FJ8 J>U 7FU (defa)lt"
8s" th" summar+ f'ag to disp'a+ additiona''+ a usag" summar+ of th" most uti'i9"d fi'"s+st"ms or th" root
f'ag to on'+ sho# root fi'"s+st"msB
@ osmo ,c s-o._fs s)mmar=
0sed Co)t
;FFU ;
JFU,JJU ;
?iles=stems .it- )sa4e over .ar t-res-old
Node v&erver !ataset Mo)tpoit T$oot =pe &iTe/M% 0sed .ar,over
4FFD; vF;D; vF;D;_root /Toes/vF;D; =es Tfs 2)defied3 ;FFU 7FU (defa)lt"
4FF7F vF;8F vF;8F_root /Toes/vF;8F =es Tfs FJ8 J>U 7FU (defa)lt"
=o !i"# fi'"s+st"ms #ith anoth"r usag" than d"fin"d in ?O&MON_?&_#A$NIN1 ? +ou can gi!" a !a'u"dir"ct'+ on th" command 'in" *+ th" option ?o!"r?.
[email protected] VDCF - Monitoring 3.0 34 / 44
-
7/29/2019 VDCF Monitoring
35/44
JomaSoft GmbHFalkensteinstr. 54a
9000 St. GallenSwitzerland
(.). ,is#lay ,ataset usage
& 'ist of a'' critica' datas"ts can *" disp'a+"d using th" ?osmon -c sho#datas"t? command.
@ osmo ,c s-o._dataset
!atasets .it- critical state fo)d
&erver =pe !ataset !ataset,=pe &tate &iTe/M% 0sed .ar,over
4FF7; Node rpool Node rpool !E1$A!E! /a DFU 7FU (defa)lt"
!atasets .it- )sa4e over .ar t-res-old
&erver =pe !ataset !ataset,=pe &tate &iTe/M% 0sed .ar,over
vF;D v&erver vF;D_root POOL ONLINE D;>F J;U 7FU (defa)lt"
sFF6F Node sFF6F_vBo9 POOL ONLINE D;>FF 77U 7FU (defa)lt"
8s" th" summar+ f'ag to disp'a+ additiona''+ a usag" summar+ of th" most uti'i9"d datas"ts or th" rootf'ag to on'+ sho# od" rootpoo'sB
@ osmo ,c s-o._dataset s)mmar= root
&tate Co)t
!E1$A!E! ;
0sed Co)t
DFU,DJU ;
!atasets .it- critical state fo)d
&erver =pe !ataset !ataset,=pe &tate &iTe/M% 0sed .ar,over
4FF7; Node rpool Node rpool !E1$A!E! /a DFU 7FU (defa)lt"
rpool !atasets .it- )sa4e over .ar t-res-old
&erver =pe !ataset !ataset,=pe &tate &iTe/M% 0sed .ar,over
4FF7D Node rpool Node rpool ONLINE /a D7U DFU
=o !i"# datas"ts #ith anoth"r usag" than d"fin"d in ?O&MON_!AA&E_#A$NIN1? +ou can gi!" a !a'u"dir"ct'+ on th" command 'in" *+ th" option ?o!"r?.
[email protected] VDCF - Monitoring 3.0 3 / 44
-
7/29/2019 VDCF Monitoring
36/44
JomaSoft GmbHFalkensteinstr. 54a
9000 St. GallenSwitzerland
(.).7 ,is#lay *6A0 usage
& 'ist of critica' s#ap usag" can *" disp'a+"d using th" ?osmon -c sho#s#ap? command.
@ osmo ,c s-o._s.ap
Node s.ap .it- )sa4e over .ar t-res-old
Node &iTe/1% 0sed .ar,over
4FF7; ;*F 8FU (8FU"
8s" th" summar+ f'ag to disp'a+ additiona''+ a usag" summar+ of th" most uti'i9"d s#ap ar"asB
@ osmo ,c s-o._s.ap s)mmar=
Node s.ap .it- )sa4e over 8FU
0sed Co)t
FU,JU ;
8FU,8JU >
Node &iTe/1% 0sed .ar,over
4FF7; ;*F FU (8FU"
4FF8J ;*F 8>U (8FU"
4FFJ; ;*F 8;U (8FU"
=o !i"# th" s#ap usag" #ith anoth"r usag" than d"fin"d in ?O&MON_AP_#A$NIN1 ? +ou can gi!" a!a'u" dir"ct'+ on th" command 'in" *+ th" option ?o!"r?.
[email protected] VDCF - Monitoring 3.0 3 / 44
-
7/29/2019 VDCF Monitoring
37/44
JomaSoft GmbHFalkensteinstr. 54a
9000 St. GallenSwitzerland
(.).8 ,is#lay *M- *ervices
& 'ist of a'' critica' MF s"r!ic"s can *" disp'a+"d using th" ?osmon -c sho#smf? command.
@ osmo ,c s-o._smf
&M? .it- state de4radedmaiteace &erver =pe &M?,Name (?M$I" &tate sFF;6 Node svc/s=stem/s=soBjdefa)lt maiteace vF;J v&erver svc/site/vdcf_postistalldefa)lt maiteace
8s" th" summar+ f'ag to additiona''+ disp'a+ a summar+ of th" critica' MF s"r!ic"sB
@ osmo ,c s-o._smf s)mmar=
&M?,&tate Co)t maiteace >
&M? .it- state de4radedmaiteace &erver =pe &M?,Name (?M$I" &tate sFF;6 Node svc/s=stem/s=soBjdefa)lt maiteace vF;J v&erver svc/site/vdcf_postistalldefa)lt maiteace
=o !i"# MF s"r!ic"s oth"r than ?de4radedmaiteace ? +ou can d"fin" stat"s on th" command 'in"*+ th" option ?stat"?.
@ osmo ,c s-o._smf state')iitialiTed
&M? .it- state )iitialiTed &erver =pe &M?,Name (?M$I" &tate vF;> v&erver svc/applicatio/fot/stfsloaderdefa)lt )iitialiTed vF;> v&erver svc/applicatio/prit/rfc;;Jdefa)lt )iitialiTed
It is a'so possi*'" to s"arch s"r!ic"s of int"r"st *+ th" option ?s"arch?.
@ osmo ,c s-o._smf searc-'sedmail
&erver =pe &M?,Name (?M$I" &tate sFF;6 Node svc/et.ork/sedmail,clietdefa)lt disaBled sFF;6 Node svc/et.ork/smtpsedmail disaBled vF;J v&erver svc/et.ork/sedmail,clietdefa)lt olie
vF;J v&erver svc/et.ork/smtpsedmail olie
[email protected] VDCF - Monitoring 3.0 32 / 44
-
7/29/2019 VDCF Monitoring
38/44
JomaSoft GmbHFalkensteinstr. 54a
9000 St. GallenSwitzerland
(.).9 ,is#lay ,is4 0ath "ount
& 'ist of a'' dis:s #ithout "nough paths on'in" can *" disp'a+"d using th" ?osmon -c sho#dis:? command.
@ osmo ,c s-o._disk
!isk Pat- Co)t .it- critical state Node 10I! C)rret Pat- Co)t ar4et Pat- Co)t sFF> 8FF;67F;>DJJ%8>FFF;;FFF;FCFFFF ; > sFF> 8FF;67F;>DJJ%8>FFF;;FFF>J;EFFFF ; > sFF> 8FF;67F;>DJJ%8>FFF;;FFF>J>>FFFF ; > sFF> 8FF;67F;>DJJ%8>FFF;;FFF;?EFFFF ; >
8s" th" summar+ f'ag to additiona''+ disp'a+ a summar+ of th" curr"nt path countB
@ osmo ,c s-o._disk s)mmar=
C)rretPat-Co)t Co)t ;
!isk Pat- Co)t .it- critical state Node 10I! C)rret Pat- Co)t ar4et Pat- Co)t sFF> 8FF;67F;>DJJ%8>FFF;;FFF;FCFFFF ; > sFF> 8FF;67F;>DJJ%8>FFF;;FFF>J;EFFFF ; > sFF> 8FF;67F;>DJJ%8>FFF;;FFF>J>>FFFF ; > sFF> 8FF;67F;>DJJ%8>FFF;;FFF;?EFFFF ; >
Hou can 'ist th" curr"nt path count for "ach nod" th" dis: is assign"d *+ using th" fo''o#ing commandB
@ diskadm ,c s-o. ame'8FF;67F;>DJJ%8>FFF;;FFF>J>>FFFF
!ataset,Name 0se,=pe !ev,=pe 10I! &iTe/1% ier Locatio, ?$EE MPIO 8FF;6**>J>>FFFF ;D*F /a HPEVA
Nodes coected to t-is disk
Node Model cPool Locatio Pat- Co)t Commet
sFFF6 O$CL&PA$C,&,> sol;; $ &,> &erver sFF> O$CL&PA$C,,; sol;; $ ; ,; &erver
[email protected] VDCF - Monitoring 3.0 3 / 44
-
7/29/2019 VDCF Monitoring
39/44
JomaSoft GmbHFalkensteinstr. 54a
9000 St. GallenSwitzerland
(. O* *ecurity
(..1 Run *ecurity "om#liance Assessments
"curit+ Comp'ianc" &ss"ssm"nts can *" run against od"s and !"r!"r running on o'aris 11.3.
=h" *"nchmar: to *" us"d can *" d"fin"d indi!idua''+ p"r s+st"m. For s+st"ms #ithout a d"fin"d *"nchmar:th" VDCF ?d"fau't? *"nchmar: is us"d. Hou can configur" +our d"fau't "nchmar: *+ adding th"CM6>I&CDF&8>=C%M&(; !aria*'" to customi9".cfg.
@ vserver ,c modif= ame'm=server Bec-mark'Baselie
@ odecf4 ,c modif= ame'server; Bec-mark'cdom
"" Chapt"r3..4to s"" #h"r" to d"fin" +our o#n *"nchmar:s.
=h" ass"ssm"nts ma+ *" running for s"!"ra' minut"s th"r"for" th"+ ar" not "A"cut"d *+ ?osmon -c updat"?op"ration. 8s" th" ass"ss op"ration to initiat" a "curit+ Comp'ianc" &ss"ssm"ntB
@ osmo ,c assess ode'4FF8> all_vserver
Assessi4 Node ad all v&ervers o Node 4FF8>E9ec)ti4 compliace assess .it- %ec-mark &olaris %aselie o 4FF8> ***E9ec)ti4 compliace assess .it- %ec-mark defa)lt o vF;>6 ***E9ec)ti4 compliace assess .it- %ec-mark defa)lt o vF;6 ***
Compliace $eport for Node 4FF8> from >F;,FJ,;;;866DD&core 7J*7DDF8
otal $)les ;F Passed ;6 ?ailed 8 (Error F / Hi4- ; / Med D / Lo. F / Ifo F"
Compliace $eport for v&erver vF;>6 from >F;,FJ,;;;86D6J&core *J67>7otal $)les ; Passed ;F ?ailed (Error F / Hi4- F / Med / Lo. F / Ifo F"
Compliace $eport for v&erver vF;6 from >F;,FJ,;;;86;J&core *J67>7otal $)les ; Passed ;F ?ailed (Error F / Hi4- F / Med / Lo. F / Ifo F"
!etailed e9t $eport ca Be fo)d i /var/opt/jomasoft/vdcf/compliace_reports#A$N Assess of Node ad all v&ervers o Node 4FF8> .as ot s)ccessf)l
For con!"ni"nc" th" ass"ss op"ration is a'so a!ai'a*'" in th" nod" and !s"r!"r commandsB
@ ode ,c assess ame'4FF8> vserver
@ vserver ,c assess ame'vF;>6 Bec-mark'recommeded
[email protected] VDCF - Monitoring 3.0 35 / 44
-
7/29/2019 VDCF Monitoring
40/44
JomaSoft GmbHFalkensteinstr. 54a
9000 St. GallenSwitzerland
(..2 ,is#lay "om#liance Re#orts
& Comp'ianc" ("port o!"r!i"# can *" disp'a+"d *+ ?osmon -c sho#comp'ianc"?B
@ osmo ,c s-o._compliace
&erver =pe %ec-mark &core ime Passed ?ailed Error ***vF;>6 v&erver defa)lt *J67>7 >F;,FJ,;; ;F FvF;6 v&erver defa)lt *J67>7 >F;,FJ,;; ;F FsFF> Node cdom 7*8;JF; >F;,FJ,;; ;F 6 F4FF8> Node Baselie 7J*7DDF8 >F;,FJ,;; ;6 8 FsFFF6 Node cdom JD*>67FJ; >F;,FJ,;; ;> ; F
& d"tai'"d r"port in %=M> can *" found in th" comp'ianc" htm' r"port dir"ctor+B/var/opt/jomasoft/vdcf/compliace_reports/-tml
=h"s" r"ports can *" disp'a+"d #ith +our pr"f"rr"d *ro#s"r using th" VDCF Dash*oard."" Chapt"r 4.2 for d"tai's.
(..3 O* Hardening
=his f"atur" is on'+ a!ai'a*'" on o'aris 11.
=o r"so'!" th" s"curit+ findings disco!"r"d *+ th" ass"ss op"ration +ou ma+ us" th" hard"ning op"rationson th" nod" and !s"r!"r commands. =h"s" commands do app'+ hard"ning using a d"dicat"dhard"ning profi'"B
@ ode ,c -arde profile'2-ardei4 profile3
@ vserver ,c -arde profile'2-ardei4 profile3
8s" th" ?nod" -c hard"n h"'p? or ?!s"r!"r -c hard"n h"'p? to g"t a 'ist of a'' a!ai'a*'" hard"ning profi'"s.Hou ma+ d"fin" +our o#n hard"ning profi'"s ,s"" Chapt"r 3..
,Bas-,*@ ode ,c -arde ame'4FFJ7 profile'Baselie
Hardei4 started ***O&C,;>D;F &ervice svc/et.ork/fs/fedfs,clietdefa)lt is i disaBled state , !ONEO&C,;DD;F &ervice svc/et.ork/fi4er is disaBled or ot istalled , !ONEO&C,;D;F &ervice svc/et.ork/ftpdefa)lt is i disaBled state , !ONE
O&C,DDF;F -e r,protocols services are disaBled i PAM , !ONEO&C,86FFD &ervice svc/et.ork/rpc/4ss is eaBled if ad ol= if KerBeros iscofi4)red , !ONEHardei4 of D items o Node 4FFJ7 .as s)ccessf)l
[email protected] VDCF - Monitoring 3.0 40 / 44
-
7/29/2019 VDCF Monitoring
41/44
JomaSoft GmbHFalkensteinstr. 54a
9000 St. GallenSwitzerland
(.7 +,"- ,ashboard web a##lication
tarting #ith V"rsion 3.0 th" VDCF Monitoring com"s #ith a #"* app'ication to disp'a+ som" informationstor"d in th" VDCF ("positor+. &nd to acc"ss comp'ianc" r"ports g"n"rat"d *+ th" ?osmon -c ass"ss?command.
(.7.1 'nabling ? ,isabling
=h" #"* app'ication is running as a apach" da"mon proc"ss and th"r"for" it can *" contro''"d *+ th"norma' apach" r"start commands. =h" #"* app'ication is d"p'o+"d in a s"parat" !irtua' host.
It?s "na*'"d *+ d"fau't ,aft"r running th" s"tupgui too' s"" Chapt"r 3.2.
=o disa*'" th" #"* app'ication just r"mo!" this fi'" from th" apach" conf.d dir"ctor+B
/etc/apac-e>/>*>/cof*d/vdcf_dja4o_-ttpd_>>*cofand r"start &pach".
(.7.2 =og%iles
&ep ;J ;D6 vdcf4)i_dja4o*lo4,r.,r,,r,, ; root root 8D &ep ;J ;D; vdcf4)i_error*lo4
(.7.3 6eb a##lication screenshots
tart +our pr"f"rr"d *ro#s"r and na!igat" to th" dash*oard ur'B httpsB//L+ours"r!"rOBL+our portO,d"p"nds on +our apach" configuration.
=o auth"nticat" +ou ha!" to us" +our 'oca' uniA account cr"d"ntia's.8s"rs #ithout a o'aris account can?t us" th" VDCF Dash*oard.
[email protected] VDCF - Monitoring 3.0 41 / 44
-
7/29/2019 VDCF Monitoring
42/44
JomaSoft GmbHFalkensteinstr. 54a
9000 St. GallenSwitzerland
&ft"r auth"ntication +ou g"t r"dir"ct"d to th" front pag" of th" app'icationB
[email protected] VDCF - Monitoring 3.0 4$ / 44
-
7/29/2019 VDCF Monitoring
43/44
JomaSoft GmbHFalkensteinstr. 54a
9000 St. GallenSwitzerland
From h"r" +ou can s"'"ct th" diff"r"nt r"ports. For "Aamp'" th" comp'ianc" o!"r!i"#B
&nd fina''+ disp'a+ a comp'ianc" r"port for a sp"cific s+st"mB
[email protected] VDCF - Monitoring 3.0 43 / 44
-
7/29/2019 VDCF Monitoring
44/44
JomaSoft GmbHFalkensteinstr. 54a
9000 St. GallenSwitzerland
) A##endies
).1 $ode %ailover detection details
& od" is consid"r"d as fai'"d if for a d"fin"d num*"r of int"r!a's no pro*" m"ssag" has *""n post"dfrom a od". =h" monitor #i'' :ic: off an action aft"r ,%&M;6&>IV&C=I=%>DP1 Q%&M;6&>IVI=(V&> s"conds aft"r a od" is no 'ong"r su*mitting its :""p a'i!"m"ssag"s.
=h" action part of th" hamonch"c: go"s through s"!"ra' st"ps unti' it consid"rs a od" as fai'"dB
1. First of a'' n"t#or: conn"cti!it+ is !"rifi"d *+ tr+ing to ch"c: th" status of th" !dcf:""pa'i!" s"r!ic" onth" susp"ct od". If th" od" can *" r"ach"d and th" ch"c: r"turns a s"r!ic" stat" oth"r th"n "na*'"d
th" monitor tri"s to r""sta*'ish th" !dcf:""pa'i!" s"r!ic". If this succ""ds th" monitor r"turns to norma'op"ration and a#aits th" :""p a'i!" pro*" for this od". If th" s"r!ic" stat" a'r"ad+ #as "na*'"d and th"monitor #as a*'" to )u"r+ its stat" it a'so r"turns to norma' op"ration assuming th" pro*" fai'ur" #as oft"mporar+ natur".
$. If n"t#or: r"acha*i'it+ of th" susp"ct od" is not gi!"n th" monitor tri"s to acc"ss th" od"s s+st"mcontro''"r. If #" succ"ssfu''+ r"ach th" s+st"m contro''"r th" monitor ch"c:s th" od"?s conso'" for arunning op"rating s+st"m. In this cas" th" monitor r"sum"s norma' op"ration assuming a h"a'th+ od"#ith :""p-a'i!" fai'ur"s du" to t"mporar+ n"t#or: pro*'"ms. If th" conso'" ch"c: r"turns no signs of 'i!"th" od" #i'' *" po#"r"d off if configur"d so and its #or:'oad #i'' *" "!acuat"d.
3. If th" monitor is not a*'" to r"ach th" s+st"m contro''"r and %&MC%C;=IV=6(. If *as"d on this ch"c: th" n"t#or: is consid"r"d ash"a'th+ th" susp"ct od" #i'' *" assum"d as fai'"d and th" #or:'oad is "!acuat"d. If th" n"t#or: isconsid"r"d as fai'"d th" monitor r"sum"s norma' op"ration #ithout acting on th" susp"ct od".