cable test at server end
DESCRIPTION
Testing the cable/LAN cable and their status from RHEL 7TRANSCRIPT
-
24/04/2015 DocumentDisplay
https://support.oracle.com/epmos/faces/SearchDocDisplay?_adf.ctrlstate=16sjohapiu_9 1/4
IdentifyingafailedEthernetcableonanOracleDatabaseMachine(Exadata)(DocID1994662.1)
APPLIESTO:
OracleExadataHardwareInformationinthisdocumentappliestoanyplatform.
PURPOSE
Thesymptomsofacablefailurearemany.SomeofthemoreobviousisthelinklightontheswitchortheNICwillnotlight.Anothermightbeadegradednetworkbandwidth.TimeDomainReflectometer(TDR)needstobeexecutedfromtheswitchandcan'tbedonefromthehost.TDRrequiresspecificcircuitrythatisnottypicallyavailableonthenetworkinterfacecard.
TouseTDR,youwillneedenableprivilegesontheswitchtoissuethecommandsneeded.EthtoolisanothertooltousedtovalidateTDR'soutput.EthtoolshowsthesettingsontheNICsoonecancomparethemtothesettingsontheswitch.
FormoreinformationonCisco'simplementationofTDRseehttp://www.cisco.com/c/en/us/td/docs/switches/lan/catalyst6500/ios/122SX/configuration/guide/book/intrface.html#wpmkr1066782
TROUBLESHOOTINGSTEPS
Beforecoveringthecommandsused,let'sreviewtheconstructionofTwistedPaircablingtoproperlyunderstandtheswitchdiagnosticoutput.Category5orCategory6TwistedPairEthernetcableconsistsoffourpairsoftwistedcopperwirethatconnectinaspecificwayintoanRJ45plug.TheTDRdiagnosticrunstestsoneachtwistedpairtodeterminehowlongtheoverallcableis,orhowfarfromtheswitchapotentialbreakislocated.ThediagnosticsalsoliststhenetworkspeedoftheNIC.Duringthetest,connectivitybetweentheswitchandhostisterminatedwhilethetestisbeingrun,soitisbesttorunthetestduringasystemoutageperiod.
NOTE:TheinformationinthisnotewasacquiredusingaCiscoCatalyst4948switchrunningVersion15.0(2)SG8oftheCIOS.ItshouldbevalidforotherCiscoequipmentthathasTDRavailable.
Ifacablefailureissuspected,theLinuxOSutilityethtoolshouldnotdetectalink:
[root@dm01adm01~]#ethtooleth0|grepLinkLinkdetected:yes
AnothersymptommightbethelinkspeedisnotwhattheNICisratedfor.Forinstance,iftheNICissupposedtobe1Gb/sEthernet,itmightonlycomeupas100Mb/sEthernet:
[root@dm01adm01~]#ethtooleth0|grepSpeedSpeed:100Mb/s
NOTE:KeepinmindthattheiLOM's'inExadataareonlyratedfor100Mb/s.
Withthisinformation,onecanvalidateifitisduetoacablefailurebygoingtotheCiscoswitchandissuetheTDRtest.Thiswillrequiretogettothe"enable"promptintheswitch.
dm01swadm0#testcablediagnosticstdrinterfaceGigabitEthernet1/3
-
24/04/2015 DocumentDisplay
https://support.oracle.com/epmos/faces/SearchDocDisplay?_adf.ctrlstate=16sjohapiu_9 2/4
Thecommanddoesnotreturnanythingasyoujuststartedthetest.Itwillbeatthispointtheportbecomesnonresponsivetothehost.Tofindtheoutputorstatusofthetest,runtheshowcommand:
dm01swadm0#showcablediagnosticstdrinterfaceGigabitEthernet1/3TDRtestisinprogressoninterfaceGi1/3
dm01swadm0#showinterfaceGigabitEthernet1/3|includelineprotocolGigabitEthernet1/3isdown,lineprotocolisdown(notconnect)
Oncethetestiscompleted,toviewtheresultsusetheshowcommand:
dm01swadm0#showcablediagnosticstdrinterfaceGigabitEthernet1/3InterfaceSpeedLocalpairCablelengthRemotechannelStatusGi1/31Gbps12N/AUnknownTerminated36N/AUnknownTerminated45N/AUnknownTerminated78N/AUnknownTerminated
Inthiscase,thecablewasfineasitsStatusshowstheallthetwistedpairswereproperlyterminated.Terminatedmeanstheimpedanceonthewireisasexpected.ItshowsthattheratedSpeedoftheinterfaceis1Gpbs,whichiswhatwouldbeexpected.Letstryonethathasafailure:
dm01swadm0#testcablediagnosticstdrinterfaceGigabitEthernet1/1dm01swadm0#showcablediagnosticstdrinterfaceGigabitEthernet1/1InterfaceSpeedLocalpairCablelengthRemotechannelStatusGi1/1100Mbps12N/AUnknownTerminated36N/AUnknownTerminated45N/AUnknownTerminated78N/AUnknownTerminated
InanormalExadatainstallation,theDescriptionfieldintheswitchisfilledoutwiththehostnameofthenodepluggedintotheport.Toseethisname:
dm01swadm0#showinterfaceGigabitEthernet1/1|includeDescriptionDescription:dm01cel14NET0
Tovalidatetheconnection,gathertheMACaddressfromtheExadatasystem:
[root@dm01celadm14~]#iplinkshoweth0|greplinklink/ether00:14:4f:ca:ef:cebrdff:ff:ff:ff:ff:ff
ToseewhattheswitchseesastheMACaddressoftheNICpluggedintotheport:
dm01swadm0#showmacaddresstableinterfaceGigabitEthernet1/1|includeGigabitEthernet30580014.4fcb.1bc0dynamicipGigabitEthernet1/1
Wellthisisfun,thetwodon't'match.Thisisatestsysteminalab,soitmaynothavebeenleftinanormalproductionstate,whichisgoodforthisnote,badifthisisaproductionsystemandits3AMinthemorning.TofindtheproperMACaddress,sshintoeveryhostandissue"iplinkshoweth0|greplink".
root@dm01adm08link/ether00:14:4f:cb:1b:c0brdff:ff:ff:ff:ff:ff
OncetheproperMACaddressisfound,onthathostcheckthestatusoftheNICusingethtool:
-
24/04/2015 DocumentDisplay
https://support.oracle.com/epmos/faces/SearchDocDisplay?_adf.ctrlstate=16sjohapiu_9 3/4
[root@dm01adm08~]#ethtooleth0Settingsforeth0:Supportedports:[TP]Supportedlinkmodes:10baseT/Half10baseT/Full100baseT/Half100baseT/Full1000baseT/FullSupportedpauseframeuse:SymmetricSupportsautonegotiation:YesAdvertisedlinkmodes:10baseT/Half10baseT/Full100baseT/Half100baseT/Full1000baseT/FullAdvertisedpauseframeuse:SymmetricAdvertisedautonegotiation:YesSpeed:100Mb/sDuplex:FullPort:TwistedPairPHYAD:1Transceiver:internalAutonegotiation:onMDIX:offSupportsWakeon:pumbgWakeon:gCurrentmessagelevel:0x00000007(7)drvprobelinkLinkdetected:yes
Soitshowsthesameastheswitch,thatthespeedoftheNICis100Mbps.YetthisNICisabletoadvertise1Gbps.Theswitchportisconfiguredfor:
dm01swadm0#showinterfaceGigabitEthernet1/1|includeHardwareHardwareisGigabitEthernetPort,addressis0024.9723.52c0(bia0024.9723.52c0)dm01swadm0#showinterfaceGigabitEthernet1/1|includemediaFullduplex,100Mb/s,linktypeisauto,mediatypeis10/100/1000TX
NOTE:Don'tmindthehardwareaddresshereisdifferent,asitistheswitchport'shardwareaddressnottheNICintheExadatasystem.
ChangetheNICspeedusingethtool:
[root@dm01adm08~]#ethtoolseth0speed1000Cannotadvertisespeed1000
Checktoseeifthechangetookusingethtool:
[root@dm01adm08~]#ethtooleth0|grepSpeedSpeed:1000Mb/s
Checktheswitchportconfiguration:
dm01swadm0#showinterfaceGigabitEthernet1/1|includemediaFullduplex,1000Mb/s,linktypeisauto,mediatypeis10/100/1000TX
Itlookslikethingsarefixed.Sohowdiditchange?TryTDRagainandseewhatitknowsabout.
dm01swadm0#testcablediagnosticstdrinterfaceGigabitEthernet1/1dm01swadm0#showcablediagnosticstdrinterfaceGigabitEthernet1/1
-
24/04/2015 DocumentDisplay
https://support.oracle.com/epmos/faces/SearchDocDisplay?_adf.ctrlstate=16sjohapiu_9 4/4
InterfaceSpeedLocalpairCablelengthRemotechannelStatusGi1/1100Mbps12N/AUnknownTerminated36N/AUnknownTerminated45N/AUnknownTerminated78N/AUnknownTerminated
Wait,itwentbackto100Mbpsandethtoolagrees:
[root@dm01adm08~]#ethtooleth0|grepSpeedSpeed:100Mb/s
ItappearsthereissomekindofproblemwheretheTDRtestiscausingthespeedtobeknockeddownto100Mbps.Theredoesnotseemtobeacablefault,butseemstobesomekindoffaultineithertheCiscoswitchortheNICastheinformation,atthispoint,isinconclusive.ThisnoteisnotaboutfindingabugineithertheCiscoswitchorNIC,buthowtouseTDR.
AnotherexampleshowsanactualfaultconditionusingTDR.Iftherebeenafaultinthecable,theStatusintheoutputoftheTDRcommandwouldshow"Fault".OnthisswitchIexaminedoneportandfoundthis:
dm01swadm0#testcablediagnosticstdrinterfaceGigabitEthernet1/2dm01swadm0#showcablediagnosticstdrinterfaceGigabitEthernet1/2InterfaceSpeedLocalpairCablelengthRemotechannelStatusGi1/2100Mbps12N/AUnknownTerminated36N/AUnknownTerminated451+/10mUnknownFault781+/10mUnknownFault
Eventhoughthisisa1Gbpsportintheswitch,a100MbpsNIConlyusesthefirsttwotwistedpairs.Herethespeedis100Mpbsandthefirsttwotwistedpairsareproperlyterminated.Thecable"fault"isabouttheproperlengthof1meter(eventhoughithasanuncertaintyof+/10m)whichshowstheTDRsignalbouncingbackfromtwopairsofa1mcable.MorethenlikelytheNICinthiscasewasaniLOM,whichisonlyratedat100Mbps.
REFERENCES
http://www.cisco.com/c/en/us/td/docs/switches/lan/catalyst6500/ios/122SX/configuration/guide/book/intrface.html#wpmkr1066782
Didn'tfindwhatyouarelookingfor?