wlpc_eu budapest 2016 | robert krumm | testing and validating stadium wi-fi

32
TESTING & VALIDATING STADIUM WI-FI JARED GRIFFITH ROBERT KRUMM Assisted by: Michal Zakrzewski

Upload: keith-parsons

Post on 14-Apr-2017

225 views

Category:

Technology


2 download

TRANSCRIPT

TESTING&VALIDATINGSTADIUMWI-FI

JAREDGRIFFITHROBERTKRUMM

Assistedby:MichalZakrzewski

PROJECTSCOMPLETED:

• 4xSTADIUMS- 2014FOOTBALLWORLDCUPBRAZIL

• 8xSTADIUMSININDIA– T20WORLDCUP/IPL

• 1xRUGBYSTADIUMSOUTHAFRICA

• OTHERS…

THEPROJECT

• CUSTOMERREQUIREMENTS… 2.4Gzvs5GHz- 70%on2.4??• VALIDATINGADESIGN…

• Whatareyouvalidatingfor?• When?• Retryrate/Utilization/DutyCycle?• Killingbroadcasttraffic– ARPsetc.• LABELSLABELSLABELS• PHYSICALVERIFICATION/OPTIMIZATION

• APLOCATION/TILT• RSSIMEASUREMENTS- -45dBmorbetter

• INFRASTRUCTUREVALIDATION• CABLETESTINGENMASSE!– usingscripts

• BUILDINGACHANNELPLAN• Automated• APsOnorOff?

WHYVALIDATE?

ClientOSType- INDIA

ANDROID

Unknown

WindowsMobile(8)

iOS

Windows7/Vista

Others

20%

26% 53%

CLIENTOSTYPE- BRAZIL

OthersAndroidApple

2.4GHz/5GHzSPLIT?

UPLINK/DOWNLINKSPLIT?

%CONCURRENCY?

VARIANCE?!

WHENAREYOUVALIDATING?

WHATAREYOUVALIDATING?(INASTADIUM)

• PHYSICALVALIDATION

APPLACEMENT/TILTS

• PHYSICALOBSTRUCTIONS/PERMISSIONSPROBLEMS

• BEAMWIDTH:-3dB? -6dB? -10dB? -20dB?

• FURTHESTCLIENTMUSTSTILLRECEIVEMINIMUMRSSI!• WHATISMINIMUMRSSI?• MEASUREDBYWHAT?• ATLEAST20dBHIGHERTHANNOISEFLOOR!

APLABELLING/NAMING!

•BIGCLEARLABELS

• READABLEFROM± 10m/45ft ?

• DOESMAC/SERIAL/NAMEMATCHTHEASSETREGISTER?

• ± 5DAYSFIXINGDISCREPANCIESHERE…

MINIMUMRSSI…

• NOISEFLOORDURINGGAME:±75dBm

• 20dBSNRFORHIGHERMODULATIONSCHEMES

• ± 55dBm TOWEAKESTCLIENTß KEEPYOUROLDANDROID/iPHONE

• ± 45dBmTOMACBOOKAIR

• DON’TFORGETBODYLOSSCAUSEDBYCROWD!(±3dBperhumaninLOS)

TRANSMITPOWER…

HIGHERSNRHIGHERMODULATION(TOAPOINT)SAMECCA/CONTENTION!(<ENERGYDETECT)SAMESINR

LOWERSNRLOWERMODULATIONSAMECCA/CONTENTION!SAMESINR

CARROTOFPOWER…

• INFRASTRUCTUREVALIDATION

CABLES,MEDIACONVERTERSANDFIBER:

• Huntdowndisconnected/“flapping”APs.

• CableValidation/Certificationnotalwaysgenuine…

• RuckusAPsrunZAP/SPEEDFLEXendpoint…

• ScriptedZAPtestingfromMAC/LINUXLaptopwGigabitEthernet.

• PlugintoAccessSwitch– Testtoall– CheckANYresult<500Mbps

RESULTS:

udp ver4172.30.9.9:172.30.9.9 172.30.9.74:172.30.9.74 ThuFeb1814:38:022016 762.7

udp ver4172.30.9.9:172.30.9.9 172.30.9.220:172.30.9.220 ThuFeb1815:22:182016 799.7

udp ver4172.30.9.9:172.30.9.9 172.30.9.87:172.30.9.87 ThuFeb1814:42:242016 800.6

udp ver4172.30.9.9:172.30.9.9 172.30.9.11:172.30.9.11 ThuFeb1814:19:402016 801.2

udp ver4172.30.9.9:172.30.9.9 172.30.9.138:172.30.9.138 ThuFeb1815:00:492016 801.3

udp ver4172.30.9.9:172.30.9.9 172.30.9.18:172.30.9.18 ThuFeb1814:21:462016 803.3

udp ver4172.30.9.9:172.30.9.9 172.30.9.84:172.30.9.84 ThuFeb1814:41:232016 804.8

udp ver4172.30.9.9:172.30.9.9 172.30.9.231:172.30.9.231 ThuFeb1815:25:292016 807.2

udp ver4172.30.9.9:172.30.9.9 172.30.9.123:172.30.9.123 ThuFeb1814:55:462016 808.8

udp ver4172.30.9.9:172.30.9.9 172.30.9.61:172.30.9.61 ThuFeb1814:33:402016 810.1

50%

NETWORKVALIDATION

• VLANS

• POLICYBASEDROUTES?

• DHCP,DNS,LOADBALANCERS,FIREWALLS,SWITCHESETC

• CAM/ARP/DHCP/ROUTING/NATCAPACITY?

• AIRINTERFACEVALIDATION

CHALLENGE…

• HOWTOTESTAIRINTERFACEINANEMPTYSTADIUM?

• KEYTOBUILDING/OPTIMIZINGCHANNELPLAN&TXPOWER

• REQUIRESMULTIPLECLIENTS/MULTIPLETESTRUNS

• PEOPLEAREEXPENSIVE…

• CLIENTDEVICESVARYWILDLY…

• MULTIPLESIMULTANEOUS CLIENTS,MULTIPLEAPs,SAMECHANNEL…

SOLUTION:

• PERFORMLIMITEDCLIENTTESTINGUSINGA“STANDARDCLIENT”

• SCRIPTPACKAGETHATALLOWSPARALLELIPERFTESTING

• MODIFIEDRUCKUSR300AP+BATTERY

• R300CONVERTEDBYDEVELOPMENTCENTERINTOCLIENTMODE• 2.4GHz/5GHz802.11n• 1x1:1/2x2:2• SPECIALSSID

RESULTS: #18results:10.10.10.17661.91710.10.10.20059.17410.10.10.17356.79110.10.10.20556.27810.10.10.21354.78510.10.10.17554.72810.10.10.21654.44410.10.10.17454.33910.10.10.19953.90710.10.10.20453.68010.10.10.20750.10810.10.10.20848.48510.10.10.21546.28310.10.10.21445.49010.10.10.20342.23410.10.10.21237.58510.10.10.17937.27510.10.10.21735.334##TotalMbps:902.838#

roberts-MacBook-Air:netcap robertkrumm$./run_iperf.sh -sstaiplist_WestStand_L220160329151331,10.10.10.1,52004,10.10.10.213,5001,4,0.0-20.0,137101312,5478527120160329151351,10.10.10.1,52038,10.10.10.215,5001,4,0.0-20.0,115736576,4628322320160329151411,10.10.10.1,52063,10.10.10.200,5001,4,0.0-20.0,147980288,5917438320160329151431,10.10.10.1,52081,10.10.10.205,5001,4,0.0-20.0,140771328,5627776120160329151451,10.10.10.1,52105,10.10.10.179,5001,4,0.0-20.0,93192192,3727470920160329151511,10.10.10.1,52143,10.10.10.217,5001,4,0.0-20.0,88342528,3533404320160329151532,10.10.10.1,52165,10.10.10.212,5001,4,0.0-20.0,93978624,3758501820160329151552,10.10.10.1,52196,10.10.10.174,5001,4,0.0-20.0,135921664,5433854520160329151612,10.10.10.1,52228,10.10.10.207,5001,4,0.0-20.0,125304832,5010754120160329151632,10.10.10.1,52254,10.10.10.203,5001,4,0.0-20.0,105644032,4223440420160329151652,10.10.10.1,52284,10.10.10.173,5001,4,0.0-20.0,142082048,5679094420160329151712,10.10.10.1,52322,10.10.10.204,5001,4,0.0-20.0,134217728,5368008320160329151732,10.10.10.1,52355,10.10.10.176,5001,4,0.0-20.0,154927104,6191720520160329151752,10.10.10.1,52389,10.10.10.199,5001,4,0.0-20.0,134873088,5390706620160329151812,10.10.10.1,52422,10.10.10.208,5001,4,0.0-20.0,121372672,4848538520160329151832,10.10.10.1,52453,10.10.10.216,5001,4,0.0-20.0,136183808,54444071connect failed:Operation timed out20160329152007,10.10.10.1,52489,10.10.10.214,5001,4,0.0-20.0,113770496,4549016620160329152027,10.10.10.1,52510,10.10.10.175,5001,4,0.0-20.0,136839168,54728224

RESULTS: #19results:10.10.10.20952.21610.10.10.21341.35610.10.10.20540.79810.10.10.17635.68810.10.10.17528.89610.10.10.20428.65710.10.10.21723.79010.10.10.17421.42310.10.10.21220.77410.10.10.17318.76710.10.10.21514.51810.10.10.20713.38210.10.10.2089.74510.10.10.2149.51310.10.10.2169.10410.10.10.2039.02410.10.10.2008.99410.10.10.1996.99610.10.10.1794.864##TotalMbps:398.504#

roberts-MacBook-Air:netcap robertkrumm$./run_iperf.sh -pstaiplist_WestStand_L2./iperf -c%s-yC-t 2020160329152107,10.10.10.1,52578,10.10.10.173,5001,5,0.0-20.0,46923776,1876651720160329152107,10.10.10.1,52568,10.10.10.213,5001,5,0.0-20.0,103415808,4135564520160329152107,10.10.10.1,52573,10.10.10.215,5001,5,0.0-20.0,36306944,1451768420160329152107,10.10.10.1,52579,10.10.10.204,5001,5,0.0-20.0,71696384,2865713520160329152107,10.10.10.1,52577,10.10.10.217,5001,5,0.0-20.0,59506688,2379018520160329152107,10.10.10.1,52569,10.10.10.205,5001,5,0.0-20.0,102105088,4079814020160329152107,10.10.10.1,52586,10.10.10.175,5001,5,0.0-20.0,72351744,2889625820160329152107,10.10.10.1,52571,10.10.10.212,5001,5,0.0-20.0,52035584,2077441120160329152107,10.10.10.1,52580,10.10.10.176,5001,5,0.0-20.0,89391104,3568849720160329152107,10.10.10.1,52583,10.10.10.216,5001,5,0.0-20.0,22806528,910390520160329152107,10.10.10.1,52575,10.10.10.179,5001,5,0.0-20.1,12189696,486358020160329152107,10.10.10.1,52570,10.10.10.200,5001,5,0.0-20.1,22544384,899358020160329152107,10.10.10.1,52574,10.10.10.207,5001,5,0.0-20.1,33554432,1338183120160329152107,10.10.10.1,52584,10.10.10.214,5001,5,0.0-20.1,23855104,951263020160329152107,10.10.10.1,52576,10.10.10.174,5001,5,0.0-20.1,53739520,2142271220160329152107,10.10.10.1,52581,10.10.10.199,5001,5,0.0-20.1,17563648,699648420160329152107,10.10.10.1,52582,10.10.10.208,5001,5,0.0-20.0,24379392,974460220160329152107,10.10.10.1,52572,10.10.10.203,5001,5,0.0-20.1,22675456,902445420160329152142,10.10.10.1,52585,10.10.10.209,5001,5,0.0-20.0,130678784,52215585

SOMEADVICE…

• GETTHEBATTERIES…

FINALVALIDATION

• INEVENTTESTING/OPTIMIZATION

• ROAMINGOPTIMIZATION- SMARTROAM

• SPECTRUM/PROTOCOLANALYSISDURINGEVENT

• THROUGHPUTTESTINGONPHONES

• ASKTHECROWD!

• STATS&REPORTS

• ClientAverageThroughput:

0

5

10

15

20

25

30

35

40

45

5pm- 6pm 6pm- 7pm 7pm- 8pm 8pm- 9pm 9pm- 10pm 10pm- 11pm

AverageOutdoorPressBoxStandAStandBStandCStandDStandEStandGStandMStandNStandP

• QUESTIONS?