internet related performance measurements...–can be used for measuring internet related...
TRANSCRIPT
Internetrelatedperformancemeasurements
MartinBrandViceChairmanofETSITCINT,RapporteurofQ9/11
Content
• General info about performance measurements
• Recommendation ITU-T Q.3960 Framework of Internet related performance measurements
• Draft Recommendation ITU-T Q.3961: Testing methodologies of Internet related performance measurements including e2e bit rate within the fixed and mobile operator’s networks
• Test implementations in Europe
• Planed Internet related performance QoS Test methods
2
Generalinfoaboutinternetperformancemeasurements
• TheprojectinternetperformancemeasurementsisajointprojectbetweenITU-SG11,ETSITCINTandtheAustrianRegulatorRTR
• PublishedRecommendationsandStandards– RecommendationITU-TQ.3960:FrameworkofInternetrelated
performancemeasurements– ETSITS103222-1Referencebenchmarking,backgroundtrafficprofiles
andKPIsforVoIPandFoIP infixednetworks
• Indevelopment:– DraftRecommendationITU-TQ.3961:TestingmethodologiesofInternet
relatedperformancemeasurementsincludinge2ebitratewithinthefixedandmobileoperator’snetworks
3
RecommendationITU-TQ.3960FrameworkofInternetrelatedperformance
measurements
4
ITU-TQ.3960:FrameworkofInternetrelatedperformancemeasurements
• ThisRecommendationdescribestheframeworkforInternetrelatedperformance measurements– which canbeestablishedatthenationalorinternationalleveland
– canbeusedformeasuringInternetrelatedperformancemeasurementsfromthecustomertoaparticularInternetresource
5
ITU-TQ.3960:FrameworkofInternetrelatedperformancemeasurements
6
DraftRecommendationITU-TQ.3961:TestingmethodologiesofInternetrelated
performancemeasurementsincludinge2ebitratewithinthefixedandmobileoperator’s
networks
7
DraftRecommendationITU-TQ.3961TestingmethodologiesofInternetrelatedperformance
measurementsincludinge2ebitratewithinthefixedandmobileoperator’snetworks
• ThisRecommendationdescribesthetestingproceduresofdatatransmissionspeedwithinthefixedandmobileoperator’snetworks
• TheproposedmethodologyisbasedontheconceptoftheITU-T Q.3960“FrameworkofInternetrelatedperformancemeasurements”(2016).
• ItisbasedontheproceduresdescribedintheETSITechnicalStandardETSITS103222-1:Referencebenchmarking,backgroundtrafficprofilesandKPIsforVoIPandFoIP infixednetworks
8
DraftRecommendationITU-TQ.3961-Architecture
9
Testingprocedures(1)
• TheMeasurementPeer(MP)isdetermineddirectlyinControllerbygeo-locatingtheMeasurementAgent(MA)anddetermininghisclosestaccesstotheInternet.IncaseofexecutingtheInternetresourcespeedtest,theMeasurementPeercanbeeitherselectedbydefaultorlettingtheuserchoseadestinationwithinalistofInternetresources.
• Thetestconsistsofsevenphaseswhicharecarriedoutoneaftereachother,i.e.phasemstartsafterphasem-1hasfinishedwithoutanypausein-between.Thatmeansthatthephasesdonotoverlap.
10
Testingprocedures(2)
• Toensurecomparabledatatransmissionspeedtestconditionsinmobilenetworks,apre-loadshouldbeinitiated.Withthepre-load,themobilenetworksaresetinadefinedinitialstatei.e.CELL_DCHinUMTSandconnectedinLTE.
• Ifthedownlinkanduplinkpre-testsproceduresarenotimplemented(Phases2and5),theMeasurementAgentshallopenaTCPuplinkanddownlinkconnection.Fordownlink,theControllersendsadatablockofsizez.Foruplink,theMeasurementAgentsendsadatablockofsizez.
11
DraftRecommendationITU-TQ.3961TestingexecutionWorkflow
12
DraftRecommendationITU-TQ.3961TestingexecutionWorkflow
Phase1:Initialization
• InPhase1:InitializationtheMeasurementAgenttriestoconnecttotheControllerwithTCP.Inordertopassthroughcertainfirewalls,whichmightblockunencrypteddatatransmissions,HTTPSmightbenecessary.Thedatastreamsthemselvesareoptionallyunencrypted.
13
DraftRecommendationITU-TQ.3961TestingexecutionWorkflowPhase2:Downlinkpre-test
14
DraftRecommendationITU-TQ.3961TestingexecutionWorkflowPhase2:Downlinkpre-test
• InPhase2,theMeasurementAgentopensn connectionstotheassignedMeasurementPeer.Withineachconnection,theMeasurementAgentrequestsandtheMeasurementPeersendsadatablockofsizez.Whilethedurationofthepre-testhasnotexceededTp,theMeasurementAgentrequestsadatablockofdoublesizecomparedtothelastiterationstep.ThetransferofthelastdatablockwillbefinishedevenifthedurationhasalreadyexceededTp.Attheendofthepre-test,allconnectionsareleftoptionallyopenforfurtheruse.
15
DraftRecommendationITU-TQ.3961TestingexecutionWorkflow
Phase3:Latencytest
16
DraftRecommendationITU-TQ.3961TestingexecutionWorkflow
Phase3:Latencytest
• DuringthePhase3,theMeasurementAgentsendsp“pings”inshortintervalstotheMeasurementPeertotestthelatencyoftheconnection.
• TheMeasurementAgentmeasuresthetimebetweensendingandreceivingthereturnmessage,whiletheMeasurementPeeradditionallymeasuresthetimebetweensendingitsreturnmessageandtheMeasurementAgent’sreceptionresponse.TheMeasurementAgentstoresallmeasurements.
17
DraftRecommendationITU-TQ.3961Workflow
Phase4:DownlinksubtestTestingexecution
18
DraftRecommendationITU-TQ.3961Workflow
Phase4:DownlinksubtestTestingexecution
• Withineachofthenconnectionsopenedduringphase2,theMeasurementAgentsimultaneouslyrequestsandtheMeasurementPeercontinuouslysendsdatastreamsconsistingoffixed-sizechunksofsizes(randomlypre-generateddatawithhighentropy).
• Alltransmissionsstartatthesametime,whichisdenotedasrelativetime0.ForeachconnectiontheMeasurementAgentrecordstheelapsedtimeandtheamountofdatareceived.
19
DraftRecommendationITU-TQ.3961Workflow
Phase5:Uplinkpre-test
20
DraftRecommendationITU-TQ.3961Workflow
Phase5:Uplinkpre-test
• InPhase5,theMeasurementAgentopensn connectionstotheassignedMeasurementPeer.Withineachconnection,theMeasurementAgentsendsadatablockofsizez(randomlypre-generateddatawithhighentropy).Whilethedurationofthepre-testhasnotexceededTp,theMeasurementAgentsendsadatablockofdoublesizecomparedtothelastiterationstep.ThetransferofthelastdatablockwillbefinishedevenifthedurationhasalreadyexceededTp.Attheendofthepre-test,theconnectionsareleftopenforfurtheruse.
21
DraftRecommendationITU-TQ.3961Workflow
Phase6:Uplinksubtest
22
DraftRecommendationITU-TQ.3961Workflow
Phase6:Uplinksubtest
• Withineachofthenconnectionsopenedduringphase5,theMeasurementAgentcontinuouslysendsdatastreams.
• Alltransmissionsstartatthesametime,whichisdenotedasrelativetime0.Foreachconnection,theMeasurementPeergivesfeedbacktotheMeasurementAgentbysendingtheelapsedtimeandtheamountofdatareceived.
23
DraftRecommendationITU-TQ.3961Workflow
Phase7:Finalization
• Afterfinishingalltests,theMeasurementAgentsendsthecollecteddatatotheCollector.AsoptiontheMPcanalsosendthedataaboutthemeasurementtothecollector.BothdatasetscouldbecomparedbytheCollectortocheckthequalityandintegrityoftheresult.Alltests,successfulorunsuccessful,arestoredbytheCollector.
24
ImplementationsinEurope
RTRImplementationwithWeb-Browser
• https://www.netztest.at/en/
26
RTRImplementationTesting procedure
27
RTRImplementationTestResults
28
RTRImplementationTestResultsDiagramm
29
RTRImplementation– Map
30
RTRImplementation,additionalQoSFeatureswithAndroid
31
https://www.netztest.at/de/Opentest?Oa60cedba-6a54-4daf-ab45-5eec6b1ee041
RTRImplementationadditionalQoSFeatureswith Android
VoIPDetails
32
RTRImplementationadditionalQoSFeatureswith Android
TraceRouteDetails
33
Furtherstandardisationdevelopments
34
PlanedInternetrelatedperformanceQoSTestmethods
• ThefollowingInternetrelatedperformanceQoSTestmethodsshouldbestandardized:– Websitedownloadstest- Thewebsitetestdownloadsareferencewebpage(mobile
KeplerpagebyETSI)– Unmodified content - Thistestdownloadsatestwebressource (e.g.image)andchecks
ifitwasmodifiedduringtransport.– Transparentconnection test - Thistestchecksifarequestismodifiedbyaproxyorother
middlebox.– TheDNSTest- DNSisafundamentalInternetservice.Itisusedtotranslatedomain
namestoIPaddresses.Dependingonthetestitischeckediftheserviceisavailable,iftheanswersarecorrectandhowfasttheserverresponds.
– TheTCPTest- TCPisanimportantconnectionorientedInternetprotocol.Itisusedforexampleforwebpagesore-mail.
– TheUDPTest- UDPisanimportantconnectionlessInternetprotocol.Itisusedforreal-timecommunications,e.g.forVoIPandvideo.
– TheVoIPTest- VoIP(VoiceoverIP)isatechnologyforthedeliveryofvoiceacrossIPbasednetworks.
35
Thankyou!