internet related performance measurements...–can be used for measuring internet related...

Internetrelatedperformancemeasurements

MartinBrandViceChairmanofETSITCINT,RapporteurofQ9/11

Content

• General info about performance measurements

• Recommendation ITU-T Q.3960 Framework of Internet related performance measurements

• Draft Recommendation ITU-T Q.3961: Testing methodologies of Internet related performance measurements including e2e bit rate within the fixed and mobile operator’s networks

• Test implementations in Europe

• Planed Internet related performance QoS Test methods

2

Generalinfoaboutinternetperformancemeasurements

• TheprojectinternetperformancemeasurementsisajointprojectbetweenITU-SG11,ETSITCINTandtheAustrianRegulatorRTR

• PublishedRecommendationsandStandards– RecommendationITU-TQ.3960:FrameworkofInternetrelated

performancemeasurements– ETSITS103222-1Referencebenchmarking,backgroundtrafficprofiles

andKPIsforVoIPandFoIP infixednetworks

• Indevelopment:– DraftRecommendationITU-TQ.3961:TestingmethodologiesofInternet

relatedperformancemeasurementsincludinge2ebitratewithinthefixedandmobileoperator’snetworks

3

RecommendationITU-TQ.3960FrameworkofInternetrelatedperformance

measurements

4

ITU-TQ.3960:FrameworkofInternetrelatedperformancemeasurements

• ThisRecommendationdescribestheframeworkforInternetrelatedperformance measurements– which canbeestablishedatthenationalorinternationalleveland

– canbeusedformeasuringInternetrelatedperformancemeasurementsfromthecustomertoaparticularInternetresource

5

ITU-TQ.3960:FrameworkofInternetrelatedperformancemeasurements

6

DraftRecommendationITU-TQ.3961:TestingmethodologiesofInternetrelated

performancemeasurementsincludinge2ebitratewithinthefixedandmobileoperator’s

networks

7

DraftRecommendationITU-TQ.3961TestingmethodologiesofInternetrelatedperformance

measurementsincludinge2ebitratewithinthefixedandmobileoperator’snetworks

• ThisRecommendationdescribesthetestingproceduresofdatatransmissionspeedwithinthefixedandmobileoperator’snetworks

• TheproposedmethodologyisbasedontheconceptoftheITU-T Q.3960“FrameworkofInternetrelatedperformancemeasurements”(2016).

• ItisbasedontheproceduresdescribedintheETSITechnicalStandardETSITS103222-1:Referencebenchmarking,backgroundtrafficprofilesandKPIsforVoIPandFoIP infixednetworks

8

DraftRecommendationITU-TQ.3961-Architecture

9

Testingprocedures(1)

• TheMeasurementPeer(MP)isdetermineddirectlyinControllerbygeo-locatingtheMeasurementAgent(MA)anddetermininghisclosestaccesstotheInternet.IncaseofexecutingtheInternetresourcespeedtest,theMeasurementPeercanbeeitherselectedbydefaultorlettingtheuserchoseadestinationwithinalistofInternetresources.

• Thetestconsistsofsevenphaseswhicharecarriedoutoneaftereachother,i.e.phasemstartsafterphasem-1hasfinishedwithoutanypausein-between.Thatmeansthatthephasesdonotoverlap.

10

Testingprocedures(2)

• Toensurecomparabledatatransmissionspeedtestconditionsinmobilenetworks,apre-loadshouldbeinitiated.Withthepre-load,themobilenetworksaresetinadefinedinitialstatei.e.CELL_DCHinUMTSandconnectedinLTE.

• Ifthedownlinkanduplinkpre-testsproceduresarenotimplemented(Phases2and5),theMeasurementAgentshallopenaTCPuplinkanddownlinkconnection.Fordownlink,theControllersendsadatablockofsizez.Foruplink,theMeasurementAgentsendsadatablockofsizez.

11

DraftRecommendationITU-TQ.3961TestingexecutionWorkflow

12

DraftRecommendationITU-TQ.3961TestingexecutionWorkflow

Phase1:Initialization

• InPhase1:InitializationtheMeasurementAgenttriestoconnecttotheControllerwithTCP.Inordertopassthroughcertainfirewalls,whichmightblockunencrypteddatatransmissions,HTTPSmightbenecessary.Thedatastreamsthemselvesareoptionallyunencrypted.

13

DraftRecommendationITU-TQ.3961TestingexecutionWorkflowPhase2:Downlinkpre-test

14

DraftRecommendationITU-TQ.3961TestingexecutionWorkflowPhase2:Downlinkpre-test

• InPhase2,theMeasurementAgentopensn connectionstotheassignedMeasurementPeer.Withineachconnection,theMeasurementAgentrequestsandtheMeasurementPeersendsadatablockofsizez.Whilethedurationofthepre-testhasnotexceededTp,theMeasurementAgentrequestsadatablockofdoublesizecomparedtothelastiterationstep.ThetransferofthelastdatablockwillbefinishedevenifthedurationhasalreadyexceededTp.Attheendofthepre-test,allconnectionsareleftoptionallyopenforfurtheruse.

15

DraftRecommendationITU-TQ.3961TestingexecutionWorkflow

Phase3:Latencytest

16

DraftRecommendationITU-TQ.3961TestingexecutionWorkflow

Phase3:Latencytest

• DuringthePhase3,theMeasurementAgentsendsp“pings”inshortintervalstotheMeasurementPeertotestthelatencyoftheconnection.

• TheMeasurementAgentmeasuresthetimebetweensendingandreceivingthereturnmessage,whiletheMeasurementPeeradditionallymeasuresthetimebetweensendingitsreturnmessageandtheMeasurementAgent’sreceptionresponse.TheMeasurementAgentstoresallmeasurements.

17

DraftRecommendationITU-TQ.3961Workflow

Phase4:DownlinksubtestTestingexecution

18

DraftRecommendationITU-TQ.3961Workflow

Phase4:DownlinksubtestTestingexecution

• Withineachofthenconnectionsopenedduringphase2,theMeasurementAgentsimultaneouslyrequestsandtheMeasurementPeercontinuouslysendsdatastreamsconsistingoffixed-sizechunksofsizes(randomlypre-generateddatawithhighentropy).

• Alltransmissionsstartatthesametime,whichisdenotedasrelativetime0.ForeachconnectiontheMeasurementAgentrecordstheelapsedtimeandtheamountofdatareceived.

19

DraftRecommendationITU-TQ.3961Workflow

Phase5:Uplinkpre-test

20

DraftRecommendationITU-TQ.3961Workflow

Phase5:Uplinkpre-test

• InPhase5,theMeasurementAgentopensn connectionstotheassignedMeasurementPeer.Withineachconnection,theMeasurementAgentsendsadatablockofsizez(randomlypre-generateddatawithhighentropy).Whilethedurationofthepre-testhasnotexceededTp,theMeasurementAgentsendsadatablockofdoublesizecomparedtothelastiterationstep.ThetransferofthelastdatablockwillbefinishedevenifthedurationhasalreadyexceededTp.Attheendofthepre-test,theconnectionsareleftopenforfurtheruse.

21

DraftRecommendationITU-TQ.3961Workflow

Phase6:Uplinksubtest

22

DraftRecommendationITU-TQ.3961Workflow

Phase6:Uplinksubtest

• Withineachofthenconnectionsopenedduringphase5,theMeasurementAgentcontinuouslysendsdatastreams.

• Alltransmissionsstartatthesametime,whichisdenotedasrelativetime0.Foreachconnection,theMeasurementPeergivesfeedbacktotheMeasurementAgentbysendingtheelapsedtimeandtheamountofdatareceived.

23

DraftRecommendationITU-TQ.3961Workflow

Phase7:Finalization

• Afterfinishingalltests,theMeasurementAgentsendsthecollecteddatatotheCollector.AsoptiontheMPcanalsosendthedataaboutthemeasurementtothecollector.BothdatasetscouldbecomparedbytheCollectortocheckthequalityandintegrityoftheresult.Alltests,successfulorunsuccessful,arestoredbytheCollector.

24

ImplementationsinEurope

RTRImplementationwithWeb-Browser

• https://www.netztest.at/en/

26

RTRImplementationTesting procedure

27

RTRImplementationTestResults

28

RTRImplementationTestResultsDiagramm

29

RTRImplementation– Map

30

RTRImplementation,additionalQoSFeatureswithAndroid

31

https://www.netztest.at/de/Opentest?Oa60cedba-6a54-4daf-ab45-5eec6b1ee041

RTRImplementationadditionalQoSFeatureswith Android

VoIPDetails

32

RTRImplementationadditionalQoSFeatureswith Android

TraceRouteDetails

33

Furtherstandardisationdevelopments

34

PlanedInternetrelatedperformanceQoSTestmethods

• ThefollowingInternetrelatedperformanceQoSTestmethodsshouldbestandardized:– Websitedownloadstest- Thewebsitetestdownloadsareferencewebpage(mobile

KeplerpagebyETSI)– Unmodified content - Thistestdownloadsatestwebressource (e.g.image)andchecks

ifitwasmodifiedduringtransport.– Transparentconnection test - Thistestchecksifarequestismodifiedbyaproxyorother

middlebox.– TheDNSTest- DNSisafundamentalInternetservice.Itisusedtotranslatedomain

namestoIPaddresses.Dependingonthetestitischeckediftheserviceisavailable,iftheanswersarecorrectandhowfasttheserverresponds.

– TheTCPTest- TCPisanimportantconnectionorientedInternetprotocol.Itisusedforexampleforwebpagesore-mail.

– TheUDPTest- UDPisanimportantconnectionlessInternetprotocol.Itisusedforreal-timecommunications,e.g.forVoIPandvideo.

– TheVoIPTest- VoIP(VoiceoverIP)isatechnologyforthedeliveryofvoiceacrossIPbasednetworks.

35

Thankyou!

MartinBrandmartin.brand@A1telekom.at