quality of service experienced by mobile broadband users in...
TRANSCRIPT
1
Quality of Service Experienced by MobileBroadbandusersinMyanmar1
June2016
1Thisworkwas carried outwith the aid of a grant from the International Development ResearchCentre,CanadaandtheDepartmentforInternationalDevelopmentUKandfinancialaidsupportingthepurchaseofmobiledevices from theOpenTechnology Institute,NewAmerica. TheassistanceprovidedbyPhyuPhyuThiandMyoMinAungfromtheMyanmarICTforDevelopmentOrganisation(MIDO),ChrisRitzo,CollinAndersonandGeorgiaBullen from theOpenTechnology Institute,NewAmericaandDanajaMaldeniyafromLIRNEasiaisgratefullyacknowledged.
2
TableofContents
1 ExecutiveSummary..................................................................................................................3
2 Methodology...............................................................................................................................52.1 Broadbandparametersanddefinitions.................................................................................52.2 Dataplansselectedfromeachoperator.................................................................................62.3 Methodandlocations....................................................................................................................6
3 Results:ValueforMoney(MbpsperUSD,basedondownloadspeedsfromtheserverinLosAngeles)....................................................................................................................83.1 Natureoftestsite:Business........................................................................................................83.2 Natureoftestsite:Residential.................................................................................................10
4 Results:Downloadspeed,Uploadspeed,Latency&Retransmission..................134.1 Natureoftestsite:Business......................................................................................................134.1.1 Pathein,Ayeyarwaddy..........................................................................................................................134.1.2 Bago,Bago..................................................................................................................................................144.1.3 MyitKyiNa,Kachin................................................................................................................................154.1.4 Hpa-An,Kayin...........................................................................................................................................164.1.5 Mawlamyine,Mon...................................................................................................................................174.1.6 Myeik,Tanintharyi.................................................................................................................................184.1.7 Yangon,Yangon........................................................................................................................................19
4.2 Natureoftestsite:Residential.................................................................................................204.2.1 Hakha,Chin...............................................................................................................................................204.2.2 Demoso,Kayah.........................................................................................................................................214.2.3 Pakokku,Magway...................................................................................................................................224.2.4 Nyaung-U,Mandalay..............................................................................................................................234.2.5 NayPiTaw,NayPiTaw........................................................................................................................244.2.6 Sittwe,Rakhine.........................................................................................................................................254.2.7 Sagaing,Sagaing.......................................................................................................................................264.2.8 Lashio,NorthernShan..........................................................................................................................274.2.9 Hopone,SouthernShan........................................................................................................................28
5 ResultsbyoperatorbasedonNatureofTestsite(Businessv.Residential).....295.1 MPT:Downloadspeed(fromaserverinLosAngeles)....................................................295.2 Ooredoo:Downloadspeed(fromaserverinLosAngeles)............................................305.3 Telenor:Downloadspeed(fromaserverinLosAngeles)..............................................315.4 MPT:Latency(fromaserverinLosAngeles)......................................................................325.5 Ooredoo:Latency(fromaserverinLosAngeles)..............................................................335.6 Telenor:Latency(fromaserverinLosAngeles)...............................................................34
3
1 ExecutiveSummary
MyanmarhasseentremendousgrowthintheInformationandCommunicationTechnology(ICT)sectorsince2011.ThankstomarketliberalizationthecostofaSIMcardwentfromUSD1500toUSD1withinaspanofafewyears(ASIMwithdatacostUSD200in2013).Themarketsawtwonewentrants,OoredooMyanmarandTelenorMyanmarin2013.A4thlicensehasbeenawardedtoViettel.
Research2indicates that social media is one of the main reasons people get online, withFacebookbeing themostpopular followedbyViber andTwitter. In fact, before theprices formobile SIMs and services camedown themobilephonewasbeingusedviaWiFi networks toaccess text and voice services via apps likeViber and Skype.Access to such services requiresadequateQualityofService(QoS).
The importance of non-traditional QoS parametersmust be highlighted. It is often downloadspeedthatisquotedandhighlightedasanindicatorofQoS.However,otherparametersplayanequallyimportantroledependingonwhatthebroadbandserviceisbeingusedfor(Table1).
Service Download(Mbps)
Upload(Mbps)
Latency(RoundTripTime,RTT)
(ms)
PacketLoss(%)
Browsing(Text) ++ - ++ -
Browsing(Media) +++ - ++ +
Downloading +++ - - -
Transactions - - ++ -
Streamingmedia +++ - ++ ++
VOIP + + +++ +++
Games + + +++ +++++Highlyrelevant;++Veryrelevant;+Relevant;-Irrelevant
Table1:Broadbandparametersanditsimportancefordifferentservices(Source:Gonsalves,T.A&Bharadwaj,A.2009)
Forexample,high latency (orRTT, round trip time)will result indelays for theelementsofawebpagetoload,delaysinhearingtheotherpartyduringaSkypecall,etc.3Agoodanalogyisahighway;thebandwidth(capacityavailablefordownload)isanalogoustothenumberoflaneson a highway, where as the latency depicts the distance from a start point to a destination.Various factors can affect the download speed even if latency is low and vice-versa. Thiswasevidentinourrecentdiagnostics(Figure1&Figure2)whereareaswithhighdownloadspeedsdidnotnecessarilymeasureupwellintermsoflatency.
2Ref:LIRNEasiasurveyandhttp://mmrdrs.com/2015/09/24/5-facts-about-the-internet-market-in-myanmar/3AccordingtotheInfocommDevelopmentAuthority(IDA)ofSingaporethebenchmarkforlatencyislessthan50mstoalocalserverandlessthan300mstoaninternationalserverhttps://www.ida.gov.sg/Policies-and-Regulations/Industry-and-Licensees/Standards-and-Quality-of-Service/Broadband-Access-Services/Broadband-QoS-Performance-for-Q1-2016
4
MPT OoredooMyanmar TelenorMyanmar
Figure1:Averagedownloadspeed(inMbpsfromaserverinLA)forMPT,OoredooMyanmarandTelenorMyanmar(Source:LIRNEasia,2016)
MPT OoredooMyanmar TelenorMyanmar
Figure2:Averagelatency(inmstoaserverinLA)forMPT,OoredooMyanmarandTelenorMyanmar(Source:LIRNEasia2016)
Uploadspeedisanotherparameterthattraditionalhasnottakenprecedence,butwillbecomemore important as access and use of the cloud grows. This report contains detailed findings(Section0)ofourresearchforthebroadbandparametersdescribedinthemethodology(Section2).
5
2 Methodology
TherearemanytoolsandmethodsthatcanbeusedtomeasurebroadbandQualityofService.Often,theunderlyingmethodologyadoptedisoneofthereasonsastowhyreadingsvastlydifferbasedonthetoolusedfortesting.4LIRNEasiaconsideredeasytoaccess,non-proprietarytoolsbeforeselectingMeasurementLab’s(M-Lab)NetworkDiagnostictool(NDT).Themethodologyand technical details of the NDT can be found at https://github.com/ndt-project/ndt/wiki/NDTTestMethodology. M-Lab is coordinated through the Open TechnologyInstituteatNewAmerica,aWashingtonDCbasedthinktank.
2.1 BroadbandparametersanddefinitionsThemetricspresentedinthisreportare:
Throughput Categorized further by download speed and upload speed, is theamount of data sent / received by the application from the TCPconnectionoverthedurationoftheTCPconnection.
Throughput=SentorReceived(bytes)/Testduration(seconds)*8/1000
Unit:Mbps
Latency (orRTT,roundtriptime)
The time taken for a packet to reach the destination server andback.Latency=Thesumofallsampledroundtriptimes/ThenumberofroundtriptimesamplesUnit:milliseconds(ms)
Retransmission Therationbetweenpacketsthathadtoberesentasaresultofloss,transmissionerrorsortimeoutsandallpacketssent.
Retransmission = No. of segments transmitted with someretransmitteddata/Totalnumberofdatasegmentstransmitted
Unit:Percentage
Table2:Broadbandparametersdefined(Source:MLab’sNDTTestMethodology5)
4Zuhyle,S.&Mirandilla-Santos,G.2015.MeasuringBroadbandPerformance:LessonsLearnt,ChallengesFaced.Availableat:http://www.cprsouth.org/wp-content/uploads/2015/08/CPR-south-2015_Measuring-Broadband-Performance-Lessons-Learnt-Challenges-Faced_PP21_Final.pdfandBauer,S.etal.2010.UnderstandingBroadbandSpeedMeasurements.MassachusettsInstituteofTechnology.Availableat:http://groups.csail.mit.edu/ana/Publications/Understanding_broadband_speed_measurements_bauer_clark_lehr_TPRC_2010.pdf5https://github.com/ndt-project/ndt/wiki/NDTTestMethodology#client-to-server-throughput-test
6
2.2 DataplansselectedfromeachoperatorGiventhenegligibleavailabilityoffixedbroadbandinMyanmar,thefocuswasonthreesimilarmobiledataplansofferedbyMPT,OoredooMyanmarandTelenorMyanmar.TheSamsung J1wasusedasthetestingdeviceinallinstances.
MPT6 OoredooMyanmar7
TelenorMyanmar8
DataPlan 1.35GB Internet Monthly1.35GB
Smart InternetMonthPack1.25GB
Price MMK6500 MMK6850 MMK6600
AdvertisedSpeed Notadvertised Notadvertised Upto2Mbps
Validity 30days 30days 30days
Table3:Dataplansusedfordiagnostics,LIRNEasiaMay2016
2.3 Methodandlocations
Theresearchersconducteddiagnosticsontwoweekdaysandaweekend(4daysintotal)duringthe 2nd week inMay 2016, atmultiple times of the day (8:00, 11:00 15:00, 18:00 20:00 and23:00)soastoironoutpotentialpeak/off-peaktrafficvariations.
Researcherswereinthefollowinglocationscoveringallstates/regions(Figure3andTable4).
Ideally, multiple locations will be covered togeographically represent a state / region. However,asthisisaresource-intensiveexerciseonetownshipwas selected per state / region. Diagnostics werecarriedoutinonelocationpertownship.
Figure3:TownshipswithineachState/Region,(LIRNEasia,May2016)
6http://www.mpt.com.mm/en/product-services/mobile/internet-packages/7http://www.ooredoo.com.mm/en/Personal/Plans/Prepaid/Internet-Pack.aspx8https://www.telenor.com.mm/page/smart-internet/173
7
State/Region CapitalCity
Townshipstests wereconductedin
AreainSq.Km
Population(2014Census)
Natureoftestsite
AyeyarwaddyRegion Pathein Pathein 35,031.90 6,184,829 BusinessBagoRegion Bago Bago 39,404.40 4,867,373 BusinessChinState Hakha Hakha 36,018.90 478,801 ResidentialKachinState Myit Kyi
NaMyitKyiNa 89,041.80 1,689,441 Business
KayinState Hpa-an Hpa-an 30,382.80 1,574,079 BusinessKayahState Loikaw Demoso 11,731.50 286,627 ResidentialMagwayRegion Magway Pakokku 44,820.60 3,917,055 ResidentialMandalayRegion Mandalay Nyaung-U 30,888.10 6,165,723 ResidentialMonState Mawlamyi
neMawlamyine 12,296.60 2,054,393 Business
NayPyiTaw Naypyitaw Naypyitaw 7,057.10 1,160,242 ResidentialRakhineState Sittwe Sittwe 36,778.10 3,188,807 ResidentialSagaingRegion Monywa Sagaing 93,702.50 5,325,347 ResidentialShanState(North) Taunggyi Lashio 155,801.40 5,824,432 ResidentialShanState(South) Taunggyi Hopone ResidentialThanintharyiRegion Myeik Myeik 43,344.90 1,408,401 BusinessYangonRegion Yangon Yangon 10,276.70 7,360,703 Business
Table4:TownshipsandState/Regioncharacteristics,LIRNEasiaMay2016
ServersusedforthediagnosticswerewithincoretransitlocationsinBangkokandLosAngeles.TheNDT servers are outside of ISP networks, within data centers that have direct upstream transitconnectivitytotheInternet(Tier1networks).Thisplacementisintendedtocomparetoactualuserexperience,wheremorethanonenetwork ispotentially involvedinthedeliveryofcontent.This isdifferent from isolating only one component of the ecosystem as other testing infrastructuressometimesdo,suchastotheaccessprovider’sedge.
TheintendeduseoftheserverinBangkokwastoreplicateitasalocallyhostedserver.Thiswastheinitialhypothesis.However,oncompletionofthediagnostics itwasevidentthattheNDTserver inneighboringBangkokcannotbeaproxyforaserverwithinthenationaldomain.TraceroutesfromYangon towww.google.comand to theNDT servers in LAandBangkok illustrate the routes takenbetweentheclientandserver.SeveralprivateIPaddresseswereencounteredwhicharemostlikelytobewithintheserviceprovider’snetworkandpacketsreached/wasroutedthroughBangkokaftera significant number of hops. Ideally, a locally hosted serverwould be used tomeasure BBQoSEwithinthelocaldomain.
8
3 Results:ValueforMoney(MbpsperUSD,basedondownloadspeedsfromtheserverinLosAngeles)3.1 Natureoftestsite:Business
9
10
3.2 Natureoftestsite:Residential
11
12
13
4 Results:Downloadspeed,Uploadspeed,Latency&Retransmission4.1 Natureoftestsite:Business
4.1.1 Pathein,Ayeyarwaddy
MPT–BKKServer MPT–LAServer Ooredoo–BKKServerOoredoo–LAServer Telenor–BKKServer Telenor–LAServer
14
4.1.2 Bago,Bago
MPT–BKKServer MPT–LAServer Ooredoo–BKKServerOoredoo–LAServer Telenor–BKKServer Telenor–LAServer
15
4.1.3 MyitKyiNa,Kachin
MPT–BKKServer MPT–LAServer Ooreedo–BKKServer Ooreedo–LAServer Telenor–BKKServer Telenor–LAServer
16
4.1.4 Hpa-An,Kayin
MPT–BKKServer MPT–LAServer Ooreedo–BKKServer Ooreedo–LAServer Telenor–BKKServer Telenor–LAServer
17
4.1.5 Mawlamyine,Mon
MPT–BKKServer MPT–LAServer Ooreedo–BKKServer Ooreedo–LAServer Telenor–BKKServer Telenor–LAServer
18
4.1.6 Myeik,Tanintharyi
MPT–BKKServer MPT–LAServer Ooreedo–BKKServer Ooreedo–LAServer Telenor–BKKServer Telenor–LAServer
Lower the bet ter
19
4.1.7 Yangon,Yangon
MPT–BKKServer MPT–LAServer Ooreedo–BKKServer Ooreedo–LAServer Telenor–BKKServer Telenor–LAServer
Lower the bet ter
Lower the bet ter
20
4.2 Natureoftestsite:Residential
4.2.1 Hakha,Chin
MPT–BKKServer MPT–LAServer
21
4.2.2 Demoso,Kayah
MPT–BKKServer MPT–LAServer Telenor–BKKServer Telenor–LAServer
22
4.2.3 Pakokku,Magway
MPT–BKKServer MPT–LAServer Ooreedo–BKKServer Ooreedo–LAServer Telenor–BKKServer Telenor–LAServer
23
4.2.4 Nyaung-U,Mandalay
MPT–BKKServer MPT–LAServer Ooreedo–BKKServer Ooreedo–LAServer Telenor–BKKServer Telenor–LAServer
24
4.2.5 NayPiTaw,NayPiTaw
MPT–BKKServer MPT–LAServer Ooreedo–BKKServer Ooreedo–LAServer Telenor–BKKServer Telenor–LAServer
25
4.2.6 Sittwe,Rakhine
MPT–BKKServer MPT–LAServer Ooreedo–BKKServer Ooreedo–LAServer Telenor–BKKServer Telenor–LAServer
26
4.2.7 Sagaing,Sagaing
MPT–BKKServer MPT–LAServer Ooreedo–BKKServer Ooreedo–LAServer Telenor–BKKServer Telenor–LAServer
Note:Max.valueofy-axisishigherincomparisontoothergraphs
27
4.2.8 Lashio,NorthernShan
MPT–BKKServer MPT–LAServer Ooreedo–BKKServer Ooreedo–LAServer Telenor–BKKServer Telenor–LAServer
28
4.2.9 Hopone,SouthernShan
MPT–BKKServer MPT–LAServer Ooreedo–BKKServer Ooreedo–LAServer Telenor–BKKServer Telenor–LAServer
Lower the bet ter
29
5 ResultsbyoperatorbasedonNatureofTestsite(Businessv.Residential)
5.1 MPT:Downloadspeed(fromaserverinLosAngeles)
30
5.2 Ooredoo:Downloadspeed(fromaserverinLosAngeles)
31
5.3 Telenor:Downloadspeed(fromaserverinLosAngeles)
32
5.4 MPT:Latency(fromaserverinLosAngeles)
33
5.5 Ooredoo:Latency(fromaserverinLosAngeles)
34
5.6 Telenor:Latency(fromaserverinLosAngeles)
35
About
In itspositionasa think-tankactiveacrossSouthAsiaandSouthEastAsiaLIRNEasia,since 2008, has been carrying out broadband quality of service diagnostics asexperiencedbyusers inmultiplecities intheregion.9Themainobjective is toprovideresearch-based input to relevant policy discourse. Our non-proprietary research isavailableviawww.lirneasia.net and canalsobeusedby consumers tomake informeddecisions. Our research findings have been extensively shared with the likes of TheEconomic and Social Commission for Asia and the Pacific (ESCAP), South AsianTelecommunicationRegulators'Council (SATRC), training coursesofferedby theFordFoundation and via engagements withmultiple national regulatory authorities in theregion.
9Refer:http://lirneasia.net/projects/ict-indicators/