jennifer m. schopf, cathrin stöver, pascal hoba – principal … · 2020. 8. 11. · 1 neaar...

NEAAR Award #1638863

Year 2 Quarter 4 and Annual Report 1 June 2017 through 31 May 2018

Jennifer M. Schopf, Cathrin Stöver, Pascal Hoba – Principal Investigators

Summary TheNetworksforEuropean,American,andAfricanResearch(NEAAR)projectsupportscircuitsandnetworkservicesbetweentheUSandEurope,inadditiontoextensivetrainingandscienceengagementactivitiestosupportUScollaborationswithresearchersinEuropeandAfrica.Thisreportoutlinescollaborations,scienceengagement,operationalactivities,andusagestatisticsforYear2oftheproject.ItcoverstheperiodJune1,2017throughMay31,2018.HighlightsofYear2includetheexpansionofourscienceengagementandcollaborationactivities,successfulperfSONARtrainingwithAfricanpartners,andjoiningtheAdvancedNorthAtlanticnetworkingconsortium.InYear3wewillfocusonfinalizingthedeploymentoftheopenexchangepoint,addingpeeringbetweentheNEAARASandotherNRENsdirectlyviaourconnectionattheLondonOpenExchange,continuingtoincreasethescopeofourengagementandapplicationidentificationefforts,andexpandingourtrainingeffortstoincludeindividualNRENs.

1. NEAAR Overview NEAARsupportstheuseof100GnetworksbetweentheUSandEuropewithafocusonmeasurementandendusersupport.TheNSFfundednetworkforthisprojectisa100GcircuitbetweenNewYork(ManLan)andLondon(GEANTOpenExchange).Inaddition,GEANTrunsasistercircuitthatisa100GbetweenManLanandParis.Thesecircuitsareusedinproductiontosupportawidevarietyofscienceapplicationsanddemonstrationsofadvancednetworkingtechnologies.Inaddition,theNEAARawardsupportsscienceengagement,applicationoutreach,measurementtooldeployments,trainingworkshops,andsecurityactivities.

2. Staffing AtthebeginningofYear2,theNEAARprojectsupportedthefollowingstaffmembersatIU:● JenniferSchopf,Director● AndrewLee,InternationalNetworksarchitect● ScottChevalier,perfSONARspecialist● PredragRadulovic,ScienceEngagementSpecialist● EdMoynihan,ScienceEngagementConsultant,parttimecontractor

DuringQuarter1,EdwardMoynihanshiftedfrombeingaparttimecontractortoafulltimeIUemployee.OnJune6,Radulovicleftthegrouptopursueotheropportunities.InQuarter2,wehiredanadditionalcontractor,AntoineDelvaux,toassistwithperfSONARtrainingworkshops,especiallyinFrench-speakingpartsofWestAfrica.DelvauxalsoworksinasimilarroleforPSNC,thePolishNREN,andhasassistedwithperfSONARworkinAfricapriortothis.HeisbasedinSenegalandiscontractedonaper-workshopbasisforassistancewithmultiple-daytrainingsessions.Inaddition,inOctober,wehiredHeatherHubbardasaprojectcoordinatorwhoisassistingwithprojectplanningandevents.AttheendofYear2,projectstaffincluded:● JenniferSchopf,Director● AndrewLee,InternationalNetworksArchitect● EdwardMoynihan,ScienceEngagementSpecialist● ScottChevalier,perfSONARSpecialist● AntoineDelvaux,perfSONARConsultant● HeatherHubbard,Projectsupport

InYear3,EdMoynihanwilltakeonadditionalprojectmanagementresponsibilitiesinanexpandedrolefortheproject.Inaddition,weareplanningtohireanewteammembertosupportourperfSONARtrainingandScienceEngagementefforts.Thiswillhelpusmeettheincreaseddemandfortrainingandtoexpandourresearcheroutreachefforts.

3. Conference and Workshop Travel NEAARstaffparticipatedinvariousmeetingstosupporttheirroleincollaborationsinEuropeandAfrica.Someofthesetripswerefundedbyothersources.DetailontravelforQ1-3weregiveninpreviousreports.InYear2,theseincluded:

● Schopf,Lee,Moynihan,PascalHoba(UbuntunetAlliance),CathrinStöver(GEANT),YousefTorman(ASREN),andBoubakarBarry(WACREN)attendedTNC17,May29-June2,inLinz,Austriahttps://tnc17.geant.org/.

● ChevalierattendedperfSONARmeetingatUniversityofMichigan,June7-10,inAnnArbor,MI.

● SchopfattendedPEARC17July9-13inNewOrleans,LAhttps://www.pearc17.pearc.org/.

● Schopf,Lee,andMoynihanattendedEarthScienceInformationPartners(ESIP)SummerMeeting2017,July25-28,inBloomington,INhttp://www.esipfed.org/meetings/upcoming-meetings/esip-summer-meeting-2017.

● SchopfattendedNationalResearchPlatformWorkshop,August7-8,inBozeman,MThttp://prp.ucsd.edu/events/the-first-national-research-platform-workshop.

● SchopfspentadayatNSFinlateSeptemberbriefingtheprogramofficeonthestatusofNEAARandotherprojects.

● Leeattendedthe2017AnnualGLIFWorkshop,September25-27,inSydney,Australiahttps://www.glif.is/meetings/2017/.

● LeeattendedtheANZSDNworkshop,September28,attheUniversityofNewSouthWaleshttp://www.anzsdn.net/index.php/event/sdn-workshop-2017/.

● ChevalierandDelvauxledafour-daybilingualin-depthperfSONARtrainingsessioninconjunctionwithWACRENinAccraGhana,October9-12.

● SchopfattendedtheInternet2TechnicalExchange,October15-18,inSanFrancisco,CAhttps://meetings.internet2.edu/2017-technology-exchange/.

● Moynihan,YousefTourman,CathrinStöver,VeronikaDiLuna,PascalHoba,BoubakarBarry,andOmoOaiyaattendedtheUbuntunetConnect‘17meeting,October31-November3,inAddisAbaba,Ethiopiahttps://ubuntunet.net/event/ubuntunet-connect-2017.SchopfhadplannedtoattendthismeetingaswellbutcouldnotduetoVisaissuesontheEthiopianside.

● Schopf,Lee,andChevalierattendedSuperComputing‘17,November12-17,inDenver,Coloradohttps://sc17.supercomputing.org/.

● MoynihantraveledtoAmsterdam,Netherlands,wherehemetwithleadersofNEAARprojecttodiscussfuturedirectionofengagementefforts.HealsometwithGÉANTscienceengagementstafftodiscussUS-Europeancollaboration.

● Moynihanhadplannedtoattendthe7thInternationalPlatformonIntegratingArabe-InfrastructureinaGlobalEnvironment,e-AGE17conference,December3-4,inCairo,Egypt,http://asrenorg.net/?q=content/e-age-2017.However,duetoincreasedterroristactivityintheregion,approximatelyathirdoftheregisteredparticipants(includingalloftheAmericans)didnotattend.

● SchopfandLeeattendedPTC’18,January21-24,inHonolulu,HIhttps://www.ptc.org/ptc18/.

● MoynihanattendedtheFederationofEarthScienceInformationPartners(ESIP)WinterMeeting2018,January8-11,inBethesda,MDhttp://www.esipfed.org/meetings/upcoming-meetings/esip-winter-meeting-2018.

InProjectQuarter4,travelincluded:● MoynihanattendedLHConemeeting,March6-7,inAbingdon,UnitedKingdom,

https://indico.cern.ch/event/681168/.HegaveanupdateonIndianaUniversity’sInternationalNetworks(IN@IU)andalsometwithGEANTResearchEngagementteamtodiscusssupportingUS/Europeansciencecollaborations.

● SchopfattendedtheCENICSpringMemberMeeting,March6-8,inMonterey,CAhttps://cenic.org/conference.ShehadsidemeetingswithNSF,NSRC,KENET,andothersrelatedtoNEAAR.

● Schopf,Moynihan,andDelvauxattendedtheWACRENConference2018,March14-16,inLome,Togohttps://indico.wacren.net/event/59/page/1.Theyattendedaface-to-facemeetingwithNEAARteamleadstoplannextstepsfortheproject.MoynihangaveatalkonScienceengagement.DelvauxbriefedtheattendeesonthecurrentworkwithperfSONARandmeasurementandmonitoringacrossWACREN.One-on-onemeetingswerealsoheldwithCathrinStöver,GEANT;DaleSmith,NSRC;UrsulaChomicka,I2;BoubakarBarry,WACREN;PascalHoba,UbuntunetAlliance;andJulioIbarra,FIU.

● Schopf,Lee,andMoynihanattendedInternet2GlobalSummit,May6-9,inSanDiego,CAhttps://meetings.internet2.edu/2018-global-summit/.Moynihangaveatalkon

scienceengagementandAfrica.TheyalsoattendedtheIRNCProjectmeetingandbriefedbothNSFandInternet2staffonthestateoftheproject.SidemeetingswerealsoheldwithmembersofNIHaboutongoingworkinAfricaandpossiblepointsofcollaboration.

● DelvauxattendedAIS,April29-May11,inDakar,Senegalhttps://www.internetsummit.africa/. DelvauxpresentedperfSONARmaterialscoveringvarioustopics,includingtheinstallationprocessandpSConfig,andgaveparticipantstheopportunitytousethetoolkitGUItoperformmeasurementtests.

4. Science Engagement Activities ThroughoutYear2,ourScienceEngagementteamworkedtobetterunderstandandsupportUSscientistsworkinginEuropeandAfrica.TheteamconnectedwithAfricanandEuropeaninstitutionsandresearchprojects,beganoutreachtoUSresearchersandtheircollaborators,andcoordinatedwithinternationalpartnersformorecohesiveuserengagementefforts.Examplesoftheseengagementsinclude:

● AcademicModelProvidingAccesstoHealthcare(AMPATH)–TheAMPATHprojectisnowamemberoftheKenyanResearchandEducationNetwork(KENET),whichhasenabledtrafficbacktotheUStobeoverproductionR&Enetworks.OurdiscussionscontinueonhowtoconnectAMPATHsitesinmoreremoteareasofKenya.

● AgReachandNjalaUniversity–TheSierraLeoneResearchandEducationNetwork(SLREN)isplanninganexpansionoftheirdomesticnetwork,whichwillpotentiallybenefitAgReach(whichsupportssmallholderfarming)whenNjalaUniversityisconnected.Afollow-upmeetingwasheldtodiscussimprovingconnectivitytoNjalaonbehalfofAgReach.WealsodiscussedopportunitiesforSLRENtoparticipateinafutureperfSONARtrainingworkshop.

● HydrogenEpochofReionizationArray(HERA)andtheUniversityofCalifornia–OurteamfacilitatedconferencecallswithHERAinvestigatorsatUCBerkeleyandNRENsinEngland(JISC)andinSouthAfrica(SANREN)todiscusscurrentandfuturedatatransferandstoragerequirementsforHERAanditssistertelescopePrecisionArrayforProbingtheEpochofReionization(PAPER)inWestVirginia.

● TheLow-FrequencyArray(LOFAR)andGeorgeWashingtonUniversity(GWU)–WecontinuetoworkwithpartnerstopromotetheuseofScienceDMZsattheNetherlandsInstituteforRadioAstronomy(ASTRON)andotherlowfrequencyarrayradiotelescope(LOFAR)facilities.

● FederationofEarthScienceInformationPartners(ESIP)-WecontinuetotargettheUSGeosciencecommunityandareworkingwithESIPtohighlighthowNEAARcansupportresearcherswithlargedatatransferneeds.AttheWinterESIPmeeting,wefollowedupwithresearchersfromOlduvaiFieldSchoolonsupportingtheirNSF-fundedPaleontologyprojectsinTanzaniaandwithNASArepresentativesonbetterunderstandingcurrentnetworkuseandfuturerequirementsfordataintensiveprojects.

● NationalInstitutesofHealth(NIH)–DiscussionsadvancedonvariousNIHtopicsthroughseveralconversationswithChrisWhalen,InternationalProgramManagerattheNationalInstituteofAllergyandInfectiousDiseases,NIH.OneoutcomeisthattheNIH-fundedPanAfricanBioinformaticsNetworkforHumanHeredityandHealthinAfrica(H3Africa),knownasH3ABioNet,thatrunsclinicsacrossAfricaisnowbeginningtodeployperfSONARattheirsitesforongoingtesting.

● ResearchandEducationNetworkforUganda(RENU)-WebeganworkingmorecloselywithRENUstafftotroubleshootperfSONARdeploymentsandtoidentifyUSresearchprojectsaspossiblemembersofRENU.ThisworkledtotargetedoutreachtomultipleentitiesinUganda,includingtheBaylorUgandaOrganizationandtheUgandaCancerInstitute.DiscussionscontinuetoidentifyUSresearchercollaboratorsinUganda.

● UniversityofRwanda(UR)-WeexploredopportunitiesforsupportingfourCentersofExcellencehostedbytheCollegeofScienceandTechnologyattheUniversityofRwanda.WeparticipatedinadiscussionwithUR’sAfricanCenterofExcellenceonInternetofThingstoexploregettingURconnectedtoR&Einfrastructure.

● e-MedicinePan-Africaninitiative,Namibia-WefollowedupondiscussionswithIsaacKasana,theCEOofRENUinUgandatodiscusssupportforthisinitiativeandforthedevelopmentofR&EconnectivityingeneralinNamibia.

● IvorianTelecommunicationNetworkforEducationandResearch(RITER)-WefolloweduponYear1discussionswithRITERleadershiptofindwaystosupportresearchersdevelopinga“Virtuallibraryfortheimprovementofhighschool''.

● CovenantUniversity,Nigeria–Weassistedthegeographicinformationsystem(GIS)andremotesensingdepartmentattheuniversitymakecontactwithboththeNigerianNRENandWACRENinordertotakeadvantageofR&EconnectivitytodownloadEarthobservation(EO)dataforresearchpurposes.

● SouthAfricanTuberculosisBioinformaticsInitiative(SATBBI)–Weworkedwith theSouthAfricanResearchNetwork(SANReN)toidentifyandconnectwithProfessorGerardTrompatStellenboschUniversitytosupporthistuberculosisresearch.

● AfricanVery-Long-BaselineInterferometry(VLBI)Network(AVN)-WeareworkingwithGhanaianAcademicandResearchandEducationNetwork (GARNET)andSANReNtounderstandfuturerequirementsfortheAVNandalsospokewithGEANTaboutsupportforAVNwhenitbecomesanofficialpartneroftheEuropeanVLBI.

● TheHaystackVBLIprojectandMassachusettsInstituteofTechnology(MIT)–WeconnectedwithGEANT’sengagementteamregardingpossibleUS-EuropetrafficfromVBLIradioastronomyfacilities.

● DeepUndergroundNeutrinoExperiment(DUNE)-WespokewithPhilDemurfromFermiNationalAcceleratorLaboratory(FNAL)aboutthefutureinternationalnetworkingrequirementsoftheDUNEcollaboration.Theprojectwillbringtogetherover1,000scientistsfrom30differentcountries.Thefirstprototypeswillbeinstalledin2018.Thedetectorswon’tbefullyoperationaluntil2026.

● GlobalMonitoringforEnvironmentandSecurity(GMES)andAfricaInitiative–WeworkedwiththeEUandtheAfricanUnionCommissionGMESandAfrica

Initiative.ThisisalongstandingcollaborationbetweenAfricaandEuropeintheareaofspacesciencetechnology.DiscussionstookplacewithanumberofkeyR&EpartnersinAfricatoensurecontactsaremadewithpotentialendsites.ThisisinanticipationofprovidingEarthObservationdatafromEuropeaninstitutionstotheseendsites.

● SquareKilometerArea(SKA)SouthAfrica–GEANTisinvolvedinhelpingdesignandbuildtheglobalnetworkinfrastructureforphase1oftheSKA,incollaborationwiththeSouthAfricanNREN(SANREN).TheSKAtelescopewillconnectthousandsofdishesandaperturearraytelescopes,spreadacrosstwosites,oneinSouthAfrica,andtheotherinWesternAustralia.TheheadquartersfortheoverallprojectislocatedintheUnitedKingdom.

Ourengagementeffortsalsoincludedoutreachtoover100NSF-fundedresearcherstoassesstheirinternationaldatatransferneedsandrequirements.ThisincludedsendingoutreachemailstoNSFPartnershipsforInternationalResearchandEducation(PIRE)awardeesandtoresearchersworkinginwaterandclimatesciencethroughoutAfrica.TheseoutreachemailsweredesignedtoprovidemoreinformationaboutNEAAR,toassessiftheseresearchersandtheircollaboratorshadinternationaldatatransferneeds,andtoofferassistancewherenecessary.Theresponseratetotheseemailswasapproximately10%.Follow-upsfromthisoutreachincluded:

● RichardDick-OhioStateUniversity-WeheldaseriesofcallstodiscusshisworkinSenegalanddetermineifconnectingtoR&Einfrastructurewaspossible.WealsodiscussedthepossibilityofbuildingsupportforapossiblesubmissiontotheNSFResearchCoordinationNetwork(RCN)program.

● LiHuang-MontanaStateUniversity–WehostedateleconferenceondatatransferrequirementsforPlantGenomicsprojectsinSouthernAfrica.HuangisnotcurrentlyshippingdisksbuthasinthepastandfutureprojectsmayrequirebetteraccesstotheR&Enetworks.

● JenniferHausman-NASA’sSurfaceWaterandOceanTopography(SWOT)project–Newsatelliteswillbelaunchedwithinthreeyearsproducingterabytesofdataperday.Initialcontactwasmadeviaemailandfollow-upstookplaceattheWinterESIPmeeting.

● ChristopherTengi-PrincetonUniversity–PrincetonhasresearchersworkinginmultiplelocationsinKenya.InitialcontactwasmadetohelpassesstheirperformancefromKenyabacktotheUSandtoputthemintouchwithKENETstaff.Severalunsuccessfulfollow-upattemptsweremadetoarrangeameetingofstakeholders.

● RobGardner-UniversityofChicago–GardnerwasexperiencingsignificantpacketlossmovinghighenergyphysicsdatafromItalytoChicago.WeareworkingwithGEANTtotestperformancenowthattheNEAARcircuitisinplaceandhavenotbeenabletoreplicatethisproblem.

● JamesWestwood-VirginiaTechUniversity–WeheldateleconferencetodiscussPlantScienceprojectsanddatatransferneedsinAfrica.Noimmediatefollow-upswererequired.

● FrederickSemazzi-NorthCarolinaStateUniversity–WesentemailexchangesonClimateModelingprojectsthroughoutAfricainsupportofhisLetterofCommitmentfortheNEAARproposal.Hehasnocurrentissuesmovingdata.

● KenMiller-PennStateUniversity–WeconnectedwithMillerregardingPennStateresearchinAfricaandpotentialITcontactsforPSUprojects.

ThroughoutYear2theScienceEngagementteamalsoworkedtocoordinateactivitieswithinternationalpartnerorganizationstohelpidentifyandsupportUSresearcherswithdatatransferrequirementsinAfricaandtopromotethevalueofinvestinginresearchandeducationnetworking.Thisincluded:● ASREN-MoynihangavearemotepresentationonNEAARandinternationalscience

engagementtothe7thInternationalPlatformonIntegratingArabe-InfrastructureinaGlobalEnvironment,e-AGE17conference,inCairo,Egypt.http://asrenorg.net/eage2017/?q=content/program

● GEANT–SchopfandMoynihanmetwithrepresentativesfromGEANTatTNC17todiscussinvolvementinandfollow-upstotheMAGIC,TANDEM,andSCI-GAIAprojects.MoynihanalsometwiththeGEANTResearcherEngagementandInternationalRelationsteamstodiscusscollaborativeengagementwiththePartnershipforAdvancedComputinginEurope(PRACE),theEuropeanGridInfrastructure(EGI),theEuropeanBioinformaticsInstitute(EBI),andEU-MEDSTAT.MoynihanparticipatedintheSteeringCommitteeofGEANT’sTaskForceforResearcherEngagementDevelopment(TF-RED).

● Internet2-SchopfandMoynihanmetwithInternet2representativesattheWACRENmeetinginTogotodiscusscoordinationofoutreachactivitiesinAfrica.MoynihanalsoledasessionandpaneldiscussionattheInternet2GlobalSummitonhowtheglobalR&EnetworkingcommunityisworkingtogethertostrengthenandsupportNRENsandresearchinAfrica.

● SANReN–SchopfandMoynihanmetwithSANReNstaffatTNC17todiscusscollaborationandcoordinationofScienceEngagementefforts.Throughouttheyear,regularcallswereheldtodiscussbestpracticesandtoidentifypotentialoutreachtargets,includingtrackingcollaborationswithHydrogenEpochofReionizationArray(HERA),theSouthAfricanTuberculosisBioinformaticsInitiative(SATBBI),theAfricanVLBINetwork(AVN),theHartebeesthoekRadioAstronomyObservatory,andforgenomicsresearcherscollaboratingwithUSpartners.

● WACREN-MoynihangaveapresentationattheWACRENmeetinginLome,Togo,ontheprofessionalpracticeofscienceengagement.ThepresentationhighlightedtheimportanceofenduserengagementandthevalueforNRENsofdedicatingresourcestoendusersupport.ThetalkledtoconversationswithWACRENmembersaboutendusersinWestAfricainneedofsupportandaboutwaysofreachingouttothem.Thepresentationslidesarehere:https://indico.wacren.net/event/59/contribution/16/material/slides/1.pdf

● GLIF-InternationalNetworksatIndianaUniversitybecameasponsorofGLIF,theGlobalLambdarailIntegratedFacility(https://www.glif.is/).WehavebeenparticipantsinGLIFmeetingsandactivitiesformanyyears,andthissponsorshipshowsourcommitmenttoglobaleffortswithR&Enetworks.

InYear3,wewillcontinueeffortstoidentify,engage,andsupportscientificresearchandeducationalprojectsthroughoutAfrica.OurscienceengagementstrategywillfocusonworkingwithourAfricanregionalpartnerstoemphasizetheneedforandvalueofactiveenduserengagementwithintheAfricanNRENcommunity.Wewillalsoworkwithourregionalpartnerstoidentifycollaborationsthatcouldbenefitfromgreateraccesstonetworkresources.ThiswillincludeleveragingnewstafftoexpandouroutreachtogroupsidentifiedthroughflowdataanalysisandbyupdatingourdatabasesofNSF-fundedprojectstoidentifyandreachouttoprojectsfundedwithinthelastyear.WewillalsolooktoincreaseourworkwiththeGEANTResearchEngagementteamandotherEuropeanpartnersinsupportofUScollaborationsinEurope.Iftheanalysisandoutreachleadstoincreasedresearcherbuy-in,wewillalsopursuehostingadomainfocusedworkshopwithNEAARpartnersinYear3orYear4. 5. PerfSONAR Development and Training TheNEAARprojectsupportsaperfSONARdeploymentattheManLanendpointoftheNEAARcircuitthatprovidesperiodictestingbetweenseveralUSandEuropeansites.NEAARparticipatesintheIRNCmeshavailableathttp://data.ctc.transpac.org/maddash-webui/index.cgi?dashboard=IRNC%20Mesh.5.1 perfSONAR Consortium IUparticipatesintheproductionperfSONARconsortium,whichoverseestheproductiondevelopmentandsupportoftheperfSONARtoolkit.Chevalierleadsthetraininggroup,andparticipatedinseveralperfSONARmeetingsincludingthebi-annualface-to-facemeetingwiththeDeveloperTeam,whichtookplaceinAnnArbor,MI.UpdatestotheperfSONARtrainingmaterialscontinuedthroughoutthisperiodcoveringthetransitionfromversion3.5to4.0.2ofthesoftwaresuite.Additionally,ChevalierparticipatedasamemberoftheDevOpsteamduringtheSuperComputingconferenceinDenver,CO.ActivitieswerefocusedonimplementingandmonitoringperfSONARserversatSC17.5.2 perfSONAR Training Separatefrommonitoringourowncircuit,oneofthegoalsoftheNEAARprojectistosupporttheuseofperfSONARbroadlyacrossEuropeandAfricatohelpsupportunderstandingnetworkbehaviortoassistindatasharingbetweenUSresearchersandthoseintheregionviadeploymentsandtrainingforthethreeAfricanRegionalRENs.InYear2Quarter2,weheldaworkshopinAccra,Ghana,withWACREN-https://indico.wacren.net/event/54/.Thisbi-lingualfourdayeventwasledbyChevalierandDelvaux.Twenty-oneparticipantsfromWACRENinstitutionsdescribedtheircurrentnetworkconnectivityandstructure,receivedadvicefrominstructors,builttheirownperfSONARsmallnode,learnedhowtotestandinterpretresults,andthenconfiguredthemachinestoworktogetherasadashboard.Onthefinaldayoftheworkshop,participantsreconfiguredmachinestocoordinateinamorepermanentWACRENMaDDashinstallation(http://central-lagos.ps.wacren.net/maddash-webui/).ConfigurationeffortscontinueasmoreofWACREN’sNRENmembersbecomeconnected.EachofthetenWACRENmemberinstitutionsreceivedorhaveintrustasmallnodeconfiguredtointeractwiththe

dashboard.AnadditionalperfSONARserverwasinstalledinLagostoserveasthecentralWACRENtestpoint.Workshopparticipantsweresurveyedatthecompletionoftraining.Oftheeighteenparticipatingengineersallresponded.Priortotheworkshop76%ofparticipants(13)reportedbeing‘notatall’or‘notveryknowledgeable’aboutperfSONAR,nonewerefamiliarwithpScheduler,andonlyoneparticipanthadanyfamiliaritywithMaDDashorMeshConfig.Atthecompletionoftraining,allengineersreportedbeing‘somewhatknowledgeable’or‘veryknowledgeable’aboutperfSONAR,withseventeensayingthesameaboutMaDDash,andallengineersreportinganincreaseinknowledgeregardingMeshConfig.Inaddition,weheldtwoperfSONARinformationsessionsinconjunctionwiththeUbuntuNetConnect‘17meetinginAddis,Ethiopia,inNovember-https://events.ubuntunet.net/indico/event/10/.TheseonehourintroductionsprovidedanoverviewoftheperfSONARtoolkitandprovidedexamplesofhowtheNEAARpartnersareworkingtogethertoprovidehardware,onthegroundassistancefortraining,andongoingengineeringandtechnicalassistanceforperfSONARinAfrica.ThesetalksalsohelpedassessfuturedemandfortrainingworkshopsforUbuntuNetpartnerNRENs.InYear2Quarter3,webeganpreparationsandlogisticsforaperfSONARtrainingworkshoptobeheldinMay2018attheAIS/AFRINICconferenceinDakar,Senegal.Onrequestfromtheproject’sAfricanpartners,thistrainingwasplannedasafull-continent,cross-RENworkshopforover30participantsfromASREN,UbuntuNetAlliance,andWACREN.(SeeMilestone4.13).However,duetologisticalchallengesandpartnermiscommunicationsduringtheplanningphases,itwasagreedthatthisworkshopwouldbecancelled.Thecancellationofthisworkshopledustore-evaluateourapproachtoworkshopplanningandtothedevelopmentofnewproceduraldocumentsdesignedtohelpwithfutureworkshopplanningandexpectations.Werefocusedourapproachsothatwecouldbesureitwouldresultinafunctioningmonitoringmeshforanetworkregionthatcouldmakeuseofboththetrainingandinfrastructureinatimelyfashion.ThisalsomeantshiftingtoworkingdirectlywiththeNationalnetworks,whichnowincludesaformalintakeformwithclearerexpectationsanddeadlines,clarificationonrequirementsoflocalresources,asimplerdefinitionofwhattheNEAARteamcouldcontributeversuswhatwasneededfromalocalsite,andatimelineofcontactpointstoensuretheoutcomeofameasurementmeshfortheregionwhichwouldbewellsupportedafterthetrainingtookplace.ThishasresultedinplanningforseveralindividualNRENtrainingstobeheldlaterin2018andearly2019.TheseincludepotentialworkshopswithZAMREN(Zambia),TERNET(Tanzania),MoRENet(Mozambique),andASREN(Jordan).AspartoftheAfricanInternetSummit(AIS-2018),DelvauxparticipatedintheInternetMeasurementsandResearchinAfricaworkshopandledahands-onperfSONARtrainingsessionfor25participantsinplaceofthelonger,cancelledworkshop.

InYear3,inadditiontotheplannedworkshopsinZambia,Tanzania,Mozambique,andJordan,weareplanningtoworkwiththeUbuntunetAlliancetodeploythree10Gnodesontheirbackbone,assistinthesetupanactivemesh,andinstallMadDash.WealsoplantoworkwithASRENfollowingtheirtrainingworkshoptosetupameshandinstallMadDashfortheASRENbackbone.AcrossalloftheIN@IUprojects,theperfSONARtrainingteamisnowfullybookedforthenext12months.Becauseofthis,wewillbebringingonanadditionalstaffmemberinYear3tohelpmeetthedemandforNREN-focusedperfSONARworkshops.5.3 perfSONAR Node Distribution AttheendofYear2,NEAAR-providedperfSONARnodeshavebeenallocatedwiththefollowingdistribution:

● WestandCentralAfricanResearchandEducationNetwork(WACREN)-Lagos,Nigeria-Rack-mountedmeasurementarchiveandMeshConfighost

● GhanaianAcademicandResearchNetwork(GARNET)-Accra,Ghana-NUC5smallnodetester

● Réseaud’EducationetdeRechercheduTOGO(TogoRER)-Togo-NUC5smallnodetester

● NigerianResearchEducationNetwork(NgREN)-Nigeria-UniversityofJos-NUC5smallnodetester

● MaliResearchEducationNetwork(MaliREN)-Mali-NUC5smallnodetester● BeninResearchandEducationNetwork(RERBenin)-Benin-NUC5small

nodetester● Dakar,Senegal-20NUC5smallnodetestersinholdingforanupcoming

trainingintheregionTwonodesweredamagedduringtraining.WACRENisholdingnodesforeventualusebyNIGER-REN,RITER,andRICtobedeployedwhenthoseareoperational.

6. Additional Collaborations 6.1 Project Coordination TheprimarycollaboratorsfortheNEAARprojectareGEANT,representingEuropeaninterests,andthethreeregionalR&EnetworksinAfrica.ThroughoutYear2,bi-weeklycallsacrossthe5mainpartnerswereheldtobettercoordinateprojectsandplanfutureactivities.Wealsoheldface-to-facecoordinationmeetingsatmajorR&Enetworkingconferencesthroughouttheyear,includingatTNC,attheUbuntunetConnectmeetinginAddisAbaba,Ethiopia,andattheWACRENannualmeetinginMarchinLome,Togo.6.2 Coordination with IRNC partners IRNCAMI-CollaborationwiththeIRNCAMIawardee,NetSage,movedforwardinYear2.DatafortheNEAARcircuitisarchivedintheNetSageframework,includingSNMP,perfSONAR,andsampledflowdata.TheNewYorkexchangepointsiteincludedrackspace

formonitoringequipmentandaperfSONARnodebegancollectingdatainY2Q1.WealsodeployedaTstatservertocollectunsampledflowdatausinganopticaltap.TstatreportsanumberofusefulTCPflowstatistics,suchascongestionwindowsizeandnumberofpacketsretransmitted,whichcanbeusedtoanalyzethehealthandperformanceofthelink.Thisdataisde-identifiedbeforeitreachestheNetSagearchive.MoynihanalsoworkedwiththeNetSageprojecttobegindevelopingandpopulatingtheScienceRegistrythatwillallowflowstobetaggedandidentifiedbysciencedomain,project,location,andeducationalinstitutionendpoints,startingwiththeTopTalkersdatafromNEAAR.InYear3,wewillcontinuetoengageandassistwiththedevelopmentandpopulationoftheScienceRegistry..IRNCNOC-TheIRNCNOCcontinuedtoprovideTier1supportservicesincludingmonitoringthestateoftheNEAARcircuitandtheinstalledequipmentinNewYork.UsingNEAARfunding,theIUGlobalNOCsuppliesTier2andTier3servicesfortheproject.IRNCBackbone-WeworkedcloselywiththeAmericasAfricaResearchandeduCationLightpaths(AARCLight)projecttocoordinatetalksatinternationalconferences,tosharesciencedriverandengagementinformation,andtodiscussareasoffuturecollaborationbetweenourprojects.6.3 Other CollaborationsAdvancedNorthAtlantic(ANA)Consortium-InApril2018,wefinalizedandsignedaMoUagreementwiththeANAconsortium(partnersincludeCANARIE,ESnet,GÉANT,Internet2,NORDUnet,andSURF)thatlaysoutaframeworkforcapacitysharing,reciprocalbackupagreements,andjointoperationsofhigh-speed100Gbit/sinterconnectsthroughGlobalR&EExchangePoints(GXPs).TheMoUraisestheavailabletransatlanticR&Ebandwidthto800Gbit/s,strengthensresilienceoftheavailablecircuits,andpavesthewayforafuturecooperativepartnershipbetweentheconsortiummembers.Thepressreleasecanbefoundathttps://itnews.iu.edu/articles/2018/across-the-north-atlantic-for-research-and-education-.php.ESnet-OurongoingcollaborationwiththeEnergySciencesNetwork(ESnet)hasresultedintheNEAARcircuitshiftingfromjustbeingabackuprouteintimesforoutagesforESnettoactivelycarryingtrafficforenergyscienceresearchersequallywiththerestoftheirtrans-Atlanticcapacity.ThisnetworkusecanbeseenbeginninginearlyFebruary(seeSection8.1).NetworkExperiments-DuringTNC17,boththeTransPACandNEAARnetworksprovidedsupporttoKenjiroYamanaka’sMassivelyMulticonnectedFileTransferProtocol(MMCFTP)

demonstrationallowingthetransfertoreach150gbpsofthroughputfromTokyotoLondon(https://tnc17.geant.org/core/poster/1).TheexperimenttransferreddatabetweenahostinTokyoandahostinLondon,crossingthePacificwiththeTransPAC-PacificWaveandSINET100GcircuitsandcrossingtheAtlanticusingboththeNEAARandGEANT/ANA100Gcircuits.WhilethesetupwassimilartotheexperimentthatwasrunaspartofSC16,itincorporatedimprovementstosystemmemoryusageaswellasutilizingamuchlongerpath.DespitethesignificantlylongerRTT,thedatatransferwasabletoachieve150gbpssplitacrosstwopaths.

7. Network Operations 7.1 Peering Undertheinitialnetworkarchitecture,theNEAARswitchinNewYorkwasoriginallyconfiguredtopassthroughVLANstoallowNRENsintheUStopeerwithNRENsinEurope.InYear2,discussionsbeganwithNORDUnetandGEANTonaddingpeeringbetweentheNEAARASandotherNRENsdirectlyviaourconnectionattheLondonOpenExchange.ThiswillsimplifyconnectivityforemergingNRENswhowanttopeerwiththeUSNRENsinthattheywillnothavetonegotiatewitheachoneseparately.ItwillalsocreateamorestabletechnicalenvironmentforthoseNRENsbycausinglesschurnintheBGPtablewhenthereisanoutage.DuringYear3,wewillapproachNRENsandRegionalRENsindividuallytoarrangethesepeeringagreements.7.2 Routing InYear2,wealsobegananefforttolookatflowdatatodeterminewhatcountriesworldwideweresendingorreceivingdataontheNEAARcircuitandtolookforpotentialroutinganomaliesontrafficcominginandoutofEuropeandAfrica.Ourinitialresearchshowedthat156countries(80%oftheworld)sendorreceivedataovertheNEAARcircuit,asshowninFigure1.ThedatacollectionandanalysiswillcontinueinYear3,andourresultswillbepresentedatTNC18inJune2018inNorway.

Figure 1: Map showing NEAAR countries that are endpoints to data transfers that take place over the NEAAR circuit. This includes 156 countries, or 80% of the world, at this time.

7.3 Exchange Point Deployment PartoftheNEAARprojectplanhasbeentodeployanopenexchangepoint(OXP).TheAfricanRegionalRENpartnerschoseLagos,Nigeria,asthesitethatwouldmostlikelybenefitfromadditionalsupportintheformofanOXP,complementarytotheAfricaConnect2connectivityandequipmentbeingputinplacetosupportWACREN,whichwasexpectedtobeliveinMarch,2018.InNovember2017,discussionsbegantodefinetheneedsandservicesjointlywiththeWACRENteam.ThegoalthatwasdiscussedacrossthepartnerswastohaveNEAARpurchaseaswitchandsomemonitoringequipmenttohelpsupportaWACREN-NEAAROXP.Thelistthatwasusedtodeterminetherequirementsfortheswitchtoorderincluded5-7differentconnectionstoWACRENNRENsat10G,aswellasacrossconnecttotheAC-fundedcircuittoLondon.Additionalcapacitywasreservedforafuture100GconnectiontoSANREN.ArequisitionwasissuedinDecemberfortheswitch,whichwaswonbyBrocade.However,BrocadesubsequentlyhadtodeclineduetotheirinabilitytosupportequipmentinLagospurchasedbyaUSentity.AsecondrequisitionwasissuedinJanuary,whichresultedinthepurchaseofanAristaswitch.Inparallelwiththis,acontractforco-locationwasdevelopedtolocatetheswitchattheLagosMainOnedatacenter,thelocationfortheWACRENandAfricaConnect2equipment.WenegotiatedforrackspacenexttotheAC-2fundedrack,aswellastheuseofMainOne’shands-and-eyesteamfortheinstallationoftheequipment.InearlyFebruary,theIUteam(alongwithGlobalNOCsupport)begantheinitialconfigurationoftheswitchandwasontrackforamid-FebruaryshipmenttoLagos.However,thefinalstageoftheconfigurationrequiredadditionaldetailsabouttheconnectionstotheswitch,whichhadnotyetbeensuppliedbytheWACRENteam.

OnFebruary13,adiagramoftheplannedcombinedAfricaConnect2-WACREN-OXPdesignwassent.ItincludeddetailsabouttheAC-2connectionsandthelocationoftheNEAAR-WACRENopenexchangeswitch.Thisdiagram(showninFigure2)showedthatnoconnections,otherthanaconnectiontotheWACRENrouter,wereplannedtousetheswitch.InfurtherclarifyingdiscussionswithWACRENleadership,itwasconfirmedthattherewouldbenoconnectivitythroughtheOXPatthistime.AdditionalinformationfromWACRENstatedthatWACRENwouldpromotetheOXP,butwouldnotberesponsiblefortheestablishmentofotherconnections,eitherfromotherregionalRENsorNRENs.AnyNRENinitsmembershipregionwouldbefreetopeerdirectlyattheOXPifitsawtheneedtodoso,butthattheNRENwouldneedtoprocurethelinktotheOXP,thiswouldnotbeaWACREN-coveredexpense.

Figure 2: Planned Phase1 deployment for WACREN, AfricaConnect 2, and NEAAR-WACREN Open Exchange.

Inaddition,thecommunicationfromWACRENstatedthatitwaspossible,atsomefuturedate,thatSANRENortheUbuntuNetAlliancewouldmeetattheOXPbuttherehadyettobediscussionofiforwhenthismighttakeplace.DiscussionsthattookplaceviaemailonFebruary14and15withSANRENindicatedthiswasunlikelyuntilthesecondhalfof2019,andtheUbuntuNetAlliancehadnotyetdevelopedatimelineforthisconnectivityatornearthetimeofitsdeployment.SchopfmadethedecisiononFebruary16toholdtheequipmentatIUuntilafurtherdiscussion.NSFwasinformedofthisdevelopmentatthattime.

FurtherdiscussionontheusageoftheOXPequipmenttookplaceduringtheNEAARface-to-facemeetingattheWACRENannualconferenceinLome,Togo,onMarch13.Thisdiscussionfocusedontheproject’scurrentrequirementsforanOXPdeploymentandonotherpotentialoptionsfordeploymentiftherequirementscouldnotbemetinLagos.Therequirementguidelinesoutlinedanddiscussedfordeploymentwere:● Ademonstrated,timelyneed● Identifiableconnectorsandusecases● SupportforUS/Africasciencecollaboration● OperatedwithintenttomeetGNArequirements● ResourcestopromotetheOXPtopossibleconnectors

OneoptiondiscussedwasadeploymentinEastAfricaaspartofanUbuntunetAllianceco-brandedopenexchangeinKenya.Follow-updiscussionswereheldwiththeKenyanEducationNetwork(KENET)togatheradditionalinformationandtoexplorethispossibility.AttheInternet2GlobalSummitmeetinginSanDiegoinMay,ASRENalsoexpressedinterestindeployinganOXPinJordan.Additionally,wediscussedalternativeoptionsforusingtheequipmentifnoneoftheregionalnetworkswerereadytomeettherequirementsbeforetheendoftheproject.PartnerdiscussionstoadviseonthemostappropriateusageoftheOXPandanewtimeframefordeploymentareongoing.InYear3,theNEAARpartnerswillworktogethertobetterunderstandwheretheOXPequipmentcanprovidethemostvalueandtoensurethatitisusedinsupportoftheprojectmission.ItshouldalsobenotedthatasoftheendofYear2May31,2018,theAfrica-connect2linkbetweenLagosandLondonwasnotyetoperational.

8. Circuit Status and Performance TheNEAAR100GcircuitrunsbetweenManLan,NewYork,andtheLondonOpenExchange,bywayofDublin,Ireland.InQuarter1,westartedcollectingsampledflowdata(viasFlow)fromtheNEAARrouterinNewYork.However,duetoaconfigurationerror,wewereonlycollectingdatainonedirection.ThiswascorrectedinQuarter2,andwearenowcollectingflowdatainbothdirections.ThisdataisalsobeingsharedwithNetSage.

8.1. Traffic Graphs Figures3and4showthetrafficontheNEAAR100GCircuitbetweenNewYorkandLondonduringtheperiodofJune1,2017–May31,2018.Thehigherleveloftrafficinmid-SeptemberwaspartofthetestingfortheESnetuseoftheNEAARlink,whichbeganinFebruary.InMay,thecircuitvendorinformedusthattheirsubmarinecablewouldbetakenoutofserviceforanextendedperiodoftimetorepairashuntfaultinthemid-Atlantic,almostexactlyhalfwayacross.Ashuntfaultiswhenthecablebeginsrubbingonaseafloorobjectsuchasarock,causingdecreasedlightlevels.Whilethiswasnotyetserviceimpacting,thecarrierwantedtocorrecttheproblembeforeitcausedanoutage.TheinitialmaintenancewindowwasMay19,2018toMay28,2018.Howeverduetounfavorable

weather,therepairshipwasnotabletocompletetheworkasscheduledandthecurrentanticipatedcompletiondateisJune3,2018.Figures5and6showthetrafficontheGEANT100GCircuitbetweenNewYorkandParisduringtheperiodofJune1,2017–May31,2018.

Figure 3: NEAARNewYork-London100GCircuit(NSF-funded)trafficusingsmootheddailyaverages.

Figure 4: NEAARNewYork-London100GCircuit(NSF-funded)trafficusingmaximumdailyaverages.

Figure 5: GEANT New York-Paris 100G Circuit (GEANT-funded) traffic using smoothed daily averages.

Figure 6: GEANT New York-Paris 100G Circuit (GEANT-funded) traffic using maximum daily averages.

8.2 Traffic Volume Table1showsfullvolumeoftraffictransferredovertheNEAARcircuitsduringQuarter4.Over36PetabytesoftraffichasbeentransferredovertheNEAARcircuitsduringthe3months.Table2showsfullvolumeoftraffictransferredovertheNEAARcircuitsduringtheannualreportingperiod.Over88PetabytesoftraffichasbeentransferredovertheNEAARcircuitsduringthelastyear.Table1:TrafficinterabytestransferredoverNEAARcircuits,March1,2018throughMay31,2018.

March April May Total

London-NewYork 3,823.42 5,138.64 4,097.95 13,060.01

NewYork-London 4,559.98 4,348.08 2,038.93 10,946.99

Paris-NewYork 1,821.31 1,435.32 1,828.01 5,084.64

NewYork-Paris 2,131.92 2,253.20 3,341.30 7,726.43

Total 7,213.75 7,138.37 8,173.87 36,818.06

Table2.TrafficinterabytestransferredoverNEAARcircuits,June1,2017throughMay31,2018.

Jun-Aug Sep-Nov Dec-Feb Mar-May Total

London-NewYork 972.85 3,092.26 5,993.03 13,060.01 23,118.15

NewYork-London 760.61 2,445.57 4,906.44 10,946.99 19,059.61

Paris-NewYork 4,987.76 6,080.51 5,297.08 5,084.64 21,449.99

NewYork-Paris 6,495.55 5,809.00 7,031.56 7,726.43 27,062.54

Total 11,483.32 17,427.34 23,228.10 36,818.06 88,956.82

8.3 Flow Data

NEAARcollectsbothsampledandunsampledflowdataforthe100GlinkbetweenManLanandLondon.ThesampledflowdataisconnectedviasFlowfromtheNEAARrouterinstalledinNewYorkandisaggregatedandusedtocreatetheTopTenTalkergraphsshowninFigures7-10forQuarter4andinFigures11-14forYear2.InQuarter4,inboundtraffic(showninFigures7and8)washeavilyweightedcomingfromJISCintheUK,andwasassociatedwithhighenergyphysicsviaGridPP-relatedcomputingresourcesforhighenergyphysicsresearchincludingScotGrid,aswellasbioinformaticsrelateddatafromtheEuropeanBioinformaticsInstitute(EBI).TherewasalsoasignificantamountofdatarelatedtootherhighenergyphysicsprojectscomingfromCERNandgoingtoUSDepartmentofEnergylabsincludingNERSC,FermiLab,andSLAC,aswellasphysicsresourcesatMIT.TENETalsoshowsupasasignificantsourceofdata,primarilyrelatedtoastronomydatafromfacilitiessuchastheHartebeesthoekRadioAstronomyObservatory(HartRAO)inSouthAfrica.OutboundtrafficforQuarter4,showninFigures9and10,wasalsodominatedbyhighenergyphysicsdatagoingfromDOElabstoLHC-relatedfacilitiesinEurope.Inaddition,asignificantamountoftraffictransitedbetweentheInternetArchive,whichmirrorsmanylargeR&Edatasets,andacademicinstitutionsusingTENET.LookingatYear2inaggregate,JISCagainwasadominantsourceofdatainboundintotheUS,especiallyrelatedtoGridPPresources,EBI,andtheATLAStier2attheUniversityofManchester,asshowninFigure11.TheSchoolofMarineandAtmosphericSciencesatStonyBrookUniversityandtheHartRAOandrelatedradioastronomydatasourcesviaTENETweretheotherdriversofdatanotrelatedtoHEP.Theoutboundtraffic,showninFigures13and14,weremostlydominatedbyDOElabsandfacilitiesrelatedtotheLHC.TheInternetArchivewasagainadatasourceforEuropeandAfricaduetothemanyR&Edatasetsthatithosts.

Figure 7: Top 10 talkers by autonomous system source, inbound to the US for Quarter 4.

Figure 8: Top 10 talkers by autonomous system destination, inbound to the US for Quarter 4.

Figure 9: Top 10 Talkers by autonomous system source, outbound from the US for Quarter 4.

Figure 10: Top 10 talkers by autonomous system destination, outbound from the US for Quarter 4.

Figure 11: Top 10 talkers by autonomous system source, inbound to the US for Year 2.

Figure 12: Top 10 talkers by autonomous system destination, inbound to the US for Year 2.

Figure 13: Top 10 Talkers by autonomous system source, outbound from the US for Year 2.

Figure 14: Top 10 talkers by autonomous system destination, outbound from the US for Year 2.

8.4 Trouble Tickets DuringYear2,therewereninescheduledmaintenancesandthirty-eightunscheduledoutages,asdetailedinTables3and4. Table 3: Scheduled maintenance for NEAAR equipment and circuits, June 1, 2017 - May 31, 2018.

Ticket#

CustImpact

NWImpact

Title MaintType

SourceImpact

CurrentState

StartTime(UTC)

EndTime(UTC)

163:166

4-Low 2-High EmergencyMaintenanceCompleted-NEAARBackboneNEWY32AOA-LOND

Circuit Vendor Closed 2018-03-3101:52:00

2018-03-3101:58:00

118:166

3-Mod 2-High MaintenanceCompleted-NEAARBackboneNEWY32AOA-LOND

2017-09-0200:29:00

144:166

2017-12-0900:55:00

108:166

3-Mod 2-High EmergencyMaintenanceCompleted-NEAARBackboneNEWY32AOA-LOND

2017-07-2906:40:00

158:166

2018-03-2403:35:00

133:166

2017-10-2100:27:00

156:166

2018-03-1703:52:00

116:166

2017-08-1702:51:00

168:166

2018-04-0602:23:00

Table4:UnscheduledmaintenanceforNEAARequipmentandcircuits,June1,2017-May31,2018.

Ticket#

CustImpact

NWImpact

Title Type SourceImpact

CurrState

StartTime(UTC)

EndTime(UTC)

148:166

4-Low 2-High BriefOutageResolved-NEAARBackboneNEWY32AOA-LOND

UnannMaint

Vendor Resolved

2018-02-0605:18:00

2018-02-0605:19:00

142:166

UnannMaint

Vendor Resolved

2017-11-2807:13:002017-12-0402:27:00

2017-11-2807:14:002017-12-0402:27:00

88:166

2-High 2-High Stability-NEAARBackboneNEWY32AOA-LOND

Undet Vendor Resolved

2017-06-2602:17:00

2017-06-2602:31:00

145:166

UnannMaint

Vendor Resolved

2017-12-1301:24:00

2017-12-1301:25:00

91:166

2-High 2-High OutageResolved-NEAARBackboneNEWY32AOA-LOND

UnannMaint

Vendor Resolved

2017-07-0212:33:00

2017-07-0212:40:00

115:166

4-Low 2-High BriefOutage-NEAARBackboneNEWY32AOA-LOND

2017-08-0921:48:00

2017-08-0921:49:00

127:166

2017-09-2123:37:00

2017-09-2123:45:00

139:166

2017-11-0616:01:00

2017-11-0616:02:00

174:166

UnannMaint

Vendor Resolved

2018-04-2100:43:00

2018-04-2100:51:00

130:166

2017-10-0910:26:00

2017-10-0910:27:00

159:166

UnannMaint

Vendor Resolved

2018-03-2412:54:00

2018-03-2413:01:00

94:166

CircuitOther

Vendor Resolved

2017-07-0601:41:002017-07-0602:17:00

2017-07-0601:42:002017-07-0602:17:00

128:166

2017-09-2918:14:00

2017-09-2918:15:00

172:166

UnannMaint

Vendor Resolved

2018-04-1400:05:00

2018-04-1400:12:00

155:166

UnannMaint

Vendor Resolved

2018-03-1506:23:00

2018-03-1506:24:00

105:166

Circuit–Dam.Fiber

Vendor Resolved

2017-07-2712:07:00

2017-07-2712:22:00

149:166

UnannMaint

Vendor Resolved

2018-02-2100:58:00

2018-02-2100:59:00

INC0012927

2-High 2-High Availability-NEAARBackboneNEWY32AOA-LOND

CircuitOther

Undetermined

Resolved

2018-04-1212:57:002018-04-1611:32:002018-04-1612:19:00

2018-04-1212:58:002018-04-1611:32:002018-04-1612:19:00

160:166

CircuitBumpFiber

Vendor Resolved

2018-03-2700:44:00

2018-03-2700:55:00

112:166

UnannMaint

Vendor Resolved

2017-08-0323:05:00

2017-08-0323:15:00

120:166

UnannMaint

Vendor Resolved

2017-08-2613:24:00

2017-08-2613:31:00

152:166

CircuitDamFiber

Undetermined

Resolved

2018-03-0915:15:00

2018-03-0915:17:00

143:166

2017-12-0523:35:00

2017-12-0523:36:00

153:166

CircuitBumpFiber

Vendor Resolved

2018-03-0918:09:00

2018-03-0918:17:00

135:166

UnannMaint

Vendor Resolved

2017-10-2809:31:00

2017-10-2809:40:00

161:166

2018-03-2910:27:002018-03-2910:37:002018-03-2910:41:002018-03-3101:52:00

2018-03-2910:28:002018-03-2910:37:002018-03-2910:41:002018-03-3101:52:00

146:166

CircuitBumpFiber

Vendor Resolved

2017-12-2714:55:002018-01-0501:58:38

2017-12-2714:56:002018-01-0501:58:38

141:166

CircuitBumpFiber

Vendor Resolved

2017-11-1412:31:002017-11-1415:01:33

2017-11-1412:32:002017-11-1415:01:33

132:166

2-High 2-High Availability-NEAARBackboneNEWY32AOA-LOND

CircuitBumpFiber

Vendor Resolved

2017-10-1804:14:00

2017-10-1805:08:00

109:166

CircuitBumpFiber

Vendor Resolved

2017-08-0109:00:00

2017-08-0109:01:00

150:166

2018-02-2310:44:00

2018-02-2310:45:00

90:166

CircuitBumpFiber

Vendor Resolved

2017-06-2809:50:00

2017-06-2810:05:00

114:166

CircuitBumpFiber

Vendor Resolved

2017-08-0813:19:00

2017-08-0813:20:00

126:166

CircuitOther

Vendor Resolved

2017-09-2104:11:002017-09-2104:13:252017-09-2123:31:59

2017-09-2104:12:002017-09-2104:13:252017-09-2123:31:59

138:166

CircuitBumpFiber

Vendor Resolved

2017-11-0219:05:00

2017-11-0219:06:00

173:166

CircuitOther

Vendor Resolved

2018-05-1900:52

2018-06-0216:05

8.5 Downtime and Availability

Table5showsthereporteddowntimeforcorenodesontheproject,whichwas100%overtheyear.Table6liststhedowntimefortheprojectscircuits,whichwasslightlymorethan15days,primarilyduetotheshuntfaultrepairthattookplaceMay19-June3.Duringthistime,ESnettrafficshiftedtootherESnetcircuits,andothertrafficwasroutedoveroursistercircuitwithGEANT.

Table5:DowntimeandavailabilityforNEAARcorenodes.

NEAAR Nodes Down Time Reporting Period Availability

52 Week Availability

dcp.newy32aoa.neaar.net 00 hr 00 min 100% 100%

netsage-probe.newy32aoa.neaar.net 00 hr 00 min 100% 100%

rtr.newy32aoa.neaar.net 00 hr 00 min 100% 100%

perf.newy32aoa.neaar.net 00 hr 00 min 100% 100%

oob.newy32aoa.neaar.net 00 hr 00 min 100% 100%

Aggregate NEAAR Core Nodes 0 days 0 hr 0 min 100% 100% Table6:DowntimeandavailabilityforNEAARcircuits.

NEAAR Backbone Circuits Down Time Reporting Period Availability

52 Week Availability

NEAAR-NEWY32AOA-LOND-100GE-01500 15 days 1 hr 53 min 96% 96%

NEAAR-NEWY32AOA-NEWY32AOA-100GE-01501 00 hr 00 min 100% 100%

Aggregate All NEAAR Backbone Circuits 15 days 1 hr 53 min 96% 96%

9. Security Events and Activities Basicsecuritymeasuresarebeingmaintained,andtherewerenosecurityincidentstoreportforthisyear.AsecurityplanhasbeendevelopedjointlywiththeIN@IUSecurityOfficer,HansAddleman.ThesedocumentsincludeaMasterInformationSecurityPolicyandProceduresdocument,NetworkAUP,NetFlowandDataPrivacystatement,InformationClassificationandInventory,andaIncidentResponseDocument.Thesecuritydocumentscannowbefoundonlineathttps://internationalnetworks.iu.edu/about/policies.html.TheyhavebeenreviewedbyCACRandtheIN@IUTeam.ThedocumentswillberevisedandupdatedonanongoingbasisthroughoutYear3.

10. Summary of Year 3 Plans 10.1TechnologyPlanningandOperationsPeeringinLondon(Milestone1.5)-DiscussionswillcontinueinYear3withEuropeanandAfricanNRENstodirectlypeerwiththeNEAARASandotherNRENsdirectlyviaour

connectionattheLondonOpenExchange.WeareworkingdirectlywiththeNRENsandRegionalRENsindividuallytoarrangethesepeeringagreements.WeplantoinitiallyapproachNordunetinthebeginningofYear3Quarter1.(SeeSection6.3)DeploymentofOXP(Milestone2.2.3)-PartoftheNEAARY2projectplanwastodeployanOXPinLagos,Nigeria.However,itwasconfirmedbytheproject’spartnersthattherewouldbenoconnectivitythroughanOXPinLagosinY2andthatnodiscussionhadtakenplaceonplannedconnectivityforY3.Sincethedeploymentoftheequipmentisdependentonitbeingused,weexpectinYear3Quarter2tomakeadecisionondeployingtheOXPinanewlocation.(SeeSection7)Scienceregistrydevelopment(Milestone2.5)-Attributionofflowsinthenetworktosciencedomainsorevenspecificscientificendeavorsisbecominganimportantcomponentofhowwewillshapebigscienceresearchnetworksinthefuture.WeareworkingcloselywithNetSageduringthedevelopmentoftheScienceRegistrytoolsandcontributingdatatoprovideaninitialseedingoftheregistryitself.InYear3,wewillcontinuetoengageandassistwiththedevelopmentandpopulationoftheScienceRegistry.(SeeSection6)ReviseandupdateSecuritydocuments(Milestone2.6)-InYear2,ourSecurityofficerdevelopedasecurityplanthatincludedthecreationofdocumentsoutliningNEAAR’ssecuritypoliciesandprocedures.InYear3,thesedocumentsandpolicieswillcontinuetobedevelopedandmaintained.WewillcontinuetostayabreastofnewnetworkattackvectorsandleveragetheNetSageprojectdatatoexamineNEAARtrafficforpossibleincomingattacks.(SeeSection9)10.2MeasurementandMonitoring-EUcircuitRoutingresearch-(Milestones3.2.2,4.1.6)InYear2,aspartofourflowdataanalysis,welookedintoroutinganomaliesontrafficgoinginandoutofAfricaandEurope.WewillpresenttheresultsofourresearchattheTNC18conferenceinJune2018.WeareplanningtocontinueourroutingresearchinYear3andtobeginaddressingsomeoftheroutesthatareincorrect.(SeeSection8.3)Increasedflowdataanalysis(Milestone3.2.2)-InYear2,weusedflowdataanalysistoidentifythetoptalkersonaquarterlybasis,primarilyforreportingpurposes.InYear3,wewillbehiringonadditionalstafftoenableustoextendtheanalysisthatweperformonflowdata,includingananalysisoftheeffectivenessofthedatatransferratesexperiencedbyNEAAR’slargestusers.(SeeSections4and8.3.) 10.3 Measurement and Monitoring- African Regional RENs pStrainingforNRENsinAfrica(Milestone4)-TheNEAARprojectplanoriginallyincludedthreeperfSONARworkshopsforeachAfricanregionalREN(oneperRENperyear).WechosethismodelbecausetheregionalpartnersbelieveditwouldbethemostefficientmeansofgettingbroadparticipationfromtheirNRENengineers,havingthemallgatherinacentrallocation.However,fundingtobringengineerstoacentrallocationcannotcomefromtheNEAARprojectdirectlyandaddingadditionaltrainingtothealreadycrowded

regionalRENannualmeetingshasprovenchallenging.Therefore,startinginYear3wewillfocusthetrainingeffortsattheindividualNRENlevel.WeexpectthismodelwillallowustotargetourtrainingwhereitisneededmostandtoavoidadditionaltravelandlogisticalcostsforboththeregionalandnationalRENs.WecurrentlyareplanningworkshopsforYear3inZambia,Tanzania,Mozambique,andJordan.Additionalstaffingwillbehiredinparttosupportthiseffort.(SeeSection5.)UbuntunetAlliancepSnodesandmeshset-up(Milestone4.10)-DiscussionsbeganinYear2onthepossibilityofinstallingNEAAR-supportedperfSONARnodesat3UbuntunetAlliancePoPs(Nairobi,Durban,andTBD).ThiswouldprovidegreatervisibilityintotheperformanceoftheUAbackboneandallowustoworkwithUbuntunetengineerstosetupanactivemeshandMadDashfortheUAnetwork.(SeeSection5.)ASRENpSnodesandmeshset-up(Milestone4.11)-PlanningbeganattheendofYear2foraperfSONARworkshoptobeheldintheASRENregioninYear3.AspartofthistrainingweareplanningtoworkwithASRENtoinstallperfSONARnodesinstrategiclocationsontheASRENbackboneandtoworkwithASRENengineerstosetupanactivemeshandMadDash.(SeeSection5.) 10.4 Outreach Applicationidentificationandworkshop(Milestone4.1,4.2)-WithadditionalstaffinginYear3,wewillworktoexpandoureffortstoidentifyspecificresearchprojectstransferringlargeamountsofdatabetweenEurope,Africa,andtheUS.Wewillalsolookatperformancedatatohelpguideouroutreachefforts.Withthisnewinformation,wehopetogainsupportfromtheresearchcommunitytohostaapplicationworkshopinAfricainYear3or4foraspecifictargetedapplicationdomain.(SeeSection4).IncreasedcoordinationwithGEANTResearchEngagementTeam(Milestone4.4.1)-InYear3,wewillworktoidentifyadditionalopportunitiestoreachouttothescienceusercommunityinEuropeandworkmorecloselywithGEANTtoidentifyandsupportresearchersworkingandcollaboratinginAfrica.Thiswillincludesharingouranalysisofflowdatatoidentifyadditionalendusercommunities.(SeeSection4)RENAdvocacy(Milestone4.4)-DocumentingthescopeandscaleofresearchandeducationcollaborationstakingplaceonthegroundinAfricacanhelplocalRENsmakethecaseforsustainedsupport.InYear3wewillcontinueoureffortstoadvocateonbehalfofourpartnerregionalRENsandtheirmembers.WewillworkcloselywithourpartnerstohelpmakethecaseforRENinvestmentandtomaturetheiruserengagementandbusinessdevelopmentefforts.(SeeSection4).

11. Reporting against Objectives BelowisthelistofWBSitemsforYear2andtheircurrentstatus.

1PlanningforTechnology1.4ExchangePointforRegionalREN-planning● ONGOING-PlanningwascompletedforadeploymentinLagos,butlocation

andtimingofdeploymenthasbeenchanged-seeSection7.1.5DiscussionofLondonOpenExchangeconnections● ONGOING-Lagos>LondoncircuitwasnotoperationalduringYear2.

DiscussionsonadditionalpeeringattheLondonOpenExchangeareongoing-SeeSection6.3

2Operations2.2Exchangepoint● ONGOING-Equipmenthasbeenprocuredbutdeploymenthasbeen

postponeduntilY3Q1-seeSection7.2.3OperateInfrastructure● ONGOING-alsoincludesdebuggingincorrectroutes-seeSection7. 2.4CoordinatewithIRNC:NOCwinner● ONGOING-NEAARcontinuesclosecoordinationwiththeIRNCNOC 2.5CoordinatewithIRNC:AMIwinner● ONGOING-NEAARsharesmeasurementdatawithNetSageandcontinuesto

workonTstatanalysisandtheScienceRegistry. 2.6NetworkSecurity● ONGOING-Securitypoliciesandprocedureswerecreatedandsecurity

documentscontinuetobeupdated. 3MeasurementandMonitoring3.2Flowdatacollectionfrom100G● ONGOING-collectionbeganinY2Q1 3.3PerfSONARdatafromAfricanexchangepoint● DELAYED-perfSONARwillbeinstalledwithwhenOXPdeploymentis

complete-Y3Q2-SeeSection7 3.4FlowdatafromAfricanexchangepoint● DELAYED-FlowdatacollectionwillbeginafterOXPdeploymentiscomplete

-Y3Q2-SeeSection7 3.5Routingresearchandanalysis● ONGOING-BeganinYear2,ouranalysisandoutreachwillcontinueinYear

3-SeeSection74TrainingforMeasurementandMonitoring4.2SmallPSnodeclassforASRENEarly2018● DELAYED-ASRENexpresseddesiretomovethisworkshoptoSpring2019.

PlanningbeganinY2Q4.

4.3 SmallPSnodeclassforWACREN-Ghana,Oct2017● COMPLETED-SuccessfultraininghostedbyGARNET-SeeSection5 4.4SmallPSnodeclassforUbuntunetAlliance-EthiopiaNov2017● COMPLETED-AdaptedtointroductiontoperfSONARsessionduring

NSRCworkshopandsmallnodetalkduringplenarysession.4.10.HelpsupportUAPSmesh● ONGOING-DiscussionstookplaceatUAmeetinginNov2017.UAwouldlike

topursueinstalling10GsnodesatUApopsbytheendof2018. 4.11HelpsupportASRENPSmesh● ONGOING-TheASRENmeshisnotyetactive.Thisisaplannedoutcomeof

theYear3ASRENpSworkshop. 4.12HelpsupportWacrenPSmesh● ONGOING-AMeshandMadDashweresetupasanoutcomefromtheGhana

trainingworkshop.MoreNRENswillbeaddedtothemeshoncetheyjoinWACRENandtheirnetworkscomesonline.

4.13Cross-RENtraining● CANCELLED-PlannedjointworkshopwithAfriNICinMay2018was

canceled.PlanschangedtofocusonindividualNRENtraining 4.14SmallPSnodeclassforZAMREN-Lusaka,Zambia,Sept2018● ONGOING-PlanningstartedinYear2-SeeSection5 4.15SmallPSnodeclassforTERNET-Tanzania,February2019● ONGOING-PlanningstartedinYear2-SeeSection5 4.16SmallPSnodeclassforMoRENet-Mozambique,Summer2019● ONGOING-PlanningstartedinYear2-SeeSection5

5OtherOutreach5.1Attenddomesticandinternationalconferencesforapplicationidentificationandrelationshipmaintenance● COMPLETED:

○ TNC17,Linz,Austria,May2017 ○ perfSONARmeetingatUniversityofMichigan,AnnArbor,MI,June

2017 ○ PEARC17,NewOrleans,July2017 ○ ESIPSummerMeeting,Bloomington,IN,July2017 ○ NationalResearchPlatformWorkshop,Bozeman,MT,August2017 ○ GLIF,Sydney,Australia,September2017 ○ ANZSDNworkshop,NewSouthWales,Australia,September2017 ○ Internet2TechnicalExchange,SanFrancisco,CA,October2017 ○ UbuntunetConnect‘17,AddisAbaba,Ethiopia,November2017 ○ SuperComputing‘17,Denver,CONovember2017 ○ PTC’18,Honolulu,HI,January2018 ○ ESIPWinterMeeting2018,Bethesda,MD,January2018 ○ LHConemeeting,Abingdon,UnitedKingdom,March2018○ CENICspringmembermeeting,Monterey,CA,onMarch2018

○ WACRENConference2018,Lome,Togo,March2018○ Internet2GlobalSummit,SanDiego,CA,May6-9

● ONGOING-WewillcontinuetoparticipateinsimilaractivitiesinYear3.5.2OutreachtoscienceapplicationsbasedonNetFlowinformation● ONGOING,seeSection4,wecontinuetolookthroughflowdataanddiscuss

withourpartnerswhatapplicationcommunitieswouldmostbenefitfrommoreintentionalengagement

5.3OutreachtoscienceapplicationsbasedonNSFfundingdata● ONGOING,seeSection4,wecontinuetoreachouttoNSFawardees 5.4Coordinationofscienceengagement● ONGOING,seeSection4,wecontinuetoworkwithESNetandglobalpartners

on 6ProjectCoordination6.1ProjectManagement● ONGOING-Weholdregularpartnercallsandfacetofacemeetings

throughouttheyear 6.2ProjectReporting● ONGOING-Reportinginfrastructureinplaceforuptodatequarterly

reporting;WBSupdateaspartofthisreport.

12. Financial Reporting Details Year 2

Description

2018 Total

Compensation (including benefits and F&A)

Schopf, Jennifer (PI) 3,357 3,506 3,506 3,506 3,506 3,506 3,506 3,506 3,506 3,506 3,506 3,506 41,920Lee, Andrew 3,643 3,729 3,729 3,729 3,729 3,729 3,729 3,729 3,729 3,729 3,729 3,729 44,657Chevalier, Scott 1,803 1,835 1,835 1,835 1,835 1,835 1,835 1,835 1,835 1,835 1,835 1,835 21,987Moynihan, Ed 9,357 10,397 2,921 2,921 2,921 2,921 2,921 2,921 2,921 2,921 2,921 2,921 48,968DelVaux, Antoine 6,130 6,972 13,102Hubbard, Heather 3,277 1,456 1,456 1,458 1,530 1,676 10,853F&A on Compensation 32% 5,811 6,229 3,837 3,837 3,837 5,799 4,886 4,303 4,303 4,303 4,327 6,604 58,075Subtotal Compensation 23,970 25,695 15,828 15,828 15,828 23,920 20,154 17,749 17,750 17,752 17,848 27,243 239,562Travel, Other

Travel-Schopf Washington Sep 2017 841 841Travel - Chevalier - Ghana Oct 2017 2,441 1,858 4,299Travel- Schopf- Entebbe Oct 2017 1,485 1,485Travel- Moynihan-Addis Ababa Oct 2017 1,600 1,953 3,553Travel - Chevalier - SC'17 Denver Nov 2017 2,592 327 894 3,813Travel-Moynihan Amsterdam Dec 2017 783 2,983 3,767Travel-Moynihan ESIP Bethesda Jan 2018 2,163 2,162 4,325Travel-Schopf WACREN Lome Mar 2018 1,045 3,227 2,092 6,364Travel-Moynihan WACREN Lome Mar 2018 1,045 294 628 4,375 6,343Travel-Chevalier perfSONAR Amsterdam Mar 2018 1,506 1,113 998 3,617Travel- Chevalier Dakar Apr 2018 2,087 2,087Travel-Moynihan I2 Global Summit May 2018 750 472 1,222Travel-Schopf TNC18 Trondheim Jun 2018 956 803 1,759Travel-Moynihan TNC18 Trondheim Jun 2018 795 3,388 4,183F&A on Travel/Other 32% 0 0 1,611 580 512 845 1,180 2,316 2,541 1,117 4,548 0 15,250Subtotal Travel 0 0 6,645 2,392 2,112 3,486 4,868 9,554 10,480 4,609 18,762 0 62,907Equip >5K

AE Connect 100G circuit 22,125 22,125 22,125 22,125 22,125 23,644 23,644 23,643 23,643 70,930 23,643 23,643 323,416Nysernet 4,275 875 4,275 2,625 5,850 17,900Geant 44,309 44,309CDW Nodes for perfSONAR training Senegal 6,167 6,167OUMOU-Parts for Senegal training 6,634 6,394 13,028CDW Parts for Zamren Training 81 1,684 2,145 3,911Amazon- computer parts for training 3,524 447 3,971CDW-Parts for OXP Switch 1,213 1,213Dell-Parts for OXP Switch 23,451 23,451Napatech-Parts for OXP Switch 9,863 9,863OSI-Parts for OXP Switch 5,518 465 5,983Pier Group-Parts for OXP Switch 31,684 737 32,421N2N-Parts for OXP Switch 4,855 210 5,065wire transfer fee 20 20 20 40 20 20 20 0 20 80 20 40 320Subtotal Circuits 26,420 23,020 22,226 69,998 26,867 26,289 29,514 58,169 65,720 79,056 31,514 32,223 491,016Participant Support

Moynihan trip Bloomington May 2017237 237Jason Zurawski, SANREN training May 2017-2,092 3,122 1,030Moynihan Terena 972 972Travel-Delvaux perfSONAR Accra Oct 2017 2,182 2,182Subtotal Participant Support -882 3,122 0 0 0 0 0 0 2,182 0 0 0 4,421TOTAL 23,088 28,816 44,698 88,217 44,806 53,694 54,536 85,472 96,131 101,417 68,125 59,465 797,907

Table7showstheactualexpensesbylineitemforYear2.Table8showstheactualexpensesforYear1and2bycategory,andtheestimatedexpensesforYear3and4.Wemakeseveralassumptionsfortheoutyears:● AnewstaffmemberishiredatIUtoassistwiththetrainingandscienceengagement

(asoutlinedinSections10.4and10.5);● TravelandotherexpenseschargedF&AinYear3and4areatthesamemonthly

rateasYear2;● EquipmentfortrainingispurchasedfortwoadditionalsessionsinYear3(two

sessionstakingplaceinYear3hadequipmentpurchasedinYear2),andfourtotalsessioninYear4;

● Wepayco-locationandportcostsinYear3and4fortheOXPattherateof$30,000peryear.

AfterYear1,weproposedare-budgetingacrosstheprojectyearsduetotheslowstartupfortheprojectandthedelayandchangestakingplacewiththeplanningoftheOXP.ItshouldbenotedthattheoriginalbudgetestimateforYear2was$800,000,whichwasspentthisyearinpractice.WedidnotmeetthehigherspendingestimatemainlyduetothedelaysintheOXPdeployment.WiththeassumptionsaboveforspendinginYear3and4,theprojectwillbespentdowntounder$7,000duringtheexpectedprojecttimeline. Table 8: Actual expenses for Year 1 and 2 by category, and estimated expenses for Year 3 and 4.

Salaries (incl benefits, F&A)

Travel, Other (incl F&A)

Circuits, Equip (no F&A)

Part. Support (no F&A)

Total Expenses

Year 1 Rebudget

Estimate Over Rebudget

Actual Year 1- 9 month 136,913 28,472 187,038 12,413 364,836 370,000 5,164

Actual Year 2- 12 month 239,562 62,907 491,016 4,421 797,906 889,166 91,260

Year 3 - 12 month (est.) 361,435 119,342 437,179 12,197 930,153 879,167 -50,986

Year 4- 15 month (est) 523,870 132,066 484,984 10,000 1,150,920 1,111,667 -39,253

Total 1,261,780 342,787 1,600,217 39,031 3,243,815 3,250,000 6,185

jennifer m. schopf, cathrin stöver, pascal hoba – principal … · 2020. 8. 11. · 1 neaar...

Documents

2013-2014 mrs. jennifer najera miss jennifer welch

voynataktb.files.wordpress.com · 2/12/2018 · ha...

jennifer nock innovation to legacy manufacturing jennifer...

ubuntunet alliance/pascal hoba

6. environme ntal impa ct study, hoba rt quarries pty ltd

· surgery in cerebral palsy - decision making, operative...

golden ring ultra trail · miroshnikova hvirviujviha...

jennifer culbertson the partner marketing group...

cathrin stöver, dante, cathrin@dante.org.uk the alice...

cathrin stöver, project manager dante terena networking...

celestials jennifer sumbu longe screenplay by jennifer

the fall of the hoba meteorite

jennifer painter, vp housing operations & jennifer rass, vp...

2016 jennifer duke batten -...

hoba vator manual en espaÑol

jennifer lopez

jennifer lawrence

the history of the hoba meteorite part ii: the news...

stöver lehmann consulting

{ works of beauty myth by: jennifer han by: jennifer han