oscar: online services for correction of atmosphere in ... · radiation at near ir wavelengths is...

1

OSCAR:OnlineServicesforCorrectionofAtmosphereinRadar

PaulvonAllmen,EricFielding,EricFishbein,ZhangfanXing,LeiPan,MartinLoJetPropulsionLaboratory,CaliforniaInstituteofTechnology,Pasadena,CA91109

ZhenhongLiSchoolofGeographicalandEarthSciences,UniversityofGlasgow,Glasgow,U.K.

1. IntroductionInterferometricSyntheticApertureRadar(InSAR)isusedtomeasurethedeformationofEarth’ssurfacebycomputingtheinterferenceoftworadarimagestakenatdifferenttimes.ThephaseofaSARimageisaffectedbypropagationdelaysintheatmosphereandconstitutesthelargestsourceoferrorinInSARmeasurements.Whileboththeionosphereandthetropospherecontributetothepropagationdelays,themajorityofSARarchivesisintheC‐band(wavelength6cm)andisonlyweaklyaffectedbytheionosphere.OSCARconcentratesonwebservicesforlocating,collectingandprocessingatmosphericdatatocorrecttheInSARpropagationdelayscausedbythewetatmosphere.InSAR‐basedcorrectionshavehistoricallyusedsingleatmosphericdatasetsandadhocmethodologiesthatcannotbeappliedtoallsituations.Onecandistinguishfourmethodstocorrectforatmosphericdelays,whichareusingancillarydata:a. ContinuousGlobalPositioningSystems:Global

NavigationSatelliteSystemssignalshavepropagationdelayssimilartothoseofInSAR.Thegroundreceiverscanmeasurebothionosphericandtroposphericdelays.TheionosphericdelayisestimatedfromthemultiplefrequenciesoftheGPSsignalbyusingthepropertythatdelaysaredispersiveintheionospherebutnotinthetroposphere.TheremainingdelayoftheGPSsignalisthetroposphericcomponent.ThetotaltroposphericdelaycanbeestimatedasrandomwalkprocessesandthenbeinterpolatedspatiallyandtemporallytothegridoftheInSARimages.

b. NearIRabsorptionandreflectiondata:TheMODISinstrument(onboththeNASATerraandAquasatellites)providesawatervaporproductthatcanbecalibratedtoagreewithGPSdatabyusingonecontinuousGPSstationwithina2,030kmx1,354kmMODISscene.TheMERISinstrumentiscollocatedwiththeradarASARontheEuropeanplatformENVISAT.ItproducesawatervaporproductthatcloselyagreeswithGPSdata.BothMODISnearIRandMERISnearIRmeasuretheabsorptionofreflectedsunlightbywatervaporinthetroposphere.Thismeansthattheycanonlymakemeasurementsduringtheday.Inaddition,

Figure1.StretchedBoundaryLayerandTruncatedBoundaryLayeralgorithmsfortheextrapolationofthespecifichumidityasafunctionofaltitude.Thetoppanelillustratesthetroposphericmodelandtheairflowpatternsnearobstacles.ThemiddlepanelshowstheoriginalECMWFmodel(green),theTBL(blue)andSBL(red)precipitablewatervaporprofiles.Thelowerpanelshowstheelevationoftheunperturbedprofile.

2

radiationatnearIRwavelengthsisreflectedbyclouds,withtheconsequencethattheseinstrumentsonlymeasurethewatervaporaboveanycloudsthatarepresent.

c. ThermalIR:MODISprovidesthermalIRmeasurementsofwatervapor,butwefoundthistobeinsufficientlyaccurateforourpurposes.WewillconsiderAIRSdataatlaterstage.

d. NumericalWeatherModels(NWF):GPSandnear‐IRdataarecomplementarybutnotgloballyavailableatalltimes.WeatherforecastmodelslikethosefromtheEuropeanCenterforMediumRangeWeatherForecasting(ECMWF)andtheNOAANCEPNorthAmericanMesoscaleModel(NAM)fillthisgapbutcarehastobetakentocorrectforlowspatialresolutioninthemodel,ascomparedtothehighresolutionofInSAR.CorrectionsfromNWFaregreatlyimprovediflocaltopographiccorrectionsareapplied.WedevelopedtheStretchedBoundaryLayer(SBL)andtheTruncatedBoundaryLayer(TBL)algorithmstomodulatethecoarsefieldsoftheweathermodeldatawiththehighresolutiontopographyoftheSAR(Figure1).TheTBLalgorithmtruncatesthemodelprofileatthecorrectelevationobtainedfromaDigitalElevationModel(DEM)whentheDEMsurfaceisabovethemodelsurface,andlinearlyextrapolatesthelogarithmofthewatervaporasafunctionofthelogarithmoftheelevationwhentheDEMsurfaceisbelowthemodelsurface.TBLisexpectedtobemostaccuratewhentheairflowsaroundobstacles.TheSBLalgorithmlinearlyexpandsorcontractsthemodeltroposphericelevationgridtomatchtheDEMsurfaceelevation.SBLisexpectedtobemostaccuratewhentheairflowsalongtheslopes.

2. Informationtechnologyarchitecture OSCARconsistsofasetofservicesthathelptheclientsgenerateatmosphericcorrections.Thediagramabovedepictsthefunctionalarchitecturediagram(Fig.2).

Dataprocessing“smarts”aredistributedamongservices.Thedesignprinciplesareoutlinedasfollows:(1)Eachserviceisresponsibleforasingletask.(2)Communicationsbetweenclientsandservices,andamongservicesuseconciseRESTfulWebAPIs.Thisapproachprovidesflexibilityfor

!"#$%&'(

!"#$%"!&

)*+( ),-( ./01( 234( -54(

2346(23-78(9$":;(<$%$=:>?%(

5-0(

@$A#B"$(C:DD#%<(&?(

:(%$&E?=F(?G('$=H$='(

)*+6('D:!$(I(>C$(JK$=;(

),-6(-L1.)('KB'$&(M(C$=<$(

./016(-L1.)(9$":;(<$%$=:>?%(

5-06(C:D(&?(:(!?CC?%(<=#9(

-546(C$=<$(9$":;(#C:<$'((

'D:!$N(>C$( -L1.)(<=:%K"$'( 9$":;(#C:<$(

'$=H#!$'(

-L1.)(9$":;(

23-78(9$":;(

-L1.)(9$":;(OP(:=!('$!(

23-78(9$":;(OP(:=!('$!(

Figure2.FunctionalarchitecturediagramforOSCAR.

3

buildingcomplexapplicationslikeOSCARandestablishesanewfoundation,onwhichfutureEarthscienceapplicationscanleverage.OSCARincludes6services,ofwhichthefirst4arefunctional:(1)theSpaceandTimeQuery(STQ)service,(2)theSubsetAndMerge(SAM)service,(3)theInterpolatedZenithPathDelay(IZPD)service,(4)theECMWFdelayGeneration(ECG)service,(5)theReMaPpingservice(RMP),and(6)theMeRGe(MRG)service.Atypicalusecaseisdescribedbythefollowing8steps.

1. UserselectsInSARscenes,whereOSCARwillcomputetroposphericdelays2. Userselectsdatatouseforcorrections(MODIS,MERIS,AIRS,ECMWF,NAM)3. UserprovidesOSCARclientwithspatialboundingboxandtemporalconstraints4. OSCARretrievestheURLofdatagranulescorrespondingtospatio‐temporalconstraints5. OSCARmergesgranulesandsubsetsthedata6. OSCARreturnsthedelaysonalatitude‐longitudegrid7. UserappliesgriddeddelaystoInSARscenesindataprocessingpackage(e.g.,ROI_pac)8. UserretrievesscientificanalysisfromInSARpackage(ROI_pacorISCE)

3. MergingRemoteSensingandWeatherForecastDataOneofthekeyobjectivesofOSCARistocombineremotesensingdatafromforexampleMODISwithweatherforecastdatafromforexampleECMWF.WehavedevelopedamergingmethodbasedonBayesianstatisticsthatrequiresthefollowingelementsforthedatasets.MODISnear‐IRtotalprecipitablewatervaporneedsqualitycontrol,errorcharacterization,biascorrectionandremappingtoauniformlatitude‐longitudegrid.ECMWFglobalanalysisdatarequiresbiasandtopographycorrections,andremapping.MODISQualityControlModelThequalityofthedataisalsoassessedfrom5parametersdirectlyavailablefromtheMODISdata:Water_Vapor_Near_Infrared,Cloud_Mask_QA,surfacetypeflag,Quality_Assurance_Near_Infrared,andthetotalprecipitablewater(NIR)usefulnessflag.Wedefineasinglequalitycontrolmaskthattakesthevalue1ifalltheMODISqualityparametersaresatisfactoryand0otherwise.ECMWFTopographyCorrectionThetopographycorrectionisappliedusingtheTBLortheSBLalgorithmsdescribedinsection1.2.

ThevalidityofthecorrectionalgorithmsisassessedbycomparingwithwatervaporburdendatafromasetofGPSstationsequippedwithameteorologicalpackage,obtainedfromA.MooreoftheBocketal.AISTprojectonreal‐timeGPSprocessing.Figure3showshistogramsforthewaterburdendifferencefortheoriginalmodeldataandtheSBLandTBLcorrecteddata,conditionalontheelevationdifferencebetweenthemodelandtheGPSstation.ThisstatisticalanalysisshowsthattheSBLandTBLalgorithmsleadtobettercorrectionswhenthesurfaceisaboveandbelowthemodelsurface,respectively.WeusethisresulttochoosewhichalgorithmtoapplyforagivenInSARscene.ECMWFBiasCorrectionValidationstudiesshowthatECMWFdataincludesa5.5%drybiasandaregionalandseasonalwatervaporbiaswhencomparedwithMODISorGPSdata.Sincewatervaporismodulatedbytopographyandaffectedbylargeseasonalvariations,weselectedabiascorrectionthatisdynamicandderivedfromcoincidentandcollocatedECMWFandMODISdata.Figure3.Histogramofthewatervapor

burdendifferenceconditionalonelevationdifference.

4

ThetopographicallycorrectedECMWFandMODISdataarecollocatedonauniformlatitude‐longitudegridandascalingfactoriscomputedastheratioofthemedianECMWFtothemedianMODISwatervapordataintheregionswherethequalitycontrolflagforMODIS(seesection3.1)is1.Anannealingalgorithmextendsthebiascorrectiontotheemptybins.MergingAlgorithmABayesianmergingalgorithmgivesthecombinedwatervaporastheaverageoftheMODISandtheECMWFdataweightedbytheinverseofthesquareoftheerrors.Asneitherproductprovideserrorcovariancematrices,adhocpointerrorestimatesareinferred.TheMesoscaleAlpineExperiment,SpecialObservingPeriod(MAP‐SOP)1999usingGPSoverEuropegivesanerrorforECMWFof2.6kg/m2(13%RMS)ataspatialresolutionof0.25o(O.Bocketal.2005).TheaccuracyofMODISNIRdatawasestimatedintheliteraturetobe5.44kg/m2at1kmresolutionbycomparisonwithGPS,radiosondesandAERONETSunphotometerdata(Prasadetal.2009).WhiletheMODISandECMWFhavecomparableerrors,atthesamespatialresolution(foruncorrelatederrors)theMODISdataisabout25timesmoreprecisethantheECMWFdata.TheECMWFerrorisspatiallycorrelatedoverroughly25MODISpixels.ThereforeintransitioningsmoothlyfromaregionofpoorMODISdatatogood,thetransitionshouldbesmoothedovertheECMWFcorrelationlength.

ThequalitycontrolmaskforMODISdata(seesection3.1)isusedinthemergingalgorithmtoweighttheMODISandtheECMWFerrorsaccordingtothefollowingexpression.

Figure4.IllustrationofthemergingforascenecoveringSouthernCalifornia.TopleftpanelshowsthequalitycontrolledMODISwatervapordata.ToprightpanelshowstheweightoftheMODISdatainthemergingalgorithm.MiddleleftpanelshowsthetopographicallycorrectedECMWFdata.MiddlerightpanelshowsthebiasfactorforthecorrectionofECMWFdata.ThebottompanelshowsthemergedmapoftheMODISandECMWFdata.

5

!ECMWF

2

!MODIS

2=smoothed_qc_mask

1!smoothed_qc_mask

wherethesmoothedquanlitycontrolmapisobtainedbymappingthemaskforeachoftherelevantMODISgranulestoauniformgridandapplyaboxcarsmoothing.TheresultofthemergingalgorithmisillustratedinFigure3.Thesuccessofthemergingalgorithmisdemonstratedbythefactthatthemapofthemergeddataatthebottomofthefigureuniformlycoversthescene,smoothlyintegratingtheECMWFdataintheregionswhereMODISdataisnotavailable,asshowninthetopleftpanelinFig.4.Wehavetestedthealgorithmforseveralotherspatialandtemporalconditionsandhavenotyetfoundancasewherethealgorithmfails.4. ConclusionAlgorithmswerepresentedandvalidatedforcorrectingtheeffectoftroposphericwatervaporonInSARimagesusingmergedtotalwatervaporcontentsfromMODISandfromECMWFnumericalweatherforecast.AwebservicearchitecturewasdevelopedandimplementedusingRESTfulservicestopresentthecorrectionalgorithmstotheuser.5. AcknowledgmentsThistaskwasperformedattheJetPropulsionLaboratoryundercontractwiththeNationalAeronauticsandSpaceAdministration.FundingwasprovidedbytheAdvancedInformationSystemsTechnologiesprogrammanagedbytheEarthScienceTechnologyOffice.6. ReferencesO.Bocketal.2005,QJRoy.Meteor.Soc.,131,3013.Prasadetal.2009,J.Geophys.Res.,114,D05107.