evaluation of gridded multi-satellite precipitation (trmm -tmpa) estimates for performance in the...
Post on 19-Jan-2016
221 Views
Preview:
TRANSCRIPT
Evaluation of gridded multi-satellite precipitation (TRMM -TMPA) estimates for performance in the Upper Indus Basin
(UIB)
Asim J Khan
Advisor: Prof. Dr. Rer. nat. Manfred Koch
Department of Geo-hydraulics and Engineering Hydrology,
University of Kassel, Germany
Presentation Outline
Introduction Study Area
Upper Indus basin Indus River Basin
Datasets TMPA Data (TRMM 3B42 V7) Gauge Rainfall Data
Methodology Qualitative Statistical Analysis Categorical Statistics Visual Comparison
Results Conclusions
Introduction Daily climatic data with acceptable gridded resolution critical for hydrological
modelling.
Mountainous regions-Two major issues:
sparsity of the data sampling points (gauge stations), and
the discontinuities in the data series or the quality of the temporal records.
Currently an increasing number of gridded climatic products such as satellite based gridded data are readily available
These satellite products though they have high spatial resolution, may show considerable errors and biases.
The present study aims to evaluate the capability of the “Tropical Rainfall Measurement Mission” (TRMM) “Multi-satellite Precipitation Analysis” (TMPA) in estimating appropriate precipitation rates in the Upper Indus basin (UIB)
Study area – Upper Indus Basin (UIB)
Area: about 170,000 km2
Length (UIB): about 1125 km long
Location: 31º - 37º N
72º - 82º E
Features
• Feed Largest irrigation system of the world
• UIB contains the greatest area of perennial glacial ice cover (22 000 km2) outside the polar regions of the earth
• The altitude within the UIB ranges from as low as 455 m to height of 8611 m (Tahir et al., 2011).
• Most of the annual precipitation originates in the west and falls in winter and spring whereas occasional rains are brought by the monsoonal incursions to trans-Himalayan areas (Wake, 1987).
Indus River basin
Area: about 912,000 km2
Length (Indus):
• largest rivers in Asia
• about 2880 km Location:
24º - 37º 70º - 82º E
DatasetsSatellite Rainfall Product- TMPA Data (TRMM 3B42 V7)
The Tropical Rainfall Measuring Mission (TRMM) Multi-satellite Precipitation Analysis (TMPA) provides 0.25x0.25° 3-hourly estimates of precipitation
The TMPA depends on input from two different types of satellite sensors, namely microwave and IR.
Current study used TMPA Data (TRMM 3B42 V7) aggregated to daily time step (1st January 1998 to 31st December 2008)
Gauge Rainfall data The daily time series of fourteen (14) meteorological stations (1st January
1998 to 31st December 2008) were used for the point-to-point validation of the TRMM data.
Station Latitude (N) Longitude (E) Elevation (m.a.s.l)
Khunjrab 36.85 75.4 4710Burzil 34.906 75.902 4030Zani pass 36.334 72.167 3886Shandur 36.086 72.525 3800Ziarat 36.853 74.278 3669Kot Pass 36.517 72.583 3500Yasin 34.367 73.3 3150Hushey 35.376 76.4 3010Deosai 34.95 74.383 3000Rama 35.358 74.806 3000Ushkore 36.018 73.358 2970Naltar 36.128 73.185 2810Ratu 35.153 74.187 2570Shigar 35.53 75.592 2440
Quantitative Statistics
Quantitative comparison through widely used statistical indicators:
correlation coefficient (R),
mean relative bias error (BIAS),
the mean error (MAE), and
root mean square error (RMSE)
1
2 2
1 1
( )( )
( ) . ( )
n
i ii
n n
i ii i
T T G GR
T T G G
1
100( )
ni i
i i
T GBIAS
n G
1
| |1 ( )
ni i
i i
T GMAE
n G
1
100( )
ni i
i i
T GBIAS
n G
Categorical statistics
A 2x2 Contingency Table was used to list rain events, no events, misses by TRMM and false-alarms by the TRMM, over the Indus river basin. Based on these, categorical statistics were derived including, Accuracy (Ac), bias score or frequency bias index (FBI), probability of detection (POD), false alarm ratio (FAR), critical success index (CSI) and true skill statistics (TSS) (Wilks 1995, 2006).
(2x2 Contingency Table)
OBSERVED VALUES(GAUGE DATA)
TOTAL
YES NO
ESTIMATED VALUES
(TRMM-ESTIMATES)
YES-a-
Hits-b-
False AlarmsTotal-Yes
Estimated
NO-c-
Misses
-d-Correct
negative
Total-No Estimated
TOTALTotal-Yes Observed
Total-No Observed
TOTAL
a dAccuracy
Total
a bFBI
a c
a
PODa c
b
FARa b
a
CSIa b c
a b ad bc
TSSa b b d a b c d
Results
The results are presented under three groups:i. Quantitative statistics
Monthly and Annual
Summer and Winter Season
ii. Categorical Statistics
iii. Visual comparison TRMM Estimates and Gauge data for mean monthly rainfall for all station
Monthly, Annual and Seasonal Time series for rainfall totals at Khunjrab Station
Monthly, Annual and Seasonal Time series for rainfall totals at Yasin Station
Quantitative StatisticsMonthly and Annual
MONTHLY ANNUAL
STATIONS R BIAS MAE RMSE R BIAS MAE RMSE
Shigar -0.47 9.6810.33 0.86 -0.38 0.39 0.78 1.28
Ushkor 0.83 0.21 0.75 0.36 0.62 0.02 0.22 0.27
Yasin 0.36 5.47 5.78 3.28 0.10 2.65 2.65 2.77
Zani Pass 0.84 0.56 1.69 0.64 0.52 -0.62 0.62 0.63
Zyarat -0.21 0.47 1.04 0.38 0.55 -0.03 0.30 0.34
Kot Pass 0.72 2.38 3.27 0.44 0.30 0.01 0.88 1.54
Naltar 0.88 -0.53 0.61 0.60 0.12 -0.56 0.56 0.58
Rama 0.67 -0.49 0.67 0.67 0.78 -0.66 0.66 0.66
Ratu 0.02 0.54 1.22 0.93 0.30 -0.30 0.33 0.38
Shandur 0.63 0.94 1.43 0.60 0.54 0.15 0.25 0.40
Burzil 0.89 -0.52 0.56 0.58 0.43 -0.52 0.52 0.53
deosai 0.38 0.65 0.99 0.75 -0.37 0.41 0.49 0.61
Hushey 0.20 0.23 1.03 0.50 -0.15 -0.29 0.42 0.48
Khunjrab 0.65 0.54 1.01 0.60 -0.28 0.13 0.31 0.44
Average 0.46 1.44 2.17 0.80 0.22 0.06 0.64 0.78
Maximum 0.89 9.6810.33 3.28 0.78 2.65 2.65 2.77
Minimum-0.47
-0.53 0.56 0.36 -0.38 -0.66 0.22 0.27
For monthly data, the mean relative BIAS was huge and ranged from a negative 0.53 to a positive 9.68, with an average monthly BIAS of 1.44 for all the stations.
There was no indication of a similar trend or sequence in the over or under estimation in the monthly data,
The monthly relative MAE and RMSE also showed great variation ranging from 0.56 to 10.33 and 0.36 to 3.28 times the original amounts as well as all stations averages of 2.17and 0.80, respectively.
The annual indices followed the same pattern, but with considerably better matches.
The relative BIAS ranged from a negative value of 0.66 to a positive value of 2.65, while MAE and RMSE ranged from 0.22 to 2.65 and 0.27 to 2.77 respectively.
The average MAE and RMSE for all stations were 0.64 and 0.78 respectively.
Summer season mostly showing a positive BIAS while winter predominantly a negative BIAS.
R ranged from a negative 0.47 to a positive 0.68 for the summer season while -0.55 to 0.66 for winter season, with average values of 0.22 and 0.20 respectively.
The data for only 29% of the stations had somewhat reasonable R value of above +0.50.
relative BIAS- from-0.64 to 3.6 and -0.77 to 1.93 times of the original, with average values of 0.26 and -0.08 for summer and winter season respectively.
RMSE- minimum of 0.3 to a maximum of 3.44 for summer, averaging 0.94, while 0.43 to 2.5 for winter season, averaging 0.81.
SUMMER SEASON WINTER SEASON
STATIONS R BIAS MAE RMSE R BIAS MAE RMSE
Shigar -0.47 1.16 1.44 2.24 -0.10 -0.02 0.62 0.91
Ushkor 0.49 0.30 0.45 0.53 0.66 -0.27 0.38 0.43
Yasin -0.35 3.16 3.16 3.44 0.21 1.93 1.93 2.25
Zani Pass 0.52 -0.64 0.64 0.65 0.57 -0.58 0.58 0.60
Zyarat 0.56 0.06 0.26 0.31 0.54 -0.13 0.44 0.49
Kot Pass 0.10 0.21 0.84 1.73 0.56 -0.19 0.84 1.22
Naltar 0.48 -0.49 0.49 0.52 0.17 -0.66 0.66 0.68
Rama 0.68 -0.52 0.52 0.53 0.61 -0.77 0.77 0.77
Ratu 0.49 0.30 0.46 0.65 -0.01 -0.61 0.61 0.63
Shandur 0.57 0.45 0.45 0.64 -0.02 -0.07 0.44 0.48
Burzil 0.35 -0.47 0.47 0.49 0.05 -0.55 0.55 0.58
deosai -0.42 0.37 0.45 0.57 -0.14 0.56 0.65 0.83
Hushey 0.22 -0.20 0.34 0.42 -0.55 -0.33 0.54 0.59
Khunjrab -0.11 0.02 0.30 0.43 0.33 0.63 0.77 0.87
Average 0.22 0.26 0.73 0.94 0.20 -0.08 0.70 0.81
Maximum 0.68 3.16 3.16 3.44 0.66 1.93 1.93 2.25
Minimum-0.47
-0.64 0.26 0.31 -0.55 -0.77 0.38 0.43
Quantitative StatisticsSummer and Winter
Categorical statistics for daily TRMM estimate and gauge rain data
Accuracy looked pretty good as it values for all the stations were above 0.50 and an average of 0.58.
Frequency bias index (FBI) varied on both sides with nine stations showing an overestimation while five showed underestimation. The average of FBI for all stations together was 1.05, showing a slight overestimation.
For most of the stations, the value of POD was below 0.50 with only four stations having values above it.
The value of False Alarm Ratio (FAR) for all the station except one, were too high and with an average of 0.56.
In the same way, the CSI and TSS values were also not very promising as only three station had values above 0.30 in case of former and only one station having value about 0.20 in case of the later.
Overall, the categorical statistics indicates that TRMM estimates do not have a very good match with the gauge data and therefore it can only be used after some corrections and adjustment made thereof
Accuracy FBI POD FAR CSI TSS
Shigar 0.60 1.30 0.41 0.68 0.22 0.08
Ushkor 0.61 1.07 0.42 0.60 0.26 0.12
Yasin 0.67 1.03 0.44 0.58 0.27 0.20
Zani Pass 0.55 0.86 0.35 0.59 0.24 0.03
Zyarat 0.60 0.73 0.35 0.52 0.25 0.10
Kot Pass 0.55 1.04 0.43 0.58 0.27 0.06
Naltar 0.62 0.86 0.40 0.53 0.28 0.14
Rama 0.55 1.27 0.50 0.61 0.28 0.08
Ratu 0.51 1.48 0.56 0.62 0.29 0.04
Shandur 0.56 1.16 0.40 0.65 0.23 0.04
Burzil 0.57 0.75 0.42 0.45 0.31 0.12
deosai 0.57 1.01 0.61 0.39 0.44 0.14
Hushey 0.57 0.83 0.40 0.52 0.28 0.10
Khunjrab 0.65 1.34 0.57 0.58 0.32 0.25
Average 0.58 1.05 0.45 0.56 0.28 0.11
Maximum 0.67 1.48 0.61 0.68 0.44 0.25
Minimum 0.51 0.73 0.35 0.39 0.22 0.03
Visual comparisonComparison of TRMM Estimates and Gauge data for mean monthly rainfall for all stations with seasonal demarcation
Visual comparisonTime series of TRMM Estimates and Gauge data for rainfall totals at Khunjrab Station; a. Monthly, b. Annual, and c. Seasonal (S=Summer, W=Winter)
PR
CIP
ITA
TIO
N (
mm
)
a
b
c
Visual comparisonTime series of TRMM Estimates and Gauge data for rainfall totals at Yasin Station; a. Monthly, b. Annual, and c. Seasonal (S=Summer, W=Winter)
PR
CIP
ITA
TIO
N (m
m)
a
b
c
Conclusion
considerable errors
No uniform trend detected
Summer-Over estimated Winter-Under estimated
TRMM 3B42 V7 may only be used for hydrological modeling in UIB after improvements and local calibration
• The results indicated that the TMPA product showed considerable errors in estimating rain amounts at the gauge stations, throughout the study area as well as throughout the time period studied.
• There was no uniform trend of under or overestimation found for the region as a whole, as some stations TMPA product tends to overestimate while at others the opposite.
• The seasonal values though showed a specific pattern, with the summer rain slightly overestimated while the winter predominantly underestimated at almost all locations and time scales.
• This product had an overall poor agreement with rain gauge data in the study area, at all temporal scales and unreliable for most months and years with RMSE exceeding 0.50.
• Therefore the TRMM 3B42 V7 may only be regarded suitable for further applications in the study region, if some improvements and local calibration are carried out first to the data.
top related