how to handle calibration uncertainties in high-energy astrophysics vinay kashyap spie 2008 ::...

28
w to handle calibration uncertaint in high-energy astrophysics Vinay Kashyap SPIE 2008 :: Observatory Operations :: 7016-23 :: 16:20 Wednesday 25 June 20

Upload: rosemary-griffin

Post on 18-Jan-2016

220 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: How to handle calibration uncertainties in high-energy astrophysics Vinay Kashyap SPIE 2008 :: Observatory Operations :: 7016-23 :: 16:20 Wednesday 25

How to handle calibration uncertaintiesin high-energy astrophysics

Vinay Kashyap

SPIE 2008 :: Observatory Operations :: 7016-23 :: 16:20 Wednesday 25 June 2008

Page 2: How to handle calibration uncertainties in high-energy astrophysics Vinay Kashyap SPIE 2008 :: Observatory Operations :: 7016-23 :: 16:20 Wednesday 25

How to handle calibration uncertaintiesin high-energy astrophysics

Vinay Kashyap

CHASC Astrostatistical CollaborationChandra X-ray Center

Smithsonian Astrophysical Observatory

Hyunsook Lee, Aneta Siemiginowska,Jonathan McDowell, Arnold Rots,

Jeremy Drake, Pete Ratzlaff,Andreas Zezas, Doug Burke,Rima Izem, Alanna Connors,

David van Dyk, Taeyoung Park

SPIE 2008 :: Observatory Operations :: 7016-23 :: 16:20 Wednesday 25 June 2008

Page 3: How to handle calibration uncertainties in high-energy astrophysics Vinay Kashyap SPIE 2008 :: Observatory Operations :: 7016-23 :: 16:20 Wednesday 25

bottom line

there is now a way

to include calibration uncertainty

in astrophysical data analysis

in a flexible way

for any instrument, mission, or detector.

Page 4: How to handle calibration uncertainties in high-energy astrophysics Vinay Kashyap SPIE 2008 :: Observatory Operations :: 7016-23 :: 16:20 Wednesday 25

Part Icalibration uncertainty

in data analysis

Part IIpractical issues of

storage, retrieval, flexibility

Page 5: How to handle calibration uncertainties in high-energy astrophysics Vinay Kashyap SPIE 2008 :: Observatory Operations :: 7016-23 :: 16:20 Wednesday 25

The three most important effects that affect data analysis

astrophysical model uncertainty

statistical uncertainty (measurement error)

calibration uncertainty (systematic error)

Page 6: How to handle calibration uncertainties in high-energy astrophysics Vinay Kashyap SPIE 2008 :: Observatory Operations :: 7016-23 :: 16:20 Wednesday 25

examples of calibration uncertainty

Page 7: How to handle calibration uncertainties in high-energy astrophysics Vinay Kashyap SPIE 2008 :: Observatory Operations :: 7016-23 :: 16:20 Wednesday 25

power-law residuals with current calibration

Page 8: How to handle calibration uncertainties in high-energy astrophysics Vinay Kashyap SPIE 2008 :: Observatory Operations :: 7016-23 :: 16:20 Wednesday 25

power-law residuals with 20Å contamination overlayer

Page 9: How to handle calibration uncertainties in high-energy astrophysics Vinay Kashyap SPIE 2008 :: Observatory Operations :: 7016-23 :: 16:20 Wednesday 25

(E,p,t) : photon energy, location, arrival time

(E’,p’) : detector channel, chip location

S : astrophysical source model

R : energy redistribution function (RMF)

P : position redistribution function (PSF)

A : effective area (ARF)

M : predicted model counts

general model of HEA data

Page 10: How to handle calibration uncertainties in high-energy astrophysics Vinay Kashyap SPIE 2008 :: Observatory Operations :: 7016-23 :: 16:20 Wednesday 25

effect on model parameter uncertainty

Pro

babi

lity

dens

ity

Page 11: How to handle calibration uncertainties in high-energy astrophysics Vinay Kashyap SPIE 2008 :: Observatory Operations :: 7016-23 :: 16:20 Wednesday 25

but how exactly?

Page 12: How to handle calibration uncertainties in high-energy astrophysics Vinay Kashyap SPIE 2008 :: Observatory Operations :: 7016-23 :: 16:20 Wednesday 25

MCMC

Page 13: How to handle calibration uncertainties in high-energy astrophysics Vinay Kashyap SPIE 2008 :: Observatory Operations :: 7016-23 :: 16:20 Wednesday 25

DATA CALIBRATION

Draw parameters

Update parameters

Compute likelihood

Page 14: How to handle calibration uncertainties in high-energy astrophysics Vinay Kashyap SPIE 2008 :: Observatory Operations :: 7016-23 :: 16:20 Wednesday 25

DATA CALIBRATION

Draw parameters

Compute likelihood

Draw effective areas

Update parameters

Page 15: How to handle calibration uncertainties in high-energy astrophysics Vinay Kashyap SPIE 2008 :: Observatory Operations :: 7016-23 :: 16:20 Wednesday 25
Page 16: How to handle calibration uncertainties in high-energy astrophysics Vinay Kashyap SPIE 2008 :: Observatory Operations :: 7016-23 :: 16:20 Wednesday 25
Page 17: How to handle calibration uncertainties in high-energy astrophysics Vinay Kashyap SPIE 2008 :: Observatory Operations :: 7016-23 :: 16:20 Wednesday 25

but where do the effective areas come from?

Page 18: How to handle calibration uncertainties in high-energy astrophysics Vinay Kashyap SPIE 2008 :: Observatory Operations :: 7016-23 :: 16:20 Wednesday 25
Page 19: How to handle calibration uncertainties in high-energy astrophysics Vinay Kashyap SPIE 2008 :: Observatory Operations :: 7016-23 :: 16:20 Wednesday 25

Principal Components

Page 20: How to handle calibration uncertainties in high-energy astrophysics Vinay Kashyap SPIE 2008 :: Observatory Operations :: 7016-23 :: 16:20 Wednesday 25

new nominal bias

PCs

~N (0,1)

residual

eigenvalue

eigenvector

A = A0 + bias + components + residual

Page 21: How to handle calibration uncertainties in high-energy astrophysics Vinay Kashyap SPIE 2008 :: Observatory Operations :: 7016-23 :: 16:20 Wednesday 25

Part IIpractical issues of

storage, retrieval, flexibility

A = A0 + bias + components + residual

Page 22: How to handle calibration uncertainties in high-energy astrophysics Vinay Kashyap SPIE 2008 :: Observatory Operations :: 7016-23 :: 16:20 Wednesday 25

A = A0 + bias + components + residual

store in sameformat as A0

case specificsecondary FITS extension

e.g.,SPECRESP

e.g.,PCA1DSIMS

POLY1DPCPC

MULTISCALE

Page 23: How to handle calibration uncertainties in high-energy astrophysics Vinay Kashyap SPIE 2008 :: Observatory Operations :: 7016-23 :: 16:20 Wednesday 25
Page 24: How to handle calibration uncertainties in high-energy astrophysics Vinay Kashyap SPIE 2008 :: Observatory Operations :: 7016-23 :: 16:20 Wednesday 25
Page 25: How to handle calibration uncertainties in high-energy astrophysics Vinay Kashyap SPIE 2008 :: Observatory Operations :: 7016-23 :: 16:20 Wednesday 25

what have we got so far?

• realistic error bars• implemented in BLoCXS• 500x speed up in analysis• Sherpa on the way

• unified file format for use in XSPEC/Sherpa• 100x drop in storage• generalize to any instrument• extendable to model lacunae• roll your own

Page 26: How to handle calibration uncertainties in high-energy astrophysics Vinay Kashyap SPIE 2008 :: Observatory Operations :: 7016-23 :: 16:20 Wednesday 25

summary

there are a number of steps between a calibration

scientist saying “the error on the effective area is X%

at energy Y” to then have it fold into a spectral model

fit and inflate the error bars on the parameters, and

we believe that we have connected the dots.

Page 27: How to handle calibration uncertainties in high-energy astrophysics Vinay Kashyap SPIE 2008 :: Observatory Operations :: 7016-23 :: 16:20 Wednesday 25

uncertainty in energy response

QuickTime™ and aYUV420 codec decompressor

are needed to see this picture.

Page 28: How to handle calibration uncertainties in high-energy astrophysics Vinay Kashyap SPIE 2008 :: Observatory Operations :: 7016-23 :: 16:20 Wednesday 25

what’s next?

unified file format implemented in XSPEC/Sherpa

other schemes of dimensionality reduction

RMFs: 2D PCA, within and between PCA

PSFs: multiscale residuals