uvot analysis software and data products · 2012-04-24 · 9/7/04 swift workshop, new orleans note...
TRANSCRIPT
![Page 1: UVOT Analysis Software and Data Products · 2012-04-24 · 9/7/04 Swift Workshop, New Orleans Note The ideology behind UVOT software development has been to convert raw telemetry](https://reader033.vdocuments.us/reader033/viewer/2022041913/5e687851f08186014d5bd911/html5/thumbnails/1.jpg)
9/7/04 Swift Workshop, New Orleans
Martin StillMartin Still
Swift Science Center, NASA GSFCSwift Science Center, NASA GSFC
UVOT Analysis SoftwareUVOT Analysis Softwareand Data Productsand Data Products
![Page 2: UVOT Analysis Software and Data Products · 2012-04-24 · 9/7/04 Swift Workshop, New Orleans Note The ideology behind UVOT software development has been to convert raw telemetry](https://reader033.vdocuments.us/reader033/viewer/2022041913/5e687851f08186014d5bd911/html5/thumbnails/2.jpg)
9/7/04 Swift Workshop, New Orleans
Who are we?Who are we?
SSC = Swift Science Center.
Primarily we are the two-way information highwaybetween the Swift Team and the community (SSCtalk by Stephen Holland today).
The SSC is not a member of the UVOT instrumentteam.
UVOT software is being developed by the SSC atNASA Goddard Space Flight Center, close to theHEASARC, FTOOL developers, Swift SDC and theBAT team.
![Page 3: UVOT Analysis Software and Data Products · 2012-04-24 · 9/7/04 Swift Workshop, New Orleans Note The ideology behind UVOT software development has been to convert raw telemetry](https://reader033.vdocuments.us/reader033/viewer/2022041913/5e687851f08186014d5bd911/html5/thumbnails/3.jpg)
9/7/04 Swift Workshop, New Orleans
OutlineOutline
TDRSS message data & software
Malindi data & software
Burst Advocate software
![Page 4: UVOT Analysis Software and Data Products · 2012-04-24 · 9/7/04 Swift Workshop, New Orleans Note The ideology behind UVOT software development has been to convert raw telemetry](https://reader033.vdocuments.us/reader033/viewer/2022041913/5e687851f08186014d5bd911/html5/thumbnails/4.jpg)
9/7/04 Swift Workshop, New Orleans
NoteNote
The ideology behind UVOT software developmenthas been to convert raw telemetry to generic dataproducts which are readily readable by your favouriteanalysis packages.
In particular, your high-level analysis can be achievedusing the HEASoft main-stays XIMAGE, XSELECT,XRONOS, and XSPEC.
The vast majority of UVOT software will rarely/neverhave to be used by YOU for science analysis.
![Page 5: UVOT Analysis Software and Data Products · 2012-04-24 · 9/7/04 Swift Workshop, New Orleans Note The ideology behind UVOT software development has been to convert raw telemetry](https://reader033.vdocuments.us/reader033/viewer/2022041913/5e687851f08186014d5bd911/html5/thumbnails/5.jpg)
9/7/04 Swift Workshop, New Orleans
TDRSS Data and SoftwareTDRSS Data and Software
![Page 6: UVOT Analysis Software and Data Products · 2012-04-24 · 9/7/04 Swift Workshop, New Orleans Note The ideology behind UVOT software development has been to convert raw telemetry](https://reader033.vdocuments.us/reader033/viewer/2022041913/5e687851f08186014d5bd911/html5/thumbnails/6.jpg)
9/7/04 Swift Workshop, New Orleans
TDRSS and GCN messagesTDRSS and GCN messages
Two distinct messages are sent through the TDRSSsystem from UVOT to the GCN (GRB CoordinatesNetwork). They are derived onboard from the 100-s Vfilter finding chart exposure.
1. sparse finding chart message sent 243-s after settling
2. Gamma-ray burst Neighbourhood Image (GeNIe) sent shortly(?) afterwards
Products derived from the TDRSS messages will becommunicated by email to GCN subscribers.
![Page 7: UVOT Analysis Software and Data Products · 2012-04-24 · 9/7/04 Swift Workshop, New Orleans Note The ideology behind UVOT software development has been to convert raw telemetry](https://reader033.vdocuments.us/reader033/viewer/2022041913/5e687851f08186014d5bd911/html5/thumbnails/7.jpg)
9/7/04 Swift Workshop, New Orleans
Sparse finding chart messageSparse finding chart message
An on-board Algorithm detects sources in the field. Spacecraft transmits a table, containing detector
locations and count rates from incomplete samples ofpixels around each source.
The on-board algorithm is not sophisticated: Source list may be incomplete if the field is crowded. Source list may contain spurious sources from:
Extended sourcesSaturated point sourcesBackground spikesStray light
Aim of the UVOT software is to convert this raw listinto readable products that allow both machine andhumans to identify afterglow candidates.
![Page 8: UVOT Analysis Software and Data Products · 2012-04-24 · 9/7/04 Swift Workshop, New Orleans Note The ideology behind UVOT software development has been to convert raw telemetry](https://reader033.vdocuments.us/reader033/viewer/2022041913/5e687851f08186014d5bd911/html5/thumbnails/8.jpg)
9/7/04 Swift Workshop, New Orleans
GeNIeGeNIe image image
An 80x80 pixel image from the 100-s V filter findingchart exposure. If an XRT position is known, the image will be binned 1x1;
with a window size of 0.63x0.63 arcmin.
if an XRT position is not transmitted, the image will bebinned 8x8; with a window size of 5x5 arcmin.
Primary function of theGeNIe is to test thefidelity of the sparsefinding chart message.
![Page 9: UVOT Analysis Software and Data Products · 2012-04-24 · 9/7/04 Swift Workshop, New Orleans Note The ideology behind UVOT software development has been to convert raw telemetry](https://reader033.vdocuments.us/reader033/viewer/2022041913/5e687851f08186014d5bd911/html5/thumbnails/9.jpg)
9/7/04 Swift Workshop, New Orleans
GCN messagesGCN messages
Messages from the GCN are:
Sparse finding chart:GCN #1 Sky image reconstructed from source positions.
GCN #2 List of sources with RA, Dec and magnitude.
GCN #3 List of detected sources cross-correlated with GSC.
GCN #4 Finding chart with XRT & BAT error circles.
GeNIe image:GCN #5 Sky image.
GCN #6 List of sources with RA, Dec and magnitude.
GCN #7 List of detected sources cross-correlated with GSC.
GCN #8 Finding chart with XRT & BAT error circles.
![Page 10: UVOT Analysis Software and Data Products · 2012-04-24 · 9/7/04 Swift Workshop, New Orleans Note The ideology behind UVOT software development has been to convert raw telemetry](https://reader033.vdocuments.us/reader033/viewer/2022041913/5e687851f08186014d5bd911/html5/thumbnails/10.jpg)
9/7/04 Swift Workshop, New Orleans
packettable + keywords
uvottfcImage &
source listuvotmag
uvotstarid uvotpict
Skyview orcatalog
source list[w/ MAG]
GCN #2
Finding chart
GCN #4
annotatedsource list
GCN #3
sparse finding chart processingsparse finding chart processing
GCN #1
![Page 11: UVOT Analysis Software and Data Products · 2012-04-24 · 9/7/04 Swift Workshop, New Orleans Note The ideology behind UVOT software development has been to convert raw telemetry](https://reader033.vdocuments.us/reader033/viewer/2022041913/5e687851f08186014d5bd911/html5/thumbnails/11.jpg)
9/7/04 Swift Workshop, New Orleans
packet [RAWimage + keywords]
uvotdetectsource listuvotmag
uvotstarid uvotpictFindingchart
source list[w/ MAG]
annotatedsource list
GCN #6
SKY imageswiftxform
skyview orcatalog
GCN#7 GCN#8
GeNIe GeNIe image processingimage processing
GCN #5
![Page 12: UVOT Analysis Software and Data Products · 2012-04-24 · 9/7/04 Swift Workshop, New Orleans Note The ideology behind UVOT software development has been to convert raw telemetry](https://reader033.vdocuments.us/reader033/viewer/2022041913/5e687851f08186014d5bd911/html5/thumbnails/12.jpg)
9/7/04 Swift Workshop, New Orleans
GCN source listGCN source list
![Page 13: UVOT Analysis Software and Data Products · 2012-04-24 · 9/7/04 Swift Workshop, New Orleans Note The ideology behind UVOT software development has been to convert raw telemetry](https://reader033.vdocuments.us/reader033/viewer/2022041913/5e687851f08186014d5bd911/html5/thumbnails/13.jpg)
9/7/04 Swift Workshop, New Orleans
sparse finding chart messagesparse finding chart message
![Page 14: UVOT Analysis Software and Data Products · 2012-04-24 · 9/7/04 Swift Workshop, New Orleans Note The ideology behind UVOT software development has been to convert raw telemetry](https://reader033.vdocuments.us/reader033/viewer/2022041913/5e687851f08186014d5bd911/html5/thumbnails/14.jpg)
9/7/04 Swift Workshop, New Orleans
Malindi Malindi Data and SoftwareData and Software
![Page 15: UVOT Analysis Software and Data Products · 2012-04-24 · 9/7/04 Swift Workshop, New Orleans Note The ideology behind UVOT software development has been to convert raw telemetry](https://reader033.vdocuments.us/reader033/viewer/2022041913/5e687851f08186014d5bd911/html5/thumbnails/15.jpg)
9/7/04 Swift Workshop, New Orleans
Software productsSoftware products
The goal of UVOT pipeline processing is to provide dataproducts on two levels:
Level II: Series of images, exposure maps and event tables that are compatible
with your favourite analysis tools. These will the starting point for all ofyour high-level data analysis.
Level III Higher level products. The quality of some these products must always
be verified by yourselves.
deep, co-added images
source lists
light curves
grism spectra
gif plots
![Page 16: UVOT Analysis Software and Data Products · 2012-04-24 · 9/7/04 Swift Workshop, New Orleans Note The ideology behind UVOT software development has been to convert raw telemetry](https://reader033.vdocuments.us/reader033/viewer/2022041913/5e687851f08186014d5bd911/html5/thumbnails/16.jpg)
9/7/04 Swift Workshop, New Orleans
UVOT broad band effective areasUVOT broad band effective areas
![Page 17: UVOT Analysis Software and Data Products · 2012-04-24 · 9/7/04 Swift Workshop, New Orleans Note The ideology behind UVOT software development has been to convert raw telemetry](https://reader033.vdocuments.us/reader033/viewer/2022041913/5e687851f08186014d5bd911/html5/thumbnails/17.jpg)
9/7/04 Swift Workshop, New Orleans
UVOT UVOT grism grism effective areaseffective areas
![Page 18: UVOT Analysis Software and Data Products · 2012-04-24 · 9/7/04 Swift Workshop, New Orleans Note The ideology behind UVOT software development has been to convert raw telemetry](https://reader033.vdocuments.us/reader033/viewer/2022041913/5e687851f08186014d5bd911/html5/thumbnails/18.jpg)
9/7/04 Swift Workshop, New Orleans
data modesdata modes
Imaging modeImaging mode 1x1, 2x2, 4x4 and 8x8
binned images are possible.
The image can bewindowed onboard to anysubset of the 2048x2048 fullframe.
More than one combinationof binning and windowingwill occur during a singleobserving sequence.
Event modeEvent mode 1x1 binning always.
Any detector window ispossible.
Event timing will be good to11 ms, regardless ofwindow size and binning.
Image&Event modeImage&Event mode Imaging and Event data
obtained simultaneously.
Binning and windowing maydiffer between the twomodes.
1x1 event binning always.
![Page 19: UVOT Analysis Software and Data Products · 2012-04-24 · 9/7/04 Swift Workshop, New Orleans Note The ideology behind UVOT software development has been to convert raw telemetry](https://reader033.vdocuments.us/reader033/viewer/2022041913/5e687851f08186014d5bd911/html5/thumbnails/19.jpg)
9/7/04 Swift Workshop, New Orleans
Typical observing sequenceTypical observing sequence
Seconds since trigger
![Page 20: UVOT Analysis Software and Data Products · 2012-04-24 · 9/7/04 Swift Workshop, New Orleans Note The ideology behind UVOT software development has been to convert raw telemetry](https://reader033.vdocuments.us/reader033/viewer/2022041913/5e687851f08186014d5bd911/html5/thumbnails/20.jpg)
9/7/04 Swift Workshop, New Orleans
image file formatimage file format
There will be a maximum of11 raw image files, one foreach filter.
Each file contains multipleimage extensions. Theextensions contain oneimage exposure in thesequence they were taken.
Data taken in Event mode isextracted over RAWX andRAWY and added as extraextensions to the image file.
Event mode data fromImage&Event mode issimilarly included if thewindows of the Image andEvent modes do not overlap.
![Page 21: UVOT Analysis Software and Data Products · 2012-04-24 · 9/7/04 Swift Workshop, New Orleans Note The ideology behind UVOT software development has been to convert raw telemetry](https://reader033.vdocuments.us/reader033/viewer/2022041913/5e687851f08186014d5bd911/html5/thumbnails/21.jpg)
9/7/04 Swift Workshop, New Orleans
event file formatevent file format
There will be one raw event fileper filter.
Each file contains an EVENTStable extension containing eventsfrom all exposures during theobserving sequence.
A STDGTI extension is notpossible because the sciencewindow may change fromexposure to exposure.
The EXPREF column in theEVENTS table points to a specificGTI extension in the file, one GTIextension per exposure.
The WINDOW extension containsbookkeeping data for eachexposure, i.e. start time andwindow size and location.
![Page 22: UVOT Analysis Software and Data Products · 2012-04-24 · 9/7/04 Swift Workshop, New Orleans Note The ideology behind UVOT software development has been to convert raw telemetry](https://reader033.vdocuments.us/reader033/viewer/2022041913/5e687851f08186014d5bd911/html5/thumbnails/22.jpg)
9/7/04 Swift Workshop, New Orleans
Level II processingLevel II processing
Image data
Create bad pixel maps(uvotbadpix).
Reduce mod-8 fixed patternnoise (uvotmodmap).
Flat field images(uvotflatfield).
Convert from rawcoordinates to RA and Dec(swiftxform).
Create exposure maps(uvotexpmap).
Event data
Calculate RA & Dec anddetector coordinates foreach event (coordinator).
Screen the data for orbitaland astrometriccontamination, bad pixelsand compression damage(uvotscreen).
![Page 23: UVOT Analysis Software and Data Products · 2012-04-24 · 9/7/04 Swift Workshop, New Orleans Note The ideology behind UVOT software development has been to convert raw telemetry](https://reader033.vdocuments.us/reader033/viewer/2022041913/5e687851f08186014d5bd911/html5/thumbnails/23.jpg)
9/7/04 Swift Workshop, New Orleans
Level III processingLevel III processing
Image data
Co-add images.
Pass source detectionalgorithm over images(uvotdetect).
Convert count rates tomagnitude in source lists(uvotmag).
Cross-correlate with GSC(uvotstarid).
Create FITS tables and gifplots of magnitude history(uvotmaghis).
Extract grism spectrum(uvotevgrism).
Construct response matricesfor spectra (uvotrmfgen).
Create spectral gif plots.
Event data
Extract 11 ms time resolutionlight curves for the source(FITS and gif).
For grism events, calculatewavelength of each photonand re-screen data.
![Page 24: UVOT Analysis Software and Data Products · 2012-04-24 · 9/7/04 Swift Workshop, New Orleans Note The ideology behind UVOT software development has been to convert raw telemetry](https://reader033.vdocuments.us/reader033/viewer/2022041913/5e687851f08186014d5bd911/html5/thumbnails/24.jpg)
9/7/04 Swift Workshop, New Orleans
Level III products: deep imagesLevel III products: deep images
![Page 25: UVOT Analysis Software and Data Products · 2012-04-24 · 9/7/04 Swift Workshop, New Orleans Note The ideology behind UVOT software development has been to convert raw telemetry](https://reader033.vdocuments.us/reader033/viewer/2022041913/5e687851f08186014d5bd911/html5/thumbnails/25.jpg)
9/7/04 Swift Workshop, New Orleans
Level III products: decay curvesLevel III products: decay curves
![Page 26: UVOT Analysis Software and Data Products · 2012-04-24 · 9/7/04 Swift Workshop, New Orleans Note The ideology behind UVOT software development has been to convert raw telemetry](https://reader033.vdocuments.us/reader033/viewer/2022041913/5e687851f08186014d5bd911/html5/thumbnails/26.jpg)
9/7/04 Swift Workshop, New Orleans
Level III products: Level III products: grism grism spectraspectra
![Page 27: UVOT Analysis Software and Data Products · 2012-04-24 · 9/7/04 Swift Workshop, New Orleans Note The ideology behind UVOT software development has been to convert raw telemetry](https://reader033.vdocuments.us/reader033/viewer/2022041913/5e687851f08186014d5bd911/html5/thumbnails/27.jpg)
9/7/04 Swift Workshop, New Orleans
Burst Advocate SoftwareBurst Advocate Software
![Page 28: UVOT Analysis Software and Data Products · 2012-04-24 · 9/7/04 Swift Workshop, New Orleans Note The ideology behind UVOT software development has been to convert raw telemetry](https://reader033.vdocuments.us/reader033/viewer/2022041913/5e687851f08186014d5bd911/html5/thumbnails/28.jpg)
9/7/04 Swift Workshop, New Orleans
UVOT & Burst AdvocacyUVOT & Burst Advocacy
Automated GCN UVOTsoftware will provide none, oneor many afterglow candidates.
The role of the Burst Advocatewill be to confirm or find theafterglow position: quality-check GCN messages. Inspect the Malindi data. Archive afterglow properties
position/magnitude/redshiftusing the AKBAR system.
It would take many hours toperform these tasks manually.UVOT burst advocate softwareallows the BA to navigate thearchive, detect and localize theafterglow, and fill the majority ofAKBAR boxes autonomously.
![Page 29: UVOT Analysis Software and Data Products · 2012-04-24 · 9/7/04 Swift Workshop, New Orleans Note The ideology behind UVOT software development has been to convert raw telemetry](https://reader033.vdocuments.us/reader033/viewer/2022041913/5e687851f08186014d5bd911/html5/thumbnails/29.jpg)
9/7/04 Swift Workshop, New Orleans
Comparison with source cataloguesComparison with source catalogues
![Page 30: UVOT Analysis Software and Data Products · 2012-04-24 · 9/7/04 Swift Workshop, New Orleans Note The ideology behind UVOT software development has been to convert raw telemetry](https://reader033.vdocuments.us/reader033/viewer/2022041913/5e687851f08186014d5bd911/html5/thumbnails/30.jpg)
9/7/04 Swift Workshop, New Orleans
Image comparisonsImage comparisons
![Page 31: UVOT Analysis Software and Data Products · 2012-04-24 · 9/7/04 Swift Workshop, New Orleans Note The ideology behind UVOT software development has been to convert raw telemetry](https://reader033.vdocuments.us/reader033/viewer/2022041913/5e687851f08186014d5bd911/html5/thumbnails/31.jpg)
9/7/04 Swift Workshop, New Orleans
Aperture photometryAperture photometry
![Page 32: UVOT Analysis Software and Data Products · 2012-04-24 · 9/7/04 Swift Workshop, New Orleans Note The ideology behind UVOT software development has been to convert raw telemetry](https://reader033.vdocuments.us/reader033/viewer/2022041913/5e687851f08186014d5bd911/html5/thumbnails/32.jpg)
9/7/04 Swift Workshop, New Orleans
RedshiftRedshift
![Page 33: UVOT Analysis Software and Data Products · 2012-04-24 · 9/7/04 Swift Workshop, New Orleans Note The ideology behind UVOT software development has been to convert raw telemetry](https://reader033.vdocuments.us/reader033/viewer/2022041913/5e687851f08186014d5bd911/html5/thumbnails/33.jpg)
9/7/04 Swift Workshop, New Orleans
SummarySummary
UVOT software is 95% flight-ready.
Development will obviously continue in to themission.
Feedback from the community will be solicited.