wise science data center readiness assessmentwise science data center is go for launch . national...

National Aeronautics and Space Administration Jet Propulsion Laboratory California Institute of Technology

Wide-field Infrared Survey Explorer (WISE) – Flight Readiness Review

Flight Readiness Review RMC 1 10/29/09

WISE Science Data Center Readiness Assessment

R. Cutri - IPAC October 29, 2009




Summary

•  WSDC is fully staffed, IOC/Ops staff assignments made •  Operations procedures documented •  Operations workforce deployment plan ready •  Required WSDS functionality in place to support IOC and nominal survey

operations –  Ingest, Scan/Frame PL, Quicklook QA software (v3.2) frozen and under CCB management –  Development completion dates have been scheduled for post-launch required functionality

•  Hardware system in final launch-ready configuration

•  IOC and Survey Ops interfaces and operations tested successfully in MSTs and ORTs

•  Ops-critical requirements verified –  Performance validated with high-fidelity simulations of sky data combined with detector

characteristics from payload testing

WISE Science Data Center is GO for launch




Required WSDC Functions for IOC and Early Operations

•  IOC: Support scan rate calibration, boresight alignment, anneal characterization

–  Ingest H/K, Nav and Science Data, partial Scan/Frame processing –  Enable data access for cognizant scientists and project personnel

•  Early survey operations: Ingest and Quicklook QA, Scan coverage report

–  Ingest H/K, Nav and Science Data, partial Scan/Frame processing, Quicklook QA processing, progress reporting, alert generation

–  Monitor scan rate synchronization, system throughput (photometric zero point), detector noise

•  Desired for data product generation, but not required to support IOC and flight ops

–  Full Scan/Frame processing, Multiscan processing, Ops Coadd (Multiframe) processing, full QA analysis, Science Archive loading




WSDC IOC and Operations Functional Assignments

Management Lead – Cutri Financial – Kennedy IRSA – Teplitz, Groom ISG - Burt

IOC/Early Ops Coordinators – Wachter, Masci Boresight – Grillmair, McCallon Scan Rate Cal – Kirkpatrick, Gelino, Fajardo-Acosta Anneal – Padgett Linearity – Kirkpatrick, Masci Inst. Cal. – Masci, Padgett, Wachter PSF Determ. – Marsh, Grillmair Distortion – McCallon, Fowler Latent Char. – Padgett, Liu, Alles Phot. ZP – Wheelock, Cutri

Pipeline Tuning/Dev Lead – Conrow INGEST - Conrow ICAL – Masci, Fowler MDET – Marsh PREX – McCallon, Fowler WPHOT – Marsh, Jarrett. Evans PCAL – Wheelock ARTID – Alles SSOID – Fowler, Tholen NEOWISE – Dailey, Bauer QA – Brandenburg, Lungu

Ingest/Processing Operations Coordinator – Beck Team – Barba, Lungu, Wyatt

QA Operations Lead – Kirkpatrick QA Thresholds – Gelino, Fajardo-

Acosta Ops – Bauer, Dailey, Fajardo-Acosta,

Gelino, Grillmair, Hoffman Kirkpatrick, Liu, Padgett, Tsai, Wachter

Archive Lead – Yan DB Prep – Evans, Wheelock DBA – Rey Interfaces – Monkewitz, Paredes,

Zhang

Hardware System Coordinator – Brandenburg Conrow

Science Analysis/Validation Coordinator – Cutri Team – Bauer, Gelino, Grav, Fajardo-

Acosta, Grillmair, Hoffman Jarrett, Kirkparick, Liu, Marsh, Masci, Padgett, Tsai, Wachter,

Tools – Evans, Wheelock

•  IPAC management




Operations Procedures are Documented

•  Documented in WSDC D-C001 through C005 –  http://web.ipac.caltech.edu/staff/roc/wise/docs/wsdc_document_tree.html

•  All at version 1 or higher •  Update as necessary post-launch in response to on-orbit data

needs




Daily Processing Operations Tasks are Scheduled

PST Activity

09

10

11

12

13

14

15

16

17

18

19

20 21

22

23

00

01

0 2

03 04

05

06

07

08

HRP Xfers (auto)

T1

T2

T3

T4

Ingest/QL (auto)

InQL 3

InQL 4

InQL 1

InQL 2

Scan/frame (T+0)

S/F 1,2

S/F 3,4

Backups Backups

Multi-scan (T+1 days)

MS 1-4

Coadds (T+2 days)

Coad 1-4

Reruns, Make-up

Idle Idle

Min

. Ops

Sup

port

N

orm

al O

ps

Staffed Unstaffed

Daily Ops Processing




Operations Staffing Plan is Ready

•  Processing Operations –  2 FTE (1 full-time, 2 part time), additional coverage by two other WSDC

engineers –  IOC: 7 day coverage, 8am-midnight hours/day (split shifts) –  Survey Ops: 6 day coverage, 8am-9pm (split shifts)

•  QA Operations –  5 FTE (3 full time, 5 part time) –  IOC: 7 day coverage, 6am-9pm (split shifts) –  Survey Ops: 5 day coverage, 9am-6pm




WSDS Development Closeout Schedule

Subsystem Current Status

Launch/IOC First-Pass Processing

Second-Pass Processing

INGEST Frozen 10/23/09 - N/A

EXEC Frozen 10/23/09 2/19/10 2/2/11

Pipelines Scan/Frame Frozen 10/23/09 2/4/10 2/2/11

Multiscan Mature [11/11/09] 2/4/10 2/2/11

Multiframe Mature [11/11/09] 2/4/10 2/2/11

QA Quicklook Frozen 10/23/09 - N/A

Pipeline Mature [11/11/09] 2/19/10 2/16/11

Archive DB Load Mature [11/18/09] 2/19/10 2/16/11

Image Svc. Prelim. [11/25/09] 2/19/10 2/16/11

FPG Design - 4/22/10 5/8/11

•  WSDS v3.2 has been deployed. Elements critical for for launch/IOC support (shown in green) are frozen and under CCB Management

•  Dates in “[]” are goals. Elements not required for IOC, early ops support.




Requirements Verification Status

•  85 L4WSDC Requirements –  76 verified during unit test, ORT2, ORT3 –  9 deferred to post-launch activities:

Requirement Topic Method Activity L4WSDC-003 FR – Expl. Supplement Demonstration FPG

L4WSDC-004 FR Schedule Demonstration Plan, FPG

L4WSDC-007 PR – Expl. Supplement Demonstration FPG

L4WSDC-008 PR Schedule Demonstration Plan, FPG

L4WSDC-038 Moon proximity Analysis Early Ops, FPG

L4WSDC-063 Sci. Team product valid. Demonstration FPG

L4WSDC-064 Sci. Team data quality char. Demonstration Early Ops, FPG

L4WSDC-080 Catalog Reliability Analysis Early Ops, FPG

L4WSDC-086 Image Server capabilities Demonstration Server v2 Del. (2010)




MOS/WSDC Interfaces Have Been Tested and Verified

•  RFSOC tests and early HRP/MUB testing –  Ingest core has been reading, decommutating, decompressing real

instrument/MUB data for >1 year.

•  MST-7 –  Partial MOS interface –  Successfully used

•  ORT-2 –  Full MOS interface –  Mostly successful –  C-kernel issues resolved

•  ORT-3 –  Full MOS Interfaces, SOC Interface –  Fully successful




Backup Slides




•  Data Ingest –  Receive raw science image packets from White Sands and engineering telemetry from MOS –  Decompress and assemble image data into Level 0 FITS format, and mate with engineering telemetry

•  Science Data Processing –  Convert raw imaging and engineering data into a photometrically and astrometrically calibrated Image

Atlas and extracted Source Catalog –  Compile Explanatory Supplement to the WISE Data Products –  Generate ancillary data products to support mission requirements

•  Science Data Quality Assurance –  Provide rapid QA feedback for selected on-orbit performance (i.e. scan mirror synch) –  Overall science data QA for survey assessment and data product generation and validation

•  Science Data Archiving and Distribution –  Archive raw data (Level 0) during mission, deliver to NSSDC at end of mission –  Provide an operational archive to store and serve intermediate data products and metadata to project

team during mission –  Provide a long-term “living” archive that stores and serves WISE science data products to the

astronomical community and general public along with user’s guide documentation and descriptive analysis

WSDC Responsibilities




Accomplishments Since ORR

•  WSDS v3.2 deployed, frozen and under CCB management –  All functionality in place to support launch and IOC

•  Final pre-launch hardware system updates completed. •  Procedure documents updated to v1 or higher •  Ingest software updated and tested to handle split HRP science

data packets •  Raw and processed data tape back-up scripts completed and

tested •  WISE/IRSA L1 and L3 Image Service deployed (v1) •  IPAC Director’s Review held 10/20




ORR Actions Have Been Addressed

•  Recommended Action: Eliminate any further GDS updates unless necessary to insure success of launch and IOC operations. Defer efficiency improvements until after start of survey operations.

–  WSDS development frozen at v3.2 (10/23). Includes critical Ingest, Scan/Frame pipeline, Quicklook QA elements. Under CCB managements.

–  Hardware system is in final, pre-launch configuration. No further updates.

•  Recommended Actions: Make sure that there are fast B/W and color printrs that are readily available and accessible to your visiting scientists.

–  Order has been placed for fast color printer that will be deployed in the WISE situation room. Access will be enabled for visiting project and science team use.




WISE Science Data Processing Flow




IOC and Operations Staffing Plans are Ready

•  Put plan here




Visiting Team Member Support

•  Approximately 10 project team members at IPAC during IOC and 1-2 months of survey operations

•  WISE “Situation Room” –  Work stations, b/w and color printer, dedicated meeting facility (MR214;

reconfiguration underway ) –  Temporary visitor offices for additional guests

•  Visitors will supply own computers –  IPAC ISG will provide user support –  Visitors will scp processed data to their computers for analysis

•  Connectivity –  Hardline network connection in Situation Room to WSDC computer to download

raw or processed data –  Wireless network for general Internet access –  Small volume data transfers via Ground Test Data Archive sftp site for SDL




Activities Before Launch (Not Launch Critical)

•  Priority 1 –  Finalize and document survey progress reports and delivery protocol

(WSDC-SOC interface) –  Exercise raw telemetry and processed data tape archive process –  Complete testing of HRP science data transfers –  Re-deliveries of nav/ancillary data for 30 orbit sim to confirm interface

stability –  Continue multiscan and multiframe (coadd) pipeline ops training –  Complete dev-to-ops software transition checklist

Operational Readiness Review – October 7-8, 2009




Activities Before Launch (Not Launch Critical)

•  Priority 2 –  Generate summary table from Ingest on MOS deliveries –  Continue anomalous data ingest and processing testing –  Complete scan/frame pipeline ARTID parameter tuning –  Define IRSA archive loading protocols and continue transfer testing –  Finalize processing and QA filtering criteria for data taken in SAA and

during flight system maneuvers

•  Priority 3 –  Web-accessible WebQA Ingest Summary –  Long-duration WSDC data processing exercises –  Continue processing testing, performance characterization –  Complete multiframe ARTID design and development

Operational Readiness Review – October 7-8, 2009

wise science data center readiness assessmentwise science data center is go for launch . national...

Documents