WEAVEOperational Rehearsal 2: Planning

Nicholas Walton, Eduardo Gonzalez-Solares, Mike Irwin, Jim Lewis, David Murphy & Clare

Worley

1

2

End-to-End Data Flow

219 Dec 2016 Nic Walton - SPA/CPS @ WEAVE AHM16 - Cambridge

QL, CPS and OR at CASU

STL

OCS

APS

WAS

CPS

3

WEAVE Data Flow (simplified)… testing in advance of operations

319 Dec 2016 Nic Walton - SPA/CPS @ WEAVE AHM16 - Cambridge

OCS

SWG

4

WEAVE Operational Rehearsals

Concept of testing the data flow developed early 2016

OpR’s staged 1,2,3

Increasing realism

419 Dec 2016 Nic Walton - SPA/CPS @ WEAVE AHM16 - Cambridge

5

WEAVE Operational Rehearsal 1

• Operational Rehearsal 1: October 2016• This tested the OCS – CPS

– APS – (WAS) interfaces• Successfully demonstrated

data flow, hardware, interfaces ING-CASU-TNG-IAC

• Operational Rehearsal 2:• Will increase range of

systems exercised

519 Dec 2016 Nic Walton - SPA/CPS @ WEAVE AHM16 - Cambridge

SPA Contributed data products Date: 02-Nov-2016

WEAVE-XXX-NNN Version 0.10 Page 14 of 23

4 THE REHEARSAL

We detail here the particulars of the operational rehearsal for each node. The final section highlights general points about the rehearsal. After making the changes and adjustments details below, the final configuration and architecture of the system as a whole is shown in Figure 5.

Figure 5 - The dataflow between the different nodes operating within the OpR1. Red lines indicate the flow of data, whilst thin black lines indicate the flow of semaphores. This was the architecture of the nodes at conclusion of the

rehearsal. In order to complete the OpR in a timely manner, and to provide faster iterations for testing design changes, bug fixes etc, the frequency with which nodes interact with each other was increased relative to anticipated WEAVE operations. The CPS, APS and (some elements of) the WAS were exchanging semaphores and acting on new data on 60 second timescales.

6619 Dec 2016 Nic Walton - SPA/CPS @ WEAVE AHM16 - CambridgeDavid Murphy: v20161220

Operational Rehearsal 2

Configure: run by Gavin but SWG welcome to use and provide configure files

7

Planning for OpR2: cont …

• Rehearsal to run 13-17 March 2017• Will simulate ~4 nights of data

• OpR2 plan will be issued early Jan 2017• Input catalogues required from science teams 1st Feb 2017• This allow set of simulated data to be generated

• During operations phase, data will be passed on a nightly basis and flow through the analysis chain

• Survey Working Group involved in both generating the input catalogues, and assessing the output data (OR and WAS)• OpR2 need not be perfect: aim to engage all actors, check

interfaces, check that s/w components in place • Kickoff telecon: early Jan 2017 (planning doodle at

http://doodle.com/poll/cczp9344pmx3xbx6)719 Dec 2016 Nic Walton - SPA/CPS @ WEAVE AHM16 - Cambridge

8

Planning for OpR2

• Planning materials available via WEAVE OpR2 confluence page

• Key Points of contact• Op Repository and OpR2 plan: David Murphy• CPS and OpR2 Plan: Jim Lewis• OpR2 Science: Shoko Jin• Catalogue Generation: Clare Worley• APS: Cristina Zurita• WAS: Emilio Molinari• OpR2 coordination: Scott Trager/ Nic Walton

819 Dec 2016 Nic Walton - SPA/CPS @ WEAVE AHM16 - Cambridge

9

Future Operational Rehearsals

• Full OpR3 scheduled for Q1 2018• This will aim at a full run through the complete

analysis chain• Key milestone in advance of the Operational

Readiness Review Q2 2018• Full operations commence with WEAVE

commissioning and early science operations• Staged enhancements to both pipelines and

archive envisaged during operations to allow for future incorporation of contributed products

919 Dec 2016 Nic Walton - SPA/CPS @ WEAVE AHM16 - Cambridge