TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01
TITLE:
Ozone_cci
System Verification Report SVR
Reference: Ozone_cci_DLR_SVR_01
Date of issue: 30-10-2015
Version: 01.01
Phase 2, Task 5
Deliverable: D3.2 WP Manager: M. Wolfmüller WP Manager Organization: DLR-EOC Other partners: EOST: BIRA, CHALM, DLR-, FMI, KIT, KNMI, RAL, UBR, ULB, UofT, UofS VALT: CRG:
TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01
DOCUMENT PROPERTIES
Title SVR
Reference Ozone_cci_DLR_SVR_01
Issue 01
Revision 01
Status Released
Date of issue 30-10-2015
Document type System Verification Report
FUNCTION NAME DATE SIGNATURE
LEAD AUTHOR
WP Manager M.Wolfmüller 30-10-2015 Original in hands of PM
CONTRIBUTING AUTHORS
C. Lerot (TC_L2)
D. Loyola (TC/TTOC_L3)
M. Coldewey-Egbers (TC L3)
K.-P. Heue (TTOC_L3)
G. Miles (NP_L2)
R. van der A (NP_L3/L4)
N. Rahpoe (LP_L2_SCIA)
V.Sofieva (LP_L2_GOMOS)
A. Laeng (LP_L2_MIPAS)
C. Roth (LP_L2_OSIRIS)
J. Urban (LP_L2_SMR)
P.-F. Coheur (NP_L2_IASI)
R. Astoreca (NP_L2_IASI)
R. Hargreaves (LP_L2_ACE)
V.Sofieva (LP_L3_MRG)
M. Weber (LP)
M. Wolfmüller
TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01
REVIEWED BY
ISSUED BY
DOCUMENT CHANGE RECORD
Issue Revision Date Modified items Observations
00 01 20/06/2015 - Creation of document
00 0 25/09/2015 - Contributions inserted from C.Lerot, G.Miles, R. van der A, V.Sofieva, R.Astoreca, N.Rahpoe, M.Coldewey-Egbers and K.-P.Heue
00 05 07/10/2015 First version for internal review
01 00 14/10/2015 - First realised version with the inputs from the EOSTs
01 01 30/10/2015 Minor changes in chapters: 1.2.2, 5.3, 7.4, 8.4 regarding inputs from A.Laeng and N. Rahpoe
TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01
Executive Summary
The System Verification Report (SVR, deliverable D3.2) gives a complete report of all activities executed and the results achieved form a technical assessment of the end-to-end Ozone_cci system with all its subcomponents to verify that the Ozone_cci system is compliant to the requirements (PSD) and technical specifications (IODD, SSD) and that it fulfils its intended purpose and replicates the results of the selected algorithms selected.
The new products created in this context are Essential Climate Variables, which are used for an assessment of climate forcing, health impact and other environmental issues.
TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01
SVR – System Verification Report
This document describes the verification activities for the CCI O3 system phase 2.
TABLE OF CONTENTS
1 Introduction ................................................................................................................... 9 1.1 Scope and Applicability ............................................................................................... 9 1.2 Definitions, acronyms and abbreviations ..................................................................... 9
1.2.1 Terms and Definitions ....................................................................................................... 9 1.2.2 Abbreviations .................................................................................................................. 11
1.3 Applicable Documents .............................................................................................. 12 1.4 Reference Documents ............................................................................................... 12 1.5 Document Overview ................................................................................................. 12
2 General Approach for Ozone_cci System Verification .............................................. 13 2.1 General Verification Strategy .................................................................................... 13 2.2 Technical Verification Strategy .................................................................................. 14 2.3 Test Environment ...................................................................................................... 14 2.4 Naming Conventions ................................................................................................ 14 2.5 Responsibilities ......................................................................................................... 15
3 Overview about the Verification of the System ....................................................... 17 3.1 Objectives and Scope of the Ozone_cci System ......................................................... 17
3.1.1 Workflow, elements and components of the TC processing system ................................. 17 3.1.2 Workflow, elements and components of the NP processing system ................................. 18 3.1.3 Workflow, elements and components of the LP processing system .................................. 18
4 Test Assemblies ........................................................................................................... 21 4.1 Test Assemblies of the TC processing system............................................................. 21 4.2 Test Assemblies of the NP processing system............................................................. 22
5 Summary Description of Test Cases and Test Data ................................................... 25 5.1 Test Cases and Test Data for TC ................................................................................ 25 5.2 Test Cases and Test Data for NP ................................................................................ 26 5.3 Test Cases and Test Data for LP ................................................................................ 27
6 Test Results .................................................................................................................. 31 6.1 Overview about all Test Results TC ............................................................................ 31 6.2 Overview about all Test Results TTOC ....................................................................... 32 6.3 Overview about all Test Results NP ............................................................................ 32 6.4 Overview about all Test Results LP ............................................................................. 33
7 Description of acceptable and stated Limitations in the Ozone_cci System ........... 37 7.1 Limitations in the TC Processing System .................................................................... 37 7.2 Limitations in the TTOC Processing System ................................................................ 37 7.3 Limitations in the NP Processing System .................................................................... 37 7.4 Limitations in the LP Processing System ..................................................................... 37
TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01
8 Verification Summary ................................................................................................. 39 8.1 Verification Summary for TC ..................................................................................... 39 8.3 Verification Summary for NP ..................................................................................... 39 8.4 Verification Summary for LP ...................................................................................... 39
TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01
Figures
Figure 2-1 System Verification Approach ...................................................................................... 14 Figure 3-1 Workflows for the generation of the TC ECV products .............................................. 17 Figure 3-2 Workflows for the generation of the NP ECV products .............................................. 18 Figure 3-3 Workflows for the generation of the LP ECV products .............................................. 19 Figure 3-4 Workflows for the generation of the UTLS ECV products .......................................... 20 Figure 3-5 Workflows for the generation of the MLT ECV products ........................................... 20 Figure 8-1 Comparison Ozone profiles for SABER and HALOE .................................................... 40
TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01
Tables
Table 2-1 Test Responsibilities ........................................................................................................ 16 Table 4-1 Test Assemblies for Total and Tropospheric Column ................................................... 22 Table 4-2 Test Assemblies for Nadir Profile ................................................................................... 22 Table 4-3 Test Assemblies for Limb Profile .................................................................................... 24 Table 5-1 Test Data used by the Total Column Tests .................................................................... 25 Table 5-2 Summary Description of all Test Cases for Total Column ............................................ 26 Table 5-3 Summary Description of all Test Cases for TTOC .......................................................... 26 Table 5-4 Test Data used by the Nadir Profile Tests ..................................................................... 26 Table 5-5 Summary Description of all Test Cases for Nadir Profile .............................................. 27 Table 5-6 Test Data used by the Limb Profile Tests ...................................................................... 28 Table 5-7 Summary Description of all Test Cases for Limb Profile ............................................... 30 Table 6-1 Summary of all performed Test Cases for Total Column ............................................. 32 Table 6-2 Summary of all performed Test Cases for TTOC ........................................................... 32 Table 6-3 Summary of all performed Test Cases for Nadir Profile ............................................... 33 Table 6-4 Summary of all performed Test Cases for Limb Profile ................................................ 36
TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01
1 Introduction
1.1 Scope and Applicability
This document defines the overall activities to be performed for the integration and technical verification of the Ozone_cci system for CCI phase 2. It defines various strategies and test preparations which are required to conduct the integration and technical verification activities and gives a list of assemblies and test cases to be conducted by the subsystem team.
This system verification report contains the test plans and the test results of the processing systems and additional assemblies covering different levels of integration.
The described verification processes of the ozone_cci system shall verify the generation processes of the following ozone ECV parameters generated by the ozone_cci system:
Total Ozone from UV nadir instruments,
Tropical Tropospheric Ozone Column from UV nadir instruments,
Low vertical resolution ozone profiles from nadir sensors and
Stratospheric and upper tropospheric ozone profiles from limb and occultation types of sensors
The Ozone ECV products shall be generated using the following data sets:
The Ozone ECV products shall be generated using the following data sets:
Input data from GOME, SCIAMACHY, GOME-2A, GOME-2B, OMI and OMPS for total ozone ([CR1], in [AD1] chapter 1.2).
Input data from GOME, GOME-2A, and GOME-2B for tropical tropospheric ozone column ([CR1], in [AD1] chapter 1.2).
Input data from GOME, SCIAMACHY, GOME-2, OMI and IASI for Ozone nadir profiles ([CR1], in [AD1] chapter 1.2)
Input data from MIPAS, GOMOS, SCIAMACHY, OSIRIS, SMR, ACE, SAGE II and HALOE for the generation of ozone limb profiles ([CR1], in [AD1] chapter 1.2) and optionally TPM.
This document is applicable for the components of the TC, NP and LP processing systems. It describes the strategies used to verify the compatibility of the implemented components of these systems.
The integration of the Processors shall be done without the need of other subsystems except for the Processor-Subsystem itself.
1.2 Definitions, acronyms and abbreviations
Terms, definitions and abbreviations are collected within this document.
1.2.1 Terms and Definitions
Term Explanation of the term
Ozone_cci project for the development of the CCI ECV Ozone
TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01
Processor Software algorithm running in the Ozone_cci system to produce intermediate or ECV products according the Product Specification Document ([AD5])
TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01
1.2.2 Abbreviations
abbreviation Explanation of the abbreviation (tbc)
API Application Programming Interface
CCI Climate Change Initiative
CRG Climate Research Group
CMUG CCI Climate Modelling User Group
DARD Data Access Requirements Document
DCA Diurnal Correction Adjusted
ECMWF European Centre for Medium-Range Weather Forecasts
ECV Essential Climate Variable
EOST-1 EO Science Team for Total Column and Nadir Prodfile within the Ozone_cci project
EOST-2 EO Science Team for Limb Profile within the Ozone_cci project
ESA European Space Agency
EUMETSAT European Organisation for the Exploitation of Meteorological Satellites
GMES Global Monitoring for Environment and Security is the European Programme for the establishment of a European capacity for Earth Observation
HMI Human Machine Interface
KNMI Royal Netherlands Meteorological Institute
LP Limb Profile
NASA National Aeronautics and Space Administration
NP Nadir Profile
O3 Ozone
O3TC Ozone Total Column
TTOC Tropical Tropospheric Ozone Column
O3NP Ozone NadirProfile
O3LP Ozone Limb Profile
OMI Ozone Monitoring Instrument (aboard EOS-Aura)
OS Operating System
PSD Product Specification Document
SET System Engineering Team within the Ozone_cci project
UPAS Processor for Atmospheric Spectrometers
tbc to be collected
tbd to be defined (shall be defined later if the information is available)
TC Total Column
TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01
1.3 Applicable Documents
[AD1] Ozone_cci Phase-II Technical Baseline, ESA RFQ 3-13904/13/I-NB , 26/09/2013
[AD2] ESA Climate Change Initiative Phase 1: Scientific User Consultation and Detailed Specification, AO/1-6207/09/I-LG, 11/11/2009
[AD3] CCI System Requirements v1, CCI-PRGM-EOPS-TN-12-0031, 13 June 2013. Available on line at: http://46.137.76.174/?q=webfm_send/72.
[AD4] Ozone_cci System Specification Document (SSD Phase 2)
[AD5] Product Specification Document (PSD Phase 2)
[AD6] Data Access Requirement Document (DARD Phase 2)
1.4 Reference Documents
[RD1] CCI guidelines from the colocation meeting 1, Issue 1.0, EOP-DTEX-EOPS-SW-10-0002, 05/11/2010
[RD2] User Requirements Document (URD Phase 2)
1.5 Document Overview
Chapter 2 describes the verification approach for the system.
Chapter 3 gives a overview about the verification of the Ozone_cci sytsem and the tested system components and workflows.
Chapter 4 describes all test assembies used for the verification of the Total Column, Nadir, and Limb Profile system components.
Chapter 5 describes the test cases for the verification of the Total Column, Nadir, and Limb Profile system components.
Chapter 6 summarizes the verification results of the Total Column, Nadir, and Limb Profile system components.
Chapter 7 contains a summary of possible limitations of the Ozone_cci system.
TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01
2 General Approach for Ozone_cci System Verification
This chapter describes the approach taken on system and sytsem component level to integrate the ozone_cci system components and to verify them. The test assemblies and test cases are then listed and described in chapters 5 and 6.
2.1 General Verification Strategy
Figure 2-1 shows the general strategy for the verification of the whole Ozone_cci sytsem which is responsible to ensure the production of the Ozone_cci ECVs TC, NP and LP. The Ozone_cci system consists of the following specific processing systems:
Processing System BIRA
Processing System CHALM
Processing System DLR
Processing System FMI
Processing System KIT
Processing System KNMI
Processing System RAL
Processing System UBR
Processing System ULB
Processing System UofT
Processing System UofS
Each specific processing system consists of several components. Each component implements several functions and features which are needed to handle the complete production process of the ECVs. The components implement interfaces by which it is possible to exchange interface items (e.g. input products, auxiliary products).
The system components must be under version control and are tagged with configuration items. For the verification of the system suitable Test Assemblies are defined to test simple up to more and more integrated workflows. An Assembly is instanced by Assembly Versions. Each Assembly version holds the information about used versions of the involved system components.
The test coverage of an Assembly/Assembly Version is defined by the different Test Cases which are defined for an Assembly Version. The results of the test runs of an Assembly Version are documented in this document.
The verification that the system is conform to the System Requirements is reached if sufficient tests are performed successfully which cover all functions of the system.
The Test Assemblies are described in chapter 4 and the Test Cases are described with the help of tables (see chapter 5.
TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01
Figure 2-1 System Verification Approach
2.2 Technical Verification Strategy
The system is verified by the successful execution of all defined Test Cases of all defined Test Assemblies.
Regression tests are planned for the integration of the system components into the Ozone_cci system. These tests will include the whole chain of data driven.
Test runs shall be done on the basis of predefined Assembly Versions which document the following Information:
The used configuration items (versions of the used components, environment, test data etc)
Administrative test Information (Test Date, Test Persons)
One test report for the execution of the test cases of an Assembly Version reporting the test execution and the test results.
2.3 Test Environment
Each science team has its own test environment to install and test the specific processing systems.
2.4 Naming Conventions
The following naming conventions are defined for the Test Assemblies, Test Assembly Versions, Test Cases and Test Reports.
These naming conventions are not obligatory. If the teams use already other naming conventions they are free to use their own.
TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01
Test Assemblies: AS-<pp>-<aa> pp = TC or NP or LP, aa = 2 digits, e.g. AS-NP-01 Test Case: CS-<pp>->aa>-<tt> pp = TC or NP or LP, aa = the Assembly number, tt = 2 Digits for the Test Case number, e.g. TC-NP-01-01 (first Test Case of the first Nadir Profile Test Assembly)
2.5 Responsibilities
Each science team is responsible for testing its specific processing system as indicated in the table below.
Team Product Responsible institute
EOST-1 TC L2 BIRA
TC L3 DLR
TTOC_L3 DLR
NP L2 (GOME, SCIA, GOME2, OMI)
RAL
NP L2 (IASI) ULB
NP L3/L4 KNMI
EOST-2 LP L3 SCIA FMI
LP L3 GOMOS FMI
LP L3 MIPAS FMI
LP L3 OSIRIS FMI
LP L3 SMR FMI
LP L3 ACE FMI
LP L3 Merge FMI
LNTOC_L3 UBR
LP_L2_SCIA_HARMOZ UBR
LP_L2_SAGEII_HARMOZ UBR
LP_L2_HALOE_HARMOZ UBR
LP_L2_MLS _HARMOZ UBR
LP_L2_GOMOS_HARMOZ FMI
LP_L2_MIPAS_HARMOZ KIT
LP_L2_OSIRIS_HARMOZ UofS
LP_L2_SMR_HARMOZ CHALM
TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01
LP_L2_ACE_HARMOZ UofT
UTLS_L3 FMI
UTLS_L2_SCIA UBR
UTLS_L2_MIPAS KIT
UTLS_L2_GOMOS FMI
UTLS_L2_OSIRIS UofS
UTLS_L2_ACE UofT
MLT_L3 KIT
MLT_L2_MIPAS_DN_DCA* KIT/IAA
MLT_L2_GOMOS_DN_DCA* KIT/IAA
MLT_L2_ACE_DN_DCA* UofT
MLT_L2_SMR_DN_DCA* CHALM
MLT_L2_MIPAS_SM# KIT
Table 2-1 Test Responsibilities
TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01
3 Overview about the Verification of the System
The overview includes
a description of the objectives and scope of the Ozone_cci system
a list of all elements and components of the system that have been tested including a description of the platform, the network, and the interfaces with other systems
a description of all test activities carried out and of the criteria on how the system was tested to ensure that the requirements are fulfilled and that the system performs as specified
a summary description of all test cases, test procedures, and test data used
a record of all test results
a description of all acceptable and stated limitations in the ozone_cci system and the steps taken to workaround anomalous, inappropriate, or undesired operating conditions.
3.1 Objectives and Scope of the Ozone_cci System
3.1.1 Workflow, elements and components of the TC processing system
The Ozone_cci system can be seen as the collective of the processing systems distributed over several organisations. These processing systems are used for the generation of the ECV output products for TC, NP and LP products.
Figure 3-1 gives an overview about the main workflows implemented by the TC processing systems in order to generate all TC ECV output products.
Figure 3-1 Workflows for the generation of the TC ECV products
The following list contains all elements and components of the TC processing systems that have been tested. The TC processing system consists of the following components:
TC L2 Processor
TC L3 Processor
TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01
TC L3 Merge
TC&CL L2 Processor
TTOC L3 Processor
TTOC L3 Merge
3.1.2 Workflow, elements and components of the NP processing system
Figure 3-2 gives an overview about the main workflows implemented by the NP processing systems in order to generate all NP ECV output products.
Figure 3-2 Workflows for the generation of the NP ECV products
The following list contains all elements and components of the NP processing systems that have been tested. The NP processing system consists of the following components:
L2 Processor: ozone profile retrieval algorithm of RAL L2 Processor ozone profile retrieval algorithm of ULB L3 ECV Merge: merge and gridding algorithm of KNMI L4 ECV Merge: assimilation algorithm of KNMI
3.1.3 Workflow, elements and components of the LP processing system
Figure 3-3 gives an overview about the main workflows implemented by the LP processing systems in order to generate all LP ECV output products.
TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01
Figure 3-3 Workflows for the generation of the LP ECV products
The following list contains all elements and components of the LP processing systems that have been tested. The LP processing system consists of the following components:
The LP processing system consists of the following components:
LP L2 HARMOZ
LP L3 MZM: Monthly mean Zonal Mean
LP L3 MZM Merged: Merged Monthly mean Zonal Mean
LP L3 SMM: Merged Semi-monthly Mean
LP L3 SMM Merged: Merged Semi-monthly Mean
LP L3 FR: Fine Resolution
Figure 3-4 gives an overview about the main workflows implemented by the UTLS processing systems in order to generate all Limb ECV output products.
TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01
Figure 3-4 Workflows for the generation of the UTLS ECV products
The following list contains all elements and components of the UTLS processing systems that have been tested. The UTLS processing system consists of the following components:
UTLS L2
UTLS L3
UTLS L3 Merged
Figure 3-5 gives an overview about the main workflows implemented by the UTLS processing systems in order to generate all Limb ECV output products.
Figure 3-5 Workflows for the generation of the MLT ECV products
The following list contains all elements and components of the MLT processing systems that have been tested. The MLT processing system consists of the following components:
The MLT processing system consists of the following components:
MLT L2
MLT L3
MLT L3 Merged
TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01
4 Test Assemblies
The whole Ozone_cci system will be verified by the verification of the single processing systems. Each processing system has defined its own verification strategies, tests and verification reports. They are verified and tested according to these specific descriptions.
The following section lists and describes all Test Assemblies grouped per generated product.
4.1 Test Assemblies of the TC processing system
Table 4-1 gives an overview about all defined Test Assemblies used for the TC tests.
Test Assembly Test Assembly Description AS-TC-01 This Test Assembly is defined to verify the L2 processing of the TC
processing system. It consists of the following components: L1 Ingestion and soft correction L2 Processing of GOME data L2 Processing of SCIAMACHY data L2 Processing of GOME-2 data L2 Processing of OMI data L2 Processing of OMPS data L2 Archive and Dissemination
AS-TC-02 This Test Assembly is defined to verify the L3 processing of the TC processing system. It consists of the following components:
L2 Ingestion L3 Processing of GOME data L3 Processing of SCIAMACHY data L3 Processing of GOME-2 data L3 Processing of OMI data L3 Processing of OMPS data L3 Archive
AS-TC-03 This Test Assembly is defined to verify the L3 merging of the TC processing system. It consists of the following components:
L3 Ingestion L3 Merging of GOME, SCIAMACHY, GOME-2, OMI and OMPS
data L3 Archive and Dissemination
AS-TC-04 This Test Assembly is defined to verify the L2 processing of the TTOC processing system. It consists of the following components:
L1 Ingestion and soft correction L2 TT&CL Processing of GOME data L2 TT&CL Processing of GOME-2 data L2 Archive and Dissemination
AS-TC-05 This Test Assembly is defined to verify the L3 processing of the TTOC processing system. It consists of the following components:
TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01
L2 TC&CL Ingestion L3 TTOC Processing of GOME data L3 TTOC Processing of GOME-2 data L3 TTOC Archive
AS-TC-06 This Test Assembly is defined to verify the L3 merging of the TTOC processing system. It consists of the following components:
L3 TTOC Ingestion L3 TTOC Merging of GOME and GOME-2 data L3 TTOC Archive and Dissemination
Table 4-1 Test Assemblies for Total and Tropospheric Column
4.2 Test Assemblies of the NP processing system
Table 4-2 gives an overview about all defined Test Assemblies used for the NP tests.
Test Assembly Test Assembly Description AS-NP-01 This Test Assembly is defined to verify the L2 processing of the NP
processing system. It consists of the following components: L1 Ingestion L2 Processing of GOME data L2 Processing of GOME-2 data L2 processing of SCIAMACHY data L2 processing of OMI data L2 processing of IASI data L2 Archive and Distribution
AS-NP-02 This Test Assembly is defined to verify the L3 processing of the NP processing system. It consists of the following components:
L2 Ingestion Processing of L2 data to a merged L3 product L3 Archive and Dissemination
AS-NP-03 This Test Assembly is defined to verify the L4 processing of the NP processing system. It consists of the following components:
L2 Ingestion Processing of L2 data to a merged L4 product using data
assimilation L4 Archive and Dissemination
Table 4-2 Test Assemblies for Nadir Profile
Test Assemblies of the LP processing system
AS-LP-07 This Test Assembly is defined to verify the L3 UTLS processing of the LP processing system. It consists of the following components:
L2 HARMOZ Ingestion L3 UTLS processing L3 UTLS Archive and Dissemination
TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01
AS-LP-08 This Test Assembly is defined to verify the L3 UTLS Merge processing of the LP processing system. It consists of the following components:
L2 HARMOZ Ingestion L3 UTLS Merge processing L3 UTLS Archive and Dissemination
Table 4-3 gives an overview about all defined Test Assemblies used for the LP tests.
Test Assembly Test Assembly Description AS-LP-01 This Test Assembly is defined to verify the L2 processing of the LP
processing system and the UTLS L2 Processing. It consists of the following components:
L2 Ingestion L2 HARMOZ processing L2 Archive and Dissemination
AS-LP-02 This Test Assembly is defined to verify the L3 MZM processing of the LP processing system. It consists of the following components:
L2 HARMOZ Ingestion L3 MZM processing L3 MZM Archive and Dissemination
AS-LP-03 This Test Assembly is defined to verify the L3 MZM Merge processing of the LP processing system. It consists of the following components:
L3 MZM Ingestion L3 MZM Merge processing L3 MZM Merge Archive and Dissemination
AS-LP-04 This Test Assembly is defined to verify the L3 SMM processing of the LP processing system. It consists of the following components:
L2 HARMOZ Ingestion L3 SMM processing L3 SMM Archive and Dissemination
AS-LP-05 This Test Assembly is defined to verify the L3 SMM Merge processing of the LP processing system. It consists of the following components:
L3 SMM Ingestion L3 SMM Merge processing L3 SMM Archive and Dissemination
AS-LP-06 This Test Assembly is defined to verify the L3 FR processing of the LP processing system. It consists of the following components:
L2 HARMOZ Ingestion L3 FR processing L3 FR Archive and Dissemination
AS-LP-07 This Test Assembly is defined to verify the L3 UTLS processing of the LP processing system. It consists of the following components:
L2 HARMOZ Ingestion L3 UTLS processing L3 UTLS Archive and Dissemination
TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01
AS-LP-08 This Test Assembly is defined to verify the L3 UTLS Merge processing of the LP processing system. It consists of the following components:
L2 HARMOZ Ingestion L3 UTLS Merge processing L3 UTLS Archive and Dissemination
Table 4-3 Test Assemblies for Limb Profile
TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01
5 Summary Description of Test Cases and Test Data
5.1 Test Cases and Test Data for TC
Table 5-1 gives an overview about all used test data for the TC tests.
Test Data Test Data Description GOME L1 Orbit for January/1999, version 4_00
One month of GOME L1 data from orbit 19338 to 19781
SCIAMACHY L1 Orbit for January/2006, version 7_04
One month of SCIAMACHY L1 data from orbit 20068 to 20511
GOME-2 L1 Orbit for January/2009, version R/5_12
One month of GOME-2 L1 data from orbit 11428 to 11867
OMI L1 One month of OMI L1 data from orbit 13962 to 14406 OMPS L1 Not yet achieved Auxiliary Data FRESCOv6 and O2-O2 cloud parameters
Table 5-1 Test Data used by the Total Column Tests
Table 5-2 gives an overview about all tests performed. Column one identifies the Test Case performed, column two gives a short description of the test case and column 3 is a reference to the input data used in the test case.
Test Case Summary Test Case Description Input Test Data CS-TC-01-01: TC L2 GOME Processing
Test the L2 processing of one month of GOME data
GOME L1 described in Table 5-1
CS-TC-01-02: TC L2 SCIAMACHY Processing
Test the L2 processing of one month of SCIAMACHY data
SCIAMACHY L1 described in Table 5-1
CS-TC-01-03: TC L2 GOME-2 Processing
Test the L2 processing of one month of GOME-2 data
GOME-2 L1 described in Table 5-1
CS-TC-01-04: TC L2 OMI Processing
Test the L2 processing of one month of OMI data
OMI L1 described in Table 5-1
CS-TC-01-05: TC L2 OMPS Processing
Test the L2 processing of one month of OMPS data (not yet achieved)
OMPS L1 described in Table 5-1
CS-TC-02-01: TC L3 GOME Processing
Test the L3 processing of one month of GOME data
GOME L2 data generated in CS-TC-01-01
CS-TC-02-02: TC L3 SCIAMACHY Processing
Test the L3 processing of one month of SCIAMACHY data
SCIAMACHY L2 data generated in CS-TC-01-02
CS-TC-02-03: TC L3 GOME-2 Processing
Test the L3 processing of one month of GOME-2 data
GOME-2 L2 data generated in CS-TC-01-03
CS-TC-02-04: TC L3 OMI Processing
Test the L3 processing of one month of OMI data
OMI L2 data generated in CS-TC-01-04
CS-TC-02-05: TC L3 Test the L3 processing of one month of OMPS OMPS L2 data generated
TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01
OMPS Processing data in CS-TC-01-05 CS-TC-03-01: TC L3 Merging
Test the L3 merging of one month of GOME, SCIAMACHY, GOME-2, OMI and OMPS data
TC L3 data generated in CS-TC-02-01, CS-TC-02-02, CS-TC-02-03, CS-TC-02-04 and CS-TC-02-05
Table 5-2 Summary Description of all Test Cases for Total Column
Table 5-3 gives an overview about all tests performed. Column one identifies the Test Case performed, column two gives a short description of the test case and column 3 is a reference to the input data used in the test case.
Test Case Summary Test Case Description Input Test Data CS-TC-05-01: TTOC L3 GOME Processing
Test the L3 TTOC processing of one month of GOME data
GOME L2 TC&CL data generated in CS-TC-04-01
CS-TC-05-02: TTOC L3 GOME-2 Processing
Test the L3 TTOC processing of one month of GOME-2 data
GOME-2 L2 TC&CL data generated in CS-TC-04-02
CS-TC-06-01: TTOC L3 Merging
Test the L3 TTOC merging of one month of GOME, GOME-2 data
TTOC L3 data generated in CS-TC-05-01 and CS-TC-05-02
Table 5-3 Summary Description of all Test Cases for TTOC
5.2 Test Cases and Test Data for NP
Table 5-4 gives an overview about all used test data for the NP tests.
Test Data Test Data Description GOME L1 Orbit for June/1997, version GDP V4
One month of GOME L1 data from orbit 19970601T004807 to 19970630T232006
GOME-2 L1 Orbit for June/2008, version 4.0
One month of MetOp-A GOME-2 L1 data from orbit 20080601010857 to 20080630230257
SCIA L1 tbd OMI L1 tbd IASI L1 One month of IASI Metop-A L1 data from bufr 20080401 to 20080430 Auxiliary Data ECMWF re-analysis meteorological data
Table 5-4 Test Data used by the Nadir Profile Tests
Table 5-5 gives an overview about all tests performed. Column one identifies the Test Case performed, column two gives a short description of the test case and column 3 is a reference to the input data used in the test case.
Test Case Summary Test Case Description Test Data CS-NP-01-01: NP L2 Processing
Test the L2 processing of one month of GOME data
GOME L1 data described in Table 5-4
CS-NP-01-02: NP L2 Processing
Test the L2 processing of one month of GOME-2 data
GOME-2 L1 data described in Table 5-4
CS-NP-01-03: NP L2 Test the L2 processing of one month of SCIA SCIA L1 data data
TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01
Processing data described in Table 5-4 CS-NP-01-04: NP L2 Processing
Test the L2 processing of one month of OMI data
OMI L1 data data described in Table 5-4
CS-NP-01-05: NP L2 Processing
Test the L2 processing of one month of IASI data
IASI L1 data data described in Table 5-4
CS-NP-02-01 NP L3 processing of GOME1
Test the L3 processing of one month of GOME data
GOME L2 data data described in CS-NP-01-01
CS-NP-02-02 NP L3 processing of GOME2
Test the L3 processing of one month of GOME-2 data
GOME-2 L2 data data described in CS-NP-01-02
CS-NP-02-03 NP L3 processing of SCIA
Test the L3 processing of one month of SCIA data
SCIA L2 data data described in CS-NP-01-03
CS-NP-02-04 NP L3 processing of OMI
Test the L3 processing of one month of OMI data
OMI L2 data data described in CS-NP-01-04
CS-NP-02-05 NP L3 processing of IASI
Test the L3 processing of one month of IASI data
IASI L2 data data described in CS-NP-01-05
CS-NP-03-01 NP L4 processing of GOEM1
Test the L4 processing of one month of GOME data
GOME L2 data data described in CS-NP-01-01
CS-NP-03-02 NP L4 processing of GOME2
Test the L4 processing of one month of GOME-2 data
GOME-2 L2 data data described in CS-NP-01-02
CS-NP-03-03 NP L4 processing of SCIA
Test the L4 processing of one month of SCIA data
SCIA L2 data data described in CS-NP-01-03
CS-NP-03-04 NP L4 processing of OMI
Test the L4 processing of one month of OMI data
OMI L2 data data described in CS-NP-01-04
CS-NP-03-05 NP L4 processing of IASI
Test the L4 processing of one month of IASI data
IASI L2 data data described in CS-NP-01-05
Table 5-5 Summary Description of all Test Cases for Nadir Profile
5.3 Test Cases and Test Data for LP
Table 5-6 gives an overview about all used test data for the LP tests.
Test Data Test Data Description SCIAMACHY L2 Orbit for Jan/2008, version 7.04
One month of SCIAMACHY L2_HARMOZ data from orbit 30717 to 30730
GOMOS L2 Orbit for Jan/2008, version
One month of GOMOS L2_HARMOZ data
MIPAS L2 Orbit for Jan/2008 , version 220
One month of MIPAS L2_HARMOZ data from orbit 30516 to 30960
ACE L2 Orbit for Jan/2008 , version 220
One month of ACE L2_HARMOZ data from orbit 23612 to 24068
SMR L2 Orbit for Jan/2008 , version 6.0
One month of SMR L2_HARMOZ data from orbit 0x9201 to 093C5
OSIRIS L2 Orbit for One month of OSIRIS L2_HARMOZ data from scan 37376020 to
TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01
Jan/2008 , version 37838034
SAGE II L2 One month of SAGE II L2 data from January 2000 HALOE L2 One month of HALOE L2 data from January 2006 SABER L2 One month of SABER L2 data from January 2002 MLS L2 One month of MLS L2 data from January 2000 Auxiliary Data ECMWF pressure and temperature profiles are included in the HARMOZ
files. MIPAS retrieves ITS own pressure and temperature profiles.
Table 5-6 Test Data used by the Limb Profile Tests
Table 5-7 gives an overview about all tests performed. Column one identifies the Test Case performed, column two gives a short description of the test case and column 3 is a reference to the input data used in the test case.
Test Case Summary Test Case Description Test Data CS-LP-01-01: LP L2 SCIAMACHY Processing
Test the L2 processing of one month (January 2008) of SCIAMACHY data
SCIAMACHY L2 described in Table 5-6
CS-LP-01-02: LP L2 GOMOS Processing
Test the L2 processing of one month of GOMOS data
GOMOS L2 described in Table 5-6
CS-LP-01-03: LP L2 ACE-FTS Processing
Test the L2 processing of one month of ACE-FTS data
ACE-FTS L2 described in Table 5-6
CS-LP-01-04: LP L2 MIPAS Processing
Test the L2 processing of one month of MIPAS data
MIPAS L2 described in Table 5-6
CS-LP-01-05: LP L2 OSIRIS Processing
Test the L2 processing of one month of OSIRIS data
OSIRIS L2 described in Table 5-6
CS-LP-01-06: LP L2 SMR Processing
Test the L2 processing of one month of SMR data
SMR L2 described in Table 5-6
CS-LP-01-07: LP L2 SAGEII Processing
January 2000 test L2 harmoz processing
SAGEII L2 described in Table 5-6
CS-LP-01-08: LP L2 HALOE Processing
January 2006 test L2 harmoz processing
HALOE L2 described in Table 5-6
CS-LP-01-09: LP L2 MLS Processing
January 2000 test L2 harmoz processing
MLS L2 described in Table 5-6
CS-LP-01-10: LP L2 SABER Processing
January 2002 test L2 harmoz processing SABER L2 described in Table 5-6
CS-LP-02-01: LP L3 MZM SCIAMACHY Processing
Test the L3 MZM processing of one month of SCIAMACHY data
SCIAMACHY L2 data generated in CS-LP-01-01
CS-LP-02-02: LP L3 MZM GOMOS Processing
Test the L3 MZM processing of one month of GOMOS data
GOMOS L2 data generated in CS-LP-01-02
CS-LP-02-03: LP L3 MZM ACE-FTS Processing
Test the L3 MZM processing of one month of ACE-FTS data
ACE-FTS L2 data generated in CS-LP-01-03
CS-LP-02-04: LP L3 MZM MIPAS Processing
Test the L3 MZM processing of one month of MIPAS data
MIPAS L2 data generated in CS-LP-01-
TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01
04 CS-LP-02-05: LP L3 MZM OSIRIS Processing
Test the L3 MZM processing of one month of OSIRIS data
OSIRIS L2 data generated in CS-LP-01-05
CS-LP-02-06: LP L3 MZM SMR Processing
Test the L3 MZM processing of one month of SMR data
SMR L2 data generated in CS-LP-01-06
CS-LP-02-07: LP L3 MZM SAGEII Processing
Test the L3 MZM processing of one month of SAGEII data
SAGEII L2 data generated in CS-LP-01-07
CS-LP-02-08: LP L3 MZM HALOE Processing
Test the L3 MZM processing of one month of HALOE data
HALOE L2 data generated in CS-LP-01-08
CS-LP-02-09: LP L3 MZM MLS Processing
Test the L3 MZM processing of one month of MLS data
MLS L2 data generated in CS-LP-01-09
CS-LP-02-10: LP L3 LNTOC SCIAMACHY Processing
Test the L2 processing of one month (January 2008) of LMN Ozone profiles for SCIA SCIA
SCIAMACHY L2 described in Table 5-6
CS-LP-03-01: LP L3 Merge MZM Processing
Test the L3 MZM Merge processing of one month of L3 MZM data
L3 data generated in CS-LP-02-01 - CS-LP-02-09
CS-LP-04-01: LP L3 SMM SCIAMACHY Processing
Test the L3 SMM processing of one month of SCIAMACHY data
SCIAMACHY L2 data generated in CS-LP-01-01
CS-LP-04-02: LP L3 SMM GOMOS Processing
Test the L3 SMM processing of one month of GOMOS data
GOMOS L2 data generated in CS-LP-01-02
CS-LP-04-03: LP L3 SMM ACE-FTS Processing
Test the L3 SMM processing of one month of ACE-FTS data
ACE-FTS L2 data generated in CS-LP-01-03
CS-LP-04-04: LP L3 SMM MIPAS Processing
Test the L3 SMM processing of one month of MIPAS data
MIPAS L2 data generated in CS-LP-01-04
CS-LP-04-05: LP L3 SMM OSIRIS Processing
Test the L3 SMM processing of one month of OSIRIS data
OSIRIS L2 data generated in CS-LP-01-05
CS-LP-04-06: LP L3 SMM SMR Processing
Test the L3 SMM processing of one month of SMR data
SMR L2 data generated in CS-LP-01-06
CS-LP-04-07: LP L3 SMM SAGEII Processing
Test the L3 SMM processing of one month of SAGEII data
SAGEII L2 data generated in CS-LP-01-07
CS-LP-04-08: LP L3 SMM HALOE Processing
Test the L3 SMM processing of one month of HALOE data
HALOE L2 data generated in CS-LP-01-08
TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01
CS-LP-04-09: LP L3 SMM MLS Processing
Test the L3 SMM processing of one month of MLS data
MLS L2 data generated in CS-LP-01-09
CS-LP-05-02: LP L3 Merge SMM Processing
Test the L3 SMM Merge processing of one month of L3 SMM data
L3 data generated in CS-LP-04-01 - CS-LP-04-09
CS-LP-06-01: LP L3 FR SCIAMACHY Processing
Test the L3 FR processing of one month of SCIAMACHY data
SCIAMACHY L2 data generated in CS-LP-01-01
CS-LP-06-02: LP L3 FR GOMOS Processing
Test the L3 FR processing of one month of GOMOS data
GOMOS L2 data generated in CS-LP-01-02
CS-LP-06-03: LP L3 FR ACE-FTS Processing
Test the L3 FR processing of one month of ACE-FTS data
ACE-FTS L2 data generated in CS-LP-01-03
CS-LP-06-04: LP L3 FR MIPAS Processing
Test the L3 FR processing of one month of MIPAS data
MIPAS L2 data generated in CS-LP-01-04
CS-LP-06-05: LP L3 FR OSIRIS Processing
Test the L3 FR processing of one month of OSIRIS data
OSIRIS L2 data generated in CS-LP-01-05
CS-LP-07-01: LP L3 UTLS SCIAMACHY Processing
Test the L3 UTLS processing of one month (January 2008) of SCIAMACHY data
SCIAMACHY L2 described in Table 5-6
CS-LP-07-02: LP L3 UTLS GOMOS Processing
Test the L3 UTLS processing of one month of GOMOS data
GOMOS L2 described in Table 5-6
CS-LP-07-03: LP L3 UTLS ACE-FTS Processing
Test the L3 UTLS processing of one month of ACE-FTS data
ACE-FTS L2 described in Table 5-6
CS-LP-07-04: LP L3 UTLS MIPAS Processing
Test the L3 UTLS processing of one month of MIPAS data
MIPAS L2 described in Table 5-6
CS-LP-07-05: LP L3 UTLS OSIRIS Processing
Test the L3 UTLS processing of one month of OSIRIS data
OSIRIS L2 described in Table 5-6
CS-LP-08-01: LP UTLS L3 Merge Processing
Test the UTLS L3 Merge processing of one month of L3 UTLS data
L3 UTLS data generated in CS-LP-07-01 - CS-LP-07-05
Table 5-7 Summary Description of all Test Cases for Limb Profile
TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01
6 Test Results
The following summaries give an overview about all tests performed and its main results. The gray rows are the test results from the tests in phase 1 which are still valid within this context.
6.1 Overview about all Test Results TC
Table 6-1 gives an overview about all tests performed. Column one identifies the Test Case performed, column two the test environment and column three the summary of the test result.
Test Case Test Environment Summary Test Result CS-TC-01-01: TC L2 GOME Processing
Processor GODFIT (v3) running in a Linux cluster with 1 core @ 2.3 GHz.
Pass Processing time for 412 orbits: 0 day, 18 hours.
CS-TC-01-02: TC L2 SCIAMACHY Processing
Processor GODFIT (v3) running in a Linux cluster with 1 core @ 2.3 GHz.
Pass Processing time for 410 orbits: 2 days, 10 hours.
CS-TC-01-03: TC L2 GOME-2 Processing
Processor GODFIT (v3) running in a Linux cluster with 1 core @ 2.3 GHz.
Pass Processing time for 423 orbits: 7 days, 22 hours.
CS-TC-01-04: TC L2 OMI Processing
Processor GODFIT (v3 - look-up table version) running in a Linux cluster of 32 cores @ 2.66 Ghz.
Pass Processing time for 445 orbits: 1 day, 9 hours.
CS-TC-01-05: TC L2 OMPS Processing
Not yet achieved NA
CS-TC-02-01: TC L3 GOME Processing
Processor UCAS (v2) running in a Linux workstation with 1 core @ 2.4 GHz
Pass Processing time for one month data: 3 hours, 40 minutes
CS-TC-02-02: TC L3 SCIAMACHY Processing
Processor UCAS (v2) running in a Linux workstation with 1 core @ 2.4 GHz
Pass Processing time for one month data: 2 hours, 25 minutes
CS-TC-02-03: TC L3 GOME-2 Processing
Processor UCAS (v2) running in a Linux workstation with 1 core @ 2.4 GHz
Pass Processing time for one month data: 6 hours, 30 minutes
CS-TC-02-04: TC L3 OMI Processing
Processor UCAS (v2) running in a Linux workstation with 1 core @ 2.4 GHz
Pass Processing time for one month data: 32 hours
CS-TC-02-05: TC L3 OMPS Processing
Not yet achieved NA
CS-TC-03-01: TC L3 Merging
Not yet achieved NA
TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01
Table 6-1 Summary of all performed Test Cases for Total Column
6.2 Overview about all Test Results TTOC
Table 6-2 gives an overview about all tests performed. Column one identifies the Test Case performed, column two the test environment and column three the summary of the test result.
Test Case Test Environment Summary Test Result CS-TC-05-01: TTOC L3 GOME Processing
Processor CCD-trop (v1) running in a Linux cluster with 1 core @ 2.9 GHz.
Pass Processing time for 1 Month of L2 data: 2 Minutes
CS-TC-05-02: TTOC L3 GOME-2 Processing
Processor CCD-trop (v1) running in a Linux cluster with 1 core @ 2.9 GHz.
Pass Processing time for 1 Month of L2 data: 7 Minutes
CS-TC-06-01: TTOC L3 Merging
not yet achieved NA-
Table 6-2 Summary of all performed Test Cases for TTOC
6.3 Overview about all Test Results NP
Table 6-3 gives an overview about all tests performed. Column one identifies the Test Case performed, column two the test environment and column three the summary of the test result.
Test Case Test Environment Summary Test Result CS-NP-01-01: NP L2 Processing of GOME
Processor RAL O3P (2.1) running in a Linux cluster with 140 cores @ 2.4 GHz (Opteron 6238), SPEC2006: 30/45/400/330.
Pass. Processing time for 420 orbits: 0 days, 10 hours.
CS-NP-01-02: NP L2 Processing of GOME2
Processor RAL O3P (2.1) running in a Linux cluster with 140 cores @ 2.4 GHz (Opteron 6238), SPEC2006: 30/45/400/330.
Pass Processing time for 420 orbits: 1days, 12 hours. Summary
CS-NP-01-03: NP L2 Processing of SCIA
not yet achieved NA
CS-NP-01-04: NP L2 Processing of OMI
not yet achieved NA
CS-NP-01-05: NP L2 Processing of IASI
Processor FORLI-O3 v20140922 running in a Linux cluster with 280 cores @2.4 Ghz
Pass Processing time for 14400 BUFR: 10 days
CS-NP-02-01 NP L3 processing of GOME
Processor NADC running on a cluster of blades
Pass Processing time for 12 months of data: 30 minutes
CS-NP-02-02 NP L3 Processor NADC running on a Pass
TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01
processing of GOME-2 cluster of blades Processing time for 12 months of data: 30 minutes
CS-NP-02-03: NP L3 Processing of SCIA
not yet achieved NA
CS-NP-02-04: NP L3 Processing of OMI
not yet achieved NA
CS-NP-02-05: NP L3 Processing of IASI
not yet achieved NA
CS-NP-03-01 NP L4 processing of GOME
Processor NADC running on a single blade
Pass Processing time for 12 months of data: 50 hours
CS-NP-03-02 NP L4 processing of GOME-2
Processor NADC running on a single blade
Pass Processing time for 12 months of data: 50 hours
CS-NP-03-03: NP L4 Processing of SCIA
not yet achieved NA
CS-NP-03-04: NP L4 Processing of OMI
not yet achieved NA
CS-NP-03-05: NP L4 Processing of IASI
not yet achieved NA
Table 6-3 Summary of all performed Test Cases for Nadir Profile
6.4 Overview about all Test Results LP
Table 6-4 gives an overview about all tests performed. Column one identifies the Test Case performed, column two the test environment and column three the summary of the test result.
Test Case Test Environment Summary Test Result CS-LP-01-01: LP L2 SCIAMACHY Processing
HARMOZ_SCIA_UBR 2.9 Linux local PC with 1 core @ 3.16 GHz
Pass Processing time for 50000 orbits: 10 days 6 hours
CS-LP-01-02: LP L2 GOMOS Processing
GOMOS HARMOZ v1 Windows laptop and Linux desktop,
passed
CS-LP-01-03: LP L2 ACE-FTS Processing
not yet achieved NA
CS-LP-01-04: LP L2 MIPAS Processing
MIPAS IMK Original L2 V5R_O3_220 and V5H_O3_20; MIPAS HARMOZ v1 Solaris Cluster
passed
CS-LP-01-05: LP L2 OSIRIS Processing
2 Xeon E5420 2.5 GHz Pass 64000 orbits: 8 hours
CS-LP-01-06: LP L2 SMR not yet achieved NA
TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01
Processing CS-LP-01-07: LP L2 SAGEII Processing
harmoz_sage V7 Linux local PC with 1 core @ 3.16 GHz
Pass Processing time: 50 minutes
CS-LP-01-08: LP L2 HALOE Processing
harmoz_haloe V19 Linux 1 core @ 3.16 GHz
Pass Processing time 6 hours
CS-LP-01-09: LP L2 MLS Processing
harmoz_mls 3.3 Linux @ 2.7 GHz
Pass Procssing time: 45 days
CS-LP-01-10: LP L2 SABER Processing
harmoz_saber V 1.07 Linux @ 2.7 GHz
Pass Procssing time:28 hours
CS-LP-02-01: LP L3 MZM SCIAMACHY Processing
LP-MZM-HARMOZ V1 Windows laptop and Linux desktop
pass
CS-LP-02-02: LP L3 MZM GOMOS Processing
LP-MZM-HARMOZ V1 Windows laptop and Linux desktop
pass
CS-LP-02-03: LP L3 MZM ACE-FTS Processing
LP-MZM-HARMOZ V1 Windows laptop and Linux desktop
pass
CS-LP-02-04: LP L3 MZM MIPAS Processing
LP-MZM-HARMOZ V1 Windows laptop and Linux desktop
pass
CS-LP-02-05: LP L3 MZM OSIRIS Processing
LP-MZM-HARMOZ V1 Windows laptop and Linux desktop
pass
CS-LP-02-06: LP L3 MZM SMR Processing
LP-MZM-HARMOZ V1 Windows laptop and Linux desktop
pass
CS-LP-02-07: LP L3 MZM SAGEII Processing
LP-MZM-HARMOZ V1 Windows laptop and Linux desktop
verification open
CS-LP-02-08: LP L3 MZM HALOE Processing
LP-MZM-HARMOZ V1
verification open
TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01
Windows laptop and Linux desktop
CS-LP-02-09: LP L3 MZM MLS Processing
LP-MZM-HARMOZ V1 Windows laptop and Linux desktop
verification open
CS-LP-02-10: LP L3 LNTOC SCIA Processing
Code 4 LNTOC V 2.9 SCIA SCIA Linux 2.7 GHz
Pass 7.5 days
CS-LP-03-01: LP L3 Merge MZM Processing
LP-MZMM V1 Windows laptop and Linux desktop
pass
CS-LP-04-01: LP L3 SMM SCIAMACHY Processing
LP-L3SMM V1 Windows laptop and Linux desktop
pass
CS-LP-04-02: LP L3 SMM GOMOS Processing
LP-L3SMM V1 Windows laptop and Linux desktop
pass
CS-LP-04-03: LP L3 SMM ACE-FTS Processing
LP-L3SMM V1 Windows laptop and Linux desktop
pass
CS-LP-04-04: LP L3 SMM MIPAS Processing
LP-L3SMM V1 Windows laptop and Linux desktop
pass
CS-LP-04-05: LP L3 SMM OSIRIS Processing
LP-L3SMM V1 Windows laptop and Linux desktop
pass
CS-LP-04-06: LP L3 SMM SMR Processing
LP-L3SMM V1 Windows laptop and Linux desktop
Verification open
CS-LP-05-02: LP L3 Merge SMM Processing
LP-SMM V1 Windows laptop and Linux desktop
pass
TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01
CS-LP-06-01: LP L3 FR SCIAMACHY Processing
LP-FR V1 Windows laptop and Linux desktop
pass
CS-LP-06-02: LP L3 FR GOMOS Processing
LP-FR V1 Windows laptop and Linux desktop
pass
CS-LP-06-03: LP L3 FR ACE-FTS Processing
LP-FR V1 Windows laptop and Linux desktop
pass
CS-LP-06-04: LP L3 FR MIPAS Processing
LP-FR V1 Windows laptop and Linux desktop
pass
CS-LP-06-05: LP L3 FR OSIRIS Processing
LP-FR V1 Windows laptop and Linux desktop
pass
CS-LP-07-01: LP L3 UTLS SCIAMACHY Processing
results expected in SVR V2
CS-LP-07-02: LP L3 UTLS GOMOS Processing
results expected in SVR V2
CS-LP-07-03: LP L3 UTLS ACE-FTS Processing
results expected in SVR V2
CS-LP-07-04: LP L3 UTLS MIPAS Processing
results expected in SVR V2
CS-LP-07-05: LP L3 UTLS OSIRIS Processing
results expected in SVR V2
CS-LP-08-01: LP L3 UTLS Merge Processing
results expected in SVR V2
Table 6-4 Summary of all performed Test Cases for Limb Profile
TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01
7 Description of acceptable and stated Limitations in the Ozone_cci System
This chapter contains a description of all acceptable and stated limitations in the system and the steps taken to workaround anomalous, inappropriate, or undesired operating conditions.
7.1 Limitations in the TC Processing System
The following limitations were found in the TC processing:
1. The level-2 TC data sets rely on auxiliary cloud parameters provided by the FRESCO v6 and O2-O2 algorithms. In case of unavailability of these parameters, no total ozone retrieval is performed.
2. During two days per month, the OMI instrument switches in the so-called zoom mode, in which the spatial resolution is significantly improved with respect to the nominal mode, at cost of the spatial coverage. The level of accuracy of the total ozone columns retrieved from this specific mode with the look-up table version of GODFIT_3 is expected to be less good than for the nominal observations and are consequently not provided.
3. The TC_L3_MRG monthly mean product is not generated in case of too few data in high latitudes close to the polar night terminator
7.2 Limitations in the TTOC Processing System
The following limitations were found in the TTOC processing:
1. The level-3 TTOC retrieval depends on Cloud parameters and Total Ozone columns, if one is missing or incorrect the retrieval fails.
2. A strong dependency on the cloud product (cloud height) is observed, the dependency on the total column data is of similar magnitude.
7.3 Limitations in the NP Processing System
The following limitations were found in the NP processing:
1. Processing capability at the CEMS facility can be variable. We have between 300 and 2000 nodes available to use at any one time but is a shared facility and therefore processing time is dependent upon the level of community use
2. No limitations were found during the processing of IASI test data
7.4 Limitations in the LP Processing System
The following limitations were found in the LP processing:
Verification report for SCIAMACHY is presented in the Drift and Bias Analysis
Tests performed for all LP Systems:
TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01
1. For most of the products, the processing time is within couple of hours. Exceptions are dense samplers like MLS, SCIAMACHY and LNTOC from SCIA SCIA, which takes 45 days, 10 days and 7 days respectively. Especially for MLS there might be a risk of delivery delay on time for reprocessing.
Test has been successfully performed for the additional US sensors: SABER, HALOE, and SAGE II. The issues are summarized in 8.4.
TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01
8 Verification Summary
8.1 Verification Summary for TC
During the first phase of the project, processing tests have been successfully passed for the three instruments GOME, SCIAMACHY and GOME-2 and consisted in generating one month of L2 total ozone data for each of these instruments using the prototype code GODFIT v3 on a single core of a Linux machine. As the prototype code has not significantly changed since then, these tests remain valid and the results have been recalled in this document. For the processing of the OMI L1 data, a much faster look-up table version of the GODFIT algorithm has been developed. A similar verification test based on the production of one month of OMI data has been successfully carried out. The full reprocessing of the OMI sensor followed and the full OMI L2 total ozone data set has been made publicly available in Spring 2015. An interface still needs to be added to GODFIT in order to ingest OMPS L1 data. A similar verification test will be realized and reported in a future version of this document. For the L3 total ozone data from GOME, SCIAMACHY, and GOME-2 the tests carried out during the first phase of the project remain valid. A similar verification test has been carried out based on the production of one month of OMI L3 total ozone data. In the same way a verification test will be realized for the new TC_L3_MRG product.
8.2 Verification Summary for TTOC
Processing test has been performed for GOME and GOME-2 data. Both the operational DLR L2 data and the GODFIT v3 data were successfully used to generate one year of tropical tropospheric ozone data. The processing speed was independent of the input dataset. The SCIAMACHY and OMI data are not yet included in the processing. Here new interfaces are being developed and similar tests will be performed soon. After the processing of the OMI L2 GODFIT data a merged dataset is planned. The respective test results will be reported in an updated version of this report.
8.3 Verification Summary for NP
The processing of IASI test data did run without problems. Note that the time needed for this test processing concerns only one of the platforms (Metop-A). More processing time will be needed if the two platforms are considered.
8.4 Verification Summary for LP
No verification performed so far. Most of the processing of ozone limb profiles for the mentioned sensors SCIAMACHY, MLS, SAGE II; HALOE, and SABER perform within the limitation of the vertical grid resolution. Because of low vertical resolution of the CCI pressure grid the double ozone peak and maxima are missed. An example for HALOE and SABER is shown in Fig. 2. This means that tThe position of ozone peak can be shifted off to higher or lower altitudes or missing and interpolating and the missing the double ozone peaks due to interpolation. However this is accounted in the error budget.
TITLE: System Verification Report Issue: 01 - Revision: 01 - Status: Released Date of issue: 30-10-2015 Reference: Ozone_cci_DLR_SVR_01
Figure 8-1 Comparison Ozone profiles for SABER and HALOE
The comparison of the ozone profiles at the peak of ozone for SABER native (right) and HALOE (left) shown as black (dashed) lines and harmonized SABER CCI (red dashed) profiles.