110823 solta11 intro
TRANSCRIPT
What is the workshop theme?
Air Quality Data Network (ADN)
Data Network Pilot7 Active AQ WCS Servers
Data Catalog Prototype
What is the Air Quality Data Network? A non-intrusive standards-based network infrastructure consisting of
distributed servers, clients, catalogs and governance
Purpose of the Air Quality Data Network? To facilitate integration of Earth Observation and Models
and re-use in multiple Societal Benefit Areas
Earth Ob-servations
Emission
Model
Satellite
Monitorig Network
Societal Benefit
Informing the Public
Protecting Health
Global Policies
Atmosph. Science
Data Network Pilot7 Active AQ WCS Servers
Data Catalog Prototype
Any Single Problem Requires Many Datasets
Any Dataset Can Serve Many Communities
Earth Ob-servations
Emission
Model
Satellite
Monitorig Network
Data Pool
Societal Benefit
Informing the Public
Protecting Health
Global Policies
Atmosph. Science
What is the tangible contribution of the Network?
Earth Ob-servations
CIERA DataFedEBASMACCVIEWS....ACDISCAirBaseAIRNowAQSDLRGISCLANCERSIG++ others
AIRNowBlueSkyCIAMINSPIREPEGASOSSDS-WASVIEWS …Others
Emission
Model
Satellite
Monitorig Network
Data Pool
Societal Benefit
ABCAC&CAeroCOM AQASTAQMEII CCI-Aerosol PEGASOS TF-HTAP Others ...
ABC | AQ_CoP | B.GN | CHIST |CIERA | COST |CyAir DataONE | EANET | EGIDA | ESIP | EuroGEOSS | INSPIRE | MaleDecl | QA4EO
Decision Support
Informing the Public
Protecting Health
Global Policies
Atmosph. Science
Integrating Initiatives/Organizations…are the main clients and users of the AQ Network
Science Team
Data Portal
Faciliator
Who participates in the AQ Data Network?
Data Hubs
CIERA DataFedEBASMACCVIEWS....
ACDISCAirBaseAIRNowAQSDLRGISCLANCERSIG+++ others
AIRNowBlueSkyCIAMINSPIREPEGASOSSDS-WASVIEWS …Others
Earth Ob-servations
Emission
Model
Satellite
Monitorig Network
Data Pool
ABCAC&CAeroCOM AQASTAQMEII CCI-Aerosol PEGASOS TF-HTAP Others ...
ABC | AQ_CoP | B.GN | CHIST |CIERA | COST |CyAir DataONE | EANET | EGIDA | ESIP | EuroGEOSS | INSPIRE | MaleDecl | QA4EO
ScienceTeams
Decision Support
FaciltatorsSocietal Benefit
Informing the Public
Protecting Health
Global Policies
Atmosph. Science
Members of AQ CoP are from the the Motto: Other Integrating Initiatives AQ CoP Motto: Connecting and Enabling Other Integrating Initiatives
A self-organized, voluntary group promoting the use of Earth observations for air quality management and science
What is/Who are the Air Quality CoP?
Workshop Goals (Martin!)
•Get to know each other•Identify core AQ applications and sharable data sets•Exchange state-of-the-art, interoperability practices •Address technical and programmatic issues•Have fun
Preliminary Agenda•Wednesday, 25 Aug: State of AQ Interoperability
– Participant presentations– Integrating Initiatives, Agencies, ‘End Users’, their needs, roles – GEO AQ CoP role, relationships, contributions
•Thursday, 26 Aug: Technical Realization of Interoperability– Syntactic issues (Improved standards? WCS, WMS, CSW…; netcdf, other formats)– Semantic issues (Metadata for finding and understanding data? CF? )– Programmatic issues (Which data can be shared by whom? Data versions, etc.?)
•Friday, 27 Aug: Outcomes. Consensus? Next?– What few things must be the SAME, so that everything else can be DIFFERENT?– How can we collaborate? Interact with other Initiatives, Agencies, Users? – Do we have common long-term goals? Next steps?
GEOSS Goal:
Facilitate access and integration of a broad range of EOs to SBAs, including Air Quality
Data Portals
Data Aggregators for Easier Access
VIEWS - Visibility Information Exchange Web System
EPA RSIG - Remote Sensing Information Gateway
EPA AQS - Air Quality System
NASA GIOVANNI - Data & Information Services Center
EBAS - Norwegian Institute of Air Research
CEOS ACP: Atmospheric Composition Portal
CIERA: Comm. Initiative for Emissions Res. & Apps.
GMES MACC: Monitoring Atm. Composition and Climate
AQ Science TeamsScience Collectives and CollaborativesTF HTAP Task Force, Hemispheric Transport of Air PollutantsNASA AQAST - Quality Applied Science TeamESA CCI Aerosol: Climate Change Initiative for AerosolsGMES MACC: Monitoring Atmospheric Composition and ClimateEPA - Exceptional Air Pollution Event AnalysisAeroCom - Aerosol Model Inter-comparison Project
AQ Decision Support SystemsData Driven Analysis and
PrognosisVIEWS - Visibility Information Exchange Web SystemTF HTAP Task Force, Hemispheric Transport of Air PollutantsGMES MACC: Monitoring Atmospheric Composition and ClimateEPA - Exceptional Air Pollution Event AnalysisDataFed - Federated Data Systems for Air Quality Data
The era of a single data provider, the individual scientist or the lone decision supporter is over.There is a new pattern emerging in the maturing information ecosystem
Data Portals aggregators of many data streams
This is a good thin for the Earth System & GEOSS since it does not have to support individuals but can fucus on fewer groupings Implicit structure Cascading multi-stage process al la the economy-of-scale
Spectrum of User Communities
From Observations to Decisions
Measuring& Modeling
Earth Obs. & Modeler
InfoProc. & Distributi
Data Portals
EO Service Provider
SciKnow Creation
Science Teams
Discipline Scientist
Decision Support
Dec. Sup. Systems
EnvHealth Model, Res
Decision Making
EnvPolicy & Manager
Assessing Benefit
Public & Officials
Spectrum of Activities and Approach
Felicitators of CollaborationGEOSS AIP Architecture Implementation Pilot | OGC NetworkEPA Data SummitGO-ESSP: Global Org. for Earth System Science PortalsEU EGIDA - Coord. Cross-Disciplinary Projects to Promote GEOSSEPA CyAir: Cyberinfratructure for Air Quality ManagmentCIERA: Community Initiative for Emissions Research and ApplicationsGEO AQ CoP: GEO Air Quality Community of PracticeCOST ES0602: EU Network on Chemical Weather Forecasting..AeroCom - Aerosol Model Inter-comparison ProjectESIP Earth Science Information Partners, AQ Work Group
Data PortalsVIEWS - Visibility Information Exchange Web System
EPA RSIG - Remote Sensing Information Gateway
EPA AQS - Air Quality System
NASA GIOVANNI - Data & Information Services Center
EBAS - Norwegian Institute of Air Research
CEOS ACP: Atmospheric Composition Portal
CIERA: Comm. Initiative for Emissions Res. & Apps.
GMES MACC: Monitoring Atm. Composition and Climate
AQ Science TeamsTF HTAP Task Force, Hemispheric Transport of Air PollutantsNASA AQAST - Quality Applied Science TeamESA CCI Aerosol: Climate Change Initiative for AerosolsGMES MACC: Monitoring Atmospheric Composition and ClimateEPA - Exceptional Air Pollution Event AnalysisAeroCom - Aerosol Model Inter-comparison Project
AQ Decision Support SystemsVIEWS - Visibility Information Exchange Web SystemTF HTAP Task Force, Hemispheric Transport of Air PollutantsGMES MACC: Monitoring Atmospheric Composition and ClimateEPA - Exceptional Air Pollution Event AnalysisDataFed - Federated Data Systems for Air Quality Data
Value Adding Groups
Felicitators, ConnectorsGEOSS AIP Architecture Implementation Pilot | OGC NetworkEPA Data SummitGO-ESSP: Global Org. for Earth System Science PortalsEU EGIDA - Coord. Cross-Disciplinary Projects to Promote GEOSSEPA CyAir: Cyberinfratructure for Air Quality ManagmentCIERA: Community Initiative for Emissions Research and ApplicationsGEO AQ CoP: GEO Air Quality Community of PracticeCOST ES0602: EU Network on Chemical Weather Forecasting..AeroCom - Aerosol Model Inter-comparison ProjectESIP Earth Science Information Partners, AQ Work Group
GEO Air Quality Community of Practice
Main Value Adding Activity:Interoperable Network
• The GEO AQ CoP is a self-organized voluntary group that fosters the use of Earth observations to air quality management and science by leveraging synergies of sharing and collaboration.
• Community activities include collaborative website; workshops; gathering user requirements; sharing tools and best practices as well as aiding other communities: data portals, science teams and decision support activities.
• A persistent output facilitated by the AQ CoP is a network of air quality/atmospheric composition data servers that use OGC-standard protocols and the GEOSS interoperability process.
• Searching, browsing and accessing data from monitoring networks, satellite sensors, emissions, as well as from AQ models is through a Community Catalog.
• The creation of an information system for Earth Sciences has been a grand challenge for decades
• It has been pursued by innumerable workshops, vision statements, pilot projects etc…
• There were many tries Progress has been slow …• “The road toward integrated Earth Science info systems
is littered with wrecks of well-intended attempts..”•
• We know that info systems like libraries and the internet provide useful services
• The info technologies and the engineering design of these systems is understood.
• However, the science, the explanations of how these info systems work is not in hand. . – What causes information to be generated, transmitted and
‘consumed’? – What are the driving forces to the flow of information? Provider
push, consumer pull? Impediments.. …Can you push a rope?– Are there suitable ‘laws of nature’, equivalent to conservation of
mass and energy?
Selected Server Topics
Interoperability StandardsServer for Grid & Point DataServer Maintenance-SupportServer Performance
Selected Network Topics
AQ Network CharacteristicsPublish, Find, AccessCatalog & Metadata IssuesADN Operation, Governance
Workshop Focus: Technical Realization of AQ Network.
What will be discussed?The state of ADN including key impediments; co-development of server software and tools; sharing best practices
“What few things must be the SAME, so that everything else can be DIFFERENT?”
The GEOSS goal:
To create more societal benefit from Earth Observations and Models and since effective value creation hinges on seamless data flow and re-use
The AQ CoP chose to focus is on facilitating the interoperable data systems, i.e. and quality data network.
Show Nework of seven servers
Somber note
MARKET
Spectrum of User Communities and their Activites
From Observations to Decisions
Measuring& Modeling
Earth Obs. & Modeler
InfoProc. & Distribution
EO Service Provider
SciKnow Creation
Discipline Scientist
Decision Support
EnvHealth Model, Res
Decision Making
EnvPolicy & Manager
Assessing Benefit
Public & Officials
Data PortalsVIEWS - Visibility Information Exchange Web System
EPA RSIG - Remote Sensing Information Gateway
EPA AQS - Air Quality System
NASA GIOVANNI - Data & Information Services Center
EBAS - Norwegian Institute of Air Research
CEOS ACP: Atmospheric Composition Portal
CIERA: Comm. Initiative for Emissions Res. & Apps.
GMES MACC: Monitoring Atm. Composition and Climate
AQ Decision Support Sys. VIEWS - Visibility Information Exchange Web SystemTF HTAP Task Force, Hemispheric Transport of Air PollutantsGMES MACC: Monitoring Atmospheric Composition and ClimateEPA - Exceptional Air Pollution Event AnalysisDataFed - Federated Data Systems for Air Quality Data
AQ Science TeamsTF HTAP Task Force, Hemispheric Transport of Air PollutantsNASA AQAST - Quality Applied Science TeamESA CCI Aerosol: Climate Change Initiative for AerosolsGMES MACC: Monitoring Atmospheric Composition and ClimateEPA - Exceptional Air Pollution Event AnalysisAeroCom - Aerosol Model Inter-comparison Project
The of GEOSS (and most other EO integrating initiatives) is create more societal benefit from Earth Observations and Models
Effective creation of societal benefit hinges on seamless data flow and re-use, so a universal value is the ability the share and re-use data.
Hence AQ CoP chose to focus on facilitating Air Quality Data Network.We also understand that the creation of an Earth Science information system has been a grand challenge for decades….…and that the “The road toward integrated Earth Science info systems is littered with wrecks of well-intended attempts..”
So, challenge is how to make more progress this time..
Spectrum of User Communities and their Activities
Measuring& Modeling
Earth Obs. & Modeler
InfoProc. & Distribution
EO Service Provider
SciKnow Creation
Discipline Scientist
Decision Support
EnvHealth Model, Res
Decision Making
EnvPolicy & Manager
Assessing Benefit
Public & Officials
Earth Ob-servations
Emission
Model
Satellite
Monitorig Network
Societal Benefit
Informing the Public
Protecting Health
Global Policies
Atmosph. Science
Networking Air Quality Observations and Models:From Virtual to Real
Agenda, August 23, 24, 25Tue. AM: Reports of Participants, Net.-Nodes PM: State of AQ Data Network, CatalogWed. AM: Technical Realization of AQ Network PM: Technical Realization of AQ NetworkThu. AM: Technical Realization of AQ Network PM: Outcomes, Next?
Aug 23-25, 2011, Stomorska, Šolta, Croatia
See Workshop Wiki for Details, Contacts: Rudolf Husar, [email protected]; Martin Schultz, [email protected]
Participants ~30 Participants
~20 Organizations
CNR, DHZ, DLR, EEA, EnvCanada, USEPA, FZ Juelich, GEO, JRC,
MetNO, NASA, NGC, NILU, NOAA, NPS, RSIG, STI, UNIDATA, WUStL
Practitioners from Europe and North America will assess the current state of the network, address key interoperability challenges, share best practices. and work on turning the network from virtual to real.
LogisticsWS Intro slides Workshop Schedule Intro of Individual
AQ Data Network Pilot7 Active AQ WCS Servers
7 Near-Term New WCS Nodes
AQ Data Network Catalog - Prototype
Selected Server TopicsSelection and use of Standards
WCS version 1.0, 1.1.2, 2.0?
Combining WMS, WFS, WCS?Server for Different Data Types
Grid data (model, emiss., sat.)Point-Station (surf. Netw.)Other data types?
Server Maintenance-SupportSourceForge, Docum. GuidsServer code governance
Server Performance Remote access or cacheStreaming vs file transfer
Selected Network Topics
AQ Network Design IssuesAutonomy-interop. balance
Network Catalog(s)AQ Community CatalogDomain/Application Catalog(s)
Network Metadata IssuesDiscovery metadata for AQProvenance, quality, security
Network Operation, MaintenanceGovernance,
Legitimacy
Workshop Focus: Technical Realization of AQ Network.
See Workshop Wiki for Details, Contacts: Rudolf Husar, [email protected]; Martin Schultz, [email protected]
AQ Data Network Status AQ Network Future?