1 the new emissions modeling framework system emissions modeling team marc houyoux, madeleine strum,...

16
1 The New Emissions Modeling Framework System Emissions Modeling Team Marc Houyoux, Madeleine Strum, Rich Mason, Norm Possiel David Misenheimer, Darryl Weatherhead, Larry Sorrels Bill Benjey, George Pouliot Contractor: UNC Institute for the Environment Alison Eyth, Qun He, Alexis Zubrow, Darin Del Vecchio, Dongmei Yang EMF EMF

Upload: aileen-bell

Post on 02-Jan-2016

213 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: 1 The New Emissions Modeling Framework System Emissions Modeling Team Marc Houyoux, Madeleine Strum, Rich Mason, Norm Possiel David Misenheimer, Darryl

1

The New

Emissions Modeling FrameworkSystem

Emissions Modeling TeamMarc Houyoux, Madeleine Strum, Rich Mason, Norm Possiel

David Misenheimer, Darryl Weatherhead, Larry Sorrels

Bill Benjey, George Pouliot

Contractor: UNC Institute for the EnvironmentAlison Eyth, Qun He, Alexis Zubrow, Darin Del Vecchio,

Dongmei Yang

EMFEMF

Page 2: 1 The New Emissions Modeling Framework System Emissions Modeling Team Marc Houyoux, Madeleine Strum, Rich Mason, Norm Possiel David Misenheimer, Darryl

2

Overview

Background

Development status and benefits

How EPA is using the EMF

EMF Future

EMF Demo

Page 3: 1 The New Emissions Modeling Framework System Emissions Modeling Team Marc Houyoux, Madeleine Strum, Rich Mason, Norm Possiel David Misenheimer, Darryl

3

EMF Motivation

Improve timeliness, quality, and transparency of emissions data used in air quality models

EmissionsInventory

EmissionsModeling

Air QualityModeling

Summariesand Analysis

Data handlingSMOKE processing

QA checksStandard procedures

DocumentationReproducibility

Page 4: 1 The New Emissions Modeling Framework System Emissions Modeling Team Marc Houyoux, Madeleine Strum, Rich Mason, Norm Possiel David Misenheimer, Darryl

4

EMF Goals

Make emissions modeling faster and more accessible Create and implement emissions modeling protocol Provide data/processing transparency & tracking

Data with versions, metadata, QA status Emissions modeling applications and associated data Data queries and summaries

Meet needs for multi-pollutant modeling Create tools that can be used by EPA and others

(e.g., RPOs, states)

Page 5: 1 The New Emissions Modeling Framework System Emissions Modeling Team Marc Houyoux, Madeleine Strum, Rich Mason, Norm Possiel David Misenheimer, Darryl

5

EMF capabilities

Data Manager Organizes/stores data Provides tracking of data changes using data versions Supports metadata “QA Manager” facilitates QA capabilities and tracking of

QA steps, summaries, and queries

Case Manager Organizes model steps, inputs, & parameters (e.g., SMOKE) Runs Emissions Modeling steps at NCC, records history and

registers outputs

Control Strategy Tool (CoST) Stores database of control “measures” (practices and

technologies) Supports user to create control strategies (multi-pollutant

functionality) Applies controls to emission inventories for use in SMOKE

All done in a multi-user environment SMOKE and other tools are run from EMF, but are not within

EMF

Page 6: 1 The New Emissions Modeling Framework System Emissions Modeling Team Marc Houyoux, Madeleine Strum, Rich Mason, Norm Possiel David Misenheimer, Darryl

6

EMF Development Statusand benefits

Page 7: 1 The New Emissions Modeling Framework System Emissions Modeling Team Marc Houyoux, Madeleine Strum, Rich Mason, Norm Possiel David Misenheimer, Darryl

7

Timeline

2005 2006 2007 2008

Oct ‘04Project start

Apr ’05 CoST team

decides to use EMF

May ‘06First

productiondata loaded

Sep ’05Final DesignDocument

Design

Data Manager

QA ManagerEmisView

Jan ‘06Surrogate

Tool & EMF Beta-

releaseinstalled at

EPA

Case Manager

Mar ’06Initial

SpeciationTool

Oct ‘06First Case

“Inputs”Setup

(2002v2)

Oct ’07Case Mgt

RunsSpeciation

Tool

Oct ‘072020cc EMFDemo nears completion

Production

Development

Sep ’07Updated

SpeciationTool

May ’07EMF

Training

Mar ’07Initial

EMF servermove to

NCC

Oct ’07Complete

EMFDatabaseat NCC

(2TB disk)

Maintenance

Page 8: 1 The New Emissions Modeling Framework System Emissions Modeling Team Marc Houyoux, Madeleine Strum, Rich Mason, Norm Possiel David Misenheimer, Darryl

8

Major milestones met so far

EMF-funded components all exist in working form Data Manager, including QA Manager Case Manager Control Strategy Tool (CoST) Spatial Surrogate Tool Speciation Tool

Server obtained, installed, and running at NCC OAQPS using EMF for supporting ongoing

projects EMF training module created and training held at

2007 EPA Emission Inventory conference

(Create challenging SMOKE inputs)

Page 9: 1 The New Emissions Modeling Framework System Emissions Modeling Team Marc Houyoux, Madeleine Strum, Rich Mason, Norm Possiel David Misenheimer, Darryl

9

How Data Manager helps EPA

Stores data in a PostgreSQL database accessible by all. All team members can find the latest data. Others’ data changes shared. Access by staff other than emissions modelers.

Supports multiple versions of datasets. We can access both old and current versions of data, for reproducibility and transparency.

Users can edit data in a user interface to the database. Convenient.

Automatically records metadata, such as who/when makes changes. Allows users to add what/why of changes and manual metadata entry. Eases our burden for keeping track of details other ways. Adds transparency after work is done.

Exports SMOKE-ready files, including documentation in file headers. Saves us time & prevents possible format errors.

We can better focus on analysis and modeling needs.

Page 10: 1 The New Emissions Modeling Framework System Emissions Modeling Team Marc Houyoux, Madeleine Strum, Rich Mason, Norm Possiel David Misenheimer, Darryl

10

How QA Manager helps EPA Stores QA steps, who/when steps performed, & QA status along

with the data. We can easily find QA status of data. We can see the overall QA status, what QA steps complete, who performed steps, and the results. Users can add steps as needed.

Tracks QA steps by dataset version. We know what steps were performed on each version. Helps prevent skipping QA.

Supports running SQL queries on the data to perform QA steps and summaries. Give us the flexibility and convenience of database queries. Runs within EMF and results stored for present and future use.

Templates of QA steps (queries) can be created and reused. Helps ensure QA of data gets done, decreases learning curve for new emissions modelers.

Tracks both automated (run by EMF) and external and/or manual QA steps. Gives us needed flexibility to get work done.

Page 11: 1 The New Emissions Modeling Framework System Emissions Modeling Team Marc Houyoux, Madeleine Strum, Rich Mason, Norm Possiel David Misenheimer, Darryl

11

How Case Manager helps EPA

Data in a “Case” (e.g., SMOKE run) linked to datasets in Data Manager. We have a single system to use for data handling and running SMOKE.

Exports all SMOKE-ready files needed for a SMOKE run with a few mouse clicks. Saves time and prevents possible errors associated with manually writing out many data files & formats from many other data sources.

User interface for SMOKE. Reduces learning curve for new emissions modelers. We have a permanent record of SMOKE inputs, settings, and location of outputs.

Submits SMOKE jobs, preprocessing, and postprocessing to a compute server (“amber”) or EMF server. Supports desktop access to data and SMOKE cases, while running at NCC compute cluster to meet computational needs.

Page 12: 1 The New Emissions Modeling Framework System Emissions Modeling Team Marc Houyoux, Madeleine Strum, Rich Mason, Norm Possiel David Misenheimer, Darryl

12

How EPA is using the EMF

Page 13: 1 The New Emissions Modeling Framework System Emissions Modeling Team Marc Houyoux, Madeleine Strum, Rich Mason, Norm Possiel David Misenheimer, Darryl

13

Uses to date Data Manager and Case “Inputs” functions used for:

2002-based CAP platform v3 (2002, 2009, 2014, 2020, 2030) 2002-based CAP/HAP platform v3 (2002) Ozone NAAQS Final Rule OTAQ’s Locomotive Marine Rule ORD 2005-based platform Detroit Multi-Pollutant Study

Actually run using EMF Case Manager: SMOKE 2020 base case to demonstrate we can replicate the

“old” way of running SMOKE Speciation Tool runs for ORD to create SOA-enabled

speciation profiles for SAPRC99 and CB05 A few sectors on the 2002”ae” (v4 platform), in development

Page 14: 1 The New Emissions Modeling Framework System Emissions Modeling Team Marc Houyoux, Madeleine Strum, Rich Mason, Norm Possiel David Misenheimer, Darryl

14

EMF in FY 2008

In-house efforts to setup EMF for operational use EMF work assignment

Support and maintenance Add “quick and easy” emissions sensitivity tool for AQMG

CoST Completion of O3 NAAQS RIA Mobile Control Strategies NOx/SOx NAAQS RIA Control Strategies

Manage SMOKE inputs: OTAQ’s Bond Rule and SECA / IMO modeling Detroit Multi-Pollutant Study

Upcoming runs of SMOKE with EMF: 2002ae (v4) platform New base runs for 2003, 2004, 2005, & 2006 for CDC/Phase,

CMAQ evaluation, and Accountability

Page 15: 1 The New Emissions Modeling Framework System Emissions Modeling Team Marc Houyoux, Madeleine Strum, Rich Mason, Norm Possiel David Misenheimer, Darryl

15

EMF future

Ongoing work to refine Data Manager, QA Manager with a more robust protocol, Case Manager, CoST

As part of OAQPS’s daily operations, EMF is assisting us manage emissions modeling for 8+ projects simultaneously with few staff and high quality

Possibility for adapting to meet data management and modeling needs of others in AQAD and EPA EMF could be “Environmental Modeling Framework” Readily adaptable to support other applications such as CMAQ

Page 16: 1 The New Emissions Modeling Framework System Emissions Modeling Team Marc Houyoux, Madeleine Strum, Rich Mason, Norm Possiel David Misenheimer, Darryl

16

EMF demo