Structured / Unstructured Market Trials

Kick-Off MeetingMay 31, 2013

Agenda

• Structured Market Trials Dates

• Release Scorecard

• Known Issues Log• Migration Report (when needed)

• *Note: As of 5/31/2013 the Migration Report is not yet available

• Reporting and Metrics

• Extended Connectivity Testing Update – Brett Crane

• TCR Market Trials Update – Brett Crane

3

Structured Market Trials Daily Calendar

4

June 3 – June 9 – Find the Market Trials Daily Calendar on spp.org:

spp.org > Integrated Marketplace > Market Trials > Structured/Unstructured Test > Integrated Marketplace Market Trials Project Documentation Folder

Calendar Reminders

5

• SPP Hotline: Critical and High Issues• Phone Number: 501-482-2222

• Monday – Friday, 8:00 am – 5:00 PM CPT

• Critical Issue: one or more systems, or a function within a system, are rendered inaccessible or stop functioning all together

• An example of a critical issue is: "An MP cannot update RTBM offers for the current Operating Day."

• High Issue: One or more key functions within a system are non-operational, or a severe error exists in its processing, and there is no workaround

• Call the hotline when “stuck” (cannot move forward without help)• Examples: data submission issue, real-time ICCP issues, etc.

Calendar Reminders

6

Bi-weekly Meetings Mondays 9AM CPT: Review activities planned for upcoming week Fridays 9AM CPT: Review results of activities that week

Friday Maintenance Member-impacting maintenance will happen on Friday afternoons 24-hour notice if member impacts are expected

Saturday - Reserved for MP Testing SPP will not override offer data Studies will be run, system permitting

Release Scorecard

7

• Release Scorecard– Find the Release Scorecard on spp.org:

spp.org > Integrated Marketplace > Market Trials > Structured/Unstructured Test > Integrated Marketplace Market Trials Project Documentation Folder

Known Issues Log

8

• Market Trials Known Issues Log– Find the Known Issues Log on spp.org:

spp.org > Integrated Marketplace > Market Trials > Structured/Unstructured Test > Integrated Marketplace Market Trials Project Documentation Folder

– Details on issues as currently impacting the Market Trials– 5/30/13: Bug with Internet Explorer when used to submit virtual beds and offers

Solution for Internet Explorer 8:

– After inserting /changing data in a cell press “Enter” on your keyboard. This should turn the cell yellow. Use “Tab” or cursor to select other cells. Press “Enter” after modifying any cell. Repeat this process until you are satisfied and press “Save.”

Solution for Internet Explorer 9:

– After inserting/changing data in a cell press “Tab” on your keyboard. This should turn the cell yellow. Use “Tab” or cursor to select other cells. Press “Tab” after modifying any cell. Repeat this process until you are satisfied and press “Save.”

Migration Report

9

• Migration Report– Not yet available

Readiness Metrics

10

View Readiness Metrics on iDashboard on spp.org• spp.org > Integrated Marketplace > Readiness Center > View the Integrated Marketplace

iDashboard > Readiness Dashboard > Executive Dashboard

• TRL-01: Structured/Unstructured Test Markets Participation – starting June 07• Resource Owning MPs: Maintain offers for each operating day• Load Owning MPs: Submit market energy bids based on load forecasts for each operating day• Financial Only MPs: Submit virtual bids and offers for each operating day• Overall : % of Target Mass Participating in Structured/Unstructured Phase of Market Trials

• TRL-02: Structured/Unstructured Test Complete – starting June 7• Monthly: % of Structured/Unstructured scheduled operational scenarios executed & passed• Overall : % of Structured / Unstructured Operational scenarios complete

• OPS-02: State Estimator Availability – starting July 1• Measured by checking for a solved SE solution during each 5-min period in a calendar day• State Estimator has 97% availability of 5 minute solutions for 7 consecutive days prior to Parallel Ops

• OPS-03: State Estimator Accuracy – starting July 1• Measures the quality of the State Estimator• State Estimator solves 90% of the time with Mismatch level lower than 50 MW for 7 consecutive

days prior to Parallel Ops

Readiness Metrics

11

• OPS-04: Short-Term Load Forecast Accuracy – starting July 1•Compares the load forecast values calculated by the Short Term forecast engine with the raw ICCP values (i.e. telemetered values)•Short term load forecast for the SPP Market footprint used for RTBM for conforming loads solves 97% of time with +/-1% accuracy for 7 consecutive days prior to Parallel Ops

•OPS-05: Mid-Term Load Forecast Accuracy – starting July 1•Compares the load forecast values calculated by the Mid Term forecast engine with the raw ICCP values (i.e. telemetered values)•Mid-term load forecast for conforming loads for the SPP market footprint solves 97% of time with +/- 3% accuracy for seven consecutive days prior to Parallel Ops

• OPS-06: Wind Forecast Accuracy – starting July 15•Compares the wind forecast values calculated by the wind forecast engine with the real-time output of the wind resources•Wind forecast for SPP Market footprint solves with +/- 20% accuracy for six out of seven consecutive days prior to Parallel Ops

• OPS-07: Market Flow Calculations Availability – Current Hour – starting Aug 1•Calculates calculating the number of successful studies during the reporting period for the current hr.•Market Flow Calculations successful 97% of 5 minute solutions for seven consecutive days prior to Parallel Ops

Readiness Metrics

12

• OPS-08: Market Flow Calculations Availability – Next Hour – starting Aug 1• Calculates the number of successful studies during the reporting period for the next hour• Market Flow Calculations successful ninety-seven percent (97%) of 5 minute solutions for seven consecutive days

during Parallel Ops

• OPS-09: DA Market Results Posted – starting June 7• Measured by validating that the results of the Day-Ahead Market are posted to all required access points• Day-Ahead Market results are posted every day by 4pm for 5 consecutive days during Parallel Ops

• OPS-10: Generate DA LMPs and Settlement Point Prices – starting June 7• Measures whether LMPs are generated after each Day-Ahead Market execution• LMPs are made available for each settlement location every day by 4pm for 5 consecutive days during Parallel Ops

• OPS-11: RTBM Calculation Availability – starting June 7• Measures RTBM calculation availability• Real-Time Calculations successful ninety-nine percent (99%) of five (5) minute solutions for 7 consecutive days

during Parallel Ops

• OPS-12: Operating Reserves Requirements – starting Aug 1• Validates that Operating Reserves are calculated and posted on time (7:00 am Central) during Parallel Operations

phase of Market Trials for 7 consecutive days• Operating Reserves are calculated and posted on time for 7 consecutive days during Parallel Ops

Weekly Reporting

13

• Scheduled Scenarios – starting June 7• Scheduled Scenarios Successful / Unsuccessful

• DA Market Results – starting June 7• Number of MPs Participating

• Bids, Offers, Virtual Bids/Offers• Total Amount of Bids

• Fixed (min and max), Price Sensitive (min and max)• Virtual (min and max), Cleared (min and max), Cleared virtual (min and max)

• Total Amount of Offers • Min and max• Virtual (min and max), Cleared (min and max), Cleared Virtual (min and max)

• Reserve Requirements• Hourly Data (RegUp, RegDn, Spin, Supp)

• Percent of load forecast that was cleared• Min and Max

• Prices• LMPs (min and max per Hub)• MCPs (min and max per Reserve Zone)

• Binding Constraints• Top Binding Constraints, Intervals, Limits, Max Flow, and Shadow Prices• Explanations where appropriate

Weekly Reporting

14

• DARUC - starting June 7• Number of Resources Recommended for Commitment• Number of Resources Approved for Commitment• Number of Resources Recommended for Decommitment• Constraints in DARUC that Drove Commitment• Emergency Situations in DARUC

• Capacity Shortage / Surplus• Performance / Issues

• IDRUC – starting June 7• Performance / Issues

• RTBM – starting June 7• Number of MPs participating

• RTBM Offers• Prices

• LMPs (min and max per Hub)• MCPs (min and max per Reserve Zone)• Explanation for abnormally high or low prices

• Major Constraints• Constraints, Intervals, Limits, Max Flow, and Shadow Prices• Missing Intervals

Market Trials Useful Documentation

• Integrated Marketplace Market Trials Project Documentation Folder spp.org > Integrated Marketplace > Market Trials > Structured/Unstructured Test >

Integrated Marketplace Market Trials Project Documentation Folder

• Market Trials Daily Calendar• Release Scorecard• Change Tracker• Market Trials Known Issues Log• Migration Report

*Note: As of 5/31/2013 the Migration Report is not yet available• Structured Market Trials Scenarios• Market Participant Guide

• View Readiness Metrics on iDashboard on spp.org• spp.org > Integrated Marketplace > Readiness Center > View the Integrated Marketplace

iDashboard > Readiness Dashboard > Executive Dashboard

15

Connectivity Test Preparation• Connectivity Test Preparation occurs over 4 weeks from

May 6th – May 31st.

• During this timeframe Market Participants prepare for Connectivity Test through the following activities:– Complete the Connectivity Test Checklist

– Initiate Local Security Administrator (LSA) and User/Application Certificate Setup.

– Exchange Notification Certificates and Market Participant Listener URLs with SPP (if applicable)

– Request Access to OATI WebTrans and CROW (if applicable)

16

Connectivity Test Execution Timeframe & Logistics• Timeframe:

– Connectivity Test Execution occurs over 4 weeks from June 3rd – June 28th.

• Logistics: – Tests executed are determined by what tests are deemed applicable by the MP in their

Connectivity Test Checklist

– Market Participants will be assigned a week during the test execution timeframe to perform their testing. Weekly Assignments can be found here

– Test Execution Plans (modified checklists) will be provided via RMS.

– Tests are performed independently during the assigned week- no appointment needed.

– Market Participants are to populate the execution plan as directed and return their results by the end of their assigned week via RMS.

– Issues with test execution will be handled via RMS. SPP Test Appointments will be provided only on an as needed based.

17

Test Execution Week #1

MPs Scheduled to Perform Extended Connectivity Testing June 3rd – June 7th.

– TPS 1- 8– ETC ENDURE ENERGY– MAG ENERGY SOLUTIONS– MERCURIA ENERGY AMERICA, INC– CITY OF COFFEYVILLE, KS

18

TCR Market Trials Upcoming Activities• Annual 1 Round TCR Auction

– Results made available on May 17th

• July Incremental ARR Allocation– Nomination Window: June 10th

– Results Posted: June 13th

• July Monthly TCR Auction– Bid Window: June 17th & 18th

– Results Posted: June 21st

19

TCR Market Trials Known Issues & Auction Summary• Important Known Issues:

– Known Issue 376: Binding Constraint download shows binding constraints in opposite direction This is a report only issue and is not impact the MOI or TCR database.

• Phase 2 Annual Auction Summary– Pre-Run Fix and Price Issue: Ty Mitchell

20

21