Joint Exchange / Interop Work Group Test Workgroup

Eric Heflin/Judith HuntmanAug 22, 2012

Roll

2

Name Organization RepresentationNick VanDuyne NYeC StateIvan Handler ILJohn Donnelly NJ Task Group Co-Chair - IWGMarty Prahl SSA

Federal agencyDennis Peterson, Curtus Browning, Elaine Hunolt, Taimur Aslam, Willie Singletary, Monica VanDyke VHA

Kevin Brady NIST NISTDavid Tao, Dan Huber Siemens

EHR VendorDave Cassel, Rob Klootwyk Epic Bill Howard, Charles Parisot GEJeff Cunningham, Tim Dunnington ICA

HIE vendor

Mike LaRocca Intersystems

Vladi Reznikov, Jennifer Puyenbroek CONNECT PMO

Matt Bell, Tom Wilson, Kathy Lin AxolotlTeddy Gedamu MedfxMelissa Owens Marshfield Clinic Health SystemSteve Leighty MedVirginia

Regional HIE Brian Bonnington, Dave Trepanier, Dave Smith, Steve Michael IHIE

Anuj Desai Interop WG Interop WGEric Heflin THSA Task Group Co-Chair - ExchangeMariann Yeager Exchange Exchange Ed O'Connor, Judith Hutman Nitor ONC Testing Contractor

Dennis Wilson, Alisa Ray, Sue Rieber CCHIT

ATCBs and Testing SMEs

Jim St. Clair IHE USA

Amit Trivedi, Kevin Brown, Michella Knighton ICSA Labs

Traci Mapps SLI Global SolutionsKyle Meadors, Timothy Bennett Drummond Group

Milton Padilla, Steve Wilson, Mark Shin, Doublas Biggs, Les Biggs InfoGuard

• Roll Call – Cayla

• Announcements – Eric

• Direct harmonization – Judith

• Test execution status – Judith

• soapUI demo – Judith

• Open Discussion – All

• Wrap Up/Schedule Review - Eric

Agenda

3

• Harmonized PD/QD/RD/MP/AF (aka Patient Record Lookup) Tests Were Ratified Last Week• Future changes are possible, but will be incorporated into the next

phase of test cases design and implementation (post Oct 2012)

• http://exchange-iwg.wikispaces.com/Test+Artifacts+Harmonization

• Pilot is beginning

• RFP• Has 5 respondents

• Evaluations are still under way

Announcements

4

Harmonization Phases

Phase 1 – SOAP

Query/Retreive

Phase 2 – Direct Send/Receive

Phase 3 – Secondary Methods, Service

Discovery, & Provider Directories

•Parent Use Cases (Done)•Test Case harmonization (Done)•Tests: Mess & Auth Framework (Done)•Tests: Patient Discovery (XCPD, PIX, PDQ), Query for Documents, Retrieve Documents (Done)

•Test Execution Guides (Done)

•Parent Use Cases•Test Case harmonization•Tests: Direct Applicability Statement (Done)

•Tests: Direct XDM/XDR-Bridge (Done)•Tests: Direct Certificate Discovery (Done)

•Test Execution Guide

•Parent Use Cases•Test case harmonization•Tests: Web Services Registry (Done)•Tests: HPD+•Tests: Document Submission (Done)•Tests: Administrative Distribution (Done)•Test Execution Guides

Unified Test Process – Has Been Proposed

Direct Harmonization

Analysis of Test Artifacts

• Breaking down EHR-HIE Test Spec into modular components

• Mapping to ONC test cases

Test Approach:Direct only v. Internal actors

Direct Messaging

Internal Actor Messaging

Internal Actor Testing

Direct Messaging

FR-2SMTP Sender

to HISP

FR-3HISP to SMTP

Receiver

FR-5HISP Sender

to HISP Receiver

FR-7SMTP to SMTP

Deployment Model E.1

E.1

FR-5HISP Sender to HISP Receiver

FR-9SMTP to XD

FR-4HISP to XD

Receiver

FR-7SMTP to SMTP

FR-6XD to XD

Deployment Model E.2

E.2

FR-5HISP Sender to HISP Receiver

FR-7SMTP to SMTP

FR-1XD Sender

to HISP

FR-8XD to SMTP

FR-6XD to XD

Other Deployment Models: Unclear Testing Path

Deployment Model B

FR-5HISP Sender to HISP Receiver

FR-7SMTP to SMTP

Deployment Model C

FR-5HISP Sender to HISP Receiver

FR-7SMTP to SMTP

Sample Analysis: Edge Protocol EHR-HIE Test Spec FR-2

FR-2: SMTP Sender to HISP

* Internal actors specified

* Send XDR not proscribed in Direct specs

FR-2: Applying a Modular Approach

Direct Messaging

DM1 DM2

DM3

Cert Discovery

CD1

CD2

CD3

EHR-HIE ApplicantProduction Participant

Deplmnt A Reqts

FR2

A2

A3

Eve

nt-

Bas

ed

Inte

rop

Tes

tin

g

DM1

DM2

CD1

CD2

FR2

A2

Deplmnt B Reqts

B1 B2

B3

DM3

CD3

A3

Deplmnt X Reqts

X1 X2

X3

XD Conversion

XD1

XD2

XD3

FR-2SMTP to HISP

Sample Analysis: NormativeEHR-HIE Test Spec FR-5

FR-5: HISP Sender to HISP Receiver via S/MIME

FR-5: Applying a Modular Approach

Direct Messagi

ng

DM1 DM2

DM3

Cert Discove

ry

CD1

CD2

CD3

EHR-HIE ApplicantProduction Participant

Deplmnt A Reqts

FR1

A2

A3

Eve

nt-

Bas

ed

Inte

rop

Tes

tin

g

DM1

DM2

CD1

CD2

FR1

A2

Deplmnt B Reqts

B1 B2

B3

DM3

CD3

A3

Deplmnt X Reqts

X1 X2

X3

XD Convers

ion

XD1

XD2

XD3

FR-5Sending HISP to

Receiving HISP

‘round-the-room

• Should we levy normative conditional requirements for specified deployment models / edge protocols?

• If so, how far do we go in accommodating other (unknown) deployment models?

Where does conversion occur?

This end-to-end testing shows one possible model. Here, XD conversion is tested at the Sender Test Module. But it could be done at other hops too.

Test Execution Status

Automating Test Case Execution: soapUI scripts complete

Priority High Med Low X (untargeted) TOTALS

PD 7 3 3 13

QD 18 16 0 2 34

RD 5 6 1 12

M+A 1 15

Direct 18

TOTALS 48 34 6 88

NEW

NEW

soapUI Demo

‘round-the-room

• Does the (soapUI-based) approach seem appropriate?

Open Discussion

•RFP released — July 2nd 

•Questions received by 6 organizations

•Answers distributed — July 13th

•Bids due — July 20th

•Evaluating

•Expected award — TBD

•Contract start — TBD

Schedule Review

30

We are here (running late)