connectathon organization eric poiseau version 1. 0
DESCRIPTION
(Integrating the Healthcare Enterprise) IHE in Europe. Connectathon Organization Eric Poiseau Version 1. 0. Who are you ?. 77 companies 120 systems 4 domains (RAD, IT-I, CARD, LAB) RAD : 90 systems IT-I: 78 systems (XDS 22) CARD : 28 systems LAB: 21 systems. + 50 %. Progression. - PowerPoint PPT PresentationTRANSCRIPT
February 9th 2005 IHE-EU Conference Workshop
Connectathon OrganizationConnectathon OrganizationEric PoiseauEric Poiseau
Version 1.Version 1.00
(Integrating the Healthcare Enterprise)(Integrating the Healthcare Enterprise)
IHE IHE in Europein Europe
February 9th 2005 IHE-EU Conference Workshop
Who are you ?Who are you ?
77 companies77 companies120 systems120 systems4 domains (RAD, IT-I, CARD, LAB)4 domains (RAD, IT-I, CARD, LAB)RAD : 90 systemsRAD : 90 systems IT-I: 78 systems (XDS 22)IT-I: 78 systems (XDS 22)CARD : 28 systemsCARD : 28 systemsLAB: 21 systemsLAB: 21 systems
February 9th 2005 IHE-EU Conference Workshop
ProgressionProgression
0
20
40
60
80
100
120
2002 2003 2004 2005
Companies
Systems
+ 50 %
February 9th 2005 IHE-EU Conference Workshop
We need to get preparedWe need to get prepared
Pre-connectathon periodPre-connectathon period– 10 weeks10 weeks
ConnectathonConnectathon– 5 days (9 am to 6 pm)… but in the fact only 5 days (9 am to 6 pm)… but in the fact only
4 days for testing4 days for testingNeed for optimization Need for optimization
– A lot to do before A lot to do before – To perform more testing during CATTo perform more testing during CAT
February 9th 2005 IHE-EU Conference Workshop
A few numbers…A few numbers… 10 weeks gives 400 hours of work10 weeks gives 400 hours of work ~ 2700 logs are required~ 2700 logs are required
– 5 min per log file makes 225 hours5 min per log file makes 225 hours ~ 120 systems~ 120 systems
– 1 hour on phone/email makes 120 hours1 hour on phone/email makes 120 hours
That gives me 155 hours for the rest…That gives me 155 hours for the rest…– Lab tools, connectathon preparation, webtool Lab tools, connectathon preparation, webtool
maintenance, test data,….maintenance, test data,….
No time for Baby sitting
February 9th 2005 IHE-EU Conference Workshop
Pre-ConnectathonPre-Connectathon Check your registrationCheck your registration
– I do not want you to tell me during the connectathon : « I I do not want you to tell me during the connectathon : « I have forgotten to sign up for PIR, I though…. »have forgotten to sign up for PIR, I though…. »
Configuration information gathering (Configuration information gathering (you to meyou to me))– Dicom Conformance Statements Dicom Conformance Statements – Port numbers, URI, AE Titles….Port numbers, URI, AE Titles….
Configuration of your system (Configuration of your system (me to youme to you))– Before Monday morning….so before shippingBefore Monday morning….so before shipping– You need to configure your system You need to configure your system
With your peer information With your peer information With the connectathon network informationWith the connectathon network information With the testing datasetWith the testing dataset
Mesa Test Mesa Test Object Rendering Tests Object Rendering Tests New
February 9th 2005 IHE-EU Conference Workshop
Registration CheckingRegistration CheckingCombined actors/profileCombined actors/profile
– PPSM for OF and IM/IAPPSM for OF and IM/IA– PIR requires SWFPIR requires SWF– SWF and ARISWF and ARI– ……
Supportive or Thorough ?Supportive or Thorough ?– We do not know yet how supportive will be We do not know yet how supportive will be
reported in result matrix and if it willreported in result matrix and if it will
New
February 9th 2005 IHE-EU Conference Workshop
Supportive versus ThoroughSupportive versus Thorough ThoroughThorough
– This is what we have done so farThis is what we have done so far SupportiveSupportive
– You’re confident about this Actor/IP but you want You’re confident about this Actor/IP but you want to bring it at the connectathonto bring it at the connectathon
– You have already tested it at a previous CATYou have already tested it at a previous CAT– Need to provide URL to IS (published)Need to provide URL to IS (published)
Result matrix will show thorough resultsResult matrix will show thorough results
New
System Configuration / InformationSystem Configuration / Information
February 9th 2005 IHE-EU Conference Workshop
System InformationSystem Information
Dicom Conformance StatementDicom Conformance Statement– Upload Upload formform
Practical InformationPractical Information– Power informationPower information– Number of chairsNumber of chairs– StorageStorage– Special requirements -> contact meSpecial requirements -> contact me
Please provide this information before Please provide this information before March 1stMarch 1st
New
February 9th 2005 IHE-EU Conference Workshop
Configuration InformationConfiguration Information Have your configuration ready and confirmed before Have your configuration ready and confirmed before
the deadline (April 15th)the deadline (April 15th)– I have assigned some default valuesI have assigned some default values– If you change it… your peer will have to change it also….If you change it… your peer will have to change it also….
How important is it ? How important is it ? – Most of the time spend in doing a connectathon test is spend Most of the time spend in doing a connectathon test is spend
checking/changing the configuration parameters.checking/changing the configuration parameters.– More systems more choices of peers…. Try not to be the More systems more choices of peers…. Try not to be the
bad guy.bad guy. Q : How to provide my configuration information ?Q : How to provide my configuration information ?
– AnswerAnswer Q : How to find my peer configurations parameters ?Q : How to find my peer configurations parameters ?
– AnswerAnswer
February 9th 2005 IHE-EU Conference Workshop
Configuration InformationConfiguration Information If you feel that there are missing parameters, If you feel that there are missing parameters,
– this is highly probable. Let me know ASAPthis is highly probable. Let me know ASAP
No confirmation will be understood as a No confirmation will be understood as a confirmation!confirmation!– This means that your peers will configure their This means that your peers will configure their
systems with information that may be erroneous ! systems with information that may be erroneous !
Configure your systems before arriving to the Configure your systems before arriving to the connectathonconnectathon
Mesa TestingMesa Testing
General InformationGeneral Information
February 9th 2005 IHE-EU Conference Workshop
Why Do We Have Test Tools ?Why Do We Have Test Tools ?
1.1. Reduce the number of systems to 80 Reduce the number of systems to 80 because the room we have reserved because the room we have reserved for the connectathon is too small !for the connectathon is too small !
2.2. The project manager is evil and he The project manager is evil and he likes to make you suffer with buggy likes to make you suffer with buggy mesa tools !mesa tools !
3.3. Prepare your systems for the Prepare your systems for the connectathon !connectathon !
February 9th 2005 IHE-EU Conference Workshop
Why Do We Have Test Tools ?Why Do We Have Test Tools ?
Test tools prepare you for the Test tools prepare you for the connectathonconnectathon– Provides a minimum set of test to prepare Provides a minimum set of test to prepare
your systemsyour systemsTools are a benefit of participationTools are a benefit of participation
– As a participant you get them before the As a participant you get them before the public releasepublic release
Tools are released to the public later onTools are released to the public later on
February 9th 2005 IHE-EU Conference Workshop
How Do Tests Help You ?How Do Tests Help You ? Tests encourage you and your peers to read Tests encourage you and your peers to read
details of the Technical Frameworkdetails of the Technical Framework– You may find you do not agree with our You may find you do not agree with our
interpretation of the TFinterpretation of the TF– You may not agree with the TFYou may not agree with the TF
If you and your peers complete the tests, we If you and your peers complete the tests, we can avoid a lot of wasted time at the can avoid a lot of wasted time at the Connectathon Connectathon
Thus we can prepare more complex Thus we can prepare more complex demonstrations and do more complex demonstrations and do more complex connectathon testsconnectathon tests
February 9th 2005 IHE-EU Conference Workshop
Test CoverageTest Coverage
Test software do NOT cover all aspects Test software do NOT cover all aspects of the Technical Framework of the Technical Framework
Test software do NOT guarantee Test software do NOT guarantee compliance with DICOM or HL7.compliance with DICOM or HL7.
All what it does, is provide a reasonable All what it does, is provide a reasonable preparation for the Connectathon.preparation for the Connectathon.
February 9th 2005 IHE-EU Conference Workshop
Test Cases versus DemonstrationTest Cases versus Demonstration
MESA tests cover more transactions than MESA tests cover more transactions than will be demonstratedwill be demonstrated
Participants are required to complete all test Participants are required to complete all test cases, even if they do not lead directly to cases, even if they do not lead directly to demonstrationdemonstration
Thus : Your system may perform one Thus : Your system may perform one transaction at transaction at a a demonstration but perform demonstration but perform several transactions with the MESA tests several transactions with the MESA tests (and the Connectathon)(and the Connectathon)
Mesa TestingMesa Testing
How toHow to
February 9th 2005 IHE-EU Conference Workshop
Rad – Card – IT-I (except XDS)Rad – Card – IT-I (except XDS)
February 9th 2005 IHE-EU Conference Workshop
MESA ToolsMESA ToolsSimulate your peersSimulate your peers
Order
Filler
MESA
ADT, OP, IM/IA
TCP/IP
Network
System being testedWin32 / Linux / Solaris
MESA OS is independant of system under test OSMESA OS is independant of system under test OSChoosing NTChoosing NT, , Linux Linux or Solaris or Solaris is a question of tasteis a question of taste
Mesa SimulatorWin32 / Linux / Solaris
February 9th 2005 IHE-EU Conference Workshop
Hardware/network requirement Hardware/network requirement for testingfor testing
One computer system can :One computer system can :– Support all of the MESA actors Support all of the MESA actors – Can serve as the driver for any system under test. Can serve as the driver for any system under test.
Only one computer required to test an IHE actor. Only one computer required to test an IHE actor. It is impossible to test multiple systems It is impossible to test multiple systems
simultaneously simultaneously – (sockets are not multithreaded). (sockets are not multithreaded).
You need to test separate systems serially with You need to test separate systems serially with little or no reconfiguration.little or no reconfiguration.
February 9th 2005 IHE-EU Conference Workshop
Mesa test how toMesa test how toWhere do I get the tools from ?Where do I get the tools from ?
– http://ihe.univ-rennes1.fr/testinghttp://ihe.univ-rennes1.fr/testing– If you’re logged in you’ll get the last releaseIf you’re logged in you’ll get the last release– If not you’ll get the public releaseIf not you’ll get the public release
Who writes the tools ?Who writes the tools ?– MIR, Offis, NIST, IDMMIR, Offis, NIST, IDM
What if I find a bug in a tool ?What if I find a bug in a tool ?– MIR, Offis : MIR, Offis : http://http://rome.wustl.edu/bugzillarome.wustl.edu/bugzilla– NIST, IDM : contact me !NIST, IDM : contact me !
February 9th 2005 IHE-EU Conference Workshop
InstallationInstallation
Make sure you follow the installation Make sure you follow the installation instructions provided by Steven Mooreinstructions provided by Steven Moore
Do not try to install from the sourcesDo not try to install from the sources– Sources are provided for informationSources are provided for information
February 9th 2005 IHE-EU Conference Workshop
Most common errors encounteredMost common errors encounteredEnvironment variables not setEnvironment variables not setMesa_storage files not installedMesa_storage files not installedWrong version of Win32 PerlWrong version of Win32 PerlSQL server is not installedSQL server is not installedDatabase tables are not installedDatabase tables are not installed
But also possible errors in the tools !But also possible errors in the tools !
February 9th 2005 IHE-EU Conference Workshop
Recommendations for MESA Recommendations for MESA SoftwareSoftware
We recommend that you install and test We recommend that you install and test the software as soon as possiblethe software as soon as possible
The authors try to make the installation The authors try to make the installation process simple, but there will be some process simple, but there will be some difficultiesdifficulties
It is better to go through a round of It is better to go through a round of installation now rather than waiting until installation now rather than waiting until the “final/next” release is available; the “final/next” release is available;
February 9th 2005 IHE-EU Conference Workshop
MESA Test InteractionsMESA Test InteractionsMost MESA tests are independent of Most MESA tests are independent of
other tests. You can run them in any other tests. You can run them in any order.order.
Most tests overwrite common data Most tests overwrite common data areas. They do not overwrite the output areas. They do not overwrite the output of the evaluation scripts.of the evaluation scripts.
This implies you should run a test and This implies you should run a test and perform the evaluation before starting perform the evaluation before starting another test.another test.
February 9th 2005 IHE-EU Conference Workshop
MESA Test OverviewMESA Test Overview Each actor/integration profile has several tests, Each actor/integration profile has several tests,
each test is assigned a number (101, 102, …)each test is assigned a number (101, 102, …) 100 series tests are for the Scheduled 100 series tests are for the Scheduled
Workflow / Patient Information ReconciliationWorkflow / Patient Information Reconciliation Other series of tests are for different features Other series of tests are for different features
of the Technical Framework (for actors or of the Technical Framework (for actors or classes of actors)classes of actors)
How to know what test your systems have to How to know what test your systems have to pass ? pass ? – Check the web tool on your system pageCheck the web tool on your system page
February 9th 2005 IHE-EU Conference Workshop
General Test InstructionsGeneral Test Instructions Start MESA servers on test machineStart MESA servers on test machine Run an interactive perl script that leads you Run an interactive perl script that leads you
through the test scenariothrough the test scenario Run a second perl script that evaluates your Run a second perl script that evaluates your
messagesmessages Check the logs for errors and try to Check the logs for errors and try to
understand the problemsunderstand the problems Send output of evaluation script to Project Send output of evaluation script to Project
ManagerManager Please comment your logs if this is neededPlease comment your logs if this is needed
February 9th 2005 IHE-EU Conference Workshop
Test logs returnTest logs return (2) (2)Do not send logs if you know that they Do not send logs if you know that they
will be rejected. will be rejected. – Check Bugzilla pages for informationCheck Bugzilla pages for information– Ask for some helpAsk for some help
When “error” please explain the errorsWhen “error” please explain the errorsUpload form for log returnUpload form for log return
– Please mention if you are resubmitting Please mention if you are resubmitting “old” logs“old” logs
New
February 9th 2005 IHE-EU Conference Workshop
XDSXDS
February 9th 2005 IHE-EU Conference Workshop
NIST ToolkitNIST Toolkit Remote Registry and Repository hosted by Remote Registry and Repository hosted by
NISTNIST Sources can submit documents to the NIST Sources can submit documents to the NIST
serverserver Consumer can query and retrieve documents Consumer can query and retrieve documents
from the NIST serverfrom the NIST server Java tool to submit and query a registryJava tool to submit and query a registry Log browser for PM to check/help testersLog browser for PM to check/help testers
New
February 9th 2005 IHE-EU Conference Workshop
Laboratory ToolsLaboratory Tools
Not script for the momentNot script for the momentMessage validation softwareMessage validation software
– http://ihe.univ-rennes1.fr/HL7http://ihe.univ-rennes1.fr/HL7
New
February 9th 2005 IHE-EU Conference Workshop
Connectathon LogisticsConnectathon Logistics
February 9th 2005 IHE-EU Conference Workshop
Connectathon CodesConnectathon Codes Tables and codes used for the connectathon will be Tables and codes used for the connectathon will be
provided :provided :– HL7 user tables HL7 user tables – MD’s MD’s – Beds, Facilities, Assigning authoritiesBeds, Facilities, Assigning authorities– Procedures codes (lab, radio, and cardio)Procedures codes (lab, radio, and cardio)– XDS Affinity domain informationXDS Affinity domain information
OIDsOIDs– Set of patients ID and identities for non ADT clientsSet of patients ID and identities for non ADT clients
If you think there are some missing tables and/or If you think there are some missing tables and/or information, please let me knowinformation, please let me know
February 9th 2005 IHE-EU Conference Workshop
ADTADT
Each ADT actor will be assigned a Each ADT actor will be assigned a range of pid to avoid confusion.range of pid to avoid confusion.– Patient Identifiers are 6 digit identifiers that Patient Identifiers are 6 digit identifiers that
begin with a two-digit code that identifies begin with a two-digit code that identifies the system producing the ID. the system producing the ID.
– Thus, if your prefix is 10, your Patient Thus, if your prefix is 10, your Patient Identifiers will be in the range of 100000 to Identifiers will be in the range of 100000 to 109999.109999.
February 9th 2005 IHE-EU Conference Workshop
Digital CertificatesDigital Certificates I’ll provide you with private key and certificateI’ll provide you with private key and certificate One certificate assigned for each secure One certificate assigned for each secure
systemsystem Certificates to be used only for connectathon Certificates to be used only for connectathon
and demonstrationsand demonstrations Certificates are not meant to be used in a Certificates are not meant to be used in a
production environmentproduction environment We provide no guidance on how to manage We provide no guidance on how to manage
those in a clinical environmentthose in a clinical environment
February 9th 2005 IHE-EU Conference Workshop
Webtool for test managementWebtool for test management
Provides list of possible peersProvides list of possible peersProvides chat/log Provides chat/log Provides verification loggingProvides verification loggingProvides information about « persistent Provides information about « persistent
objects » objects » New
February 9th 2005 IHE-EU Conference Workshop
Network InformationNetwork Information We will provideWe will provide
– IP Addresses and Host file IP Addresses and Host file – Local DNS (preferred to host file)Local DNS (preferred to host file)– NetmaskNetmask– GatewaysGateways– Time ServerTime Server– Kerberized ServerKerberized Server– Mail Server Mail Server – LDAPLDAP– XDS Repository and RegistryXDS Repository and Registry
New
New
New
February 9th 2005 IHE-EU Conference Workshop
Network InformationNetwork Information Intranet will be at least 100 Mb/sIntranet will be at least 100 Mb/s Internet will be at least 10 Mb/sInternet will be at least 10 Mb/s
– Internet is used for convenience for email Internet is used for convenience for email and communication of files with home and communication of files with home based team.based team.
– Internet access is not guaranteed Internet access is not guaranteed You will get on drop per systemYou will get on drop per system
– It is your responsibility to bring a hub It is your responsibility to bring a hub
February 9th 2005 IHE-EU Conference Workshop
Power SupplyPower Supply
240 Volts240 VoltsA power strips with 3-5 slots per tableA power strips with 3-5 slots per tableUK plugs do not fit to NL outlet !! UK plugs do not fit to NL outlet !!
– Are we not talking about interoperability !Are we not talking about interoperability !
If you need more than 240 V, please let If you need more than 240 V, please let me know ASAP !me know ASAP !
February 9th 2005 IHE-EU Conference Workshop
Tables and chairsTables and chairs
120 tables 120 tables – One per systemOne per system– Please use the table that will be assigned Please use the table that will be assigned
to your systemto your system– If your company brings 2 systems, they If your company brings 2 systems, they
might not be close to each other !!! might not be close to each other !!!
February 9th 2005 IHE-EU Conference Workshop
Connectathon TestConnectathon Test
February 9th 2005 IHE-EU Conference Workshop
Preliminary Connectathon Preliminary Connectathon ScheduleSchedule
Monday :Monday :– am : installation of your systems am : installation of your systems
Systems deliverySystems delivery Check network access, correctness of configurationCheck network access, correctness of configuration
– pm : start of testing (p2p)pm : start of testing (p2p)
…….. Wednesday : Wednesday :
– start of scenario testingstart of scenario testing Friday : Friday :
– am : very last testsam : very last tests– pm : packingpm : packing
Package pick-upPackage pick-up
February 9th 2005 IHE-EU Conference Workshop
Peer To Peer Tests (P2P)Peer To Peer Tests (P2P)
You have to test with some peersYou have to test with some peersYou need to get at least 3 instances of a You need to get at least 3 instances of a
test verified per testtest verified per testPeer are prioritizedPeer are prioritized
You can do more testing.You can do more testing.
February 9th 2005 IHE-EU Conference Workshop
Peer To Peer Tests (P2P)Peer To Peer Tests (P2P)
Enhancement :Enhancement :– Use of a chat room for peers to Use of a chat room for peers to
communicate and keep track of the communicate and keep track of the transactions.transactions.
– Use of log storage mechanism : (cut and Use of log storage mechanism : (cut and paste the logs in text file)paste the logs in text file)
Other suggestions/ideasOther suggestions/ideas
New
February 9th 2005 IHE-EU Conference Workshop
Scénarii TestsScénarii Tests
Compared to last yearCompared to last year– Increased complexityIncreased complexity
Could combine RSWF, LSWF, PIX, RID, EUA, Could combine RSWF, LSWF, PIX, RID, EUA, XDS…XDS…
– Increased number of peersIncreased number of peersWill have a schedule, so will need you Will have a schedule, so will need you
to be ready at the time of the test.to be ready at the time of the test.Will have a list of difficulties to check.Will have a list of difficulties to check.
February 9th 2005 IHE-EU Conference Workshop
HintsHints
Switching peer should be an easy and Switching peer should be an easy and rapid task.rapid task.– Try to avoid need of rebootingTry to avoid need of rebooting– Try to avoid typing the peer configuration Try to avoid typing the peer configuration
each time you need to switch.each time you need to switch.Have the procedure codes entered in Have the procedure codes entered in
your systems. your systems.
February 9th 2005 IHE-EU Conference Workshop
How can I failHow can I fail
I have not a single test verified by I have not a single test verified by Wednesday evening !!! Wednesday evening !!!
I am spying my colleagues !!!I am spying my colleagues !!! I am not fair to the PM !!!I am not fair to the PM !!!
February 9th 2005 IHE-EU Conference Workshop
Special CasesSpecial Cases You all are in a special case !!!!You all are in a special case !!!! I have finished all my testing on Monday, I have finished all my testing on Monday,
shall I leave ????shall I leave ????– Print Server case Print Server case
I have 5 zillion tests to perform during the I have 5 zillion tests to perform during the week, …can we stay for another 2 weeks…week, …can we stay for another 2 weeks…– Register more systemsRegister more systems– Register fewer profiles/actorsRegister fewer profiles/actors
February 9th 2005 IHE-EU Conference Workshop
ResultsResults
Concerns only positive resultsConcerns only positive resultsTest failure are “forgotten”Test failure are “forgotten”Matrix published in the following weeksMatrix published in the following weeks
Diverse IssuesDiverse Issues
February 9th 2005 IHE-EU Conference Workshop
CommunicationCommunication
Me to youMe to you– Email (mailing list)Email (mailing list)– News on IHE-Europe Web (RSS)News on IHE-Europe Web (RSS)– PhonePhone
You to Me :You to Me :– Email +++Email +++– Phone ---Phone ---
February 9th 2005 IHE-EU Conference Workshop
CommunicationCommunication Protocol (are we not dealing with interoperability):Protocol (are we not dealing with interoperability):
– CompanyCompany– SystemSystem– Operating systemOperating system– Actor testedActor tested– Tool Version…Tool Version…
Any information about your context will help me Any information about your context will help me – Remember that you have an open credit of ½ hour per Remember that you have an open credit of ½ hour per
systems… do not waste it !!!!systems… do not waste it !!!!
February 9th 2005 IHE-EU Conference Workshop
ShippingShippingShipping informationShipping information
– We will let you know in time.We will let you know in time.StorageStorage
– We will have a space for storageWe will have a space for storage– If possible, for small boxes store in your If possible, for small boxes store in your
roomroomSecurity during the nightsSecurity during the nights
– Security from the hotelSecurity from the hotel
February 9th 2005 IHE-EU Conference Workshop
February 9th 2005 IHE-EU Conference Workshop
February 9th 2005 IHE-EU Conference Workshop
February 9th 2005 IHE-EU Conference Workshop
CConnectathononnectathon Check List Check List Swimming Suit and squash equipmentSwimming Suit and squash equipment Bowling bowl Bowling bowl Technical FrameworkTechnical Framework Your system fully configured Your system fully configured
– NetworkNetwork– Codes, procedures, tables….Codes, procedures, tables….
Laptop to run the webtoolLaptop to run the webtool– Could be also used to sniff messages or service you systemCould be also used to sniff messages or service you system
Power strip + power cord extensionPower strip + power cord extension Hub (preferred to switch)Hub (preferred to switch) Calibration material for CPI profile actorsCalibration material for CPI profile actors
– Print Server and print composerPrint Server and print composer
February 9th 2005 IHE-EU Conference Workshop
Thank youThank you