program update november 8, 2012 andrew j. buckler, ms principal investigator, qi-bench
DESCRIPTION
Program Update November 8, 2012 Andrew J. Buckler, MS Principal Investigator, QI-Bench. With Funding Support provided by National Institute of Standards and Technology. Agenda. Update on large download capability (Patrick) First look at new user access concept (Andy) - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Program Update November 8, 2012 Andrew J. Buckler, MS Principal Investigator, QI-Bench](https://reader035.vdocuments.us/reader035/viewer/2022070415/56814ef8550346895dbc8a08/html5/thumbnails/1.jpg)
Program UpdateNovember 8, 2012
Andrew J. Buckler, MSPrincipal Investigator,
QI-Bench
WITH FUNDING SUPPORT
PROVIDED BY NATIONAL
INSTITUTE OF STANDARDS AND
TECHNOLOGY
![Page 2: Program Update November 8, 2012 Andrew J. Buckler, MS Principal Investigator, QI-Bench](https://reader035.vdocuments.us/reader035/viewer/2022070415/56814ef8550346895dbc8a08/html5/thumbnails/2.jpg)
Agenda• Update on large download capability (Patrick)• First look at new user access concept (Andy)• Consolidation of batch analysis, ISA file generation,
and statistical analysis workflows (Gary and Jovanna)• Contour-based analysis (Team)
22
![Page 3: Program Update November 8, 2012 Andrew J. Buckler, MS Principal Investigator, QI-Bench](https://reader035.vdocuments.us/reader035/viewer/2022070415/56814ef8550346895dbc8a08/html5/thumbnails/3.jpg)
3
![Page 4: Program Update November 8, 2012 Andrew J. Buckler, MS Principal Investigator, QI-Bench](https://reader035.vdocuments.us/reader035/viewer/2022070415/56814ef8550346895dbc8a08/html5/thumbnails/4.jpg)
CONSOLIDATION OF BATCH ANALYSIS AND ISA FILE GENERATION (GARY)
![Page 5: Program Update November 8, 2012 Andrew J. Buckler, MS Principal Investigator, QI-Bench](https://reader035.vdocuments.us/reader035/viewer/2022070415/56814ef8550346895dbc8a08/html5/thumbnails/5.jpg)
![Page 6: Program Update November 8, 2012 Andrew J. Buckler, MS Principal Investigator, QI-Bench](https://reader035.vdocuments.us/reader035/viewer/2022070415/56814ef8550346895dbc8a08/html5/thumbnails/6.jpg)
![Page 7: Program Update November 8, 2012 Andrew J. Buckler, MS Principal Investigator, QI-Bench](https://reader035.vdocuments.us/reader035/viewer/2022070415/56814ef8550346895dbc8a08/html5/thumbnails/7.jpg)
![Page 8: Program Update November 8, 2012 Andrew J. Buckler, MS Principal Investigator, QI-Bench](https://reader035.vdocuments.us/reader035/viewer/2022070415/56814ef8550346895dbc8a08/html5/thumbnails/8.jpg)
![Page 9: Program Update November 8, 2012 Andrew J. Buckler, MS Principal Investigator, QI-Bench](https://reader035.vdocuments.us/reader035/viewer/2022070415/56814ef8550346895dbc8a08/html5/thumbnails/9.jpg)
![Page 10: Program Update November 8, 2012 Andrew J. Buckler, MS Principal Investigator, QI-Bench](https://reader035.vdocuments.us/reader035/viewer/2022070415/56814ef8550346895dbc8a08/html5/thumbnails/10.jpg)
![Page 11: Program Update November 8, 2012 Andrew J. Buckler, MS Principal Investigator, QI-Bench](https://reader035.vdocuments.us/reader035/viewer/2022070415/56814ef8550346895dbc8a08/html5/thumbnails/11.jpg)
![Page 12: Program Update November 8, 2012 Andrew J. Buckler, MS Principal Investigator, QI-Bench](https://reader035.vdocuments.us/reader035/viewer/2022070415/56814ef8550346895dbc8a08/html5/thumbnails/12.jpg)
![Page 13: Program Update November 8, 2012 Andrew J. Buckler, MS Principal Investigator, QI-Bench](https://reader035.vdocuments.us/reader035/viewer/2022070415/56814ef8550346895dbc8a08/html5/thumbnails/13.jpg)
![Page 14: Program Update November 8, 2012 Andrew J. Buckler, MS Principal Investigator, QI-Bench](https://reader035.vdocuments.us/reader035/viewer/2022070415/56814ef8550346895dbc8a08/html5/thumbnails/14.jpg)
![Page 15: Program Update November 8, 2012 Andrew J. Buckler, MS Principal Investigator, QI-Bench](https://reader035.vdocuments.us/reader035/viewer/2022070415/56814ef8550346895dbc8a08/html5/thumbnails/15.jpg)
![Page 16: Program Update November 8, 2012 Andrew J. Buckler, MS Principal Investigator, QI-Bench](https://reader035.vdocuments.us/reader035/viewer/2022070415/56814ef8550346895dbc8a08/html5/thumbnails/16.jpg)
![Page 17: Program Update November 8, 2012 Andrew J. Buckler, MS Principal Investigator, QI-Bench](https://reader035.vdocuments.us/reader035/viewer/2022070415/56814ef8550346895dbc8a08/html5/thumbnails/17.jpg)
CONSOLIDATION OF STATISTICAL ANALYSIS WORKFLOWS (JOVANNA)
![Page 18: Program Update November 8, 2012 Andrew J. Buckler, MS Principal Investigator, QI-Bench](https://reader035.vdocuments.us/reader035/viewer/2022070415/56814ef8550346895dbc8a08/html5/thumbnails/18.jpg)
18
18
Objects that interact with the RDSM
![Page 19: Program Update November 8, 2012 Andrew J. Buckler, MS Principal Investigator, QI-Bench](https://reader035.vdocuments.us/reader035/viewer/2022070415/56814ef8550346895dbc8a08/html5/thumbnails/19.jpg)
19
19
![Page 20: Program Update November 8, 2012 Andrew J. Buckler, MS Principal Investigator, QI-Bench](https://reader035.vdocuments.us/reader035/viewer/2022070415/56814ef8550346895dbc8a08/html5/thumbnails/20.jpg)
20
20
Preprocess the data
![Page 21: Program Update November 8, 2012 Andrew J. Buckler, MS Principal Investigator, QI-Bench](https://reader035.vdocuments.us/reader035/viewer/2022070415/56814ef8550346895dbc8a08/html5/thumbnails/21.jpg)
21
21
Core Analysis: BiasAndLinearity
![Page 22: Program Update November 8, 2012 Andrew J. Buckler, MS Principal Investigator, QI-Bench](https://reader035.vdocuments.us/reader035/viewer/2022070415/56814ef8550346895dbc8a08/html5/thumbnails/22.jpg)
22
22
Core Analysis: ReaderPerformance
![Page 23: Program Update November 8, 2012 Andrew J. Buckler, MS Principal Investigator, QI-Bench](https://reader035.vdocuments.us/reader035/viewer/2022070415/56814ef8550346895dbc8a08/html5/thumbnails/23.jpg)
23
23
Composite Analysis: CrossSectionalVariability
![Page 24: Program Update November 8, 2012 Andrew J. Buckler, MS Principal Investigator, QI-Bench](https://reader035.vdocuments.us/reader035/viewer/2022070415/56814ef8550346895dbc8a08/html5/thumbnails/24.jpg)
Contour-based Analysis• Purpose• Methods:
– STAPLE– Meyer’s P-maps– MICCAI indices– DICE
• File formats:– DICOM segmentation objects– AIM 4.0– STL– MHT
2424242424
![Page 25: Program Update November 8, 2012 Andrew J. Buckler, MS Principal Investigator, QI-Bench](https://reader035.vdocuments.us/reader035/viewer/2022070415/56814ef8550346895dbc8a08/html5/thumbnails/25.jpg)
2525
![Page 26: Program Update November 8, 2012 Andrew J. Buckler, MS Principal Investigator, QI-Bench](https://reader035.vdocuments.us/reader035/viewer/2022070415/56814ef8550346895dbc8a08/html5/thumbnails/26.jpg)
Value proposition of QI-Bench• Efficiently collect and exploit evidence establishing
standards for optimized quantitative imaging:– Users want confidence in the read-outs– Pharma wants to use them as endpoints– Device/SW companies want to market products that produce them
without huge costs– Public wants to trust the decisions that they contribute to
• By providing a verification framework to develop precompetitive specifications and support test harnesses to curate and utilize reference data
• Doing so as an accessible and open resource facilitates collaboration among diverse stakeholders
2626
![Page 27: Program Update November 8, 2012 Andrew J. Buckler, MS Principal Investigator, QI-Bench](https://reader035.vdocuments.us/reader035/viewer/2022070415/56814ef8550346895dbc8a08/html5/thumbnails/27.jpg)
Summary:QI-Bench Contributions• We make it practical to increase the magnitude of data for increased
statistical significance. • We provide practical means to grapple with massive data sets.• We address the problem of efficient use of resources to assess limits of
generalizability. • We make formal specification accessible to diverse groups of experts that are
not skilled or interested in knowledge engineering. • We map both medical as well as technical domain expertise into
representations well suited to emerging capabilities of the semantic web. • We enable a mechanism to assess compliance with standards or
requirements within specific contexts for use.• We take a “toolbox” approach to statistical analysis. • We provide the capability in a manner which is accessible to varying levels of
collaborative models, from individual companies or institutions to larger consortia or public-private partnerships to fully open public access.
2727
![Page 28: Program Update November 8, 2012 Andrew J. Buckler, MS Principal Investigator, QI-Bench](https://reader035.vdocuments.us/reader035/viewer/2022070415/56814ef8550346895dbc8a08/html5/thumbnails/28.jpg)
QI-BenchStructure / Acknowledgements• Prime: BBMSC (Andrew Buckler, Gary Wernsing, Mike Sperling, Matt Ouellette, Kjell Johnson, Jovanna
Danagoulian)
• Co-Investigators– Kitware (Rick Avila, Patrick Reynolds, Julien Jomier, Mike Grauer)– Stanford (David Paik)
• Financial support as well as technical content: NIST (Mary Brady, Alden Dima, John Lu)
• Collaborators / Colleagues / Idea Contributors– Georgetown (Baris Suzek)– FDA (Nick Petrick, Marios Gavrielides) – UMD (Eliot Siegel, Joe Chen, Ganesh Saiprasad, Yelena Yesha)– Northwestern (Pat Mongkolwat)– UCLA (Grace Kim)– VUmc (Otto Hoekstra)
• Industry– Pharma: Novartis (Stefan Baumann), Merck (Richard Baumgartner)– Device/Software: Definiens, Median, Intio, GE, Siemens, Mevis, Claron Technologies, …
• Coordinating Programs– RSNA QIBA (e.g., Dan Sullivan, Binsheng Zhao)– Under consideration: CTMM TraIT (Andre Dekker, Jeroen Belien)
2828