![Page 1: Bill Hoffman, Jesus Caban, Brad Lowkamp, Dan Muller, Fabrice de Chaumont, Julien Michel, Harvey Cline, Gabe Hart, Ghassam Hamarech, John Galeotti, Raghu](https://reader036.vdocuments.us/reader036/viewer/2022062302/5a4d1b767f8b9ab0599b764d/html5/thumbnails/1.jpg)
Bill Hoffman, Jesus Caban, Brad Lowkamp, Dan Muller, Fabrice de Chaumont, Julien Michel,
Harvey Cline, Gabe Hart, Ghassam Hamarech, John Galeotti, Raghu Machiraju, Hans Johnson,
Wes Turner, Luis Ibanez, Terry Yoo, Daniel Blezek
SimpleITK Status
![Page 2: Bill Hoffman, Jesus Caban, Brad Lowkamp, Dan Muller, Fabrice de Chaumont, Julien Michel, Harvey Cline, Gabe Hart, Ghassam Hamarech, John Galeotti, Raghu](https://reader036.vdocuments.us/reader036/viewer/2022062302/5a4d1b767f8b9ab0599b764d/html5/thumbnails/2.jpg)
Problem
2
![Page 3: Bill Hoffman, Jesus Caban, Brad Lowkamp, Dan Muller, Fabrice de Chaumont, Julien Michel, Harvey Cline, Gabe Hart, Ghassam Hamarech, John Galeotti, Raghu](https://reader036.vdocuments.us/reader036/viewer/2022062302/5a4d1b767f8b9ab0599b764d/html5/thumbnails/3.jpg)
Problem
• Doxygen for itk::Image• 42 pages long
3
![Page 4: Bill Hoffman, Jesus Caban, Brad Lowkamp, Dan Muller, Fabrice de Chaumont, Julien Michel, Harvey Cline, Gabe Hart, Ghassam Hamarech, John Galeotti, Raghu](https://reader036.vdocuments.us/reader036/viewer/2022062302/5a4d1b767f8b9ab0599b764d/html5/thumbnails/4.jpg)
Complexity
• Powerful but complex• Steep learning curve
• ever had 2 pages of compile errors?• Mainly C++• ITK often unused
• But it’s the best...
4
![Page 5: Bill Hoffman, Jesus Caban, Brad Lowkamp, Dan Muller, Fabrice de Chaumont, Julien Michel, Harvey Cline, Gabe Hart, Ghassam Hamarech, John Galeotti, Raghu](https://reader036.vdocuments.us/reader036/viewer/2022062302/5a4d1b767f8b9ab0599b764d/html5/thumbnails/5.jpg)
Audience
• Students• Grad students• Researchers
• Microscopy• Computer vision• Remote sensing
• Application developers
5
![Page 6: Bill Hoffman, Jesus Caban, Brad Lowkamp, Dan Muller, Fabrice de Chaumont, Julien Michel, Harvey Cline, Gabe Hart, Ghassam Hamarech, John Galeotti, Raghu](https://reader036.vdocuments.us/reader036/viewer/2022062302/5a4d1b767f8b9ab0599b764d/html5/thumbnails/6.jpg)
Simplify
• As simple as possible• But no simpler• Simple for:
• users• application developers• developers
6
![Page 7: Bill Hoffman, Jesus Caban, Brad Lowkamp, Dan Muller, Fabrice de Chaumont, Julien Michel, Harvey Cline, Gabe Hart, Ghassam Hamarech, John Galeotti, Raghu](https://reader036.vdocuments.us/reader036/viewer/2022062302/5a4d1b767f8b9ab0599b764d/html5/thumbnails/7.jpg)
Goals
• Simple• “On ramp”• Wrapping• Integration
• In apps• With ITK, VTK, etc
• Extensible
7
![Page 8: Bill Hoffman, Jesus Caban, Brad Lowkamp, Dan Muller, Fabrice de Chaumont, Julien Michel, Harvey Cline, Gabe Hart, Ghassam Hamarech, John Galeotti, Raghu](https://reader036.vdocuments.us/reader036/viewer/2022062302/5a4d1b767f8b9ab0599b764d/html5/thumbnails/8.jpg)
Survey Says!
• 214 respondents• Takeaways
• Compiled packages• 3D & 4D• Out of core processing• Object model• char, short, float/double, vector• Visualization
8
Gabe Hart
![Page 9: Bill Hoffman, Jesus Caban, Brad Lowkamp, Dan Muller, Fabrice de Chaumont, Julien Michel, Harvey Cline, Gabe Hart, Ghassam Hamarech, John Galeotti, Raghu](https://reader036.vdocuments.us/reader036/viewer/2022062302/5a4d1b767f8b9ab0599b764d/html5/thumbnails/9.jpg)
Decisions
• API• Datatypes• Dimensionality• Pipeline?• Out of core processing• Wrapping• Distribution
9
![Page 10: Bill Hoffman, Jesus Caban, Brad Lowkamp, Dan Muller, Fabrice de Chaumont, Julien Michel, Harvey Cline, Gabe Hart, Ghassam Hamarech, John Galeotti, Raghu](https://reader036.vdocuments.us/reader036/viewer/2022062302/5a4d1b767f8b9ab0599b764d/html5/thumbnails/10.jpg)
Strawman Proposal
• Object model• 3D images (& slice-by-slice for 2D)
• 4D as vector of images• char, short, float (double?)
• No exposed pipeline• Out of core orchestration framework
• VOI readers/writers• Call list of filters / handle boundaries
• SWIG wrapping10
![Page 11: Bill Hoffman, Jesus Caban, Brad Lowkamp, Dan Muller, Fabrice de Chaumont, Julien Michel, Harvey Cline, Gabe Hart, Ghassam Hamarech, John Galeotti, Raghu](https://reader036.vdocuments.us/reader036/viewer/2022062302/5a4d1b767f8b9ab0599b764d/html5/thumbnails/11.jpg)
API
• Procedural / functional?
11
![Page 12: Bill Hoffman, Jesus Caban, Brad Lowkamp, Dan Muller, Fabrice de Chaumont, Julien Michel, Harvey Cline, Gabe Hart, Ghassam Hamarech, John Galeotti, Raghu](https://reader036.vdocuments.us/reader036/viewer/2022062302/5a4d1b767f8b9ab0599b764d/html5/thumbnails/12.jpg)
Data types
• Which to support?• Scalar in all filters?• Vector in limited set?
• How to support?• Dynamic loading?• Compile time configured?• Template meta programming?• Macros?
12
![Page 13: Bill Hoffman, Jesus Caban, Brad Lowkamp, Dan Muller, Fabrice de Chaumont, Julien Michel, Harvey Cline, Gabe Hart, Ghassam Hamarech, John Galeotti, Raghu](https://reader036.vdocuments.us/reader036/viewer/2022062302/5a4d1b767f8b9ab0599b764d/html5/thumbnails/13.jpg)
Dimensionality
• 3D critical• 4D nice• How to support?
• 4D == 4D itk::Image?• 4D == vector of 3D images?• 4D == 3D with vector pixels?
13
![Page 14: Bill Hoffman, Jesus Caban, Brad Lowkamp, Dan Muller, Fabrice de Chaumont, Julien Michel, Harvey Cline, Gabe Hart, Ghassam Hamarech, John Galeotti, Raghu](https://reader036.vdocuments.us/reader036/viewer/2022062302/5a4d1b767f8b9ab0599b764d/html5/thumbnails/14.jpg)
Pipeline
• Unnecessary complexity• Utility in streaming
• Not (fully) implemented in ITK
14
![Page 15: Bill Hoffman, Jesus Caban, Brad Lowkamp, Dan Muller, Fabrice de Chaumont, Julien Michel, Harvey Cline, Gabe Hart, Ghassam Hamarech, John Galeotti, Raghu](https://reader036.vdocuments.us/reader036/viewer/2022062302/5a4d1b767f8b9ab0599b764d/html5/thumbnails/15.jpg)
Out of core processing
• Essential• ITK Pipeline?• OpenCL model?
• single pixel kernel pixel• called for all pixels• “orchestration” framework
15
![Page 16: Bill Hoffman, Jesus Caban, Brad Lowkamp, Dan Muller, Fabrice de Chaumont, Julien Michel, Harvey Cline, Gabe Hart, Ghassam Hamarech, John Galeotti, Raghu](https://reader036.vdocuments.us/reader036/viewer/2022062302/5a4d1b767f8b9ab0599b764d/html5/thumbnails/16.jpg)
Wrapping
• SWIG• Languages
• Matlab• Python• Java• C#• Others: Tcl, R, Perl, Ruby...
• Interact with WrapITK nice to have16
![Page 17: Bill Hoffman, Jesus Caban, Brad Lowkamp, Dan Muller, Fabrice de Chaumont, Julien Michel, Harvey Cline, Gabe Hart, Ghassam Hamarech, John Galeotti, Raghu](https://reader036.vdocuments.us/reader036/viewer/2022062302/5a4d1b767f8b9ab0599b764d/html5/thumbnails/17.jpg)
Distribution
• Binary• Matlab (somehow)• Python egg• Java jar• C++ lib/dll/so & include
• Source• Less useful
17
![Page 18: Bill Hoffman, Jesus Caban, Brad Lowkamp, Dan Muller, Fabrice de Chaumont, Julien Michel, Harvey Cline, Gabe Hart, Ghassam Hamarech, John Galeotti, Raghu](https://reader036.vdocuments.us/reader036/viewer/2022062302/5a4d1b767f8b9ab0599b764d/html5/thumbnails/18.jpg)
Bill Hoffman, Jesus Caban, Brad Lowkamp, Dan Muller, Fabrice de Chaumont, Julien Michel,
Harvey Cline, Gabe Hart, Ghassam Hamarech, John Galeotti, Raghu Machiraju, Hans Johnson,
Wes Turner, Luis Ibanez, Terry Yoo, Daniel Blezek
SimpleITK Status