Download - Hongen Liao, Takashi Inomata, Ichiro Sakuma and Takeyoshi Dohi Presented by Zhenzhou Shao
![Page 1: Hongen Liao, Takashi Inomata, Ichiro Sakuma and Takeyoshi Dohi Presented by Zhenzhou Shao](https://reader035.vdocuments.us/reader035/viewer/2022062518/56814c13550346895db912c0/html5/thumbnails/1.jpg)
3D Augmented Reality for MRI-Guided Surgery Using Integral Videography
Autostereoscopic Image OverlayHongen Liao, Takashi Inomata, Ichiro
Sakuma and Takeyoshi Dohi
Presented by Zhenzhou Shao2/24/2011
![Page 2: Hongen Liao, Takashi Inomata, Ichiro Sakuma and Takeyoshi Dohi Presented by Zhenzhou Shao](https://reader035.vdocuments.us/reader035/viewer/2022062518/56814c13550346895db912c0/html5/thumbnails/2.jpg)
Outline• Introduction• Material and Methods
– System Configuration– IV Image Display and Overlay Device– Registration of Spatial 3D Image in Patient– Software Alignment– Surgical Procedure
• Experiment and Results• Conclusion
![Page 3: Hongen Liao, Takashi Inomata, Ichiro Sakuma and Takeyoshi Dohi Presented by Zhenzhou Shao](https://reader035.vdocuments.us/reader035/viewer/2022062518/56814c13550346895db912c0/html5/thumbnails/3.jpg)
Introduction
• Magnetic resonance imaging (MRI)– A medical imaging technique– Provides detailed information about soft tissue.
![Page 4: Hongen Liao, Takashi Inomata, Ichiro Sakuma and Takeyoshi Dohi Presented by Zhenzhou Shao](https://reader035.vdocuments.us/reader035/viewer/2022062518/56814c13550346895db912c0/html5/thumbnails/4.jpg)
Introduction
• Potential efficacy using MRI-guided surgery• Advantages
– Enhance the surgeon’s capability– Decrease the invasiveness of surgical procedure– Increase the accuracy and safety
• Disadvantages– Display of a set of 2D sectional images– Hand–eye coordination problem
![Page 5: Hongen Liao, Takashi Inomata, Ichiro Sakuma and Takeyoshi Dohi Presented by Zhenzhou Shao](https://reader035.vdocuments.us/reader035/viewer/2022062518/56814c13550346895db912c0/html5/thumbnails/5.jpg)
Introduction
• Augmented Reality (AR)– Superimpose the virtual model into the real scene.– Video see-through AR
• Head mounted display (HMD)• Limited field of view• A lag for motion parallax• Cannot provide a natural view for multiple observers
![Page 6: Hongen Liao, Takashi Inomata, Ichiro Sakuma and Takeyoshi Dohi Presented by Zhenzhou Shao](https://reader035.vdocuments.us/reader035/viewer/2022062518/56814c13550346895db912c0/html5/thumbnails/6.jpg)
Introduction
• Optical see-through AR– Using a semi-transparent mirror for merging
virtual model with a direct view.– Surgeon can see through the body.– Enhance the surgeon’s ability to perform a complex procedure.– Depth information is required.
![Page 7: Hongen Liao, Takashi Inomata, Ichiro Sakuma and Takeyoshi Dohi Presented by Zhenzhou Shao](https://reader035.vdocuments.us/reader035/viewer/2022062518/56814c13550346895db912c0/html5/thumbnails/7.jpg)
Introduction
• Integral Videography(IV)
![Page 8: Hongen Liao, Takashi Inomata, Ichiro Sakuma and Takeyoshi Dohi Presented by Zhenzhou Shao](https://reader035.vdocuments.us/reader035/viewer/2022062518/56814c13550346895db912c0/html5/thumbnails/8.jpg)
System Configuration
![Page 9: Hongen Liao, Takashi Inomata, Ichiro Sakuma and Takeyoshi Dohi Presented by Zhenzhou Shao](https://reader035.vdocuments.us/reader035/viewer/2022062518/56814c13550346895db912c0/html5/thumbnails/9.jpg)
IV Image and Overlay Device
![Page 10: Hongen Liao, Takashi Inomata, Ichiro Sakuma and Takeyoshi Dohi Presented by Zhenzhou Shao](https://reader035.vdocuments.us/reader035/viewer/2022062518/56814c13550346895db912c0/html5/thumbnails/10.jpg)
Registration of 3D Image in Patient
![Page 11: Hongen Liao, Takashi Inomata, Ichiro Sakuma and Takeyoshi Dohi Presented by Zhenzhou Shao](https://reader035.vdocuments.us/reader035/viewer/2022062518/56814c13550346895db912c0/html5/thumbnails/11.jpg)
Registration of 3D Image in Patient
![Page 12: Hongen Liao, Takashi Inomata, Ichiro Sakuma and Takeyoshi Dohi Presented by Zhenzhou Shao](https://reader035.vdocuments.us/reader035/viewer/2022062518/56814c13550346895db912c0/html5/thumbnails/12.jpg)
Registration of 3D Image in Patient
![Page 13: Hongen Liao, Takashi Inomata, Ichiro Sakuma and Takeyoshi Dohi Presented by Zhenzhou Shao](https://reader035.vdocuments.us/reader035/viewer/2022062518/56814c13550346895db912c0/html5/thumbnails/13.jpg)
Registration of 3D Image in Patient
![Page 14: Hongen Liao, Takashi Inomata, Ichiro Sakuma and Takeyoshi Dohi Presented by Zhenzhou Shao](https://reader035.vdocuments.us/reader035/viewer/2022062518/56814c13550346895db912c0/html5/thumbnails/14.jpg)
Software Alignment
![Page 15: Hongen Liao, Takashi Inomata, Ichiro Sakuma and Takeyoshi Dohi Presented by Zhenzhou Shao](https://reader035.vdocuments.us/reader035/viewer/2022062518/56814c13550346895db912c0/html5/thumbnails/15.jpg)
Surgical Procedure
• Calibrate the position of reflected IV image;• Place sterile fiducial markers on the surface of
the patient’s body and scan the target area;• Segment the target of interest and markers
from the MRI data. Perform patient-to-image registration to find the ;
![Page 16: Hongen Liao, Takashi Inomata, Ichiro Sakuma and Takeyoshi Dohi Presented by Zhenzhou Shao](https://reader035.vdocuments.us/reader035/viewer/2022062518/56814c13550346895db912c0/html5/thumbnails/16.jpg)
Surgical Procedure
• Render the IV images and transfer them to the overlay device;
• Perform the surgical treatment under the guidance of IV image overlay;
• After finishing the treatment, translate the patient into the scanner again and confirm surgical result.
![Page 17: Hongen Liao, Takashi Inomata, Ichiro Sakuma and Takeyoshi Dohi Presented by Zhenzhou Shao](https://reader035.vdocuments.us/reader035/viewer/2022062518/56814c13550346895db912c0/html5/thumbnails/17.jpg)
Experiment and Results
• Accuracy measurement– Implemented by using markers in a phantom
simulating the human head.
![Page 18: Hongen Liao, Takashi Inomata, Ichiro Sakuma and Takeyoshi Dohi Presented by Zhenzhou Shao](https://reader035.vdocuments.us/reader035/viewer/2022062518/56814c13550346895db912c0/html5/thumbnails/18.jpg)
Accuracy measurement
– Five markers for registration and two for error measurement.
– Marker: 10 mm in external diameter and 3 mm in internal diameter.
– The distance between the center of the actual marker and that of the spatial projected IV marker was measured as an overlay error.
– The mean value of the error was 0.90 mm, and the standard deviation was 0.21 mm
![Page 19: Hongen Liao, Takashi Inomata, Ichiro Sakuma and Takeyoshi Dohi Presented by Zhenzhou Shao](https://reader035.vdocuments.us/reader035/viewer/2022062518/56814c13550346895db912c0/html5/thumbnails/19.jpg)
Targeting Experiment
• Compare the procedure time and success rate of targeting an object using 2-D image guidance and IV overlay system guidance.
• Phantom consisted of a plastic cube container filled with an agar.
![Page 20: Hongen Liao, Takashi Inomata, Ichiro Sakuma and Takeyoshi Dohi Presented by Zhenzhou Shao](https://reader035.vdocuments.us/reader035/viewer/2022062518/56814c13550346895db912c0/html5/thumbnails/20.jpg)
Targeting Experiment
• Six MRI markers were attached.• Three sets of acrylic cylinders with diameters of 1.5, 2 and 3 mm were embedded within the phantom.
![Page 21: Hongen Liao, Takashi Inomata, Ichiro Sakuma and Takeyoshi Dohi Presented by Zhenzhou Shao](https://reader035.vdocuments.us/reader035/viewer/2022062518/56814c13550346895db912c0/html5/thumbnails/21.jpg)
2-D image guidance
![Page 22: Hongen Liao, Takashi Inomata, Ichiro Sakuma and Takeyoshi Dohi Presented by Zhenzhou Shao](https://reader035.vdocuments.us/reader035/viewer/2022062518/56814c13550346895db912c0/html5/thumbnails/22.jpg)
IV overlay system guidance
![Page 23: Hongen Liao, Takashi Inomata, Ichiro Sakuma and Takeyoshi Dohi Presented by Zhenzhou Shao](https://reader035.vdocuments.us/reader035/viewer/2022062518/56814c13550346895db912c0/html5/thumbnails/23.jpg)
Results of guidance
2-D image guidance
IV overlay system guidance
![Page 24: Hongen Liao, Takashi Inomata, Ichiro Sakuma and Takeyoshi Dohi Presented by Zhenzhou Shao](https://reader035.vdocuments.us/reader035/viewer/2022062518/56814c13550346895db912c0/html5/thumbnails/24.jpg)
Comparison of procedure time
![Page 25: Hongen Liao, Takashi Inomata, Ichiro Sakuma and Takeyoshi Dohi Presented by Zhenzhou Shao](https://reader035.vdocuments.us/reader035/viewer/2022062518/56814c13550346895db912c0/html5/thumbnails/25.jpg)
Feasibility Evaluation
• Evaluate the feasibility by a volunteer test.• Scan brain using MRI.• Motion parallax could be generated due to
the motion of an observer.• The motion parallax of IV autostereoscopic
brain images combined with the volunteer’s head was taken from various directions.
![Page 26: Hongen Liao, Takashi Inomata, Ichiro Sakuma and Takeyoshi Dohi Presented by Zhenzhou Shao](https://reader035.vdocuments.us/reader035/viewer/2022062518/56814c13550346895db912c0/html5/thumbnails/26.jpg)
Feasibility Evaluation
![Page 27: Hongen Liao, Takashi Inomata, Ichiro Sakuma and Takeyoshi Dohi Presented by Zhenzhou Shao](https://reader035.vdocuments.us/reader035/viewer/2022062518/56814c13550346895db912c0/html5/thumbnails/27.jpg)
In Vivo Animal Experiment
• Target a pig’s gallbladder.• A set of markers was attached to the skin of
the surgical area.
![Page 28: Hongen Liao, Takashi Inomata, Ichiro Sakuma and Takeyoshi Dohi Presented by Zhenzhou Shao](https://reader035.vdocuments.us/reader035/viewer/2022062518/56814c13550346895db912c0/html5/thumbnails/28.jpg)
In Vivo Animal Experiment• Surgical planning to minimizing the surgical
exposure.• Surgical instrument is tracked.• The targeting experiment was performed by a
medical doctor.
![Page 29: Hongen Liao, Takashi Inomata, Ichiro Sakuma and Takeyoshi Dohi Presented by Zhenzhou Shao](https://reader035.vdocuments.us/reader035/viewer/2022062518/56814c13550346895db912c0/html5/thumbnails/29.jpg)
Conclusion• An autostereoscopic image overlay system for MRI-
guided surgery is developed. • IV is employed to provide accurate 3-D spatial images
and reproduces motion.• A fast and accurate spatial image registration method
was developed.• Safe, easy, and accurate surgical diagnosis and therapy.
![Page 30: Hongen Liao, Takashi Inomata, Ichiro Sakuma and Takeyoshi Dohi Presented by Zhenzhou Shao](https://reader035.vdocuments.us/reader035/viewer/2022062518/56814c13550346895db912c0/html5/thumbnails/30.jpg)
• Questions?