exploring connectivity of the brain’s white matter with dynamic queries
DESCRIPTION
Exploring Connectivity of the Brain’s White Matter with Dynamic Queries. Anthony Sherbondy, David Akers, Rachel Mackenzie, Robert Dougherty, and Brian Wandell. IEEE Transactions on Visualization and Computer Graphics, V11, No 4, July/August 2005. Presented by: Eugene (Austin) Stoudenmire - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/1.jpg)
Exploring Connectivity of the Brain’s White Matter with Dynamic Queries
Presented by:Eugene (Austin) Stoudenmire
14 Feb 2007
Anthony Sherbondy, David Akers, Rachel Mackenzie, Robert Dougherty, and Brian Wandell
IEEE Transactions on Visualization and Computer Graphics, V11, No 4, July/August 2005
![Page 2: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/2.jpg)
Problem
• New technology emerged–Diffusion Tensor Imaging (DTI)
–White matter connections, i.e. fiber tracts, can now be measured
• Need to take advantage of it
• Requires better visualization
![Page 3: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/3.jpg)
We Care• Better visualization would
–Assist research–Interactive
![Page 4: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/4.jpg)
Approach• Combine types of data
–Anatomical – White – DTI–Functional – Gray – fMRI
• Functional Magnetic Resonance Imaging
• Precompute• Query Interface
–Pictoral–Labeled–Ranges
![Page 5: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/5.jpg)
DTI
• Diffusion Tensor Imaging• New Technology• Measures white matter pathways• Estimates water molecule diffusion
–Water diffuses lengthwise along axons–Diffusion direction nerve fiber
orientation
![Page 6: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/6.jpg)
One Method of DTI Visualization
• MR Tractography
• Traces principle direction of diffusion
• Connects points into fiber tracts
• Fiber tracts = pathways
• Anatomical connections between endpoints of the pathways are implied
• Therefore, implied white matter structure
![Page 7: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/7.jpg)
These Pathways
• Not individual nerves
• Not Bundles
• But something
• Abstract, white matter route “possibilities”
![Page 8: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/8.jpg)
fMRI
• Functional Magnetic Res Imaging
• Correlate activity
• Suggests gray matter connections
![Page 9: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/9.jpg)
The Combination• Take the MR Tractography data
• Precompute paths, statistical properties
• Interactive manipulation– Regions of interest – Box / Ellipsoid
– Path properties – Length / Curvature
• Combine with fMRI– Search for anatomical paths that might
connect functionally-defined regions
• Saves time over existing approaches
![Page 10: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/10.jpg)
Query Interface
![Page 11: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/11.jpg)
Query Interface – Partial Blowup
![Page 12: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/12.jpg)
Query Interface – Partial Blowup
![Page 13: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/13.jpg)
Query Interface – Partial Blowup
![Page 14: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/14.jpg)
Query Interface – Partial Blowup
![Page 15: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/15.jpg)
Acqusition
DTI & fMRI
![Page 16: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/16.jpg)
Subject
• Neurologically Normal• Male• Human• 35
![Page 17: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/17.jpg)
DTI• Eight 3-minute whole brain scans
–Averaged–38 axial slices–2 x 2 x 3 mm voxels
• 8-minute high res anat images–1 x 1 x 1 mm voxel
• Coregistered• DTI resampled to 2 mm
![Page 18: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/18.jpg)
fMRI
• 21-30 obliquely oriented slices• 2 x 2 x 3 mm voxel• Registered with anatomy• Mapped to cortical surface mesh
![Page 19: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/19.jpg)
Precomputation
![Page 20: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/20.jpg)
Fractional Anisotropy (FA)• Diffusion orientation ratio
0 = spherical = gray matter0.5 = linear or planar ellipsoid1 = very linear
• Uses–Algorithm termination criteria–Queries–Navigational aid
![Page 21: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/21.jpg)
Approaches• Typical
–Interactively trace pathways
• Authors’–Precompute pathways–Over entire white matter–Then let software “prune”
![Page 22: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/22.jpg)
Cortical Surface• Classified white matter • Semi-manually – neuroscientist• Marching-Cubes -> t-mesh• Smoothed• Kept both• 230,000 vertices
![Page 23: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/23.jpg)
Precomputation• Statistical properties• Length• Avg FA• Avg Curvature• Tractography Algorithm
![Page 24: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/24.jpg)
Implementation
![Page 25: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/25.jpg)
Path Rendering• Lines vs streamtubes (for speed)• Pathways – luminance offset• Groups of pathways – hue
–User defined hue–Virtual staining
• Queries modified – stains remain
![Page 26: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/26.jpg)
Hardware/Software• Visualization C++• ToolKit (VTK)• RAPID
–Fast VOI / Path Intersection Comp–80K-120K paths/sec (w/SGI RE)–Allowed 3-8
• 510MB for 26K paths @ 20KB/path• 160MB for cortical meshes
![Page 27: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/27.jpg)
Sequential Dynamic Queries
![Page 28: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/28.jpg)
All 13,000 Pathways
![Page 29: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/29.jpg)
Length > 4 cm
![Page 30: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/30.jpg)
Through VOI 1
![Page 31: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/31.jpg)
Through VOI 1 AND (2 or 3)
![Page 32: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/32.jpg)
Volumes of Interest
Surface-constrained
![Page 33: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/33.jpg)
VOI on Cortical Surface
![Page 34: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/34.jpg)
Same VOI, Smoothed Surface
![Page 35: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/35.jpg)
Validation of Known Pathways
![Page 36: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/36.jpg)
Occipital Lobe
![Page 37: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/37.jpg)
Occipital to Right Frontal Lobe
![Page 38: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/38.jpg)
Occipital to Left Frontal Lobe
![Page 39: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/39.jpg)
Occipital to R & L, w/Context
![Page 40: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/40.jpg)
Forming Hypotheses
![Page 41: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/41.jpg)
Known and Unknown Paths
![Page 42: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/42.jpg)
Algorithm Comparison
STT – Streamlines Tracking TechniquesVs
TEND – Tensor Deflection
![Page 43: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/43.jpg)
STT (blue) vs TEND (yellow)
![Page 44: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/44.jpg)
Exploration of Connections
Between Functional Areas
![Page 45: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/45.jpg)
fMRI Areas Colormapped
![Page 46: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/46.jpg)
VOI Placement
![Page 47: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/47.jpg)
Surface Removed Paths Visible
![Page 48: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/48.jpg)
VOI Adjusted Different Paths
![Page 49: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/49.jpg)
Evaluation• Types of functions
–Validation of known pathways
–Hypothesis generation
• Time to explore – 10 minutes for significant exploration
• Speed – Interactive rates
• Interface – Interactive queries
![Page 50: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/50.jpg)
Alternative Methods
![Page 51: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/51.jpg)
Alternative Methods
• Diffusion tensor visualization
![Page 52: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/52.jpg)
White Matter Algorithms
• Streamlines Tracking Techniques
• Fiber Assg thru Cont Tracking
• Tensor-deflection
![Page 53: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/53.jpg)
Filters
• Length
• Average linear anisotropy
• Regions of interest
![Page 54: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/54.jpg)
Conclusion
• Multiple data types (DTI & fMRI)• New visualization interface• Interactive queries• Hypothesis generation & testing
![Page 55: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/55.jpg)
Next Steps
• Real work• Multiple subjects• Normal to abnormal• Acquisition technology• Path tracing algorithms
![Page 56: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/56.jpg)
Question
• Is there any reason for tools such as this to be validated?
![Page 57: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/57.jpg)
Question
• If validated this early on, wouldn’t every change pretty much negate the validation?
![Page 58: Exploring Connectivity of the Brain’s White Matter with Dynamic Queries](https://reader034.vdocuments.us/reader034/viewer/2022051517/5681512f550346895dbf4b0f/html5/thumbnails/58.jpg)
Question
• Should there be some kind of benchmark to use to measure these applications against?