shape modeling in cellorganizer€¦ · shape modeling in cellorganizer robert f. murphy ray &...
TRANSCRIPT
![Page 1: Shape Modeling in CellOrganizer€¦ · Shape Modeling in CellOrganizer Robert F. Murphy Ray & Stephanie Lane Professor of Computational Biology and Professor of Biological Sciences,](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f9269ba96a8ce1d971663e7/html5/thumbnails/1.jpg)
ShapeModelinginCellOrganizerRobertF.Murphy
Ray & Stephanie Lane Professor of Computational Biology and Professor of Biological Sciences, Biomedical Engineering and Machine Learning
External Senior Fellow, Freiburg Institute for Advanced Studies Honorary Professor, Faculty of Biology, University of Freiburg, Germany
AnNIHBiomedicalTechnologyResearchCenter
March9,2018
![Page 2: Shape Modeling in CellOrganizer€¦ · Shape Modeling in CellOrganizer Robert F. Murphy Ray & Stephanie Lane Professor of Computational Biology and Professor of Biological Sciences,](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f9269ba96a8ce1d971663e7/html5/thumbnails/2.jpg)
Methodsformodelingcellshape• Parametric
– Outline– Ratio-metricrelativetonuclearshape
• Nonparametric– Diffeomorphic– Autoencoder
![Page 3: Shape Modeling in CellOrganizer€¦ · Shape Modeling in CellOrganizer Robert F. Murphy Ray & Stephanie Lane Professor of Computational Biology and Professor of Biological Sciences,](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f9269ba96a8ce1d971663e7/html5/thumbnails/3.jpg)
Parametricshapeoutlinemodels
Kerenetal.
2008
Imagessh
owing
realsh
apes
Gene
rativ
e
shapemod
el
![Page 4: Shape Modeling in CellOrganizer€¦ · Shape Modeling in CellOrganizer Robert F. Murphy Ray & Stephanie Lane Professor of Computational Biology and Professor of Biological Sciences,](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f9269ba96a8ce1d971663e7/html5/thumbnails/4.jpg)
Shapespace
Kerenetal.2008
![Page 5: Shape Modeling in CellOrganizer€¦ · Shape Modeling in CellOrganizer Robert F. Murphy Ray & Stephanie Lane Professor of Computational Biology and Professor of Biological Sciences,](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f9269ba96a8ce1d971663e7/html5/thumbnails/5.jpg)
Limitationsofcommonoutlinemodel
Srivastavaet
al.2005
![Page 6: Shape Modeling in CellOrganizer€¦ · Shape Modeling in CellOrganizer Robert F. Murphy Ray & Stephanie Lane Professor of Computational Biology and Professor of Biological Sciences,](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f9269ba96a8ce1d971663e7/html5/thumbnails/6.jpg)
Cell shape: eigenshape ratio model
• Conditionedonnuclearshape:– Sampleevenlyaroundacircletorepresenttheshapebyradiusratios
– Parameterization
– Keep10principalcomponents(2D)– Keep25principalcomponents(3D)
1 2/r d d=
∑ =+≈
k
i iib1 φrr d1 d2
![Page 7: Shape Modeling in CellOrganizer€¦ · Shape Modeling in CellOrganizer Robert F. Murphy Ray & Stephanie Lane Professor of Computational Biology and Professor of Biological Sciences,](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f9269ba96a8ce1d971663e7/html5/thumbnails/7.jpg)
However…• Cellsdon’talwayssatisfyassumptionsofparametricmodels.
SegmentedPC12cell Star-polygonratiomodelrepresentation
![Page 8: Shape Modeling in CellOrganizer€¦ · Shape Modeling in CellOrganizer Robert F. Murphy Ray & Stephanie Lane Professor of Computational Biology and Professor of Biological Sciences,](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f9269ba96a8ce1d971663e7/html5/thumbnails/8.jpg)
LDDMM-LargeDeformationDiffeomorphicMetricMapping
![Page 9: Shape Modeling in CellOrganizer€¦ · Shape Modeling in CellOrganizer Robert F. Murphy Ray & Stephanie Lane Professor of Computational Biology and Professor of Biological Sciences,](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f9269ba96a8ce1d971663e7/html5/thumbnails/9.jpg)
Whatisadiffeomorphism?• Essentiallyasmoothandinvertiblemappingfromonecoordinatespacetoanother
Adiffeomorphicmappingfromaregularrectangulargrid.
https://en.wikipedia.org/wiki/Diffeomorphism
Diffeomorphicmappingsofcontinentstoa2Dprojectionofaglobe
http://wwwx.cs.unc.edu/~mn/classes/comp875/doc/diffeomorphisms.pdf
![Page 10: Shape Modeling in CellOrganizer€¦ · Shape Modeling in CellOrganizer Robert F. Murphy Ray & Stephanie Lane Professor of Computational Biology and Professor of Biological Sciences,](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f9269ba96a8ce1d971663e7/html5/thumbnails/10.jpg)
Adiffeomorphicmappingfromoneimagetoanother.http://wwwx.cs.unc.edu/~mn/classes/comp875/doc/diffeomorphisms.pdf
![Page 11: Shape Modeling in CellOrganizer€¦ · Shape Modeling in CellOrganizer Robert F. Murphy Ray & Stephanie Lane Professor of Computational Biology and Professor of Biological Sciences,](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f9269ba96a8ce1d971663e7/html5/thumbnails/11.jpg)
Nonparametricshapeimage-basedmodels
Pengetal.2009
Real2Dnuclearshapes
http://alumni.media.mit.edu/~maov/classes/comp_photo_vision08f/
Cannotjustinterpolateimagesasiftheywerevectors
![Page 12: Shape Modeling in CellOrganizer€¦ · Shape Modeling in CellOrganizer Robert F. Murphy Ray & Stephanie Lane Professor of Computational Biology and Professor of Biological Sciences,](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f9269ba96a8ce1d971663e7/html5/thumbnails/12.jpg)
Morphingtointerpolateimages
12http://alumni.media.mit.edu/~maov/classes/comp_photo_vision08f/
![Page 13: Shape Modeling in CellOrganizer€¦ · Shape Modeling in CellOrganizer Robert F. Murphy Ray & Stephanie Lane Professor of Computational Biology and Professor of Biological Sciences,](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f9269ba96a8ce1d971663e7/html5/thumbnails/13.jpg)
ShapeBShapeAWorksofar
0.0191
Distancebetweentwoshapes
0.01650 0.0194 0.0195
Distance
Pengeta
l.2009
0.01650 0.0191 0.0194 0.0195
Distance
IterativereductionindifferencebetweendeformedshapeAandB
![Page 14: Shape Modeling in CellOrganizer€¦ · Shape Modeling in CellOrganizer Robert F. Murphy Ray & Stephanie Lane Professor of Computational Biology and Professor of Biological Sciences,](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f9269ba96a8ce1d971663e7/html5/thumbnails/14.jpg)
LDDMM-LargeDeformationDiffeomorphicMetricMapping
• Minimalenergytransformationwithrespecttothegradientofthedeformationfieldi.e.Geodesicdistance
• Deformationfieldisanonlinearmanifoldthatcontainstheinformationoftheimage,includinggradient,secondorderderivationetc.Theupdateisageodesicpathonthemanifold.
Shadel1974 http://wwwx.cs.unc.edu/~mn/classes/comp875/doc/diffeomorphisms.pdf
![Page 15: Shape Modeling in CellOrganizer€¦ · Shape Modeling in CellOrganizer Robert F. Murphy Ray & Stephanie Lane Professor of Computational Biology and Professor of Biological Sciences,](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f9269ba96a8ce1d971663e7/html5/thumbnails/15.jpg)
f1.png
0 0.2 0.4 0.6 0.8 1
![Page 16: Shape Modeling in CellOrganizer€¦ · Shape Modeling in CellOrganizer Robert F. Murphy Ray & Stephanie Lane Professor of Computational Biology and Professor of Biological Sciences,](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f9269ba96a8ce1d971663e7/html5/thumbnails/16.jpg)
Constructingacellshapespace• Finddistancesofeverycelltoeveryothercell
• Trytofinda“map”thatputseachcellthecorrectdistancefromtheothers(i.e.,putscellswithshortdistancesneareachother)
![Page 17: Shape Modeling in CellOrganizer€¦ · Shape Modeling in CellOrganizer Robert F. Murphy Ray & Stephanie Lane Professor of Computational Biology and Professor of Biological Sciences,](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f9269ba96a8ce1d971663e7/html5/thumbnails/17.jpg)
Distancematrix…BOS CHI DC DEN LA MIA NY SEA SF
BOS 0 963 429 1949 2979 1504 206 2976 3095CHI 963 0 671 996 2054 1329 802 2013 2142DC 429 671 0 1616 2631 1075 233 2684 2799DEN 1949 996 1616 0 1059 2037 1771 1307 1235LA 2979 2054 2631 1059 0 2687 2786 1131 379MIA 1504 1329 1075 2037 2687 0 1308 3273 3053NY 206 802 233 1771 2786 1308 0 2815 2934SEA 2976 2013 2684 1307 1131 3273 2815 0 808SF 3095 2142 2799 1235 379 3053 2934 808 0
http://personality-project.org/r/mds.html
![Page 18: Shape Modeling in CellOrganizer€¦ · Shape Modeling in CellOrganizer Robert F. Murphy Ray & Stephanie Lane Professor of Computational Biology and Professor of Biological Sciences,](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f9269ba96a8ce1d971663e7/html5/thumbnails/18.jpg)
…tocoordinates
http://personality-project.org/r/mds.html
![Page 19: Shape Modeling in CellOrganizer€¦ · Shape Modeling in CellOrganizer Robert F. Murphy Ray & Stephanie Lane Professor of Computational Biology and Professor of Biological Sciences,](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f9269ba96a8ce1d971663e7/html5/thumbnails/19.jpg)
Shapespacesmodeljointdistributionacrossmorphologicalfeatures
19
Shapespace
![Page 20: Shape Modeling in CellOrganizer€¦ · Shape Modeling in CellOrganizer Robert F. Murphy Ray & Stephanie Lane Professor of Computational Biology and Professor of Biological Sciences,](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f9269ba96a8ce1d971663e7/html5/thumbnails/20.jpg)
DiffeomorphicTraining
![Page 21: Shape Modeling in CellOrganizer€¦ · Shape Modeling in CellOrganizer Robert F. Murphy Ray & Stephanie Lane Professor of Computational Biology and Professor of Biological Sciences,](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f9269ba96a8ce1d971663e7/html5/thumbnails/21.jpg)
ShapestoSpace
MDS
Butthistakesalotoftime
![Page 22: Shape Modeling in CellOrganizer€¦ · Shape Modeling in CellOrganizer Robert F. Murphy Ray & Stephanie Lane Professor of Computational Biology and Professor of Biological Sciences,](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f9269ba96a8ce1d971663e7/html5/thumbnails/22.jpg)
PartialDistanceMatrixLearning
• Mostcompleteshapespace
MDS
![Page 23: Shape Modeling in CellOrganizer€¦ · Shape Modeling in CellOrganizer Robert F. Murphy Ray & Stephanie Lane Professor of Computational Biology and Professor of Biological Sciences,](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f9269ba96a8ce1d971663e7/html5/thumbnails/23.jpg)
ShapeSpaceEmbedding• Thisembeddingmethodrequiresallpairsofdistances• Let’ssaywehave250cellsandittakes~30sectoregisterapair• (30sec*2502)/2≈10days.Waytoolong…..• canweinferembeddingwithmissingdata?• MDSwithmissingdata
wherewi,jistheweightofobservationDi,j
![Page 24: Shape Modeling in CellOrganizer€¦ · Shape Modeling in CellOrganizer Robert F. Murphy Ray & Stephanie Lane Professor of Computational Biology and Professor of Biological Sciences,](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f9269ba96a8ce1d971663e7/html5/thumbnails/24.jpg)
PartialDistanceMatrixLearning• LandmarkMDS
?
ApproximateMDS
![Page 25: Shape Modeling in CellOrganizer€¦ · Shape Modeling in CellOrganizer Robert F. Murphy Ray & Stephanie Lane Professor of Computational Biology and Professor of Biological Sciences,](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f9269ba96a8ce1d971663e7/html5/thumbnails/25.jpg)
DiffeomorphicSynthesis
![Page 26: Shape Modeling in CellOrganizer€¦ · Shape Modeling in CellOrganizer Robert F. Murphy Ray & Stephanie Lane Professor of Computational Biology and Professor of Biological Sciences,](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f9269ba96a8ce1d971663e7/html5/thumbnails/26.jpg)
SpacetoShapes
?
Synthesisstrategyfornewpoints
![Page 27: Shape Modeling in CellOrganizer€¦ · Shape Modeling in CellOrganizer Robert F. Murphy Ray & Stephanie Lane Professor of Computational Biology and Professor of Biological Sciences,](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f9269ba96a8ce1d971663e7/html5/thumbnails/27.jpg)
Modelingthedistributionofshapes• Theshapespacedefinesanimplicitprobabilitydensity.
x
Nonparametricdensityestimation
p(x)=1/vin
Modelingdistributionofshapes–p(x)
![Page 28: Shape Modeling in CellOrganizer€¦ · Shape Modeling in CellOrganizer Robert F. Murphy Ray & Stephanie Lane Professor of Computational Biology and Professor of Biological Sciences,](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f9269ba96a8ce1d971663e7/html5/thumbnails/28.jpg)
Modelingthedistributionofshapes• Theshapespacedefinesanimplicitprobabilitydensity.
x
Nonparametricdensityestimation
p(x)=1/vin
![Page 29: Shape Modeling in CellOrganizer€¦ · Shape Modeling in CellOrganizer Robert F. Murphy Ray & Stephanie Lane Professor of Computational Biology and Professor of Biological Sciences,](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f9269ba96a8ce1d971663e7/html5/thumbnails/29.jpg)
ParametricRepresentationGaussianmixturemodel2components
Modelingdistributionofshapes–p(x)n=1 n=2
n=3 n=4
ShapespacemodeledasaGaussianMixtureModel
![Page 30: Shape Modeling in CellOrganizer€¦ · Shape Modeling in CellOrganizer Robert F. Murphy Ray & Stephanie Lane Professor of Computational Biology and Professor of Biological Sciences,](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f9269ba96a8ce1d971663e7/html5/thumbnails/30.jpg)
Diffeomorphicspace• Newfeaturespace
– Positionsinspacecorrespondtoarealimage– Featuredimensionscorrespondtodimensionswithhighesteigenvalues
– Canbetreatedexactlylikeanormalfeaturespace
![Page 31: Shape Modeling in CellOrganizer€¦ · Shape Modeling in CellOrganizer Robert F. Murphy Ray & Stephanie Lane Professor of Computational Biology and Professor of Biological Sciences,](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f9269ba96a8ce1d971663e7/html5/thumbnails/31.jpg)
HeLashapespacewithDNAintensity
Component1(R2=0.04)
Compo
nent2(R
2 =0.08)
Component3(R2=0.57)
DNAintensity
![Page 32: Shape Modeling in CellOrganizer€¦ · Shape Modeling in CellOrganizer Robert F. Murphy Ray & Stephanie Lane Professor of Computational Biology and Professor of Biological Sciences,](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f9269ba96a8ce1d971663e7/html5/thumbnails/32.jpg)
Docellandnuclearshapedependoneachother?
• Buildshapespacesfor– nuclearshapesonly– cellshapesonly
• Foreachnuclearshape,predictapositionincellshapespaceforitbyinterpolatingatthesamerelativedistancesfromthecellshapesofitsneighborsinnuclearshape(andviceversa)
• Measurepredictionerrorasthedistanceintheshapespacebetweenthepredictedpositionandtheactualposition
![Page 33: Shape Modeling in CellOrganizer€¦ · Shape Modeling in CellOrganizer Robert F. Murphy Ray & Stephanie Lane Professor of Computational Biology and Professor of Biological Sciences,](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f9269ba96a8ce1d971663e7/html5/thumbnails/33.jpg)
Predictionofcellandnuclearshapedependency
John
sonetal.
2015
![Page 34: Shape Modeling in CellOrganizer€¦ · Shape Modeling in CellOrganizer Robert F. Murphy Ray & Stephanie Lane Professor of Computational Biology and Professor of Biological Sciences,](https://reader034.vdocuments.us/reader034/viewer/2022043007/5f9269ba96a8ce1d971663e7/html5/thumbnails/34.jpg)
H1299shapespace,coloredbyproteinlabel
Johnsonetal.2015