presented by yuhua jiao 2012-12-4. outline limitation of some network clustering methods...
Post on 15-Jan-2016
218 Views
Preview:
TRANSCRIPT
Presented by Yuhua Jiao2012-12-4
Outline
• Limitation of some network clustering methods• Hierarchical Agglomerative Clustering– Method– Performance evaluation
• Results and Discussion– Data preparation– Empirical evaluation– Multi-resolution view of a physical interaction
network
Background of network clustering
• Challenges in biological network analysis– Inference of structure of subgroups of related vertices– Prediction of possible links not represented in data
• Network clustering is a valuable approach for– summarizing the structure in large networks,– predicting unobserved interactions – predicting functional annotations
Common limitations for some network clustering algorithms
• Poor resolution of top-level clusters– Stochastic block models
• Over-splitting of bottom-level clusters– Hierarchical network model
• Requirements to pre-define the number of clusters prior to analysis– Stochastic block models
• An inability to jointly cluster over multiple interaction types
Hierarchical network model by Clauset, Moore, and Newman (CMN)
Hierarchical Agglomerative Clustering
• Hierarchical Agglomerative Clustering– An approximation for optimizing a network
probability motivated by CMN.– Interactions with vertices outside a group often
provide more information than within-group interactions.
– Power Graph Analysis is a lossless transformation of biological networks into a compact, less redundant representation, exploiting the abundance of cliques and bicliques as elementary topological motifs.
HAC-Method• Notation– Graph– Groups– Edges between groups
– Total possible connections
– Number of holes
• For a given pair of group i and j, edges between groups are result of tij independent Bernoulli trials.
• The probability of observed edges, conditioned on parameter θij
• The maximum likelihood estimate of θij is
• The maximum likelihood value of Pij(θij) is
HAC-Method
• Given two groups: ni = 5 nj = 4• Probability density is
• The likelihood of the flat model
An instance of flat model
HAC-Method• Generalization to hierarchical model– Binary dendrogram T– Each node r in the dendrogram represents the
joining of vertices in left sub-tree L(r) and vertices in right sub-tree R(r).
– Er and hr are numbers of edges and holes crossing between the left and right sub-trees.
HAC-Agglomerative clustering• Maximum likelihood guide tree– K top-level clusters– R total tree nodes– Merge clusters 1 and 2 into
cluster 1’, defining a new model M’
1 21’
Current top level
HAC-Agglomerative clustering
• During the merging process, if clusters 1 and 2 are selected for merging and are both collapsed, the probability ratio is calculated, where the subscripts indicate edges and holes within and between groups.
• The merged cluster is collapsed if λc ≥1 . • Clusters of two vertices are always merged because λc = 1.
HAC-Bayesian model selection for terminal clusters
Performance Evaluation• Data preparation– BioGRID database (http://thebiogrid.org)– The graph is undirected and unweighted with no self
edges.• Other methods– Fast Modularity (CNM)– Variational Bayes modularity (VBM)– Graph Diffusion Kernel (GDK)– Heuristic merging scores
• Edge density (HAC-E)• Combined edge density and shared neighbor density (HAC-ES)• Decomposed Newman modularity Q from CNM (HAC-Q)
Link Prediction• Starting with a real-world network, training networks are generated by
deleting a specified fraction of edges. • A test set is defined by the held-out edges and a random choice of an equal
number of holes.• The trained group structure provides maximum likelihood estimates for
edges within and between clusters (Eq. 9). For VBM and CNM, we estimated edge densities between all pairs of clusters and within all clusters. For hierarchical models, we estimated densities between all left and right clusters at all tree levels. For GDK, each pair’s diffusion was directly used to rank pairs.
• Finally we assessed precision and recall of pairs in the test set ranked by link probability or GDK score.
Results and Discussion
• Data Preparation
Further Discussion• Extending HAC to dynamic networks is limited:
– A solution is required to the identifiability problem: how complexes inferred at one time point correspond to complexes inferred at other time points.
– Transitions of a protein from one complex to another must be permitted by the model, requiring dynamical coupling between network snapshots.
• Dynamical Hierarchical Agglomerative Clustering (DHAC) – Maximum likelihood is converted to fully Bayesian statistics– The likelihood modularity is ‘kernelized’ with an adaptive bandwidth
to couple network clusters at nearby time points.– Matching clusters across time points is solved with a new belief
propagation method that extends Expectation-Maximization and belief propagation for bipartite matching to consistently match multiple time-evolving clusters.
top related