overview of network theory,...
TRANSCRIPT
![Page 1: Overview of Network Theory, Imae.engr.ucdavis.edu/dsouza/Classes/ECS289-W11/Lectures/lecture1-11.pdfEarthquake magnitude 1.35 - 1.7 ˘ 1021 Nm Avalanche size of ferromagnetic materials](https://reader033.vdocuments.us/reader033/viewer/2022051923/6010eac7ad4321194e299a8c/html5/thumbnails/1.jpg)
Overview of Network Theory, I
ECS 289 / MAE 298, Winter 2011, Lecture 1
Prof. Raissa D’SouzaUniversity of California, Davis
![Page 2: Overview of Network Theory, Imae.engr.ucdavis.edu/dsouza/Classes/ECS289-W11/Lectures/lecture1-11.pdfEarthquake magnitude 1.35 - 1.7 ˘ 1021 Nm Avalanche size of ferromagnetic materials](https://reader033.vdocuments.us/reader033/viewer/2022051923/6010eac7ad4321194e299a8c/html5/thumbnails/2.jpg)
Raissa’s Professional history: i.e., (How did I get here?)
• 1999, PhD, Physics, Massachusetts Inst of Tech (MIT):– Joint appointment: Statistical Physics and Lab for Computer Science
• 2000-2002, Postdoctoral Research Fellow, Bell Laboratories:– Joint appointment: Fundamental Mathematics and Theoretical
Physics Research Groups.
• 2002-2005, Postdoctoral Research Fellow, Microsoft Research:– “Theory Group” (Physics and Theoretical Computer Science)
• Fall 2005-present, UC Davis:– Dept of Mechanical and Aeronautical Eng., Complexity Sciences
Center, Grad Group Applied Math, Grad Group CS.
• 2007-present, External Faculty Member, Santa Fe Institute
• Fall 2009-present, UC Davis:– Dept of CS, Dept of Mech and Aero Eng., Complexity Sciences
Center, Grad Group Applied Math.
![Page 3: Overview of Network Theory, Imae.engr.ucdavis.edu/dsouza/Classes/ECS289-W11/Lectures/lecture1-11.pdfEarthquake magnitude 1.35 - 1.7 ˘ 1021 Nm Avalanche size of ferromagnetic materials](https://reader033.vdocuments.us/reader033/viewer/2022051923/6010eac7ad4321194e299a8c/html5/thumbnails/3.jpg)
What is a Network?
• Topology (i.e., structure: nodes/vertices and edges/links)Measures of topology
• Activity (i.e., function, processes on networks, dynamics ofnodes and edges)
Modeling networks
• Network growth
• Phase transitions
• Algorithms: analysis, growth/formation, searching andspreading
• Processes on networks
![Page 4: Overview of Network Theory, Imae.engr.ucdavis.edu/dsouza/Classes/ECS289-W11/Lectures/lecture1-11.pdfEarthquake magnitude 1.35 - 1.7 ˘ 1021 Nm Avalanche size of ferromagnetic materials](https://reader033.vdocuments.us/reader033/viewer/2022051923/6010eac7ad4321194e299a8c/html5/thumbnails/4.jpg)
Example social networks(Immunology; viral marketing; aliances/policy)
M. E. J. Newman
![Page 5: Overview of Network Theory, Imae.engr.ucdavis.edu/dsouza/Classes/ECS289-W11/Lectures/lecture1-11.pdfEarthquake magnitude 1.35 - 1.7 ˘ 1021 Nm Avalanche size of ferromagnetic materials](https://reader033.vdocuments.us/reader033/viewer/2022051923/6010eac7ad4321194e299a8c/html5/thumbnails/5.jpg)
The Internet(Robustness to failure; optimizing future growth; testing
protocols on sample topologies)
H. Burch and B. Cheswick
![Page 6: Overview of Network Theory, Imae.engr.ucdavis.edu/dsouza/Classes/ECS289-W11/Lectures/lecture1-11.pdfEarthquake magnitude 1.35 - 1.7 ˘ 1021 Nm Avalanche size of ferromagnetic materials](https://reader033.vdocuments.us/reader033/viewer/2022051923/6010eac7ad4321194e299a8c/html5/thumbnails/6.jpg)
A typical web domain(Web search/organization and growth
centralized vs. decentralized protocols)
M. E. J. Newman
![Page 7: Overview of Network Theory, Imae.engr.ucdavis.edu/dsouza/Classes/ECS289-W11/Lectures/lecture1-11.pdfEarthquake magnitude 1.35 - 1.7 ˘ 1021 Nm Avalanche size of ferromagnetic materials](https://reader033.vdocuments.us/reader033/viewer/2022051923/6010eac7ad4321194e299a8c/html5/thumbnails/7.jpg)
The airline network(Optimization; dynamic external demands)
Continental Airlines
![Page 8: Overview of Network Theory, Imae.engr.ucdavis.edu/dsouza/Classes/ECS289-W11/Lectures/lecture1-11.pdfEarthquake magnitude 1.35 - 1.7 ˘ 1021 Nm Avalanche size of ferromagnetic materials](https://reader033.vdocuments.us/reader033/viewer/2022051923/6010eac7ad4321194e299a8c/html5/thumbnails/8.jpg)
The power grid(Mitigating failure; Distributed sources)
M. E. J. Newman
![Page 9: Overview of Network Theory, Imae.engr.ucdavis.edu/dsouza/Classes/ECS289-W11/Lectures/lecture1-11.pdfEarthquake magnitude 1.35 - 1.7 ˘ 1021 Nm Avalanche size of ferromagnetic materials](https://reader033.vdocuments.us/reader033/viewer/2022051923/6010eac7ad4321194e299a8c/html5/thumbnails/9.jpg)
Biology: Networks at many levelsControl mechanisms / drug design/ gene therapy / biomarkers of disease
protein-gene
interactions
protein-protein
interactions
PROTEOME
GENOME
METABOLISM
Bio-chemical
reactions
Citrate Cycle
Cellular networks:
• Genome, Proteome:Dandekar Lab
• Metabolome:Fiehn Lab
• Data intergrationBIOshareLin, Genome Center
• Network structure / search for biomarkers:D’Souza
![Page 10: Overview of Network Theory, Imae.engr.ucdavis.edu/dsouza/Classes/ECS289-W11/Lectures/lecture1-11.pdfEarthquake magnitude 1.35 - 1.7 ˘ 1021 Nm Avalanche size of ferromagnetic materials](https://reader033.vdocuments.us/reader033/viewer/2022051923/6010eac7ad4321194e299a8c/html5/thumbnails/10.jpg)
Software systems
(Highly evolveable, modular, robust to mutation,exhibit punctuated eqm)
Open-source software as a “systems” paradigm.
Networks:• Function calls• Email communication• Socio-Technical congruence
Bird, Devanbu, D’Souza, Filkov, Saul, Wen
![Page 11: Overview of Network Theory, Imae.engr.ucdavis.edu/dsouza/Classes/ECS289-W11/Lectures/lecture1-11.pdfEarthquake magnitude 1.35 - 1.7 ˘ 1021 Nm Avalanche size of ferromagnetic materials](https://reader033.vdocuments.us/reader033/viewer/2022051923/6010eac7ad4321194e299a8c/html5/thumbnails/11.jpg)
Networks: Physical, Biological, Social
• Geometric versus virtual (Internet versus WWW).
• Natural /spontaneously arising versus engineered /built.
• Directed versus undirected edges.
• Each network optimizes something unique.
• Identifying similarities and fundamental differences canguide future design/understanding.
• Interplay of topology and function ?
• Unifying features: – Broad heterogeneity in node degree.– Small Worlds (Diameter ∼ log(N)).
![Page 12: Overview of Network Theory, Imae.engr.ucdavis.edu/dsouza/Classes/ECS289-W11/Lectures/lecture1-11.pdfEarthquake magnitude 1.35 - 1.7 ˘ 1021 Nm Avalanche size of ferromagnetic materials](https://reader033.vdocuments.us/reader033/viewer/2022051923/6010eac7ad4321194e299a8c/html5/thumbnails/12.jpg)
Explosion of work and tools
• R, Graphviz, Pajek, igraph, Network Workbench,NetworkX, Netdraw, UCInet, Bioconductor,Ubigraph....
![Page 13: Overview of Network Theory, Imae.engr.ucdavis.edu/dsouza/Classes/ECS289-W11/Lectures/lecture1-11.pdfEarthquake magnitude 1.35 - 1.7 ˘ 1021 Nm Avalanche size of ferromagnetic materials](https://reader033.vdocuments.us/reader033/viewer/2022051923/6010eac7ad4321194e299a8c/html5/thumbnails/13.jpg)
Natn Acam Sciences/Natn Research Council Study (2005)
“all our modern critical infrastructure relies on networks... toomuch emphasis on specific applications/jargon/disciplinarystovepipes... need a cross-cutting science of networks...
Research for the 21st century”
![Page 14: Overview of Network Theory, Imae.engr.ucdavis.edu/dsouza/Classes/ECS289-W11/Lectures/lecture1-11.pdfEarthquake magnitude 1.35 - 1.7 ˘ 1021 Nm Avalanche size of ferromagnetic materials](https://reader033.vdocuments.us/reader033/viewer/2022051923/6010eac7ad4321194e299a8c/html5/thumbnails/14.jpg)
In reality a collection of interacting networks:
Networks:
TransportationNetworks/Power grid(distribution/collection networks)
Biological networks- protein interaction- genetic regulation- drug design
Computernetworks
Social networks- Immunology- Information- Commerce
• E-commerce→WWW→ Internet→ Power grid→ River networks.
• Biological virus → Social contact network → Transportation networks →Communication networks→ Power grid→ River networks.(Historical progression: Spatial waves (Black plague) Regional outbreaks (ships) Global
pandemics (airplanes))
![Page 15: Overview of Network Theory, Imae.engr.ucdavis.edu/dsouza/Classes/ECS289-W11/Lectures/lecture1-11.pdfEarthquake magnitude 1.35 - 1.7 ˘ 1021 Nm Avalanche size of ferromagnetic materials](https://reader033.vdocuments.us/reader033/viewer/2022051923/6010eac7ad4321194e299a8c/html5/thumbnails/15.jpg)
How do we represent a simple individual network as amathematical object?
![Page 16: Overview of Network Theory, Imae.engr.ucdavis.edu/dsouza/Classes/ECS289-W11/Lectures/lecture1-11.pdfEarthquake magnitude 1.35 - 1.7 ˘ 1021 Nm Avalanche size of ferromagnetic materials](https://reader033.vdocuments.us/reader033/viewer/2022051923/6010eac7ad4321194e299a8c/html5/thumbnails/16.jpg)
NETWORK TOPOLOGY
Connectivity matrix, M :
Mij =
{1 if edge exists between i and j
0 otherwise.
1 1 1 1 01 1 0 1 01 0 1 0 01 1 0 1 10 0 0 1 1
= M
Node degree is number of links.
![Page 17: Overview of Network Theory, Imae.engr.ucdavis.edu/dsouza/Classes/ECS289-W11/Lectures/lecture1-11.pdfEarthquake magnitude 1.35 - 1.7 ˘ 1021 Nm Avalanche size of ferromagnetic materials](https://reader033.vdocuments.us/reader033/viewer/2022051923/6010eac7ad4321194e299a8c/html5/thumbnails/17.jpg)
Typical measures of network topology
• Degree distribution (fraction of nodes with degree k, for all k)
• Clustering coefficient (fraction of triangles in the graph/transitivity:Are my friends friends with each other?)Also a local measure, for each node ci is number of connections existingbetween neighbors/total number of possible connections.
![Page 18: Overview of Network Theory, Imae.engr.ucdavis.edu/dsouza/Classes/ECS289-W11/Lectures/lecture1-11.pdfEarthquake magnitude 1.35 - 1.7 ˘ 1021 Nm Avalanche size of ferromagnetic materials](https://reader033.vdocuments.us/reader033/viewer/2022051923/6010eac7ad4321194e299a8c/html5/thumbnails/18.jpg)
Typical measures of network topology, cont
• Diameter (Greatest distance between any two connected nodes)
“Small world” if d ∼ logN and strong clustering.(Watts Stogatz, Nature 393, 1998.)
• Betweenness centrality (Fraction of shortest paths passing througha node, i.e., is a node a bottleneck for flow?)
![Page 19: Overview of Network Theory, Imae.engr.ucdavis.edu/dsouza/Classes/ECS289-W11/Lectures/lecture1-11.pdfEarthquake magnitude 1.35 - 1.7 ˘ 1021 Nm Avalanche size of ferromagnetic materials](https://reader033.vdocuments.us/reader033/viewer/2022051923/6010eac7ad4321194e299a8c/html5/thumbnails/19.jpg)
Typical measures of network topology, cont
• Assortative/dissortative mixing (Are nodes with similar attributesmore or less likely to link to each other? Mixing by node degree common.Also, in social networks mixing by gender and race.)
(Example of assortative mixing by race. Friendship network of HS students:White, African American and Other.)
![Page 20: Overview of Network Theory, Imae.engr.ucdavis.edu/dsouza/Classes/ECS289-W11/Lectures/lecture1-11.pdfEarthquake magnitude 1.35 - 1.7 ˘ 1021 Nm Avalanche size of ferromagnetic materials](https://reader033.vdocuments.us/reader033/viewer/2022051923/6010eac7ad4321194e299a8c/html5/thumbnails/20.jpg)
Degree distribution of “real-world” networks
Extremely broad range of node degree observed:from biological, to technological, to social.
![Page 21: Overview of Network Theory, Imae.engr.ucdavis.edu/dsouza/Classes/ECS289-W11/Lectures/lecture1-11.pdfEarthquake magnitude 1.35 - 1.7 ˘ 1021 Nm Avalanche size of ferromagnetic materials](https://reader033.vdocuments.us/reader033/viewer/2022051923/6010eac7ad4321194e299a8c/html5/thumbnails/21.jpg)
Typical distribution in node degree
The “Internet” “Who-is-Who” networkFaloutsos3, SIGCOMM 1999 Szendroi and Csanyi
p(k) ∼ k−2.16 p(k) = ck−γe−αk
1
10
100
1000
10000
1 10 100
"971108.out"exp(7.68585) * x ** ( -2.15632 )
1
10
100
1000
10000
1 10 100
"980410.out"exp(7.89793) * x ** ( -2.16356 )
1
10
100
1000
10000
1 10 100
"981205.out"exp(8.11393) * x ** ( -2.20288 )
1
10
100
1000
10000
1 10 100
"routes.out"exp(8.52124) * x ** ( -2.48626 )
• Small data sets, power laws vs other similar distributions?•What is the “Internet”/ what level? (e.g., router vs AS)
![Page 22: Overview of Network Theory, Imae.engr.ucdavis.edu/dsouza/Classes/ECS289-W11/Lectures/lecture1-11.pdfEarthquake magnitude 1.35 - 1.7 ˘ 1021 Nm Avalanche size of ferromagnetic materials](https://reader033.vdocuments.us/reader033/viewer/2022051923/6010eac7ad4321194e299a8c/html5/thumbnails/22.jpg)
Power law with exponential tail
Ubiquitous empirical measurements:
System with: p(x) ∼ x−B exp(−x/C) B C
Full protein-interaction map of Drosophila 1.20 0.038
High-confidence protein-interaction map of Drosophila 1.26 0.27
Gene-flow/hydridization network of plantsas function of spatial distance 0.75 105 m
Earthquake magnitude 1.35 - 1.7 ∼ 1021 Nm
Avalanche size of ferromagnetic materials 1.2 - 1.4 L1.4
ArXiv co-author network 1.3 53
MEDLINE co-author network 2.1 ∼ 5800
PNAS paper citation network 0.49 4.21
![Page 23: Overview of Network Theory, Imae.engr.ucdavis.edu/dsouza/Classes/ECS289-W11/Lectures/lecture1-11.pdfEarthquake magnitude 1.35 - 1.7 ˘ 1021 Nm Avalanche size of ferromagnetic materials](https://reader033.vdocuments.us/reader033/viewer/2022051923/6010eac7ad4321194e299a8c/html5/thumbnails/23.jpg)
What is a power law?
(Also called a “Pareto Distribution” in statistics).
pk ∼ k−γ
ln pk ∼ −γ ln k
1 100 10000
1e−
101e
−07
1e−
041e
−01
k
p(k)
![Page 24: Overview of Network Theory, Imae.engr.ucdavis.edu/dsouza/Classes/ECS289-W11/Lectures/lecture1-11.pdfEarthquake magnitude 1.35 - 1.7 ˘ 1021 Nm Avalanche size of ferromagnetic materials](https://reader033.vdocuments.us/reader033/viewer/2022051923/6010eac7ad4321194e299a8c/html5/thumbnails/24.jpg)
Power Laws versus Bell Curves:“Heavy tails”
• Power law distribution: pk ∼ k−γ.
• Gaussian distribution: pk ∼ exp(−k2/2σ2).
0 100 200 300 400 500
0.0
0.2
0.4
0.6
0.8
1.0
k
p(k)
1 2 5 10 20 50 100 500
1e−
561e
−44
1e−
321e
−20
1e−
08
k
p(k)
If 1 < γ < 2, mean and variance→∞.If 2 < γ < 3 mean is finite, but variance→∞.
![Page 25: Overview of Network Theory, Imae.engr.ucdavis.edu/dsouza/Classes/ECS289-W11/Lectures/lecture1-11.pdfEarthquake magnitude 1.35 - 1.7 ˘ 1021 Nm Avalanche size of ferromagnetic materials](https://reader033.vdocuments.us/reader033/viewer/2022051923/6010eac7ad4321194e299a8c/html5/thumbnails/25.jpg)
Many network growth models produce power law degreedistribution
• Preferential attachment
• Copying models (WWW, biological networks, ...)
• Optimization models
Some outstanding challenges
• Incorporating additional attributes beyond degree
• Validation
![Page 26: Overview of Network Theory, Imae.engr.ucdavis.edu/dsouza/Classes/ECS289-W11/Lectures/lecture1-11.pdfEarthquake magnitude 1.35 - 1.7 ˘ 1021 Nm Avalanche size of ferromagnetic materials](https://reader033.vdocuments.us/reader033/viewer/2022051923/6010eac7ad4321194e299a8c/html5/thumbnails/26.jpg)
Network Activity: FLOWS on NETWORKS
(Spread of disease, routing data, materials transport/flow,gossip spread/marketing)
![Page 27: Overview of Network Theory, Imae.engr.ucdavis.edu/dsouza/Classes/ECS289-W11/Lectures/lecture1-11.pdfEarthquake magnitude 1.35 - 1.7 ˘ 1021 Nm Avalanche size of ferromagnetic materials](https://reader033.vdocuments.us/reader033/viewer/2022051923/6010eac7ad4321194e299a8c/html5/thumbnails/27.jpg)
FLOWS on NETWORKS : Random walks
Random walk on the network has state transition matrix, P :
1/4 1/3 1/2 1/4 01/4 1/3 0 1/4 01/4 0 1/2 0 01/4 1/3 0 1/4 1/20 0 0 1/4 1/2
= P
The eigenvalues and eigenvectors convey much information.Markov Chains, Spectral Gap.
![Page 28: Overview of Network Theory, Imae.engr.ucdavis.edu/dsouza/Classes/ECS289-W11/Lectures/lecture1-11.pdfEarthquake magnitude 1.35 - 1.7 ˘ 1021 Nm Avalanche size of ferromagnetic materials](https://reader033.vdocuments.us/reader033/viewer/2022051923/6010eac7ad4321194e299a8c/html5/thumbnails/28.jpg)
Random walk on the WWW is the “Page Rank”
Page Rank of a node is the steady-state random walkoccupancy probabilty.
(We will discuss building a search engine in detail later.)
![Page 29: Overview of Network Theory, Imae.engr.ucdavis.edu/dsouza/Classes/ECS289-W11/Lectures/lecture1-11.pdfEarthquake magnitude 1.35 - 1.7 ˘ 1021 Nm Avalanche size of ferromagnetic materials](https://reader033.vdocuments.us/reader033/viewer/2022051923/6010eac7ad4321194e299a8c/html5/thumbnails/29.jpg)
Example Eigen-technique: Community structure(Political Books 2004)
M. Girvan and M. E. J. Newman
![Page 30: Overview of Network Theory, Imae.engr.ucdavis.edu/dsouza/Classes/ECS289-W11/Lectures/lecture1-11.pdfEarthquake magnitude 1.35 - 1.7 ˘ 1021 Nm Avalanche size of ferromagnetic materials](https://reader033.vdocuments.us/reader033/viewer/2022051923/6010eac7ad4321194e299a8c/html5/thumbnails/30.jpg)
Concepts covered today
• Social, physical and biological networks
• Simple network metrics (recapped next page)
• Random walks on networks
• Random graphs
• Phase transitions in connectivity
• Next time: Preferential attachment and network growth,Robustness, basic Internet structure, optimization.
![Page 31: Overview of Network Theory, Imae.engr.ucdavis.edu/dsouza/Classes/ECS289-W11/Lectures/lecture1-11.pdfEarthquake magnitude 1.35 - 1.7 ˘ 1021 Nm Avalanche size of ferromagnetic materials](https://reader033.vdocuments.us/reader033/viewer/2022051923/6010eac7ad4321194e299a8c/html5/thumbnails/31.jpg)
Outstanding challenges
• How do we connect network structure to function?
– Degree– Clustering Coefficient– Motifs– Betweeness Centrality– Assortativity– Flow and transport– Growth/evolution mechanisms.
• Interacting networks
• Strategic interactions / Game theory on networks
![Page 32: Overview of Network Theory, Imae.engr.ucdavis.edu/dsouza/Classes/ECS289-W11/Lectures/lecture1-11.pdfEarthquake magnitude 1.35 - 1.7 ˘ 1021 Nm Avalanche size of ferromagnetic materials](https://reader033.vdocuments.us/reader033/viewer/2022051923/6010eac7ad4321194e299a8c/html5/thumbnails/32.jpg)
Sketchy outline of course
• Today: intro to different types of networks (physical, social, biological)
• Models of network topology:– random graphs– growth mechanisms– robustness and resilience
• Measures of network topology
• Processes on networks– Percolation– Epidemic spreading– Synchronization– Web search
• Optimization– User optimal versus system optimal– Braess’s paradox
• Domain specifics and applications: CS, traffic, biology, social nets