ip over p2p: enabling self-configuring virtual ip networks for grid computing
DESCRIPTION
IP over P2P: Enabling Self-configuring Virtual IP Networks for Grid Computing. Arijit Ganguly , Abhishek Agrawal, P. Oscar Boykin, Renato Figueiredo. University of Florida IPDPS 2006. What is the talk about?. Convergence of Grid and P2P technologies 1 Context of network virtualization. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: IP over P2P: Enabling Self-configuring Virtual IP Networks for Grid Computing](https://reader036.vdocuments.us/reader036/viewer/2022081512/56815706550346895dc4aa48/html5/thumbnails/1.jpg)
Advanced Computing and Information Systems laboratory
IP over P2P: Enabling Self-configuring Virtual IP Networks
forGrid Computing
Arijit Ganguly, Abhishek Agrawal, P. Oscar Boykin, Renato Figueiredo
University of FloridaIPDPS 2006
![Page 2: IP over P2P: Enabling Self-configuring Virtual IP Networks for Grid Computing](https://reader036.vdocuments.us/reader036/viewer/2022081512/56815706550346895dc4aa48/html5/thumbnails/2.jpg)
Advanced Computing and Information Systems laboratory 2
What is the talk about?
Convergence of Grid and P2P technologies1
Context of network virtualization
1 On death, taxes, and the convergence of peer-to-peer andGrid Computing. Foster et al. IPTPS 2003
![Page 3: IP over P2P: Enabling Self-configuring Virtual IP Networks for Grid Computing](https://reader036.vdocuments.us/reader036/viewer/2022081512/56815706550346895dc4aa48/html5/thumbnails/3.jpg)
Advanced Computing and Information Systems laboratory 3
Outline
Virtual networking and Grid Computing Related work Our approach – IP over P2P Experimental evaluation Conclusion and Future work
![Page 4: IP over P2P: Enabling Self-configuring Virtual IP Networks for Grid Computing](https://reader036.vdocuments.us/reader036/viewer/2022081512/56815706550346895dc4aa48/html5/thumbnails/4.jpg)
Advanced Computing and Information Systems laboratory 4
Internet access
Internet
Background - Virtual Private Networks
Files, emails,compute cycles
printers
VPN gateway
Rhodes, Greece
User insideACIS privatenetwork
Install Cisco VPN client Connect to VPN gateway
router
NAT/Firewall
Tunnel
![Page 5: IP over P2P: Enabling Self-configuring Virtual IP Networks for Grid Computing](https://reader036.vdocuments.us/reader036/viewer/2022081512/56815706550346895dc4aa48/html5/thumbnails/5.jpg)
Advanced Computing and Information Systems laboratory 5
Grid scenario
Internetrouter
routerrouter
router
NAT
FirewallNAT/Firewall
Purdue
Florida Northwestern
LSU
Grid user
SSH only
Internetrouter
router
router
router
Purdue
Florida Northwestern
LSU
Grid user
SSH only
Issues:
Network Address Translation
Idiosyncrasies of heterogeneous access
Traffic generated by untrusted code from Grid users – DoS attacks, viruses
NAT
FirewallNAT/Firewall
![Page 6: IP over P2P: Enabling Self-configuring Virtual IP Networks for Grid Computing](https://reader036.vdocuments.us/reader036/viewer/2022081512/56815706550346895dc4aa48/html5/thumbnails/6.jpg)
Advanced Computing and Information Systems laboratory 6
Virtual network of Grid resources
Internetrouter
routerrouter
router
NAT
FirewallNAT/Firewall
Purdue
Florida Northwestern
LSU
Grid user
SSH only
Virtual Network
![Page 7: IP over P2P: Enabling Self-configuring Virtual IP Networks for Grid Computing](https://reader036.vdocuments.us/reader036/viewer/2022081512/56815706550346895dc4aa48/html5/thumbnails/7.jpg)
Advanced Computing and Information Systems laboratory 7
Virtual networking for Grids
VNET (Northwestern University)• Bridge a remote Virtual Machine (VM) to a
client network
VIOLIN (Purdue University) • Virtualized network components
• Isolated from real physical network
ViNe (University of Florida)• Virtual IP network of Grid resources
• To be presented on Friday (Session 32)Common technology: Overlay tunnelingWhat differentiates us: P2P routing
![Page 8: IP over P2P: Enabling Self-configuring Virtual IP Networks for Grid Computing](https://reader036.vdocuments.us/reader036/viewer/2022081512/56815706550346895dc4aa48/html5/thumbnails/8.jpg)
Advanced Computing and Information Systems laboratory 8
Motivations for P2P
Scalability and Self-configurability
• Manual effort required to add a new node constant
• Independent of size of the network Resiliency
• Robust P2P routing Accessibility
• Ability to traverse NAT
• Hole punching1
1 RFC 3489 - STUN - Simple traversal of UserDatagram Protocol through Network Address Translators
![Page 9: IP over P2P: Enabling Self-configuring Virtual IP Networks for Grid Computing](https://reader036.vdocuments.us/reader036/viewer/2022081512/56815706550346895dc4aa48/html5/thumbnails/9.jpg)
Advanced Computing and Information Systems laboratory 9
Our approach – IP- over-P2P (IPOP)
Isolation• Virtual address space decoupled from Internet
address space Self-configurability
• Automatic setup of routes and topologies• Decentralized
• No global state
• No central points of failure
• VM mobility
Decentralized NAT traversal• No changes to NAT configuration
• No globally deployed STUN servers
#affiliationcondor_wow#transportudp#port15000#number of remote TAs2#list of TAsbrunet.udp://planetlab-01.bu.edu:15000brunet.udp://planetlab1.cs.purdue.edu:15000#virtual interfacetap0#virtual IP address of tap0172.16.1.5#MAC address of tap0CB:DF:E7:20:60:35
![Page 10: IP over P2P: Enabling Self-configuring Virtual IP Networks for Grid Computing](https://reader036.vdocuments.us/reader036/viewer/2022081512/56815706550346895dc4aa48/html5/thumbnails/10.jpg)
Advanced Computing and Information Systems laboratory 10
IPOP - Architecture Overview
IP tunneling over P2P overlay networks• UDP, TCP
Virtual IP packet capture and injection through tap interface
Builds upon Brunet P2P library
![Page 11: IP over P2P: Enabling Self-configuring Virtual IP Networks for Grid Computing](https://reader036.vdocuments.us/reader036/viewer/2022081512/56815706550346895dc4aa48/html5/thumbnails/11.jpg)
Advanced Computing and Information Systems laboratory 11
IPOP – Packet capture and routing
applicationapplication
NodeY
IPOP
eth0
IPOP
NodeX
eth0
Socket s = new Socket(“172.16.0.10:3000”);s.connect();
ServerSocket serv = new ServerSocket(“172.16.0.10,3000);serv.accept()
X
Y
Extract IP from Ethernet Encapsulate IP inside P2P
Extract IP from P2P Encapsulate in Ethernet
tap0(172.16.0.10)
tap0
(172.16.0.9)
![Page 12: IP over P2P: Enabling Self-configuring Virtual IP Networks for Grid Computing](https://reader036.vdocuments.us/reader036/viewer/2022081512/56815706550346895dc4aa48/html5/thumbnails/12.jpg)
Advanced Computing and Information Systems laboratory 12
XY
Brunet P2P architecture Ring-structured overlay network topology
• Nodes ordered on 160-bit addresses Overlay link:
• Near: neighbor connections
• Far: connections across ring
Near connection
Far connection
Multi-hop pathbetween X and Y
U
V
![Page 13: IP over P2P: Enabling Self-configuring Virtual IP Networks for Grid Computing](https://reader036.vdocuments.us/reader036/viewer/2022081512/56815706550346895dc4aa48/html5/thumbnails/13.jpg)
Advanced Computing and Information Systems laboratory 13
Brunet P2P architecture (2)
Routing
• Constant number of connections
•O(log2(n)) overlay hops
• O(log(n)) connections
•O(log(n)) overlay hops
• n connections •1-hop
C# library, supports:
• Connection setup and maintenance
• NAT traversal
![Page 14: IP over P2P: Enabling Self-configuring Virtual IP Networks for Grid Computing](https://reader036.vdocuments.us/reader036/viewer/2022081512/56815706550346895dc4aa48/html5/thumbnails/14.jpg)
Advanced Computing and Information Systems laboratory 14
Network Address Translation (NAT)
Host A NATPublic host
128.227.56.83
Sends packet:Src = 10.5.144.69:5000Dst = 216.239.37.99:80
Sends packet:Src = 216.239.37.99:80Dst = 128.227.56.83:5126
216.239.37.9910.5.144.69
Translated:Src = 128.227.56.83:5126Dst = 216.239.37.99:80
10.5.144.69:5000 128.227.56.83:5126Outgoing packet to 128.227.56.83:5126
NAT Tables
Sends packet:Src = 216.239.37.99:80Dst = 10.5.144.69:5000
Applications on NATed hosts can learntheir NAT assigned IP:port
![Page 15: IP over P2P: Enabling Self-configuring Virtual IP Networks for Grid Computing](https://reader036.vdocuments.us/reader036/viewer/2022081512/56815706550346895dc4aa48/html5/thumbnails/15.jpg)
Advanced Computing and Information Systems laboratory 15
NAT traversal – Behind NATs
Src = R:ADst = N:Y
Src = N:YDst = M:X
R:A M:X N:Y S:B
Outgoing packet to M:X(hole punched)
Src = S:BDst = M:X
Src = M:XDst = N:Y
Outgoing packet to N:Y(hole punched)
Src = M:XDst = S:B
Exchange each other’s NAT assigned IP:port
M:X N:Y
NAT N128.139.156.90
NAT M128.227.56.83
S:BR:A Allow
Dropped
![Page 16: IP over P2P: Enabling Self-configuring Virtual IP Networks for Grid Computing](https://reader036.vdocuments.us/reader036/viewer/2022081512/56815706550346895dc4aa48/html5/thumbnails/16.jpg)
Advanced Computing and Information Systems laboratory 16
Experiments
Latency overhead and throughput of single overlay link• LAN and WAN
MPI application over IPOP• Light Scattering Spectroscopy (LSS)
Multi-hop routing experiments• More than 100 node network on PlanetLab
![Page 17: IP over P2P: Enabling Self-configuring Virtual IP Networks for Grid Computing](https://reader036.vdocuments.us/reader036/viewer/2022081512/56815706550346895dc4aa48/html5/thumbnails/17.jpg)
Advanced Computing and Information Systems laboratory 17
Latency (single IPOP link)
Two IPOP nodes separated by single overlay hopACIS – ACIS for LANACIS – VIMS for WAN
Ping times between two nodes
6ms-11ms overhead per packet for ICMP ping Relative overhead is smaller in Wide-Area
ACIS: Florida VIMS: Virginia
![Page 18: IP over P2P: Enabling Self-configuring Virtual IP Networks for Grid Computing](https://reader036.vdocuments.us/reader036/viewer/2022081512/56815706550346895dc4aa48/html5/thumbnails/18.jpg)
Advanced Computing and Information Systems laboratory 18
Latency overhead - analysis
Reasons for high LAN overhead:• Double traversal of kernel stack
• C# runtime
• User-level overlay – context switches
• Other user-level overlays (VNET, Violin) report few-ms latency overheads
![Page 19: IP over P2P: Enabling Self-configuring Virtual IP Networks for Grid Computing](https://reader036.vdocuments.us/reader036/viewer/2022081512/56815706550346895dc4aa48/html5/thumbnails/19.jpg)
Advanced Computing and Information Systems laboratory 19
Throughput (single IPOP link)
Two IPOP nodes separated by single overlay hopACIS – ACIS for LANACIS – VIMS for WAN
“ttcp” file transfer sizes (13.09 MB, 92.97 MB)
1.9MB/s LAN bandwidth (20% of physical 9.4 MB/s)
1.2MB/s WAN bandwidth (80% of physical 1.5 MB/s)
ACIS: Florida VIMS: Virginia
![Page 20: IP over P2P: Enabling Self-configuring Virtual IP Networks for Grid Computing](https://reader036.vdocuments.us/reader036/viewer/2022081512/56815706550346895dc4aa48/html5/thumbnails/20.jpg)
Advanced Computing and Information Systems laboratory 20
Real Application – Parallel LSS MPI + NFS + SSH11
1 Support for Data-Intensive, Variable-Granularity Grid Applications viaDistributed File System Virtualization - A Case Study of Light ScatteringSpectroscopy. Figueiredo et al. CLADE 2004
Internet
router
router
router
VIMS
LSU
Firewall
NAT
NAT/Firewall
NAT/Firewall
Florida
![Page 21: IP over P2P: Enabling Self-configuring Virtual IP Networks for Grid Computing](https://reader036.vdocuments.us/reader036/viewer/2022081512/56815706550346895dc4aa48/html5/thumbnails/21.jpg)
Advanced Computing and Information Systems laboratory 21
Real Application – Parallel LSS
With IPOP, could run “parallel LSS” unmodified No changes to NAT/Firewall rules
Achieve parallel speedup
![Page 22: IP over P2P: Enabling Self-configuring Virtual IP Networks for Grid Computing](https://reader036.vdocuments.us/reader036/viewer/2022081512/56815706550346895dc4aa48/html5/thumbnails/22.jpg)
Advanced Computing and Information Systems laboratory 22
PlanetLab experiments
Demonstrate ease of adding a new node and achieving IP routability in WAN environment
118 node TCP-based overlay on PlanetLab
Connect two IPOP nodes in ACIS lab to PlanetLab network
Measure ping times between nodes• Average: 1617 ms; Std Dev: 2098 ms
![Page 23: IP over P2P: Enabling Self-configuring Virtual IP Networks for Grid Computing](https://reader036.vdocuments.us/reader036/viewer/2022081512/56815706550346895dc4aa48/html5/thumbnails/23.jpg)
Advanced Computing and Information Systems laboratory 23
Planetlab experiments (analysis)
Issues:• High-load (>10) on nodes in routing path
• Geographically unaware p2p routing • Packets between machines in Florida routed
through machines in California
Improvements:• Direct overlay link setup between
communicating nodes• No concerns of load and inefficient p2p routing
![Page 24: IP over P2P: Enabling Self-configuring Virtual IP Networks for Grid Computing](https://reader036.vdocuments.us/reader036/viewer/2022081512/56815706550346895dc4aa48/html5/thumbnails/24.jpg)
Advanced Computing and Information Systems laboratory 24
Conclusion
Our contribution:
• Novel virtual IP network based on P2P overlay
•Scalable and Self-configurable
•Resilient
•NAT traversal
• Experiments showed feasibility of using P2P approach for virtual networking
![Page 25: IP over P2P: Enabling Self-configuring Virtual IP Networks for Grid Computing](https://reader036.vdocuments.us/reader036/viewer/2022081512/56815706550346895dc4aa48/html5/thumbnails/25.jpg)
Advanced Computing and Information Systems laboratory 25
Future work
Overhead of TCP or UDP• Raw sockets or Ethernet-based
overlay edges
Kernel level extensions
• Tap module with encapsulation and bridging
• Reduce context switches
![Page 26: IP over P2P: Enabling Self-configuring Virtual IP Networks for Grid Computing](https://reader036.vdocuments.us/reader036/viewer/2022081512/56815706550346895dc4aa48/html5/thumbnails/26.jpg)
Advanced Computing and Information Systems laboratory 26
Related Work
Virtual Networking• VIOLIN
• VNET
• ViNe (Session 32) Internet Indirection Infrastructure (i3)
• Support for mobility, multicast, anycast
• Decouples packet sending from receiving
• Based on Chord p2p protocol IPv6 tunneling
• IPv6 over UDP (Teredo protocol)
• IPv6 over P2P (P6P)
![Page 27: IP over P2P: Enabling Self-configuring Virtual IP Networks for Grid Computing](https://reader036.vdocuments.us/reader036/viewer/2022081512/56815706550346895dc4aa48/html5/thumbnails/27.jpg)
Advanced Computing and Information Systems laboratory 27
Acknowledgments
In-VIGO team at UFL National Science Foundation
• Middleware Initiative (http://www.nsf-middleware.org)
• Research Resources Program
• nCn center Resources
• Peter Dinda (Northwestern University)
• SURA/SCOOP
IBM Shared University Research
Questions?
![Page 28: IP over P2P: Enabling Self-configuring Virtual IP Networks for Grid Computing](https://reader036.vdocuments.us/reader036/viewer/2022081512/56815706550346895dc4aa48/html5/thumbnails/28.jpg)
Advanced Computing and Information Systems laboratory 28
Thank You