introduction to logistical networking micah beck, assoc. prof. & director logistical computing...
TRANSCRIPT
![Page 1: Introduction to Logistical Networking Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu APAN Advanced](https://reader036.vdocuments.us/reader036/viewer/2022062518/56649ee85503460f94bf932e/html5/thumbnails/1.jpg)
Introduction to Logistical Networking
Micah Beck, Assoc. Prof. & DirectorLogistical Computing & Internetworking (LoCI) Lab
APANAdvanced Networking Conf
Aug 28, 2003
![Page 2: Introduction to Logistical Networking Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu APAN Advanced](https://reader036.vdocuments.us/reader036/viewer/2022062518/56649ee85503460f94bf932e/html5/thumbnails/2.jpg)
US Govt. Funding• Dept. of Energy
SciDAC• National Science
Foundation ANIR
Industry Collab.• Yotta Yotta
Internet2
Logistical Networking Research at UTK
University of Tennessee• Micah Beck
• James S. Plank
• Jack Dongarra
University of California, Santa Barbara
• Rich Wolski
![Page 3: Introduction to Logistical Networking Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu APAN Advanced](https://reader036.vdocuments.us/reader036/viewer/2022062518/56649ee85503460f94bf932e/html5/thumbnails/3.jpg)
What is Logistical Networking?
• A scalable mechanism for deploying shared storage resources throughout the network
• A general store-and-forward overlay networking infrastructure
• A way to break transfers into segments and employ heterogeneous network technologies on the pieces
![Page 4: Introduction to Logistical Networking Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu APAN Advanced](https://reader036.vdocuments.us/reader036/viewer/2022062518/56649ee85503460f94bf932e/html5/thumbnails/4.jpg)
Why “Logistical Networking”
• Analogy to logistics in distribution of industrial and military personnel & materiel
• Fast highways alone are not enough Goods are also stored in warehouses for
transfer or local distribution
• Fast networks alone are not enough Data must be stored in buffers/files for transfer
or local distribution
![Page 5: Introduction to Logistical Networking Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu APAN Advanced](https://reader036.vdocuments.us/reader036/viewer/2022062518/56649ee85503460f94bf932e/html5/thumbnails/5.jpg)
The Network Storage Stack
Applications
Logistical File System
Logistical Tools
L-Bone
IBP
Local Access
Physical
exNode
• Our adaption of the network stack architecture for storage
• Like the IP Stack
• Each level encapsulates details from the lower levels, while still exposing details to higher levels
![Page 6: Introduction to Logistical Networking Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu APAN Advanced](https://reader036.vdocuments.us/reader036/viewer/2022062518/56649ee85503460f94bf932e/html5/thumbnails/6.jpg)
IBP: The Internet Backplane Protocol
• Storage provisioned on community “depots”• Very primitive service (similar to block service, but more
sharable)• Goal is to be a common platform (exposed)• Also part of end-to-end design
• Best effort service – no heroic measures• Availability, reliability, security, performance
• Allocations are time-limited!• Leases are respected, can be renewed• Permanent storage is to strong to share!
![Page 7: Introduction to Logistical Networking Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu APAN Advanced](https://reader036.vdocuments.us/reader036/viewer/2022062518/56649ee85503460f94bf932e/html5/thumbnails/7.jpg)
Data Movers
• Module implementing standard point-to-multipoint transfer between IBP allocations
• Uniform API allows independence from the underlying data transfer protocol
• Not every DM can apply to every transfer• Caller responsible for determining validity
• Current options: Multi-TCP, Multi-SABUL (reliable), UDP Multicast (unreliable)
![Page 8: Introduction to Logistical Networking Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu APAN Advanced](https://reader036.vdocuments.us/reader036/viewer/2022062518/56649ee85503460f94bf932e/html5/thumbnails/8.jpg)
The Network Storage Stack
The L-bone:Resource Discovery& Proximity queries
IBP: Allocating and managing networkstorage (like a network malloc)
The exNode:A data structurefor aggregation
LoRS: The Logistical Runtime System:Aggregation tools and methodologies
![Page 9: Introduction to Logistical Networking Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu APAN Advanced](https://reader036.vdocuments.us/reader036/viewer/2022062518/56649ee85503460f94bf932e/html5/thumbnails/9.jpg)
The Logistical Backbone (L-Bone)
• LDAP-based storage resource discovery.
• Query by capacity, network proximity, geographical proximity, stability, etc.
• Periodic monitoring of depots.
• 20 Terabytes of shared storage. (with plans to scale to a petabyte...)
![Page 10: Introduction to Logistical Networking Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu APAN Advanced](https://reader036.vdocuments.us/reader036/viewer/2022062518/56649ee85503460f94bf932e/html5/thumbnails/10.jpg)
L-Bone: August 2003
Current Storage Capacity: 20 TB
![Page 11: Introduction to Logistical Networking Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu APAN Advanced](https://reader036.vdocuments.us/reader036/viewer/2022062518/56649ee85503460f94bf932e/html5/thumbnails/11.jpg)
The Network Storage Stack
The L-bone:Resource Discovery& Proximity queries
IBP: Allocating and managing networkstorage (like a network malloc)
The exNode:A data structurefor aggregation
LoRS: The Logistical Runtime System:Aggregation tools and methodologies
![Page 12: Introduction to Logistical Networking Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu APAN Advanced](https://reader036.vdocuments.us/reader036/viewer/2022062518/56649ee85503460f94bf932e/html5/thumbnails/12.jpg)
The exNode
• The Network “File Descriptor• XML-based data structure/serialization• Map byte-extents to IBP buffers (or other allocations).• Allows for replication, flexible decomposition of data.• Also allows for error-correction/checksums• Arbitrary metadata.
![Page 13: Introduction to Logistical Networking Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu APAN Advanced](https://reader036.vdocuments.us/reader036/viewer/2022062518/56649ee85503460f94bf932e/html5/thumbnails/13.jpg)
ExNode vs inode
exNode
inode
IBP Allocations
the network
local system
disk blocks
kernel
capabilities
block addresses
user
![Page 14: Introduction to Logistical Networking Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu APAN Advanced](https://reader036.vdocuments.us/reader036/viewer/2022062518/56649ee85503460f94bf932e/html5/thumbnails/14.jpg)
The Network Storage Stack
The L-bone:Resource Discovery& Proximity queries
IBP: Allocating and managing networkstorage (like a network malloc)
The exNode:A data structurefor aggregation
LoRS: The Logistical Runtime System:Aggregation tools and methodologies
![Page 15: Introduction to Logistical Networking Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu APAN Advanced](https://reader036.vdocuments.us/reader036/viewer/2022062518/56649ee85503460f94bf932e/html5/thumbnails/15.jpg)
Logistical Runtime System
Basic Primitives:• Upload, Download, Augment, Refresh
End-to-end Services• Checksums, Encryption, Compression
![Page 16: Introduction to Logistical Networking Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu APAN Advanced](https://reader036.vdocuments.us/reader036/viewer/2022062518/56649ee85503460f94bf932e/html5/thumbnails/16.jpg)
Multithreaded Transfers
![Page 17: Introduction to Logistical Networking Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu APAN Advanced](https://reader036.vdocuments.us/reader036/viewer/2022062518/56649ee85503460f94bf932e/html5/thumbnails/17.jpg)
Routed/Multipath
![Page 18: Introduction to Logistical Networking Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu APAN Advanced](https://reader036.vdocuments.us/reader036/viewer/2022062518/56649ee85503460f94bf932e/html5/thumbnails/18.jpg)
Point-to-Multipoint
![Page 19: Introduction to Logistical Networking Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu APAN Advanced](https://reader036.vdocuments.us/reader036/viewer/2022062518/56649ee85503460f94bf932e/html5/thumbnails/19.jpg)
Heterogeneous Multicast
![Page 20: Introduction to Logistical Networking Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu APAN Advanced](https://reader036.vdocuments.us/reader036/viewer/2022062518/56649ee85503460f94bf932e/html5/thumbnails/20.jpg)
Caching/Staging
![Page 21: Introduction to Logistical Networking Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu APAN Advanced](https://reader036.vdocuments.us/reader036/viewer/2022062518/56649ee85503460f94bf932e/html5/thumbnails/21.jpg)
Latency hiding through aggressive prestaging
Interactive Browser
Wide Area Network
Prestaging
Remote database
LAN Depot
![Page 22: Introduction to Logistical Networking Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu APAN Advanced](https://reader036.vdocuments.us/reader036/viewer/2022062518/56649ee85503460f94bf932e/html5/thumbnails/22.jpg)
Further Advanced Capabilities
• IBP over IPv6• Specialized DataMovers
• Aggressive UDP (SABUL)
• Added features coming soon…• Pipelining, Authentication, RAM resources
• Disk-to-disk transfer (Fiber Channel over IP)
• Limited computation on the depot
![Page 23: Introduction to Logistical Networking Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu APAN Advanced](https://reader036.vdocuments.us/reader036/viewer/2022062518/56649ee85503460f94bf932e/html5/thumbnails/23.jpg)
Architecture Publications
An End-to-End Approach to Globally Scalable Network Storage
Micah Beck, Terry Moore and James S. Plank ACM SIGCOMM 2002 Conference, Pittsburgh, PA, USA, August 19-23
An End-to-End Approach to Globally Scalable Programmable Networking
Micah Beck, Terry Moore and James S. Plank Workshop on Future Directions in Network Architecture,
ACM SIGCOMM 2003, Karlsruhe, Germany, August 27
![Page 24: Introduction to Logistical Networking Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu APAN Advanced](https://reader036.vdocuments.us/reader036/viewer/2022062518/56649ee85503460f94bf932e/html5/thumbnails/24.jpg)
Application Publications
An Exposed Approach to Reliable Multicast inHeterogeneous Logistical Networks
Micah Beck, Ying Ding, Erika Fuentes and Sharmila Kancherla
Workshop on Grids and Advanced Networks, Tokyo, Japan, May 12-15, 2003
Remote Visualization by Browsing Image Based Databaseswith Logistical Networking
Jin Ding, Jian Huang, Micah Beck, Shaotao Liu, Terry Moore, and Stephen Soltesz
To appear in SC 2003, Phoenix, AZ, November, 2003
![Page 25: Introduction to Logistical Networking Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu APAN Advanced](https://reader036.vdocuments.us/reader036/viewer/2022062518/56649ee85503460f94bf932e/html5/thumbnails/25.jpg)
Conclusions
• IBP supports a global 20 TB testbed for distributed applications
• Transfer rates routinely exceed 100Mbps• New Data Movers under development• More advanced features coming soon• Server runs on Linux/Unix/OS X platforms• IBP Client & LoRS also on Win32, Java