emanicslab – a distributed computing and storage testbed...
TRANSCRIPT
![Page 1: EmanicsLab – A Distributed Computing and Storage Testbed ...ffffffff-e8de-0d6a-ffff-ffff90279dc5/hau... · David Hausheer, Cristian Morariu, Thomas Bocek Principal Investigators](https://reader037.vdocuments.us/reader037/viewer/2022090606/605b8046910e38489e7239a6/html5/thumbnails/1.jpg)
© Copyright 2008, The Membersof the EMANICS Consortium
EmanicsLab EmanicsLab –– A Distributed Computing A Distributed Computing and Storage Testbed for EMANICS and Storage Testbed for EMANICS
1st EMANICS Workshop on P2P ManagementMarch 3-4, 2008, University of Zurich
David Hausheer
*Based partially on original slides by Larry Peterson, Vivek S. Pai et al. (Princeton University) and Timothy Roscoe (Intel Research Berkeley)
![Page 2: EmanicsLab – A Distributed Computing and Storage Testbed ...ffffffff-e8de-0d6a-ffff-ffff90279dc5/hau... · David Hausheer, Cristian Morariu, Thomas Bocek Principal Investigators](https://reader037.vdocuments.us/reader037/viewer/2022090606/605b8046910e38489e7239a6/html5/thumbnails/2.jpg)
2
PlanetLab PlanetLab -- What it isWhat it is• Large collection of machines spread around the world for
distributed systems research
• Established in 2002 by UC Berkeley, Princeton University, and University of Washington
• Now a consortium of companies and universities– E.g. Intel, HP, and Google
![Page 3: EmanicsLab – A Distributed Computing and Storage Testbed ...ffffffff-e8de-0d6a-ffff-ffff90279dc5/hau... · David Hausheer, Cristian Morariu, Thomas Bocek Principal Investigators](https://reader037.vdocuments.us/reader037/viewer/2022090606/605b8046910e38489e7239a6/html5/thumbnails/3.jpg)
3
PlanetLab PlanetLab -- Value PropositionValue Proposition• Institutions join, provide 2 nodes at minimum
– Hosted outside the firewall
• In exchange, researchers get a small slice of many machines worldwide– High benefit from a small entry fee
![Page 4: EmanicsLab – A Distributed Computing and Storage Testbed ...ffffffff-e8de-0d6a-ffff-ffff90279dc5/hau... · David Hausheer, Cristian Morariu, Thomas Bocek Principal Investigators](https://reader037.vdocuments.us/reader037/viewer/2022090606/605b8046910e38489e7239a6/html5/thumbnails/4.jpg)
4
PlanetLab TodayPlanetLab Today
• 836 nodes spanning 412 sites and over 35 countries– Nodes within a LAN-hop of over 3M users
• Supports distributed virtualization– Each of over 500 network services running in their own slice
• Carries real user traffic– Generating over 4 TB / contacting over 1M unique IP addresses daily
![Page 5: EmanicsLab – A Distributed Computing and Storage Testbed ...ffffffff-e8de-0d6a-ffff-ffff90279dc5/hau... · David Hausheer, Cristian Morariu, Thomas Bocek Principal Investigators](https://reader037.vdocuments.us/reader037/viewer/2022090606/605b8046910e38489e7239a6/html5/thumbnails/5.jpg)
5
PlanetLabPlanetLab Service Example 1Service Example 1
Princeton
UC Berkeley
University of Zurich
![Page 6: EmanicsLab – A Distributed Computing and Storage Testbed ...ffffffff-e8de-0d6a-ffff-ffff90279dc5/hau... · David Hausheer, Cristian Morariu, Thomas Bocek Principal Investigators](https://reader037.vdocuments.us/reader037/viewer/2022090606/605b8046910e38489e7239a6/html5/thumbnails/6.jpg)
6
PlanetLabPlanetLab Service Example 2Service Example 2
Princeton
UC Berkeley
University of Zurich
![Page 7: EmanicsLab – A Distributed Computing and Storage Testbed ...ffffffff-e8de-0d6a-ffff-ffff90279dc5/hau... · David Hausheer, Cristian Morariu, Thomas Bocek Principal Investigators](https://reader037.vdocuments.us/reader037/viewer/2022090606/605b8046910e38489e7239a6/html5/thumbnails/7.jpg)
7
PlanetLab: What does it have to PlanetLab: What does it have to do with P2Pdo with P2P
• PlanetLab is a hybrid P2P system– Nodes are relatively autonomous– Local control through admin slice
• PlanetLab enables– Deployment of P2P applications at planetary scale
• Across jurisdictional and administrative boundaries
– Evaluation of P2P applications in a realistic setting• Real latencies between nodes, nodes may be unreliable• Nothing works as expected at scale!
• Many P2P applications are tested on PlanetLab– E.g. OceanStore, Bamboo, Chord, PeerMart
• PlanetLab Challenge– Remove PlanetLab Central entirely
![Page 8: EmanicsLab – A Distributed Computing and Storage Testbed ...ffffffff-e8de-0d6a-ffff-ffff90279dc5/hau... · David Hausheer, Cristian Morariu, Thomas Bocek Principal Investigators](https://reader037.vdocuments.us/reader037/viewer/2022090606/605b8046910e38489e7239a6/html5/thumbnails/8.jpg)
8
Drawbacks of PlanetLabDrawbacks of PlanetLab• PlanetLab configuration and control is done centrally by
PlanetLab administrators– Users needs cannot always be accommodated– Could be a problem if strong trust relationships and access
protection mechanisms are required• E.g., for trace repositories
• Resources in PlanetLab are limited– Standard disk quota only 5GB per user on each node– Distributed flow collection requires much more storage– A load average of 7 is not uncommon on PlanetLab nodes
![Page 9: EmanicsLab – A Distributed Computing and Storage Testbed ...ffffffff-e8de-0d6a-ffff-ffff90279dc5/hau... · David Hausheer, Cristian Morariu, Thomas Bocek Principal Investigators](https://reader037.vdocuments.us/reader037/viewer/2022090606/605b8046910e38489e7239a6/html5/thumbnails/9.jpg)
9
Benefits of EmanicsLabBenefits of EmanicsLab• EmanicsLab is dedicated to Emanics
– Enables the flexible allocation of resources to research activities within Emanics
– Ensures that the control of the testbed stays within the NoE
– Access to the testbed can be restricted if necessary– Extensions or changes to the testbed can be done
• E.g., use of a different virtualization platform– Specific services supporting research on network and
service management can be provided• E.g., distributed trace repositories
![Page 10: EmanicsLab – A Distributed Computing and Storage Testbed ...ffffffff-e8de-0d6a-ffff-ffff90279dc5/hau... · David Hausheer, Cristian Morariu, Thomas Bocek Principal Investigators](https://reader037.vdocuments.us/reader037/viewer/2022090606/605b8046910e38489e7239a6/html5/thumbnails/10.jpg)
10
EmanicsLab SitesEmanicsLab Sites
2 nodes
2 nodes
2 nodes
2 nodes + EmanicsLab PLC2 nodes
2 nodes
user only
2 nodesTotal:• 8 sites• 14 nodes• 30 users• 11 slices
February 2008
![Page 11: EmanicsLab – A Distributed Computing and Storage Testbed ...ffffffff-e8de-0d6a-ffff-ffff90279dc5/hau... · David Hausheer, Cristian Morariu, Thomas Bocek Principal Investigators](https://reader037.vdocuments.us/reader037/viewer/2022090606/605b8046910e38489e7239a6/html5/thumbnails/11.jpg)
11
EmanicsLab NodesEmanicsLab Nodes
9290 GB
2000 GB2000 GB
750 GB750 GB
200 GB250 GB
150 GB150 GB
800 GB1080 GB
80 GB80 GB
500 GB500 GB
HDD CPURAMHostnameSite
Dual Core Xeon, 3.0 GHzDual Core Xeon, 3.0 GHz
4 GB4 GB
emanicslab1.ewi.utwente.nlemanicslab2.ewi.utwente.nl
UT
27.6 GB
2 GB3 GB
1 GB1 GB
2 GB2 GB
1 GB3.6 GB
1 GB1 GB
1 GB1 GB
host1-plb.loria.frhost2-plb.loria.fr
moscu.upc.esmuro.upc.es
emanicslab1.informatik.unibw-muenchen.deemanicslab2.informatik.unibw-muenchen.de
emanicslab1.lab.ifi.lmu.deemanicslab2.lab.ifi.lmu.de
emanicslab1.eecs.jacobs-university.deemanicslab2.eecs.jacobs-university.de
emanicslab1.csg.uzh.chemanicslab2.csg.uzh.ch
Pentium 4, 3.0 GHzCore 2, 2.93 GHz
INRIA
Athlon XP, 1.4 GHzCore 2, 2.13 GHz
UPC
Xeon, 3.0 GHzXeon, 3.0 GHz
UniBW
Pentium 4, 3 GHzCore 2, 2.13 GHz
LMU
Pentium D, 2.8 GHzPentium D, 2.8 GHz
IUB
Pentium 4, 3.6 GHzPentium 4, 3.6 GHz
UniZH
![Page 12: EmanicsLab – A Distributed Computing and Storage Testbed ...ffffffff-e8de-0d6a-ffff-ffff90279dc5/hau... · David Hausheer, Cristian Morariu, Thomas Bocek Principal Investigators](https://reader037.vdocuments.us/reader037/viewer/2022090606/605b8046910e38489e7239a6/html5/thumbnails/12.jpg)
12
EmanicsLab SlicesEmanicsLab Slices
Ramin Sadreut_snidRamin SadreUT
Stylianos GeorgoulasUniS
INRIA
UPC
UniBW
LMU
IUB
UniZH
Sites
Emmanuel Nataf
Pau Valles
Frank Eyermann
Feng Liu
Juergen Schoenwaelder
David Hausheer,Cristian Morariu,Thomas Bocek
Principal Investigators
inria_p2psipinria_p2prevocationInria_jump
upc_sblomars
unibw_asam
iub_buglook
uzh_voipuzh_dattauzh_fastssuzh_iploc
Slices
Balamurugan KarpagavinayagamThibault CholezEmmanuel Nataf
Pau Valles
Frank Eyermann
Stefan Huber, Gregor SchaffrathCristian Morariu, Nicolas Baumgardt, Feng LiuDalibor Peric, Thomas Bocek, Fabio HechtMartin Waldburger, Stefan Bösch
Users
Further EMANICS partners can join, if they like to use EmanicsLab
![Page 13: EmanicsLab – A Distributed Computing and Storage Testbed ...ffffffff-e8de-0d6a-ffff-ffff90279dc5/hau... · David Hausheer, Cristian Morariu, Thomas Bocek Principal Investigators](https://reader037.vdocuments.us/reader037/viewer/2022090606/605b8046910e38489e7239a6/html5/thumbnails/13.jpg)
13
EmanicsLab Monitoring: EmanicsLab Monitoring: PlanetFlowPlanetFlow
![Page 14: EmanicsLab – A Distributed Computing and Storage Testbed ...ffffffff-e8de-0d6a-ffff-ffff90279dc5/hau... · David Hausheer, Cristian Morariu, Thomas Bocek Principal Investigators](https://reader037.vdocuments.us/reader037/viewer/2022090606/605b8046910e38489e7239a6/html5/thumbnails/14.jpg)
14
EmanicsLab Monitoring: GangliaEmanicsLab Monitoring: Ganglia
![Page 15: EmanicsLab – A Distributed Computing and Storage Testbed ...ffffffff-e8de-0d6a-ffff-ffff90279dc5/hau... · David Hausheer, Cristian Morariu, Thomas Bocek Principal Investigators](https://reader037.vdocuments.us/reader037/viewer/2022090606/605b8046910e38489e7239a6/html5/thumbnails/15.jpg)
15
EmanicsLab Monitoring: ElabMoniEmanicsLab Monitoring: ElabMoni
![Page 16: EmanicsLab – A Distributed Computing and Storage Testbed ...ffffffff-e8de-0d6a-ffff-ffff90279dc5/hau... · David Hausheer, Cristian Morariu, Thomas Bocek Principal Investigators](https://reader037.vdocuments.us/reader037/viewer/2022090606/605b8046910e38489e7239a6/html5/thumbnails/16.jpg)
16
EmanicsLab Web InterfaceEmanicsLab Web Interface