p2p-tuple: towards a robust volunteer computing platform
TRANSCRIPT
![Page 1: P2P-Tuple: Towards a Robust Volunteer Computing Platform](https://reader035.vdocuments.us/reader035/viewer/2022081401/55836c7ad8b42a972b8b4f79/html5/thumbnails/1.jpg)
. . . . . .
Volunteer ComputingP2P-Tuple Architecture
EvaluationFuture
.
.. ..
.
.
P2P-Tuple: Towards a Robust VolunteerComputing Platform
Emmanouil Dimogerontakis
FIB UPC
March 13, 2012
1 / 27
![Page 2: P2P-Tuple: Towards a Robust Volunteer Computing Platform](https://reader035.vdocuments.us/reader035/viewer/2022081401/55836c7ad8b42a972b8b4f79/html5/thumbnails/2.jpg)
. . . . . .
Volunteer ComputingP2P-Tuple Architecture
EvaluationFuture
Importance of VCVC Infrastructures
.. .1 Volunteer ComputingImportance of VCVC Infrastructures
.. .2 P2P-Tuple ArchitectureOverviewPeer Design
.. .3 EvaluationSimulationResults
.. .4 Future
2 / 27
![Page 3: P2P-Tuple: Towards a Robust Volunteer Computing Platform](https://reader035.vdocuments.us/reader035/viewer/2022081401/55836c7ad8b42a972b8b4f79/html5/thumbnails/3.jpg)
. . . . . .
Volunteer ComputingP2P-Tuple Architecture
EvaluationFuture
Importance of VCVC Infrastructures
.. Grid-y for Science
3 / 27
![Page 4: P2P-Tuple: Towards a Robust Volunteer Computing Platform](https://reader035.vdocuments.us/reader035/viewer/2022081401/55836c7ad8b42a972b8b4f79/html5/thumbnails/4.jpg)
. . . . . .
Volunteer ComputingP2P-Tuple Architecture
EvaluationFuture
Importance of VCVC Infrastructures
.. BOINC
4 / 27
![Page 5: P2P-Tuple: Towards a Robust Volunteer Computing Platform](https://reader035.vdocuments.us/reader035/viewer/2022081401/55836c7ad8b42a972b8b4f79/html5/thumbnails/5.jpg)
. . . . . .
Volunteer ComputingP2P-Tuple Architecture
EvaluationFuture
Importance of VCVC Infrastructures
.. P2P-Tuple Contribution
5 / 27
![Page 6: P2P-Tuple: Towards a Robust Volunteer Computing Platform](https://reader035.vdocuments.us/reader035/viewer/2022081401/55836c7ad8b42a972b8b4f79/html5/thumbnails/6.jpg)
. . . . . .
Volunteer ComputingP2P-Tuple Architecture
EvaluationFuture
OverviewPeer Design
.. .1 Volunteer ComputingImportance of VCVC Infrastructures
.. .2 P2P-Tuple ArchitectureOverviewPeer Design
.. .3 EvaluationSimulationResults
.. .4 Future
6 / 27
![Page 7: P2P-Tuple: Towards a Robust Volunteer Computing Platform](https://reader035.vdocuments.us/reader035/viewer/2022081401/55836c7ad8b42a972b8b4f79/html5/thumbnails/7.jpg)
. . . . . .
Volunteer ComputingP2P-Tuple Architecture
EvaluationFuture
OverviewPeer Design
.. Base technologies
7 / 27
![Page 8: P2P-Tuple: Towards a Robust Volunteer Computing Platform](https://reader035.vdocuments.us/reader035/viewer/2022081401/55836c7ad8b42a972b8b4f79/html5/thumbnails/8.jpg)
. . . . . .
Volunteer ComputingP2P-Tuple Architecture
EvaluationFuture
OverviewPeer Design
.. Base technologies
8 / 27
![Page 9: P2P-Tuple: Towards a Robust Volunteer Computing Platform](https://reader035.vdocuments.us/reader035/viewer/2022081401/55836c7ad8b42a972b8b4f79/html5/thumbnails/9.jpg)
. . . . . .
Volunteer ComputingP2P-Tuple Architecture
EvaluationFuture
OverviewPeer Design
.. Base technologies
9 / 27
![Page 10: P2P-Tuple: Towards a Robust Volunteer Computing Platform](https://reader035.vdocuments.us/reader035/viewer/2022081401/55836c7ad8b42a972b8b4f79/html5/thumbnails/10.jpg)
. . . . . .
Volunteer ComputingP2P-Tuple Architecture
EvaluationFuture
OverviewPeer Design
.. Overall Operation
Step 1: Peers join the overlay and a SCRIBE group.Step 2: Group owners submit their task to the Tuple Space using aclient program.(Tasks can also be pipelined)Step 3: Peers periodically broadcasts task notificationmessage.Step 4: Peers in the same group start pulling jobs related to thattask.Step 5: Notified peers spread the word.Step 6: Once the job is finished the result is put encoded back onthe Tuple Space.
10 / 27
![Page 11: P2P-Tuple: Towards a Robust Volunteer Computing Platform](https://reader035.vdocuments.us/reader035/viewer/2022081401/55836c7ad8b42a972b8b4f79/html5/thumbnails/11.jpg)
. . . . . .
Volunteer ComputingP2P-Tuple Architecture
EvaluationFuture
OverviewPeer Design
.. Peer Design
11 / 27
![Page 12: P2P-Tuple: Towards a Robust Volunteer Computing Platform](https://reader035.vdocuments.us/reader035/viewer/2022081401/55836c7ad8b42a972b8b4f79/html5/thumbnails/12.jpg)
. . . . . .
Volunteer ComputingP2P-Tuple Architecture
EvaluationFuture
OverviewPeer Design
.. Peer Daemon
12 / 27
![Page 13: P2P-Tuple: Towards a Robust Volunteer Computing Platform](https://reader035.vdocuments.us/reader035/viewer/2022081401/55836c7ad8b42a972b8b4f79/html5/thumbnails/13.jpg)
. . . . . .
Volunteer ComputingP2P-Tuple Architecture
EvaluationFuture
OverviewPeer Design
.. Job Executor Daemon
13 / 27
![Page 14: P2P-Tuple: Towards a Robust Volunteer Computing Platform](https://reader035.vdocuments.us/reader035/viewer/2022081401/55836c7ad8b42a972b8b4f79/html5/thumbnails/14.jpg)
. . . . . .
Volunteer ComputingP2P-Tuple Architecture
EvaluationFuture
OverviewPeer Design
.. Measures to Achieve Fault Tolerance
Measure: Provide high availability, face high churn rate, remainreliable.Effect: Redundancy of data, Replication, use of Erasure Code.
Measure: Loss of data from high churn rateEffect: Communicating Mirrored Replicas of stored objects.Measure: Untrusted peers, possible low job completion probability.Effect: Job Duplication using a randomized job scheduling scheme.Measure: Disconnecting Client Application.Effect: Checkpoints.
14 / 27
![Page 15: P2P-Tuple: Towards a Robust Volunteer Computing Platform](https://reader035.vdocuments.us/reader035/viewer/2022081401/55836c7ad8b42a972b8b4f79/html5/thumbnails/15.jpg)
. . . . . .
Volunteer ComputingP2P-Tuple Architecture
EvaluationFuture
OverviewPeer Design
.. Measures to Achieve Fault Tolerance
Measure: Provide high availability, face high churn rate, remainreliable.Effect: Redundancy of data, Replication, use of Erasure Code.Measure: Loss of data from high churn rateEffect: Communicating Mirrored Replicas of stored objects.
Measure: Untrusted peers, possible low job completion probability.Effect: Job Duplication using a randomized job scheduling scheme.Measure: Disconnecting Client Application.Effect: Checkpoints.
15 / 27
![Page 16: P2P-Tuple: Towards a Robust Volunteer Computing Platform](https://reader035.vdocuments.us/reader035/viewer/2022081401/55836c7ad8b42a972b8b4f79/html5/thumbnails/16.jpg)
. . . . . .
Volunteer ComputingP2P-Tuple Architecture
EvaluationFuture
OverviewPeer Design
.. Measures to Achieve Fault Tolerance
Measure: Provide high availability, face high churn rate, remainreliable.Effect: Redundancy of data, Replication, use of Erasure Code.Measure: Loss of data from high churn rateEffect: Communicating Mirrored Replicas of stored objects.Measure: Untrusted peers, possible low job completion probability.Effect: Job Duplication using a randomized job scheduling scheme.
Measure: Disconnecting Client Application.Effect: Checkpoints.
16 / 27
![Page 17: P2P-Tuple: Towards a Robust Volunteer Computing Platform](https://reader035.vdocuments.us/reader035/viewer/2022081401/55836c7ad8b42a972b8b4f79/html5/thumbnails/17.jpg)
. . . . . .
Volunteer ComputingP2P-Tuple Architecture
EvaluationFuture
OverviewPeer Design
.. Measures to Achieve Fault Tolerance
Measure: Provide high availability, face high churn rate, remainreliable.Effect: Redundancy of data, Replication, use of Erasure Code.Measure: Loss of data from high churn rateEffect: Communicating Mirrored Replicas of stored objects.Measure: Untrusted peers, possible low job completion probability.Effect: Job Duplication using a randomized job scheduling scheme.Measure: Disconnecting Client Application.Effect: Checkpoints.
17 / 27
![Page 18: P2P-Tuple: Towards a Robust Volunteer Computing Platform](https://reader035.vdocuments.us/reader035/viewer/2022081401/55836c7ad8b42a972b8b4f79/html5/thumbnails/18.jpg)
. . . . . .
Volunteer ComputingP2P-Tuple Architecture
EvaluationFuture
SimulationResults
.. .1 Volunteer ComputingImportance of VCVC Infrastructures
.. .2 P2P-Tuple ArchitectureOverviewPeer Design
.. .3 EvaluationSimulationResults
.. .4 Future
18 / 27
![Page 19: P2P-Tuple: Towards a Robust Volunteer Computing Platform](https://reader035.vdocuments.us/reader035/viewer/2022081401/55836c7ad8b42a972b8b4f79/html5/thumbnails/19.jpg)
. . . . . .
Volunteer ComputingP2P-Tuple Architecture
EvaluationFuture
SimulationResults
.. Impact of mirrors
.Result.... ..
.
.Using 1 or 2 mirrors extends the duration of the data availability.
19 / 27
![Page 20: P2P-Tuple: Towards a Robust Volunteer Computing Platform](https://reader035.vdocuments.us/reader035/viewer/2022081401/55836c7ad8b42a972b8b4f79/html5/thumbnails/20.jpg)
. . . . . .
Volunteer ComputingP2P-Tuple Architecture
EvaluationFuture
SimulationResults
.. Impact of Redundancy Level
.Result..
.. ..
.
.
The increase of the duration of data availability is proportionate tothe increase of Redundancy level.
20 / 27
![Page 21: P2P-Tuple: Towards a Robust Volunteer Computing Platform](https://reader035.vdocuments.us/reader035/viewer/2022081401/55836c7ad8b42a972b8b4f79/html5/thumbnails/21.jpg)
. . . . . .
Volunteer ComputingP2P-Tuple Architecture
EvaluationFuture
SimulationResults
.. Behavior in high churn environment
.Result.... ..
.
.In a high churn rate environment the availability decreases easily.
21 / 27
![Page 22: P2P-Tuple: Towards a Robust Volunteer Computing Platform](https://reader035.vdocuments.us/reader035/viewer/2022081401/55836c7ad8b42a972b8b4f79/html5/thumbnails/22.jpg)
. . . . . .
Volunteer ComputingP2P-Tuple Architecture
EvaluationFuture
SimulationResults
.. Results
A Volunteer Computing infrastructure:DecentralizedFault Tolerant
that provides:High AvailabilityReliability
22 / 27
![Page 23: P2P-Tuple: Towards a Robust Volunteer Computing Platform](https://reader035.vdocuments.us/reader035/viewer/2022081401/55836c7ad8b42a972b8b4f79/html5/thumbnails/23.jpg)
. . . . . .
Volunteer ComputingP2P-Tuple Architecture
EvaluationFuture
SimulationResults
.. Results
A Volunteer Computing infrastructure:DecentralizedFault Tolerant
that provides:High AvailabilityReliability
23 / 27
![Page 24: P2P-Tuple: Towards a Robust Volunteer Computing Platform](https://reader035.vdocuments.us/reader035/viewer/2022081401/55836c7ad8b42a972b8b4f79/html5/thumbnails/24.jpg)
. . . . . .
Volunteer ComputingP2P-Tuple Architecture
EvaluationFuture
.. .1 Volunteer ComputingImportance of VCVC Infrastructures
.. .2 P2P-Tuple ArchitectureOverviewPeer Design
.. .3 EvaluationSimulationResults
.. .4 Future
24 / 27
![Page 25: P2P-Tuple: Towards a Robust Volunteer Computing Platform](https://reader035.vdocuments.us/reader035/viewer/2022081401/55836c7ad8b42a972b8b4f79/html5/thumbnails/25.jpg)
. . . . . .
Volunteer ComputingP2P-Tuple Architecture
EvaluationFuture
.. Future
Optimizing current infrastructures and ensure system stability”MPI-like” support”MapReduce-like” support
25 / 27
![Page 26: P2P-Tuple: Towards a Robust Volunteer Computing Platform](https://reader035.vdocuments.us/reader035/viewer/2022081401/55836c7ad8b42a972b8b4f79/html5/thumbnails/26.jpg)
. . . . . .
Volunteer ComputingP2P-Tuple Architecture
EvaluationFuture
26 / 27
![Page 27: P2P-Tuple: Towards a Robust Volunteer Computing Platform](https://reader035.vdocuments.us/reader035/viewer/2022081401/55836c7ad8b42a972b8b4f79/html5/thumbnails/27.jpg)
. . . . . .
Volunteer ComputingP2P-Tuple Architecture
EvaluationFuture
.. Bibliography & Useful Links
Lei Ni, Aaron Harwood, P2P-Tuple: Towards a RobustVolunteer Computing Platform. International Conference onParallel and Distributed Computing, Applications andTechnologies, 2009.Hao Ning, Robust Overlay networks for Volunteer Computing.Master thesis on Chalmers University of Technology, 2010.http://ww2.cs.mu.oz.au/~lni/p2ptuple/.http://www.freepastry.org
27 / 27