Adaptive Matchmaking in Distributed ComputingKoen Bertels, Kamana Sigdel, Behnaz Pour Ebrahimi, Stamatis Vassiliadis,Email:

{koen,kamana,behnaz, stamatis}@ce.tudelft.nl

MotivationMotivation

Computer Engineering Mekelweg 4 (15th floor)2628 CD Delft The Netherlands Phone: (+31) 15 2783644 Fax : (+31) 15 2784898http://ce.et.tudelft.nl

Associated ProblemsAssociated Problems

Meta View of the SystemMeta View of the System

Adaptive ApproachAdaptive Approach

Consumer attributes => { resource request, job manager, job queue } Producer attributes => { resource report , resource manager, resource context }Matchmaker attributes => { resource list, job list, matchmaking

function machmaker list, load balancer }

Designing an adaptive and robust mechanism that enables the network to change its internal matchmaking approach from peer to peer to a more centralized form or vice versa whenever it is required.

Centralized matchmaking:• Low scalability: efficient only in a certain range of population size• Low robustness: - when matchmaker leaves the network/ goes down due to connection failure or overloaded with information

Peer to peer:• Low throughput: when there is no interaction between nodes’ neighborhoods

Faculty of Electrical Engineering, Mathematics and Computer ScienceDelft University of Technology

Adaptation IssuesAdaptation Issues

• how, when and who decides to reconfigure the system?• how an individual node becomes a matchmaker?• how to partition the system into segments to balance between jobs and resources?

For instance, • when population size of the system grows beyond the capacity of single matchmaker, then adapt to more localized model i.e. partition the system into segment each segment having its own matchmaker

• when population size of the system shrinks, then adapt to more centralized model i.e. combine the segments to reduce the number of matchmakers

Node AttributesNode Attributes

Matchmaker Job

Leaving/joiningsystem

Resource

Legends

TCP/IP

Req

uest

Man

ager

Resou

rce

Man

ager

Job Manager

Offer

Manager

TCP/IP

TCP/IP

Request

Manager

Producer

Matchmaker

Consumer

System ModelSystem Model

Adaptation ModelAdaptation Model

System Level:• more matchmakers – when system grows• less matchmakers – when system shrinks

Node Level:• producer/consumer => matchmaker • matchmaker => producer/consumer

1 2 3 N-1 N…