resurce provisioning.ppt

Upload: kamleshadhau

Post on 14-Apr-2018

216 views

Category:

Documents


0 download

TRANSCRIPT

  • 7/27/2019 resurce provisioning.ppt

    1/18

    Euro-TM meeting 19-20 May 2011WG5: Applications & Performance Evaluation

    S. Distefano, M. Fazio, A. Puliafito

    (sd istefano , m fazio, apuliaf i to ) @ un ime.it

  • 7/27/2019 resurce provisioning.ppt

    2/18

    2

    Applications/services and basic functions provided in a Cloud are

    based on the Virtual Resources which are abstracted from PhysicalResources. Virtual physical resources, such as V-CPUs, V-Storages, V-Networks etc.

    V-Networks can be further divided into V-Routers, V-Switches,V-Firewalls, VPNs, V-Interfaces, V-Links based on physical Router/ Switch equipments.

    Computational resources are managed in terms of Virtual

    Machines(VMs) and/or Virtual Clusters (VCs).

  • 7/27/2019 resurce provisioning.ppt

    3/18

    To prepare VMs with appropriate resources andmake them ready for user applications Allocating resources to VMs to match the workloads

    To prepare a virtual cluster with appropriateinstances and make it ready for virtual cluster

    computation To manage changes in resources availability

    through VMs restore or migration

    Goals:

    High resource utilization Energy efficiency reliability of services Low performance interference

  • 7/27/2019 resurce provisioning.ppt

    4/18

    ResourceBroker 3

    ResourceBroker 2

    ResourceBroker 1

    VM

    VM

    VM

    VMVirtualized Service

    VM

    VM

    VM Virtualized Service

    VM

    VM

    VM

    VMVirtualized Service

    VM

    VMVirtualized Service

  • 7/27/2019 resurce provisioning.ppt

    5/18

    5

    Resource Providers (RPs) Business companies, cluster managers and even hosts which provide

    physical resources as IaaS (Infrastructure as a Service).

    Clients Users/Application that are interested in resource provisioning. They do not have knowledge regarding or control over the underlying

    data center infrastructures of the Clouds

    Resource Brokers (RBs) allocate resources for applications/services on multiple VMs in order to

    fulfill requests of different Clientsmanage resources provided by several RPs deploying VMs on severalPhysical Servers in the same Cloud, or even different Clouds.

    resource allocation in order to obtain the most cost-effectiveresources

  • 7/27/2019 resurce provisioning.ppt

    6/18

    collecting and indexing all the resources available from severalcloud providers

    translating the application requirements (expressed in terms ofhigh-level parameters such as execution time, throughput,transaction rate) into low-level criteria related to computing,storage and network distributed resources

    estimating the capacity needs of Virtual Machines (VMs), managing the available resources in order to ensure specificrequirements of QoS

    monitoring the usage of allocated resources in order to guarateethe SLA with the user

    performing load balancing based on resource consumption.

    dynamically reallocating resources, so to have a more efficientlyuse of available resources when Application/Services request to allocate (extra) resources,

    checking whether they are authorized managing VMs migration among different physical sites.

  • 7/27/2019 resurce provisioning.ppt

    7/18

    Transactions can be proposed as alightweight mechanism to synchronize all theactivities of resource Brokers

    Transactions alleviates many of the problemsassociated with the locking of VRs during theallocation task

    STM implementation to protect shared VRs

  • 7/27/2019 resurce provisioning.ppt

    8/188

  • 7/27/2019 resurce provisioning.ppt

    9/18

    Managing concurrent allocations fromdifferent RBs cut off locks and their related problems in process

    concurrence

    Consistency of information whenever RPsupdate their resources RBs can force some kind of priorities among

    transactions

    Depending on the implementation, this prioritycould either be the age of a transaction or the typeof activity (e.g. VM allocation, VM migration,resource discovery...)

  • 7/27/2019 resurce provisioning.ppt

    10/18

    Granularity of transactions is object-based,where objects are VMs.

    Objects are shadowed, rather than changedin place.

    Commit tries to set the clone as thecurrent object.

    Abort destroy the current clone and triesto set a new clone from the current objects.

  • 7/27/2019 resurce provisioning.ppt

    11/18

    Buffering Local cache of available VR clones

    Conflict detection Cache coherence protocol

    Abort/Recovery Invalidate transactional cache activity

    Commit Validate transactional cache activity

    ResourceBrokerVM

    VMVirtualized Service

    VM

    VM

    VM

    VM

    VM

    VM

    VM

    VM

    Buffering

    Commit

    Conflict

    detection

    Abort/Recovery

    TransactionMana

    ger

    ResourceDiscovery

  • 7/27/2019 resurce provisioning.ppt

    12/18

    CM is an agent in the Transaction Manager. Notified of transaction events Decides what to do on a conflict:

    Abort a transaction or spin-wait Which transaction to abort, if any

    Several available policies Aggressive, Polite, Randomized, Greedy, Karma, Timestamp

    In Cloud systems, new policies need to be designed tomanage different types of activities user-oriented policy provider-oriented policy economy-driven policy

  • 7/27/2019 resurce provisioning.ppt

    13/18

    Representation of VRs VMs and VCs

    Atomization strategies to design RB tasks

    Managing dynamic resources resources abruptly disappear during a transaction

  • 7/27/2019 resurce provisioning.ppt

    14/18

    Clever Virtual Infrastructure management layer to access

    and administrate private/hybrid clouds.

    Provider of Iaas

    https://clever.unime.it Cloud@Home

    volunteer computing into the Cloud computingparadigm

    C@H architecture works as a Cloud Broker https://cloudathome.unime.it/

    https://clever.unime.it/https://cloudathome.unime.it/https://cloudathome.unime.it/https://clever.unime.it/
  • 7/27/2019 resurce provisioning.ppt

    15/18

    RQM is responsible for the

    management of resources

    and services needed to

    achieve the application

    requirements imposed by

    the SLA manager.

  • 7/27/2019 resurce provisioning.ppt

    16/18

    State Tracker

    RequestHandler

    Front endInterface

    ResourceManager

    Discovery

    LayerInterface

    Front end

    SLACloud

    Providers

    Discovery

    Layer

    Deuce: runtime environment forJava Software TransactionalMemory (STM)http://www.deucestm.org

    State Tracker It keeps the state of the requestsstored by the Request Handler and theirassociated resources

    It also acts as the essential eventdispatcher into which other componentscan hook routines.

    http://www.deucestm.org/http://www.deucestm.org/http://www.deucestm.org/http://www.deucestm.org/http://www.deucestm.org/http://www.deucestm.org/http://www.deucestm.org/http://www.deucestm.org/
  • 7/27/2019 resurce provisioning.ppt

    17/18

    STM to support resource provisioning in Cloudenvironments:

    Managing concurrent RBs activities andresource updates from RPs

    Increasing VMs allocation efficiency

    Specific policies in the CM to designtransaction management strategies

    Use case: C@H project

  • 7/27/2019 resurce provisioning.ppt

    18/18