european commission directorate-general information society unit f2 – grid technologies insert...
Post on 14-Dec-2015
218 Views
Preview:
TRANSCRIPT
INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW / MASTER / SLIDE MASTER)
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
Overview of Overview of GCM GCM (Grid Component Model)(Grid Component Model) andand Grid GridCOMPCOMPEU ProjectEU Project
Denis Caromel Denis Caromel
OASIS INRIA-UNSA-CNRS I3SOASIS INRIA-UNSA-CNRS I3S
Melbourne, Jan. 29 2007Melbourne, Jan. 29 2007
1. ProActive context1. ProActive context2. GCM2. GCM
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
ProActive andProActive and GCM GCM
• StructuringStructuring
of the libraryof the library3 big layersInner bricks
• Component Component
Aspects: notAspects: not
onlyonly
in Cp Box!in Cp Box!
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
ProActiveProActive• New GUIsNew GUIs
IC2D EclipseTimIt
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
Grid Computing with Grid Computing with ProActiveProActive
Melbourne
Amsterdam
Beijing
Shanghai
Hierarchical
Deployment
Challenges: Programming Model,
Scale, Latency, Heterogeneity,
Versatility (protocols,firewalls...)
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
A
ProActiveProActive : Active objects : Active objects
Proxy
Java Object
A ag = newActive (“A”, […], VirtualNode)V v1 = ag.foo (param);V v2 = ag.bar (param);...v1.bar(); //Wait-By-Necessity
V
Wait-By-Necessity
is a
Dataflow
Synchronization
JVM
A
JVM
Active Object
Future Object Request
Req. Queue
Thread
v1v2 ag
WBN!
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
A
Creating AO and GroupsCreating AO and Groups
Typed Group Java or Active Object
A ag = newActiveGroup (“A”, […], VirtualNode)V v = ag.foo(param);...v.bar(); //Wait-by-necessity
V
Group, Type, and Asynchrony
are crucial for Cpt. and GRID
JVM
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
Objects to Distributed ComponentsObjects to Distributed Components
Typed Group Java or Active Object
ComponentIdentity Cpt = newActiveComponent (params);A a = Cpt … .getFcInterface ("interfaceName");V v = a.foo(param);
V
AExample
of a
component
instance
JVM
Truly
Distributed
Components
INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW / MASTER / SLIDE MASTER)
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
GCMGCM + +
Scopes and Objectives:Scopes and Objectives:
Grid Codes that Compose and DeployGrid Codes that Compose and Deploy
No programming, No Scripting, … No PainNo programming, No Scripting, … No Pain
Innovation:Innovation:
Composite Components Composite Components
Multicast and GatherCastMulticast and GatherCast
MultiCastMultiCast GatherCastGatherCast
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
• GCM: Grid Component ModelGCM: Grid Component ModelGCM Being defined in the NoE CoreGRID
(42 institutions)
Open Source ObjectWeb ProActive implements a preliminary version of GCMService Oriented: NESSI relation exp.
• GridCOMP takes:GridCOMP takes:GCM as a first specification, ProActive as a starting point, and Open Source reference implementation.
The vision: The vision: GCMGCM to be the GRID to be the GRID GSMGSM
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
GridCOMP PartnersGridCOMP Partners
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
GCM ArchitectureGCM Architecture
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
GCM Technical StructureGCM Technical Structure
1. Component Specification as an XML schema or DTD
2. Run-Time API defined in several languages
C, Java
3. Packaging described as an XML schema
4. Information for Deployment
(Virtual Nodes, … Variables, File Transfer, …)
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
Content and ActivitiesContent and Activities
• 1 - Primitive Component Programming1 - Primitive Component Programming
• 2 - Legacy Code Wrapping, Interoperability2 - Legacy Code Wrapping, Interoperability
• 3 - Composition and Composites, Deployment3 - Composition and Composites, Deployment
• 4 – Autonomic features4 – Autonomic features
• 5 – IDE for GCM (Composition GUI, etc.)5 – IDE for GCM (Composition GUI, etc.)
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
Collective InterfacesCollective Interfaces
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
Collective InterfacesCollective Interfaces
• SimplifySimplify the design and configuration of the design and configuration of component systemscomponent systems
• ExposeExpose the collective nature of interfaces the collective nature of interfacesCardinality attributeMulticast, Gathercast, gather-multicast
• The framework handles collective behaviour The framework handles collective behaviour • at the level of the interfaceat the level of the interface
• Based on Fractal API : Based on Fractal API : Dedicated controller Interface typing Verifications
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
Multicast interfacesMulticast interfaces
Transform a single invocation into a list of invocationsTransform a single invocation into a list of invocations
• Multiple invocationsMultiple invocationsParallelismAsynchronismDispatch
• Data redistribution (invocation parameters)Data redistribution (invocation parameters)Parameterisable: Distribution FunctionBroadcast, scatteringDynamic redistribution: Dynamic dispatch
• Result = Result = listlist of results of results
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
Multicast interfacesMulticast interfacesResults as lists of resultsResults as lists of results
Invocation parameters may also be Invocation parameters may also be distributed from listsdistributed from lists
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
Gathercast interfacesGathercast interfaces
Transform: Transform:
a list of invocations a list of invocations
a single invocationa single invocation
• Synchronization of incoming Synchronization of incoming invocationsinvocations~ “join” invocationsTimeout / Drop policyBidirectional Bindings (callers
callee)
• Data gatheringData gathering
Aggregation of parameters into lists
• Result: Result:
Redistribution of resultsRedistribution of results
Redistribution function
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
Status of GCM in ProActiveStatus of GCM in ProActive
• Partial implementation: Partial implementation: ADL schema, API, Multicast, Gathercast, …Component GUI (prototype)
• Distributed components for various applications: Distributed components for various applications: Numerical, Legacy, …
• On-going experiments:On-going experiments:up to 300+ CPUs
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
Current GCM experiments in ProActiveCurrent GCM experiments in ProActive
• JEM3D: 3D JEM3D: 3D electromagnetic electromagnetic application: application:
a single Cp on 300+ a single Cp on 300+ CPUs on GridCPUs on Grid
• Vibro-Acoustic Vibro-Acoustic application with application with EADS (legacy MPI EADS (legacy MPI coupling)coupling)
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
Current GCM experiments in ProActiveCurrent GCM experiments in ProActive
• IBM:IBM:Security Fingerprint System
• ATOS Origin:ATOS Origin:Financial Application Optimization
• GridSystems:GridSystems:Wing SimulationTelecom Application, EDR processing
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
Update on ProActive and GCM (1)Update on ProActive and GCM (1)
• New Version under preparation:New Version under preparation:
Nov. 10: ProActive Version 3.2 Beta
Jan. 26: ProActive Version 3.2(After PlugTests’ Learning, New Web
Site)
New features in 3.2 release:Next slide
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
New Web Site with 3.2 VersionNew Web Site with 3.2 Version
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
Chinese Web thank to Tsinghua Univ.Chinese Web thank to Tsinghua Univ.
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
Update on ProActive and GCM (2)Update on ProActive and GCM (2)
• New Features in ProActive Version 3.2:New Features in ProActive Version 3.2:New features in 3.2 release:
Conformance tests for Fractal, towards conformance tests for GCM
IC2D Eclipse Plugin
TimIt (Hierarchical, Visual)
Skeleton (improved, with File Transfer, Documentation)
gLite EGEE deployment updated
Support for Java 1.5 Generics:Active Objects can be instantiated from Generic Classes
Some Warnings removed
Improvements in OSGi integration
Prototype TTools for UML modeling of GCM components (TBC)
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
A Vision:A Vision:GCM as EU’s GSMGCM as EU’s GSM
• Once upon a time: Once upon a time: GSM: Global System for Mobile communication
• Process: Process: “critical decisions […] the GSM initiative became a success in
Europe […] Initially the strategy and technical specifications were agreed for
Europe and […] incorporating all non-European requirements […] worldwide to participate ”
From: Gsm & Umts: The Creation From: Gsm & Umts: The Creation
of Global Mobile Communicationsof Global Mobile Communications
Standardization of GSM was crucial for Standardization of GSM was crucial for EU advances in Mobile Telephony EU advances in Mobile Telephony
(Science and Business)(Science and Business)
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
A Vision:A Vision:GCM as EU’s GSMGCM as EU’s GSM
GRID faces the same challenge: GRID faces the same challenge: Build FlexibilityOpennessInteroperability
Objectives:Objectives:
Build a Word-Wide standard for Build a Word-Wide standard for
Science and Business GRIDs: GCMScience and Business GRIDs: GCM
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
GSM and GCM PicturesGSM and GCM Pictures
• GSM cells:GSM cells:
• Components:Components:
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
GSM and GCM PicturesGSM and GCM Pictures
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
GSM and GCM PicturesGSM and GCM Pictures
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
Conclusion (1)Conclusion (1) Scientific Issues and DirectionsScientific Issues and Directions
Components in the membrane:Components in the membrane:• Membrane:Membrane:
Meta-Objects Java Objects
• Components:Components:Active Objects
• If Cp in Mb:If Cp in Mb:Active Objects as
Meta-ObjectsNot suited for all
cases. If Dist. AO
If light+local POJOTBD
INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW / MASTER / SLIDE MASTER)
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
Conclusion (2) Conclusion (2) Key technology advancementsKey technology advancements
• Programming the Grid with reusable, composable, components Programming the Grid with reusable, composable, components vs. ad hoc solutions
• Component for Separation of Concerns and AOP:Component for Separation of Concerns and AOP:Gathercast allows to have synchronisation outside functional code
• Deployment on various architectures Deployment on various architectures Super Computer Center, Clusters, data-center, desktop Grids, …
• Interoperability with related Grid software Interoperability with related Grid software
• Integration into Service Oriented Architecture (SOA)Integration into Service Oriented Architecture (SOA)
INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW / MASTER / SLIDE MASTER)
European CommissionDirectorate-General Information Society
Unit F2 – Grid Technologies
Conclusion (3) Conclusion (3) Research ChallengesResearch Challenges
• A general enough GCM, still efficientA general enough GCM, still efficient
• Effective composition: Effective composition:
Semantics, Deployment, Portability
• Non-Functional Aspects: Non-Functional Aspects:
Security, Load-Balancing, Fault-tolerance,CP. Specif (Lotos, UML TTools, pNets) and Model Checking Verification
top related