grid component model and bridging distributed and … · grid component model and . ... gcm fractal...
TRANSCRIPT
![Page 1: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/1.jpg)
Denis Caromel1
Denis Caromel, et al.http://ProActive.ObjectWeb.org
OASIS TeamINRIA --
CNRS -
I3S --
Univ. of Nice Sophia-Antipolis, IUF
October 14th, CGW, Kraków, Poland
Grid Component Model and
Bridging Distributed and Multi-Core Computing
1. Background: INRIA, OASIS, ActiveEon2. ProActive Parallel Suite & Active Objects3. Components and Standardization (GCM)4. Applications and Perspectives: SOA+GRID
![Page 2: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/2.jpg)
Denis Caromel2 2
1. Background
![Page 3: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/3.jpg)
Denis Caromel3
INRIA and OASIS Team
Computer Science and Control • 8 Centers all over France• Workforce: 3 800• 186 Million Euro annual budget• Strong in standardization committees:
– IETF, W3C, ETSI, …
• Strong Industrial Partnerships
• Foster company foundation:90 startups so far
-
Ilog
(Nasdaq, Euronext)- …-
ActiveEon
A joint team between:– INRIA, University of Nice-
CNRS
•Created in 1999•Started the ProActive Parallel Suite•Over 40 persons•Distributed and Parallel:From Multi-cores to Enterprise GRIDs
![Page 4: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/4.jpg)
Denis Caromel4
Startup Company Born of INRIACo-developing, Providing support for Open Source ProActive
Parallel Suite
Winner 80/1000 applications (Minister of Research Contest)Several Customers (Worldwide: Boston USA, etc.)
![Page 5: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/5.jpg)
Denis Caromel5 5
2. ProActive Parallel Suite
& Active Objects
![Page 6: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/6.jpg)
Denis Caromel6
• Written in Java• Features:1. Eclipse GUI 2. Parallel+Dist. Progr.3. Scheduling & Grids
Used inproduction by
industry
![Page 7: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/7.jpg)
Denis Caromel7
![Page 8: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/8.jpg)
Denis Caromel8
ProActive Parallel Suite (1)
Open Source
+PROFESSIONAL
SUPPORT
![Page 9: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/9.jpg)
Denis Caromel9
ProActive Parallel Suite: GUI
![Page 10: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/10.jpg)
Denis Caromel10
ProActive Parallel Suite: GUI
![Page 11: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/11.jpg)
Denis Caromel11
![Page 12: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/12.jpg)
Denis Caromel12
IC2D
![Page 13: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/13.jpg)
Denis Caromel13
ChartIt
![Page 14: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/14.jpg)
Denis Caromel14
Video 1: IC2D Monitoring, Debugging, Optimizing
![Page 15: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/15.jpg)
Denis Caromel15
ProActive Parallel Suite: Deploy
![Page 16: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/16.jpg)
Denis Caromel16
ProActive Parallel Suite: Deploy
![Page 17: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/17.jpg)
Denis Caromel17
Deploy on Various Kinds of Infrastructures
Internet
ClustersParallelMachine
LargeEquipment
Internet
Job management forembarrassingly parallel application (e.g. SETI)
Internet
Internet
Servlets EJBs Databases
![Page 18: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/18.jpg)
Denis Caromel18
Scheduler and Resource Manager: User Interface
![Page 19: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/19.jpg)
Denis Caromel19
Scheduler: User Interface
![Page 20: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/20.jpg)
Denis Caromel20
Video 2: Scheduler, Resource Manager
![Page 21: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/21.jpg)
Denis Caromel21
ProActive Parallel Suite: Program
![Page 22: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/22.jpg)
Denis Caromel22
ProActive Parallel Suite
![Page 23: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/23.jpg)
Denis Caromel23
ProActive Parallel Suite: Program
![Page 24: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/24.jpg)
Denis Caromel24
ProActive Parallel Suite: Program
![Page 25: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/25.jpg)
Denis Caromel25 25
Distributed and Parallel Active Objects
![Page 26: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/26.jpg)
Denis Caromel26 26
A
ProActive : Active objects
Proxy
Java Object
A ag = newActive (“A”, […], VirtualNode)V v1 = ag.foo (param);V v2 = ag.bar (param);...v1.bar(); //Wait-By-Necessity
V
Wait-By-Necessity is a
Dataflow Synchronization
JVM
AJVM
Active Object
Future Object Request
Req. Queue
Thread
v1v2 ag
WBN!
![Page 27: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/27.jpg)
Denis Caromel27 27
ProActive: Inter- to Intra- Synchronization
Sequential Multithreaded Distributed
Synchronizations, Behavior: not dependent upon
the physical location (mapping of activities)
![Page 28: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/28.jpg)
Denis Caromel28 28
ProActive: First-Class Futures
Sequential Multithreaded Distributed
Synchronizations, Behavior: not dependent upon
the physical location (mapping of activities)
![Page 29: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/29.jpg)
Denis Caromel29 29
Wait-By-Necessity: First Class Futures
ba
Futures are Global Single-Assignment Variables
V= b.bar ()
c
c
c.gee (V)
v
v
b
![Page 30: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/30.jpg)
Denis Caromel30 30
Standard system at Runtime: No Sharing
NoC: Network On ChipProofs of Determinism
![Page 31: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/31.jpg)
Denis Caromel31
Calculus
ASP: Asynchronous Sequential Processes
![Page 32: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/32.jpg)
Denis Caromel32
Proofs in GREEK
ASP Confluence and DeterminacyFuture updates can occur at any time, Mobility does not change behavior
![Page 33: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/33.jpg)
Denis Caromel33 33
TYPED
ASYNCHRONOUS
GROUPS
![Page 34: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/34.jpg)
Denis Caromel34 34
A
Creating AO and Groups
Typed Group Java or Active Object
A ag = newActiveGroup (“A”, […], VirtualNode)V v = ag.foo(param);...v.bar(); //Wait-by-necessity
V
Group, Type, and Asynchrony are crucial for Cpt. and GRID
JVM
![Page 35: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/35.jpg)
Denis Caromel35 35
Broadcast and Scatter
JVM
JVM
JVM
JVM
agcg
ag.bar(cg); // broadcast cgProActive.setScatterGroup(cg);ag.bar(cg); // scatter cg
c1 c2c3c1 c2c3
c1 c2c3c1 c2c3c1 c2c3
c1 c2c3
s
c1 c2c3
s
Broadcast is the default behavior Use a group as parameter, Scattered depends on rankings
![Page 36: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/36.jpg)
Denis Caromel36 36
Dynamic Dispatch Group
JVM
JVM
JVM
JVM
agcg
c1
c2
c3
c4
c5
c6
c7
c8c0
c9c1
c2
c3
c4
c5
c6
c7
c8c0
c9
c1
c2
c3
c4
c5
c6
c7
c8c0
c9
Slowest
Fastest
ag.bar(cg);
![Page 37: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/37.jpg)
Denis Caromel37 37
OO SPMDA ag = newSPMDGroup (“A”, […], VirtualNode)
// In each membermyGroup.barrier (“2D”); // Global BarriermyGroup.barrier (“vertical”); // Any BarriermyGroup.barrier (“north”,”south”,“east”,“west”);
A
Still, not based on raw messages, but
Typed Method Calls==> Components
![Page 38: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/38.jpg)
Denis Caromel38 38
Parallel, Distributed, Hierarchical
3. Components and
Standardization (GCM)
![Page 39: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/39.jpg)
Denis Caromel39 39
Objects to Distributed Components (1)
Typed Group Java or Active Object
ComponentIdentity Cpt = newActiveComponent (params);A a = Cpt … .getFcInterface ("interfaceName");V v = a.foo(param);
V
AExample ofcomponentinstance
JVM
Truly Distributed
Components
IoC:InversionOf Control(set in XML)
![Page 40: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/40.jpg)
Denis Caromel40
GCM: Grid Component ModelGCM
Being defined in the NoE
CoreGRID
(42 institutions)Open Source ObjectWeb
ProActive
implements a preliminary version of GCMService Oriented: NESSI relation
GridCOMP
takes:GCM
as a first specification,
ProActive as a starting point, and Open Source reference implementation.
The vision: The vision: GCMGCM to be the IT Service to be the IT Service GSMGSM
![Page 41: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/41.jpg)
Denis Caromel41
GridCOMP
Partners
![Page 42: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/42.jpg)
GCMScopes and Objectives:Grid Codes that Compose and DeployNo programming, No Scripting, …
No Pain
Innovation:Abstract DeploymentComposite Components Multicast and GatherCast
MultiCastMultiCast GatherCastGatherCast
![Page 43: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/43.jpg)
Denis Caromel43
Standardization
![Page 44: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/44.jpg)
Denis Caromel44
GCM ETSI STANDARDIZATION
ETSI TC GRID Standardization Group : one meeting every 3 or 4 months since Oct. 2006
On 12 June 2008, at the #8 ETSI TC Grid meeting, the two standards:GCM Interoperability DeploymentGCM Interoperability Application Description
have been officially approved!
Overall, the standardization is supported by industrials: BT, FT-Orange, Nokia-Siemens, Telefonica, NEC, Alcatel-Lucent, Huawei
…
![Page 45: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/45.jpg)
Denis Caromel45
ETSI GCM TC Grid Standard
GCM Interoperability Deployment
GCM Application Description
GCM Fractal ADL (Architecture Description Language)
GCM Management (Java, C, WSDL API)
Official Standard No 1Official Standard No 1
Official Standard No 2Official Standard No 2
WorkWork Item No 3Item No 3
WorkWork Item No 4Item No 4
![Page 46: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/46.jpg)
Denis Caromel46
Deploy on Various Kinds of Infrastructures
Internet
ClustersParallelMachine
LargeEquipment
Internet
Job management forembarrassingly parallel application (e.g. SETI)
Internet
Internet
Servlets EJBs Databases
![Page 47: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/47.jpg)
Denis Caromel47
Protocols and Scheduler in GCM Deployment
Protocols:rshsshOarshGsissh
Scheduler, and Grids:GroupSSH, GroupRSH, GroupOARSHARC (NorduGrid), CGSP China Grid, EEGE gLITE, Fura/InnerGrid
(GridSystem
Inc.)
GLOBUSGridBusIBM Load Leveler, LSF, Microsoft CCS (WHPC 2008)Sun Grid Engine, OAR, PBS / Torque, PRUN
![Page 48: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/48.jpg)
Denis Caromel48
GridCOMP
/ GCM ProActive
UsageUsed in Production by Companies:
E.g. Amadeus (Air France, Lufthansa)
At least 4 on going PhD. thesis:Component reconfiguration (Marcela Rivera), GCM extensions for autonomic applications (Paul Naoumenko), Specification Languages and Model-Checking (Antonio Cansado)Autonomic Service Management of Enterprise Grid Services (Cristian
Ruz)
Used in other projects:EU PROJECTS: SOA4ALL, QosCosGrid, Prospect: RESERVOIR INRIA ADT Galaxy, Pole Comp. AGOS (HP, Oracle)
Used in:BarcelonaKrakow (SemMon: Semantic Monitoring)…
![Page 49: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/49.jpg)
Denis Caromel49
4. Applications and
Perspectives: SOA+GRID
![Page 50: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/50.jpg)
Denis Caromel50
Sylvain Sylvain CussatCussat--Blanc, Yves Blanc, Yves DuthenDuthen –– IRIT TOULOUSEIRIT TOULOUSE
Artificial Life GenerationArtificial Life Generation
Application J+1 J+5 J+6 J+7
Version ProActive
251300 CPUs
Initial Application 1 PC 56h52 => Crash!
ProActive Version 300 CPUs 19 minutes
Developpement of artificial creatures
![Page 51: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/51.jpg)
Denis Caromel51
Sylvain Sylvain CussatCussat--Blanc, Yves Blanc, Yves DuthenDuthen –– IRIT TOULOUSEIRIT TOULOUSE
Artificial Life GenerationArtificial Life Generation
![Page 52: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/52.jpg)
Denis Caromel52
JECS : 3D Electromagnetism Radar Reflection
on Planes
![Page 53: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/53.jpg)
Denis Caromel53
Code Coupling : Vibro
Acoustic (courtesy of EADS)
![Page 54: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/54.jpg)
54
NAS Parallel Benchmarks
Designed by NASA to evaluate benefits of high performance systems
Strongly based on CFD
5 benchmarks (kernels) to test different aspects of a system
2 categories : communication intensive and computation intensive
![Page 55: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/55.jpg)
Denis Caromel55
Enterprise IT: Software Tests
Amadeus (Opodo, Air France, KLM, Lufthansa): 500 programmers 20 machines with
ProActive
to execute Dist. Regression Testsin the production chain
![Page 56: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/56.jpg)
Denis Caromel56
Parallel BLAST with ProActive (1) together with Mario Leyton
Basic Local Alignment Search Tool for rapid sequence comparisonBLAST developed by NCBI (National Center for Biotechnology Information)
Standard native code package, no source modification! With PPS Skeletons parallelization and distribution added to the application
A seamless deployment on all Grid platforms is obtained:• Input Files are automatically copied to computational nodes at Job
submission • Result Files will be copied on client host
BLAST Skeleton program using the Divide and Conquer skeleton:• Division of Database based on conditions (Nb. Nodes, Size, etc.)
![Page 57: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/57.jpg)
Denis Caromel57
Speedup of Distributed BLAST on Grid5000
![Page 58: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/58.jpg)
Denis Caromel58
Monte Carlo Simulations, Non-Linear Physics, INLN
![Page 59: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/59.jpg)
Denis Caromel59
Matlab
and Scilab
Grid Interface
![Page 60: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/60.jpg)
Denis Caromel60
Mikros
Image: Post Production
![Page 61: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/61.jpg)
Denis Caromel61
New Developments:
Grid & SOA
![Page 62: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/62.jpg)
Denis Caromel62
AGOS Grid
Architecture for SOA
Partners and Solutions
Building a Platform for Agile SOA with Grid
Use Cases
![Page 63: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/63.jpg)
Denis Caromel63
AGOS: What
for ?
AGOS Objectives:• Create an architecture and environment for integration of
– SOA business management with– GRID IT management
• Well fitted for data intensive and computational intensive applications:– Enact sub-parts of a BPEL workflow on dynamically allocated resource
E.g.: Financial Simulations, Insurance, Revenue Management, BIO, HPC
• Full dynamic scheduling of Services on GRIDs
in the future
• Integrated Management of SLO, SLA, QoS: – Bottom to top– Dynamic enforcement: Adaptive behavior
![Page 64: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/64.jpg)
Denis Caromel64
Summary
![Page 65: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/65.jpg)
Denis Caromel65
MultiMulti--Core to DistributedCore to Distributed
Concurrency + ParallelismMulti-Cores + Distribution
![Page 66: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/66.jpg)
Denis Caromel66
Conclusion: Why does it scale?
Thanks to a few key features:
Connection-less, RMI+JMS unified
Messages rather than long-living
interactions
ACTIVE OBJECTS --- GROUPS --- COMPONENTS
![Page 67: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/67.jpg)
Denis Caromel67
Conclusion: Why does it Compose?
Thanks to a few key features:
Because it Scales: asynchrony !
Because it is Typed: RMI with interfaces
!
First-Class Futures: No unstructured
Call Backs and Ports
ACTIVE OBJECTS --- GROUPS --- COMPONENTS
![Page 68: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/68.jpg)
Denis Caromel68
Conclusion:
A Toolkit for Acceleration:
Multi-Core & Distributed
![Page 69: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/69.jpg)
Denis Caromel69
ProActive/GCMSpecifications
for
ComponentsServicesSLAQoS
Open the way to Soft.+Serv. EU Industry with Clouds &Utilities, DAAS
ProActive/GCMSpecifications
for
ComponentsServicesSLAQoS
Open the way to Soft.+Serv. EU Industry with Clouds &Utilities, DAAS
![Page 70: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/70.jpg)
Denis Caromel70
![Page 71: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/71.jpg)
Denis Caromel71
![Page 72: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/72.jpg)
Denis Caromel72
Multi-Active Object in 1 Address Space for Multi-cores
![Page 73: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/73.jpg)
Denis Caromel73
![Page 74: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/74.jpg)
Denis Caromel74
![Page 75: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/75.jpg)
Denis Caromel75 75
Object-Oriented SPMD Single Program Multiple Data
MotivationCluster / GRID computingSPMD programming for many numerical simulationsUse enterprise technology (Java, Eclipse, etc.) for Parallel Computing
Able to express most of MPI’s
Collective Communications:
broadcast reducescatter allscattergather allgather
and Barriers, Topologies.
![Page 76: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/76.jpg)
Denis Caromel76
GCM Deployment (2/2)
Grid description: clear conceptsBridges (1 -> 1)Groups (1 -> N)HostsAcquisition (lookup, p2p)
Application description: Split Grid / Application Description
Allows reuse of grid descriptors for any application type,ProActive, using Virtual nodes
![Page 77: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/77.jpg)
Denis Caromel77
Deployment descriptor : example
![Page 78: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/78.jpg)
Denis Caromel78
Communication Intensive CG Kernel (Conjugate Gradient)
Floating point operationsEigen value computationHigh number of unstructured communications
• 12000 calls
• 570 MB sent
• 1 min 32
• 65 % comms
Data density distribution Message density distribution
![Page 79: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/79.jpg)
Denis Caromel79
Communication Intensive CG Kernel (Conjugate Gradient)
![Page 80: Grid Component Model and Bridging Distributed and … · Grid Component Model and . ... GCM Fractal ADL (Architecture Description Language) ... E.g.: Financial Simulations, Insurance,](https://reader031.vdocuments.us/reader031/viewer/2022021901/5b7b519d7f8b9ae7368d7ff2/html5/thumbnails/80.jpg)
Denis Caromel80
Summary-Perspective: Comprehensive Toolkit
Programming:Models &
Tools
Parallel:Multi-Core & Distributed