![Page 1: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration](https://reader033.vdocuments.us/reader033/viewer/2022060118/558bcc9dd8b42aa60b8b45b5/html5/thumbnails/1.jpg)
![Page 2: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration](https://reader033.vdocuments.us/reader033/viewer/2022060118/558bcc9dd8b42aa60b8b45b5/html5/thumbnails/2.jpg)
Company
A leading edge Cloud editor since 2007
![Page 3: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration](https://reader033.vdocuments.us/reader033/viewer/2022060118/558bcc9dd8b42aa60b8b45b5/html5/thumbnails/3.jpg)
Company
➢ Created from INRIA in october 2007
➢ Distribution, Parallelism, HPC, Grids, Cloud
➢ Develop solutions for many application domains:
Engineering, Bio Technologies, Finance, IT
➢ Our labels : DGA (French Dept of Defense), Pacte PME,
Initiative Achats de l’État pour PME innovantes
➢ Growth in France and worldwide
![Page 4: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration](https://reader033.vdocuments.us/reader033/viewer/2022060118/558bcc9dd8b42aa60b8b45b5/html5/thumbnails/4.jpg)
Mission
➢ Distribution, Parallelism, HPC, Grids, Cloud
for DSI Infrastructure and Critical Business Applications
➢ Anticipate technological challenges ➢ Innovation as a service to our clients ➢ Provide strong expertise in key areas such as Distributed
Systems and Cloud Computing ➢ Always be at the forefront of innovation through big
investment in R&D
![Page 5: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration](https://reader033.vdocuments.us/reader033/viewer/2022060118/558bcc9dd8b42aa60b8b45b5/html5/thumbnails/5.jpg)
History
1999 2003 2007 2010 2012 2014
![Page 6: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration](https://reader033.vdocuments.us/reader033/viewer/2022060118/558bcc9dd8b42aa60b8b45b5/html5/thumbnails/6.jpg)
Customers Technologies de
l'Information Bio
Technologies Finance
Ingénierie Aéronautique Energie Espace
Medias Distribution
![Page 7: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration](https://reader033.vdocuments.us/reader033/viewer/2022060118/558bcc9dd8b42aa60b8b45b5/html5/thumbnails/7.jpg)
Cloud & Grid IaaS
Scheduling & Orchestration
HPC Workflow & Parallelization
Innovative Technology
![Page 8: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration](https://reader033.vdocuments.us/reader033/viewer/2022060118/558bcc9dd8b42aa60b8b45b5/html5/thumbnails/8.jpg)
Products
![Page 9: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration](https://reader033.vdocuments.us/reader033/viewer/2022060118/558bcc9dd8b42aa60b8b45b5/html5/thumbnails/9.jpg)
![Page 10: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration](https://reader033.vdocuments.us/reader033/viewer/2022060118/558bcc9dd8b42aa60b8b45b5/html5/thumbnails/10.jpg)
ProActive Cloud Automation
Ø Automatic Deployment of Many Vms Applications Ø Synchronization of Composite Services Ø Monitoring (Physical, Virtual, Functional) Ø Auto-Scaling Ø Multi-Cloud Management with Bursting
Ø Reversibility (e.g. Vmware ó OpenStack)
![Page 11: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration](https://reader033.vdocuments.us/reader033/viewer/2022060118/558bcc9dd8b42aa60b8b45b5/html5/thumbnails/11.jpg)
![Page 12: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration](https://reader033.vdocuments.us/reader033/viewer/2022060118/558bcc9dd8b42aa60b8b45b5/html5/thumbnails/12.jpg)
Cloud Automation
![Page 13: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration](https://reader033.vdocuments.us/reader033/viewer/2022060118/558bcc9dd8b42aa60b8b45b5/html5/thumbnails/13.jpg)
Cloud Automation Services
Elasticity
Fault Management
Reversibility
Brokering
Scalable
Updates
Life Cycle Management
BackUp
Control and Monitoring
Deployment
![Page 14: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration](https://reader033.vdocuments.us/reader033/viewer/2022060118/558bcc9dd8b42aa60b8b45b5/html5/thumbnails/14.jpg)
From Top to Bottom
![Page 15: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration](https://reader033.vdocuments.us/reader033/viewer/2022060118/558bcc9dd8b42aa60b8b45b5/html5/thumbnails/15.jpg)
Cloud Automation
Catalogue
Supervision" Orchestration" Gestion de ressources"Construction"Catalogue"
Service Catalogue ‣ Software ‣ Platform ‣ Infrastructure
Management Console ‣ LifeCycle ‣ Supervision ‣ (Re) configuration
Added Value Services: • Elasticity • Fault-Tolerance • Reversibility • Contextualization of
generic VMs
![Page 16: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration](https://reader033.vdocuments.us/reader033/viewer/2022060118/558bcc9dd8b42aa60b8b45b5/html5/thumbnails/16.jpg)
Workflows & Scheduling
Workflow builder
Easily build New workflows ‣ Web applications ‣ Java SDK ‣ XML files
Create any type of task ‣ Scripts ‣ Executables ‣ Java
Advanced workflows ‣ Loops ‣ Conditions ‣ Variables ‣ Execution control
![Page 17: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration](https://reader033.vdocuments.us/reader033/viewer/2022060118/558bcc9dd8b42aa60b8b45b5/html5/thumbnails/17.jpg)
Workflows Orchstration
Workflows orchestration
Generate reports ‣ Users ‣ Groups ‣ Usage
Plan your actions ‣ Unique ‣ Recurrent
Manage workflows execution ‣ Logs ‣ History ‣ Priority ‣ Pause, stop, etc.
![Page 18: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration](https://reader033.vdocuments.us/reader033/viewer/2022060118/558bcc9dd8b42aa60b8b45b5/html5/thumbnails/18.jpg)
Resource Management
Resource Management
All your resources in one view ‣ Physical machines ‣ Virtual machines ‣ Multi-OS ‣ Private clouds ‣ Public clouds
Secure your resources ‣ User rights ‣ Group rights
![Page 19: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration](https://reader033.vdocuments.us/reader033/viewer/2022060118/558bcc9dd8b42aa60b8b45b5/html5/thumbnails/19.jpg)
Monitoring
Monitoring
Monitor all your resources ‣ Physical machines ‣ Virtual machines ‣ Storage ‣ Network ‣ Applications
Expose your own metrics ‣ JMX ‣ API REST ‣ Flat file
![Page 20: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration](https://reader033.vdocuments.us/reader033/viewer/2022060118/558bcc9dd8b42aa60b8b45b5/html5/thumbnails/20.jpg)
So looping back … from Bottom to Top
![Page 21: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration](https://reader033.vdocuments.us/reader033/viewer/2022060118/558bcc9dd8b42aa60b8b45b5/html5/thumbnails/21.jpg)
Live Demonstration
![Page 22: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration](https://reader033.vdocuments.us/reader033/viewer/2022060118/558bcc9dd8b42aa60b8b45b5/html5/thumbnails/22.jpg)
Live Demonstration
1. Deployment of a Composite Service
2. Update of the Application
3. Applying a Security Patch
4. Life Cycle Managment
![Page 23: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration](https://reader033.vdocuments.us/reader033/viewer/2022060118/558bcc9dd8b42aa60b8b45b5/html5/thumbnails/23.jpg)
Thanks for your attention!
![Page 24: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration](https://reader033.vdocuments.us/reader033/viewer/2022060118/558bcc9dd8b42aa60b8b45b5/html5/thumbnails/24.jpg)
Dedicated resources
Clusters
Static Policy
Amazon EC2
EC2, Azure, HP Cloud, …
Dynamic Workload Policy
Desktops
Desktops
Timing Policy 12/24
Integration: Scilab, Matlab & R Applications
![Page 25: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration](https://reader033.vdocuments.us/reader033/viewer/2022060118/558bcc9dd8b42aa60b8b45b5/html5/thumbnails/25.jpg)
With High Availability
❏ Availability ❏ Recovery ❏ Performance ❏ Backup
![Page 26: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration](https://reader033.vdocuments.us/reader033/viewer/2022060118/558bcc9dd8b42aa60b8b45b5/html5/thumbnails/26.jpg)
High Availability
What if?
❏ A node is lost ❏ Failure is detected and the task running (if any) is restarted on
another free node
❏ A crash happens while task are running ❏ Using the database, running tasks are recovered from the database
The unit of work is the task
![Page 27: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration](https://reader033.vdocuments.us/reader033/viewer/2022060118/558bcc9dd8b42aa60b8b45b5/html5/thumbnails/27.jpg)
High Availability
On node side, failure is expected and failure management built in
❏ How to maintain computational capacity? ❏ The node can reconnect to the Scheduler automatically
❏ The Scheduler can redeploy new nodes ❏ Restart Down Nodes policy
![Page 28: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration](https://reader033.vdocuments.us/reader033/viewer/2022060118/558bcc9dd8b42aa60b8b45b5/html5/thumbnails/28.jpg)
High Availability
On the server side, state is stored in:
❏ Database ❏ Real time replication
❏ MySQL Master-Master replication ❏ MySQL+DRBD Failover
❏ File system ❏ Real time replication
❏ DRBD ❏ SAN
![Page 29: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration](https://reader033.vdocuments.us/reader033/viewer/2022060118/558bcc9dd8b42aa60b8b45b5/html5/thumbnails/29.jpg)
High Availability
FS/DB
ProActive Scheduler
Node
Node
Node
FS/DB
ProActive Scheduler
Node
Node
Node
Failover installation
Primary installation
Via Active-Passive architecture
![Page 30: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration](https://reader033.vdocuments.us/reader033/viewer/2022060118/558bcc9dd8b42aa60b8b45b5/html5/thumbnails/30.jpg)
Tools involved
Linux only
❏ Failover ❏ Corosync to communicate between primary/failover site
❏ Pacemaker to coordinate service states ❏ Also does IP failover via virtual IP
❏ Stonith to avoid brain split issues
❏ SSH Infrastructure & Restart Down Nodes policy for nodes deployment
❏ State Redundancy
❏ DRBD ❏ MySQL
![Page 31: OW2con'14 - ProActive Cloud Automation: Worflow scheduling & orchestration](https://reader033.vdocuments.us/reader033/viewer/2022060118/558bcc9dd8b42aa60b8b45b5/html5/thumbnails/31.jpg)
Disaster Recovery
❏ To Backup
❏ Database ❏ Task/Job queue (running, pending, finished)
❏ File system ❏ Task logs
❏ Monitoring history
❏ Recovery Point Objective ❏ all running tasks are lost and will be restarted from scratch
❏ all active user sessions are lost ❏ Recovery Time Objective
❏ time to start ProActive Scheduler