what’s new in openlavaopenlava 3.3 •event log switch performance enhancements •guaranteed...

Copyright 2016 Teraproc Inc. All rights reserved

Click to edit Master title style

What’s New in OpenLava

Gord SissonsWilliam LuJames PangDavid Bigagli


Today’s Session

Approximately 45 minutes

15 minute Q&A

Audio available on-line only (no dial-in)

Please queue up questions using WebEx Q&A facility

Copies of the presentation will be posted at http://teraproc.com

Recordings of this webinar will be available

If you are having difficulties with VOIP audio, please be aware that your microphone may need to be enabled in your mobile application permissions before VOIP audio will work. All participant lines have been muted centrally.

http://teraproc.com/


Our speakers

Gord SissonsMarketing Consultant

to Teraproc

William Lu, PhDConsultant & Co-founder

Teraproc

James PangTeraproc, CTO

David BigagliFounder OpenLava.org

OpenLava Chief Architect


Agenda

Teraproc and OpenLava

Customer challenges

OpenLava offerings

OpenLava highlights

OpenLava roadmap

Participating, learning more


About Teraproc

Presence in North America, Europe, & China

Founders with extensive experience in HPC, cloud

and big data infrastructure

OpenLava and former Platform LSF developers

Deep technical skills, growing client base

AWS & Hortonworks partners

100% open-source, active committers to OpenLava

and related projects

Workload management solutions for high

performance scaled out clusters running on premise

and in the cloud.


About OpenLava

Open source project

https://github.com/openlava ,

http://openlava.org

Created by former LSF architect David Bigagli

Based on Platform Lava, an open-source

version of Platform LSF

LSF CLI and configuration file compatible

Widely deployed in commercial, research and

academic clusters

6,000+ downloads, hundreds of deployments,

vibrant community

https://github.com/openlava

http://openlaval.org/


Customer challenges

What we hear from customers,

partners and ISVs:

Concerns about commercial licensing costs

Commercial terms impede flexibility

Need more timely feature enhancements

Per-core licencing, cost escalation concerns

IP ownership concerns

Fear of being “locked in”

Like the idea of open source, but need

commercial support for some clusters


OpenLava - A Better Answer

What we hear from customers,

partners and ISVs:

Concerns about commercial licensing costs

Commercial terms impede flexibility

Need more timely feature enhancements

Per-core licencing, cost escalation concerns

IP ownership concerns

Fear of being “locked in”

Like the idea of open source, but need

commercial support for some clusters

OpenLava can help solve a variety

of business challenges:

Free for use, GNU GPLv2 license

Deploy without restriction

Participate, steer development priorities

Per-node support model

Bundle, fork, enhance as needed

Improves strategic flexibility

Compatible, migration assistance

High-quality 7 x 24 support


OpenLava offerings

OpenLava Community Edition OpenLava Enterprise Edition

Download it or try it free on AWS

IBM® Platform LSF® compatible

RHEL, CentOS, SUSE, Ubuntu / Debian

Easy to compile and install

On premise or on the cloud

Community support

No limits, no lock-in

All Community Edition features plus:

Pre-built and fully tested binaries

Standard or premium 7x24 support levels

Simple node based annual pricing

Emergency patches

Accelerated roadmap development

Custom extensions

LSF migration services

In-depth training and consulting

YUM repository

Shared file system installation

Web GUI and reporting tool

Additional OS support

License scheduling

Dockerized R OpenLava clusters

Cloud deployment portal

Hybrid cloud deployment support


Customer example

Tier I semiconductor design & manufacturing firm

Centers in US, Europe and Asia

Global semiconductor firm chooses OpenLava Enterprise Edition for management of global server farms

About the Customer

Open source solution for strategic flexibility

Specific scheduling enhancements to meet

evolving business needs

Solution compatible with existing tools

Scalability to 40,000 cores

Retained ownership of resulting IP

Business requirements

Teraproc solution

OpenLava Enterprise Edition, Custom

Engineering Services

Global support agreement, migration assistance

Customer benefits

Faster time to deploy new features

Reduced TCO (licensing + support costs)

Deployment flexibility, ownership of IP


Teraproc: Advancing OpenLava

New

Teraproc

Not New

Teraproc people

Innovation

Beyond HPC

OpenLava 3.2Open-source Workload

Management

LSF CompatibleWorks with what you

already have

New CapabilitiesDriven by new requirements

and user challenges


OpenLava

Highlights & Roadmap


OpenLava Highlights

Enterprise scalability: 50k+ cores, 500k+ jobs

Resilient, robust, highly available architecture

Extensible: elim, pre/post exec, job starter, eauth,

esub/eexec, resource requirement expressions

Fairshare, priority, preemption, exclusive, processor

and memory reservation

User and host groups

Job, host, queue, user, slot limits

Job dependencies, job arrays

Web GUI, reporting

Event records for accounting and analysis

Docker, cgroup, GPU, MPI, Cloud-scaling


Proven scalability

• 490 servers

• 48,925 job slots

• Master: c4.xlarge, compute: t2.micro

• Slots per compute host: 100

• Slots on master: 25

• Total jobs: 500,000

• Average job runtime: 3 minutes

• Fairshare scheduling policy enabled490 servers, 48,925 simulated cores, 500,000 jobs

In a production scale test involving

~50,000 job slots and 500,000 jobs,

OpenLava demonstrated sustained

resource utilization efficiency of 97.3%

enforcing a fairshare scheduling policy.


OpenLava Releases & Roadmap

2Q 2016

OpenLava 3.0• Fairshare• Preemption• OpenMPI• GPU• Docker• lsaddhost for Cloud autoscaling

OpenLava 3.1• OR operator in resource requirement expression• Packing and striping scheduling policies• Built-in free slot metrics• CPU affinity to enforce CPU usage• Cgroup support to enforce memory usage• Automatic host model detection• lsb.events streaming• MXJ support in lsaddhost• Sort hosts by cpufactor• Installation on shared file system• Client host

OpenLava 3.2• Scalability to 50,000 cores, 500k jobs• Event log replay performance enhancements• Scheduler performance enhancements• Memory reservation• Compact format notation for configuring large number of hosts and host groups in lsb.hosts• lsclusters command• Improved error messages• Hyperthread vs core switch for scheduling

OpenLava 3.3• Event log switch performance enhancements• Guaranteed slots with sharing• Floating client• bdepinfo command• breport• Job submission and monitoring Web GUI

Roadmap• Scalability to 60,000+ cores• Auto resizable parallel jobs• Distributed make• Generalized limits• Performance Monitoring & Analytics• blaunch• Job groups• License broker• Multiple OpenLava clusters• Short jobs• Storage• Windows

2Q 2015

3Q 2015

1Q 2016


OpenLava stewardship

How we manage OpenLava’s evolution

Customer feedback

GitHub contributors (http://github.com/openlava)

Identified bugs via public support forum (OpenLava google group)

Suggestion box - http://www.teraproc.com/openlava-suggestions/

Custom enhancements

Value-added products (Enterprise Edition)

Core scheduler enhancements contributed to open-source base

http://github.com/openlava

http://www.teraproc.com/openlava-suggestions/


Active Community Support


Next steps

Download OpenLava

http://OpenLava.org , http://Teraproc.com

Test-drive OpenLava support for free

http://teraproc.com/testdrive

Earn money for referrals

http://teraproc.com/referrals

Get Involved

Share your successes, recommend enhancements, join the community

Contact us at [email protected] or visit http://teraproc.com

http://openlava.org/


http://teraproc.com/testdrive

http://teraproc.com/referrals

mailto:[email protected]



Questions?

[email protected]


Let’s Talk!

[email protected]

visit teraproc.com

what’s new in openlavaopenlava 3.3 •event log switch performance enhancements •guaranteed...

Documents