1 What’s New in OpenLava Gord Sissons William Lu James PangDavid Bigagli
2 Today’s Session Approximately 45 minutes 15 minute Q&AAudio available on-line only (no dial-in) Please queue up questions using WebEx Q&A facility Copies of the presentation will be posted at Recordings of this webinar will be available If you are having difficulties with VOIP audio, please be aware that your microphone may need to be enabled in your mobile application permissions before VOIP audio will work. All participant lines have been muted centrally.
3 Our speakers Gord Sissons William Lu, PhD James Pang David BigagliMarketing Consultant to Teraproc William Lu, PhD Consultant & Co-founder Teraproc James Pang Teraproc, CTO David Bigagli Founder OpenLava.org OpenLava Chief Architect
4 Agenda Teraproc and OpenLava Customer challenges OpenLava offeringsOpenLava highlights OpenLava roadmap Participating, learning more
5 About Teraproc Presence in North America, Europe, & ChinaWorkload management solutions for high performance scaled out clusters running on premise and in the cloud. Presence in North America, Europe, & China Founders with extensive experience in HPC, cloud and big data infrastructure OpenLava and former Platform LSF developers Deep technical skills, growing client base AWS & Hortonworks partners 100% open-source, active committers to OpenLava and related projects
6 About OpenLava Open source project https://github.com/openlava , Created by former LSF architect David Bigagli Based on Platform Lava, an open-source version of Platform LSF LSF CLI and configuration file compatible Widely deployed in commercial, research and academic clusters 6,000+ downloads, hundreds of deployments, vibrant community
7 Customer challenges What we hear from customers, partners and ISVs:Concerns about commercial licensing costs Commercial terms impede flexibility Need more timely feature enhancements Per-core licencing, cost escalation concerns IP ownership concerns Fear of being “locked in” Like the idea of open source, but need commercial support for some clusters
8 OpenLava - A Better AnswerOpenLava can help solve a variety of business challenges: Free for use, GNU GPLv2 license Deploy without restriction Participate, steer development priorities Per-node support model Bundle, fork, enhance as needed Improves strategic flexibility Compatible, migration assistance High-quality 7 x 24 support What we hear from customers, partners and ISVs: Concerns about commercial licensing costs Commercial terms impede flexibility Need more timely feature enhancements Per-core licencing, cost escalation concerns IP ownership concerns Fear of being “locked in” Like the idea of open source, but need commercial support for some clusters
9 OpenLava Community Edition OpenLava Enterprise EditionOpenLava offerings OpenLava Community Edition OpenLava Enterprise Edition Download it or try it free on AWS IBM® Platform LSF® compatible RHEL, CentOS, SUSE, Ubuntu / Debian Easy to compile and install On premise or on the cloud Community support No limits, no lock-in All Community Edition features plus: Pre-built and fully tested binaries Standard or premium 7x24 support levels Simple node based annual pricing Emergency patches Accelerated roadmap development Custom extensions LSF migration services In-depth training and consulting YUM repository Shared file system installation Web GUI and reporting tool Additional OS support License scheduling Dockerized R OpenLava clusters Cloud deployment portal Hybrid cloud deployment support
10 Customer example About the Customer Business requirementsTier I semiconductor design & manufacturing firm Centers in US, Europe and Asia Business requirements Open source solution for strategic flexibility Specific scheduling enhancements to meet evolving business needs Solution compatible with existing tools Scalability to 40,000 cores Retained ownership of resulting IP Global semiconductor firm chooses OpenLava Enterprise Edition for management of global server farms Teraproc solution Customer benefits OpenLava Enterprise Edition, Custom Engineering Services Global support agreement, migration assistance Faster time to deploy new features Reduced TCO (licensing + support costs) Deployment flexibility, ownership of IP
11 Teraproc: Advancing OpenLavaNew Teraproc Not New Teraproc people Innovation Beyond HPC OpenLava 3.2 Open-source Workload Management LSF Compatible Works with what you already have New Capabilities Driven by new requirements and user challenges
12 OpenLava Highlights & Roadmap
13 OpenLava Highlights Enterprise scalability: 50k+ cores, 500k+ jobsResilient, robust, highly available architecture Extensible: elim, pre/post exec, job starter, eauth, esub/eexec, resource requirement expressions Fairshare, priority, preemption, exclusive, processor and memory reservation User and host groups Job, host, queue, user, slot limits Job dependencies, job arrays Web GUI, reporting Event records for accounting and analysis Docker, cgroup, GPU, MPI, Cloud-scaling
14 Proven scalability 490 servers 48,925 job slots Master: c4.xlarge, compute: t2.micro Slots per compute host: 100 Slots on master: 25 Total jobs: 500,000 Average job runtime: 3 minutes Fairshare scheduling policy enabled 490 servers, 48,925 simulated cores, 500,000 jobs In a production scale test involving ~50,000 job slots and 500,000 jobs, OpenLava demonstrated sustained resource utilization efficiency of 97.3% enforcing a fairshare scheduling policy.
15 OpenLava Releases & RoadmapScalability to 50,000 cores, 500k jobs Event log replay performance enhancements Scheduler performance enhancements Memory reservation Compact format notation for configuring large number of hosts and host groups in lsb.hosts lsclusters command Improved error messages Hyperthread vs core switch for scheduling OpenLava 3.0 Fairshare Preemption OpenMPI GPU Docker lsaddhost for Cloud autoscaling Roadmap Scalability to 60,000+ cores Auto resizable parallel jobs Distributed make Generalized limits Performance Monitoring & Analytics blaunch Job groups License broker Multiple OpenLava clusters Short jobs Storage Windows 3Q 2015 2Q 2016 2Q 2015 1Q 2016 OpenLava 3.1 OR operator in resource requirement expression Packing and striping scheduling policies Built-in free slot metrics CPU affinity to enforce CPU usage Cgroup support to enforce memory usage Automatic host model detection lsb.events streaming MXJ support in lsaddhost Sort hosts by cpufactor Installation on shared file system Client host OpenLava 3.3 Event log switch performance enhancements Guaranteed slots with sharing Floating client bdepinfo command breport Job submission and monitoring Web GUI
16 OpenLava stewardship How we manage OpenLava’s evolutionCustomer feedback GitHub contributors (http://github.com/openlava) Identified bugs via public support forum (OpenLava google group) Suggestion box - Custom enhancements Value-added products (Enterprise Edition) Core scheduler enhancements contributed to open-source base
17 Active Community Support
18 Next steps Download OpenLava Test-drive OpenLava support for free, Test-drive OpenLava support for free Earn money for referrals Get Involved Share your successes, recommend enhancements, join the community Contact us at or visit
19 Questions?
20 Let’s Talk! visit teraproc.com