linux on z13 and simulatenus multithreading - sebastien llaurency
Post on 06-Aug-2015
66 Views
Preview:
TRANSCRIPT
9.0
27th of MayBruxells
Linux on z13 and Simultaneous Multithreading
Sébastien LLaurency
IBM Certified Expert Integration Architect
IBM Client Center Montpellier
TrademarksThe following are trademarks of the International Business Machines Corporation in the United States and/or other countries.
BladeCenetr*BlueMixCICS*COGNOS*DB2*
HiperSocketsHyperSwapIBM*IBM (logo)*Infinband*
DFSMSDFSMSdfpDFSMSdssDFSMShsmDS8000*
* Registered trademarks of IBM Corporation
Notes: Performance is in Internal Throughput Rate (ITR) ratio based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput that any user will experience will vary depending upon considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve throughput improvements equivalent to the performance ratios stated here.
IBM hardware products are manufactured from new parts, or new and serviceable used parts. Regardless, our warranty terms apply.
All customer examples cited or described in this presentation are presented as illustrations of the manner in which some customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics will vary depending on individual customer configurations and conditions.
This publication was produced in the United States. IBM may not offer the products, services or features discussed in this document in other countries, and the information may be subject to change without notice. Consult your local IBM business contact for information on the product or services available in your area.
All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.
Information about non-IBM products is obtained from the manufacturers of those products or their published announcements. IBM has not tested those products and cannot confirm the performance, compatibility, or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products.
Prices subject to change without notice. Contact your IBM representative or Business Partner for the most current pricing in your geography.
This information provides only general descriptions of the types and portions of workloads that are eligible for execution on Specialty Engines (e.g, zIIPs, zAAPs, and IFLs) ("SEs"). IBM authorizes customers to use IBM SE only to execute the processing of Eligible Workloads of specific Programs expressly authorized by IBM as specified in the “Authorized Use Table for IBM Machines” provided at www.ibm.com/systems/support/machine_warranties/machine_code/aut.html (“AUT”). No other workload processing is authorized for execution on an SE. IBM offers SE at a lower price than General Processors/Central Processors because customers are authorized to use SEs only to process certain types and/or amounts of workloads as specified by IBM in the AUT.
The following are trademarks or registered trademarks of other companies.
Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or other countries. Cell Broadband Engine is a trademark of Sony Computer Entertainment, Inc. in the United States, other countries, or both and is used under license therefrom. Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries. IT Infrastructure Library is a registered trademark of the Central Computer and Telecommunications Agency which is now part of the Office of Government Commerce. ITIL is a registered trademark, and a registered community trademark of the Office of Government Commerce, and is registered in the U.S. Patent and Trademark Office. Java and all Java based trademarks and logos are trademarks or registered trademarks of Oracle and/or its affiliates.Linear Tape-Open, LTO, the LTO Logo, Ultrium, and the Ultrium logo are trademarks of HP, IBM Corp. and Quantum in the U.S. andLinux is a registered trademark of Linus Torvalds in the United States, other countries, or both. Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both. OpenStack is a trademark of OpenStack LLC. The OpenStack trademark policy is available on the OpenStack website.TEALEAF is a registered trademark of Tealeaf, an IBM Company.Windows Server and the Windows logo are trademarks of the Microsoft group of countries.Worklight is a trademark or registered trademark of Worklight, an IBM Company.UNIX is a registered trademark of The Open Group in the United States and other countries.* Other product and service names might be trademarks of IBM or other companies.
Easy Tier*ECKDFlashSystemFICON*GDPS*
IMSMQSeries*NetView*OMEGAMON*RACF*
System Storage*Tivoli*WebSphere*z13zEnterprise*
z/OS*z Systemsz/VM*z/VSE*
© 2015IBM Corporation3
Introducing z 13 innovations for Linux on z
Cloud, Analytics, Mobile & Security
Contents
Linux on z System & SMT
© 2015IBM Corporation4
Mobile, social, cloud, big data and analytics are changing how we live, work and interact
40% of peoplesocialize more online than they do face-to-face
300x growthof digital content between
2005-2020
57% of companiesusing cloud to drive competitive and cost advantages
80% of all datais unstructured and growing 15x the rate of structured data
63% of peopleexpect to be doing more shopping on their
mobile devices over the next couple of years
© 2015IBM Corporation5
A fundamental change
The people access to
centralized services
A service developed in
one flavor for all
The service access to
people everywhere
A service developed in one flavor for
all but capable to adapt
© 2015IBM Corporation6
But has all really changed ?
Find & WalkWaitAsk for serviceFew physical locationsNational
Walk & FindSelf-ServiceMore physical locationsInternational
LocateSelf-ServiceAnywhereInternational
Yes and No !
© 2015IBM Corporation7
Hybrid Cloud Private Cloud Public Cloud
Up to 10 TB Memory on z13Improves consolidation ratios
SMT-2 technology on z13Improves performance and
throughput of workloads
GDPS for Linux on z Systems
Disaster Recovery solution for mission-critical workloads
KVM New industry-standard hypervisor
(SOD)
Increase in # of LPARs on z13Improves TCO
Cloud Manager w/ OpenStack V4.2
Heterogeneous platform management from z Systems
Elastic Storage for Linux on z Systems
Enables new class of workloads
New Capabilities in z13 supporting Cloud Computing
© 2015IBM Corporation8
Introducing z 13 innovations for Linux on z
Cloud, Analytics, Mobile & Security
Contents
Linux on z System & SMT
© 2015IBM Corporation9
Existing major workloads utilizedOracle Database on Linux on z
WebSphere (App Servers, Message Broker, MQ, …)
SAP Application Servers
Basic Infrastructure Services (HTTP Server, FTP, Apache, Tomcat, Samba, Networking, Tivoli Storage Manager, Domino...)
Leverage existing ISV Solutions or custom client applications
DB2 LUW
Other WebSphere components (Portal Server, Business Process Manager, …)
...
New utilizationsMobile on z Systems (IBM MobileFirst Server)
z/VM Virtualization management (IBM Wave) and Cloud
Analytics on Linux on z (Cognos, Spss, Infosphere, …)
OpenSource solutions (Hadoop, PostGreSQL, MariaDB, Docker,...)
Enterprise Linux Printing (Ubiquitech solution,....)
Advanced Case Management (FileNet),Document and customer management (Filenet)
– Migrate Oracle to DB2 UDB on Linux on z (incl. InfoSphere Data Replication)
UNIX based Solutions from competitive platforms (e.g. Solaris, HP-UX)
...
Linux on z System
© 2015IBM Corporation10
1 processor ship
1 core 1 IFL (Integrated Facility for Linux)
Example, depending on the type,model of the server and the type of workload:- On 1 intel core you are running 4 virtual machines - On 1 IFL you can run 40 virtual machines
4 virtual cpu cores affected to 1 virtual machine
Intel
1 core 1 IFL
Consolidation Ratio used in this example, 1:10: 10 cores to 1 IFL
Consolidation of Linux on z System
© 2015IBM Corporation11
Basics of MultithreadingDefinition for « a process »
• is a running instance of a program• gets separated from other process by the OS• runs with ist own copy of resources• consists out of one or more threads (a thread container from the OS perspective)
Definition for « a thread »
• a sequence of instructions• runs with other threads in parallel within a process• shares resource like memory, open files, addresses with other threads• allows programmer to isolate code that could freeze other while waiting
What is Simultaneous Multithreading?
A modification of a processor so the processor can run more than one thread silmuntanously
What are the benefits?Superscalar processors offer a high level of parallelism (e.g. out-oforderExecution)Using SMT, unutilized execution units can be exploited for an increased efficiency:
• modern processors have a latency when memory is accessed• this is circumvented (to a certain extent ) by a complex cache topology• during cache misses other threads can run on the same coreAdditional capacity with a limit effort of additional areas on the chip
© 2015IBM Corporation12
IBM z System SMT Exploitation
MT Aware
MT Unaware
Physical Hardware
Core
Thr Thr
PR/SM Hypervisor
OS OS
Core
Thr Thr
Core
Thr Thr
Appl Appl
Core
Thr Thr
Appl Appl
Core
Thr Thr
Appl Appl
Core
Thr Thr
Appl Appl
Core
Thr Thr
Appl Appl
Core
Thr Thr
Appl Appl
Core
Thr Thr
Appl Appl
Core
Thr Thr
Appl Appl
Core
Thr Thr
Core
Thr Thr
Logical CPUs
Logical cores
Physical cores
HW Threads
Applcpu1 cpuN
n LinuxGuests
Virtual CPUs
© 2015IBM Corporation13
SMT Support Implementation on z 13 for z/VM Enable SMT for IFLs Support up to 32 multithreaded cores (64 threads) Treat each thread as an independent ‘processor’ Dispatch virtual IFLs on the Hardware Threads
• Same or different guests can share core• Adds to variability
How to Enable it ? Add the MULTITHreading ENAble statement to your system configuration
file. The system must be in vertical polarization mode (this is the default)
– Make sure you don't have an SRM POLARIZATION HORIZONTAL statement in your system configuration file.
The system must be using the reshuffle dispatcher method (this is the default)
– Make sure you don't have an SRM DSPWDMethod REBALANCE statement in your system configuration file.
Re-IPL your system!
© 2015IBM Corporation14
1 IFL
Using Simutaneous Multi-Threading (SMT), on z 13 for Linux workloads
1 IFL
Two tasks, one core
Two tasks, two threads
Elapsed Time
(assumes one thread delivers 70% of a core)
Additional capacity
Task A Task B
Flexibility & More Throughput !
thread0
thread1
Processing more work with same resources
© 2015IBM Corporation15
● Objective is to improve system capacity, not the speed of a single instruction stream.
● Not everything runs in parallel -> no linear gain● Workloads profit individually from SMT
What you see, is what you get - no general rule (like estimate20%)
It increases the capacity: things not get faster, but more thingscan be done within the given time
Some scenarios are exploiters of multi threading, there are others that don‘t: The amount of data shared between software threads is small, The amount of process is important, The size of the allocated memory pages is important (TLB misses) Lightweight Java applications with many threads.
Summary on Simutaneous Multi-Threading (SMT)
© 2015IBM Corporation16
Introducing z 13 innovations for Linux on z
Cloud, Analytics, Mobile & Security
Contents
Linux on z System & SMT
© 2015IBM Corporation17
Virtualization and Cloud Portfolio for Linux on z Systems
Servers: z13, zEC12, zBC12Massively scalable
Characterized by great economics / efficiencies
Highly secure / available
z/VM 6.3Support more virtual servers than any other platform in a single footprint
Integrated OpenStack support
IBM Wave for z/VMA graphical interface tool that simplifies the management and administration of z/VM and Linux environments
Cloud Manager with OpenStack
A simple, entry level cloud management stack
Based on OpenStack
Formerly known as SmartCloud Entry
Cloud Orchestrator
Based on OpenStack
Builds on functionality of Cloud Manager with OpenStack and adds runbook automation and middleware pattern support for workload deployment
Formerly known as SmartCloud Orchestrator
Service Lifecycle ManagementStandardizationDifferentiation
VirtualizationInfrastructure & Virtualization
Management
Entry Level Cloud
Standarization & Automation
Advanced Cloud
Orchestration & Optimization
© 2015IBM Corporation18
z System is ready for Hybrid Cloud Computing
IBM Cloud: SoftlayerExpose services in a secure manner via
zOSConnect to achieve rapid open source based development whilst leveraging mainframe assets
Expose z/OS Data as-a-Service via BlueMix to enable system of record to be called by Dev-Ops
driven composable apps
z Systems - BlueMix Integration
PaaS : Bluemix
DataPower
CastIron
Secure Gateway
z/OS Connect
© 2015IBM Corporation19
z Cloud mobile services
MobileFirst Platform
(on-prem)
CICS
IMS
WebSphere AS
DB2
Ana
lytic
s
Mobile apps run either on-prem (using Linux on
System z) or in the cloud (via BlueMix)
z/OS ConnectMobileFirst
Platform (cloud)
Analytics run on SoR system
for optimal performance and security
Mobile
Access this demonstration here: DemoSearch for : IBM Apple Advise & Grow Demo
© 2015IBM Corporation20
© Copyright IBM Corporation 2014
Str
uct
ure
dU
nstr
uct
ur
ed
InfoSphere DataStage
Functionally Complete & RichFunctionally Complete & RichFunctionally Complete & RichFunctionally Complete & Rich
Low Latency (Limited Data Flow)Low Latency (Limited Data Flow)Low Latency (Limited Data Flow)Low Latency (Limited Data Flow)
AcceleratedAcceleratedAcceleratedAccelerated
Ultra-safeUltra-safeUltra-safeUltra-safe
z Cloud secured analytics services
IBM InfoSphere z System Connector for Hadoop
© 2015IBM Corporation21
z13 – Redesigned for efficient and trusted cloud services
* All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.
Up to 8,000 virtual servers per system, more than 50 per core
Open virtualization with new KVM support *
z13 brings faster processing and higher throughput of secure
transactions (2X more throughput on crypto
coprocessor)
Business continuity and IT analytics with enterprise grade
Linux solution
Open support extended with OpenStack®, PostgreSQL, Node.JS, and KVM*
Enterprise-grade Linux provides the foundation for public, private, and hybrid cloud
Patterns for Linux on z Systems to quickly build out complex cloud workload instances
Improved overall system performance leads to a lower TCO compared to public cloud deployments and deployments on x86 architectures
Enabling next generation cloud applications with IBM Bluemix™ on z Systems
© Copyright IBM Corporation 2015
Session summary
Optimized Workload Deployment • Increased efficiency for workload deployment• “Shared everything” architecture• Consolidates monitoring and performance management• Deploy on the best suited platform• Multiple O/S Support for Heterogeneous clouds
Secure Infrastructure with Security Built in• Highest security rating • Each processor has its own cryptographic
coprocessor• End to End encryption• Hypervisors managed as firmware• Unparalleled audit and compliance capabilities
Resilience with RAS designed in• Engineered to rarely fail and to rapidly recover • Built in hardware redundancy• High degrees of elasticity / scalability• Guaranteed application performance (QoS)• Active monitoring for abnormal behavior
Linux on z System let's you take benefits of :
© 2015IBM Corporation23
IBM Client Center Montpellier
Parc Industriel de la Pompignane
34000 Montpellier
Phone: +33 4 67 34 65 74
llaurency@fr.ibm.com
Follow me on Twitter :
@SLLaurency
https://twitter.com/SLLaurency
Sébastien LLaurency
IBM Certified Expert Integration Architect
Cloud Computing
Digital Solutions for z Systems
© 2015IBM Corporation24
Affordability
Attractive price performance. Offers the lowest TCA for Linux deployment of Oracle database workloads over competition - saving over half the cost1. Lower costs through reduced complexity - Simplified management, Reduced environmental costs, Greater flexibility to meet changing needs
AvailabilityNear zero downtime/continuous availability, even during maintenance of hardware, OS, database and application components. Enhanced disaster recovery responsiveness.
Efficiency
Reduced infrastructure complexity through consolidation, automation and virtualization, saving on energy, labor, software, and more. Management of the end to end applications, fast private network, fewer hops and points of failure. High resource utilization.
Integration
Capability to handle the largest volumes of data, in a day and age when data is booming. Tight integration and simpler management of data and applications on one system. Low latency. Homogeneous system environment.
ScalabilityFlexibility and near-linear large scalability, unmatched in the IT world, to grow with your business. Superior virtualization. Unprecedented scale.
SecurityComprehensive protection of critical data from all IT security threats. Private server network. Most secure platform with Common Criteria Evaluation Assurance Level 5 (EAL5).
1 Based on measurements at a large bank comparing a production workload running on Oracle RAC DB on distributed versus Oracle RAC DB on Linux a Enterprise Linux Server with cores running at 5.5 GHz.
Infrastructure Matters
top related