accelerate your business like updates to ibm mq leif
TRANSCRIPT
Accelerate your business like never before with the latest updates to IBM MQ—Leif DavidsenProgram Director, MQ Offering Management
IBM MQ is the solution for
business critical messaging
The world depends on reliable, secure messaging and 85% of the fortune 100 depend on IBM MQ*
Your bank transfers complete without losing your money, with all of the worlds top 50 banks using
IBM MQ*
*Correct as of end 2016 against http://www.relbanks.com/worlds-top-banks/assets and http://beta.fortune.com/fortune500/list/
Reliable Secure
ScalableSimple
Precise Connected
© 2019 IBM Corporation2
IBM Messaging2
Internet of Things
Connecting millions of
devices
Lightweight
communication
Event Driven
Enterprise
Event Streaming
Stream History
Business Critical
Communication
Exactly once delivery
Reliable
IBM Messaging is essential to a modern enterprise
Scalable and Secure to the coreIBM Confidential © 2019 IBM Corporation 3
Business Critical CommunicationFlexible, reliable, secure assured delivery of business critical communication
Messaging
</>
</></> </> </>
Messaging
</> </> </>
Messaging
Proven technology for communicating business critical data within and between applications.
• Once and once only
• Targeted delivery
• Platform agnostic
IBM Confidential © 2019 IBM Corporation 4
Design considerations for moving data
API calls over HTTP?
Will the systems
always be available?
What about the
applications or
networks?
How will failures be
handled?
Roll-your-own
messaging?
Who is going to
maintain the solution?
What assurances are
there for it?
How secure is it?
Dynamic connectivity?
Scalability?
Focus for simplicity? Development
teams or infrastructure?
Other commercial messaging providers?
Do they promise to persist every message
individually?
Do they offer once-and-once-only delivery
What about end-to-end encryption?
How much experience do they have in transactions
and supporting mission critical deployments?
What data is being moved?
Why is it moving?
How do you handle errors?
Connectivity, design and
scalability
5
Request / ReplyAssured Delivery✓
Stream HistoryDecoupled subscriptions
Messages or Events?Messages† are “work that needs to be done” Events are “things that have happened”
Stan
dar
d
nee
ds
Pu
shin
g th
e
bo
un
dar
ies
† also known as commands or operations
© 2019 IBM Corporation
IBM MQ
IBM MQFocused on message exchange and transactions
KafkaFocused on streaming of events
Point-to-point Publish/Subscribe
IBM Event Streams
Supported connectivity
6
On-premise, software
and the MQ Appliance
Run MQ yourself in
public or private cloudsLet IBM host MQ for
you with its managed
SaaS MQ service in
public clouds,
IBM Cloud and AWS
Run IBM MQ in any
location or cloud,
exactly as you
need it
© 2019 IBM Corporation7
Kubernetes
AWS
Linux
Windows Solaris
AIX
IBMi
IBM Z
Appliance
zLinuxHPE NonStop
Azure
AWS
Red Hat OpenShift
IBM Cloud Pak for
Integration
7
Customers value and trust IBM MQ
8
Our investments in mobile are helping to create a more rewarding professional work environment for our employees that increases job satisfaction and creates new touchpoints with customers for more valuable, interactive relationships
We have built an innovative solution
that is delivering a game-changing
contribution to the Ethiopian economy
IBM MQ makes messages appear on time, and it cut messaging costs by 60 percent vs. SMS
Deutsche Bahn
ALL of the World’s Top 50 Banks use MQ*
85% of the Fortune 100 are MQ customers*
Over 70% of the Fortune Global 500 use MQ*
The new solution speeds transaction processingand increases visibility into transactions across the entire enterprise, strengthening management oversight and control
Government agency
*Correct as of end 2016 against http://www.relbanks.com/worlds-top-banks/assets and http://beta.fortune.com/fortune500/list/ and http://beta.fortune.com/global500/
8
MQ on Cloud service
Up and Running in Minutes
Managed for You
Hourly billing
Enabled for Hybrid Cloud Connectivity
Hardware, virtualization, servers, network, storage
Queues, topics, channels,clustering, applications
MQ installation, basic configuration, security,
maintenanceManaged &
operated
by IBM
Configured &
monitored
by the
customer
Try the service for free www.ibm.com/cloud/mq9
MQ in Containers,
continually evolving
10© 2019 IBM Corporation
MQ first supported Docker containers in 2015, showing how a stateful solution canrun in an often stateless world.
MQ was one of thefirst certified containers available on IBM’s Kubernetes platform, IBM Cloud Private. Showing how to run MQ in a managed container environment.
MQ added support for running on Red Hat OpenShift
MQ is a key componentof IBM’s Cloud Pak for Integration, providing enterprise messaging for the Integration Platform solution
hub.docker.com/r/ibmcom/mq github.com/ibm-messaging/mq-container2015 201910
Replatform
establishing the container
orchestration platform,
services and capabilities to
succeed, and move to a
runtime topology that is
native to the platform
Containerize MQ
queue managers, with
applications connected as
clients
MQ Modernization
Containerization
facilitates the
modernization of MQ
deployments.
(These pattern also
apply outside of
containers)
Repackage
break down the existing
artefacts so that they are
bounded along line of
business and development
teams to improve the
agility of the organization
Queue managers are
dedicated to an application
Refactor
re-work the artefacts that
are hard to maintain or
prevent the organization
from realising the full
benefits of their
modernization journey
Deploy MQ patterns that
provide horizontal scaling
and continuous availability
11© 2019 IBM Corporation
QM
QM
QM
QM QMQM
QM
QM QMQM
11
12
The MQ Appliance M2002
The scalability and security of IBM MQ
Supports the same MQ applications
But, with the convenience, fast time-to-value
and low total cost of ownership of an
appliance
Built-in HA/DR. Apply maintenance in
minutes
Based on latest MQ V9.1: Available to run both LTS
and CD releases on the MQ Appliance
M2002 headline numbers
• Over 200 thousand persistent, HA replicated,
messages produced and consumed per
second
• Over 600 thousand non-persistent messages
produced and consumed per second
© 2019 IBM Corporation
Me
ssa
ge
rou
nd
trips p
er s
eco
nd
Number of clients driving work
M2002 – v9.1
M2001 – v9.1
M2001 – v9.0.5
12
Why IBM MQ is the choice for so many businesses
Managing and developing for MQ
Connecting everything
Supporting key ecosystems
Custom and 3rd
party tooling
Security
Usable security
Encrypted data at rest
Encrypted data on the wire
Speed and Scalability
Scaling to > 1 trillion messages per
day
High throughput with persistence
Accelerated delivery over WAN
Availability and reliability
Continuous availability of MQ Queue
Managers
Continuous availability of messages
Designed to never lose a message13
Speed and Scalability
IBM Confidential © 2019 IBM Corporation14
How important is speed in your messaging solution?
When sending message
data outside your data
center
• You need it to be
delivered
• You need it to get there
quickly
15
Time
=
money
Why network speed isn’t always most important
Aspera FASP.io
Accelerates/improves data
transport of any
desktop/server or
server/server TCP workflows
Take advantage of the new FASPv4 protocol
➢ Lightning speed regardless of the distance or
network conditions
➢ Bidirectional
16
Winning the race by going faster. MQ accelerated by Aspera
• Sending data to remote parts of
your own business?
• Exchanging data with partners?
• Moving data between your data
center and public cloud?
• You could benefit from the new
Aspera Streaming Gateway
included with MQ Advanced
Queue Manager
Ga
tew
ay
Queue Manager
Ga
tew
ay
Available in MQ V9.1.4
for MQ Advanced and MQ
Appliance customers
TCP/IP TCP/IPFASP.io
17
Accelerate onboarding to Blockchain with MQ Advanced
▪ Bridge allows an MQ application to
connect to Hyperledger Fabric
Blockchain running in IBM Cloud or
running locally
▪ Request-reply MQ messages to query
information from Blockchain (e.g.
what is the value of the balance on this
account)
▪ MQ drives Create, Read, Update and
Delete operations on Blockchain-
managed assets
▪ No need to understand the ledger-
specific APIs, configuration or controls
18
Availability
IBM Confidential © 2019 IBM Corporation19
Message high availability
20
Consider a single message
Tied to a single runtime, on a single piece of
hardware
Any failure locks it away until recovery
completes
The problem The objective
– Messages are not tied to a single anything
– In the event of a failure, there is a fast route to access the message
Message high availability
21
– Messages are highly available, through replication
– Only one runtime is the leader and has access to the messages at a time
– A failure results in a new leader taking over
– Any message is available from any runtime at any time
– Coordinated access to each message
– A failed runtime does not prevent access to a message by another runtime
Active / active messages Active / passive messages
IBM MQ Distributed HA solutions
22
MQ managed
The resilient data and the automatic takeover is provided by the MQ system
Externally managed
External mechanisms are relied on to protect the data and provide automatic takeover capabilities
System managed HA
QMgr QMgr
Multi-instance queue managers
QMgr QMgr
MQ Appliance
QMgr
QMgr
Replicated data queue managers
QMgr QMgr QMgr
IBM MQ Advanced 9.1 LTSRHEL x86
MQ HA Group
Node 2 Node 3Node 1
Replicated Data Queue Managers App
Network
App App
MQ 9.1 saw a fully integrated, data replication and failover solution on RHEL x86 for bare metal and virtual machine deployments. Provided as part of MQ Advanced for on-prem and in the Cloud
No need for a shared file system or HA cluster
Three-way replication and monitoring for quorum
support
Synchronous data replication for once and once
only transactional delivery of messages
Active/passive queue managers with automatic
takeover
Per queue manager control to support active/active
utilisation of nodes
MQ licensing is aligned to maximise benefits
MQ 9.1.4 adds support to identify RDQM nodes in
ILMT 23
High Availability with Kubernetes
The RDQM solution does not apply to container
environments
High availability of the MQ data requires highly
available replicated storage
Container orchestrators such as Kubernetes handle
much of the monitoring and restart responsibilities…
Node 1 Node 3Node 2
HA network
storage
Pod 1
StatefulSet, Replicas=1
Kubernetes
24
High Availability with Kubernetes
The RDQM solution does not apply to container
environments
High availability of the MQ data requires highly
available replicated storage
Container orchestrators such as Kubernetes handle
much of the monitoring and restart responsibilities…
…but not all. StatefullSets such as MQ are not
automatically restarted following a Kubernetes node
failure
Node 3Node 2
HA network
storage
StatefulSet, Replicas=1
Kubernetes
25
High Availability with Kubernetes
The RDQM solution does not apply to container
environments
High availability of the MQ data requires highly
available replicated storage
Container orchestrators such as Kubernetes handle
much of the monitoring and restart responsibilities…
…but not all. StatefullSets such as MQ are not
automatically restarted following a Kubernetes node
failure
The MQ container image and Certified Container
now supports a two-replica multi-instance queue
manager deployment pattern to handle Kubernetes
node failures
The Certified Container image for MQ Advanced
in 9.1.4 now supports OpenShift natively
Node 1 Node 3Node 2
HA network
storage
Pod 1
multi-instance
active
Pod 2
multi-instance
standby
StatefulSet, Replicas=2
Kubernetes
IBM MQ 9.1.3 CD
26
Always available
IBM Confidential © 2019 IBM Corporation27
Building scalable, fault tolerant, solutions App AppApp
Many of you have built your own continuously available and horizontally scalable solutions over the years
28
Building scalable, fault tolerant, solutions
Many of you have built your own continuously available and horizontally scalable solutions over the years
The key is to decouple the applications from the individual queue managers as much as possible.
MQ has provided you many of the building blocks -
Client auto-reconnectCCDT queue manager groupsMQ Clustering
But you’re left to solve some of the problems, particularly with long running applications -
Efficiently distributing your applicationsEnsuring all messages are processedMaintaining availability during maintenanceHandling growth and contraction of scale
App App App
decoupled
AppApp
MQ V9.1.4 adds support for .Net and XMS .Net
applications. Also rebalancing is faster, with
more reporting. And configuration is simpler.29
Managing, securing and connecting MQ
© 2019 IBM Corporation30
Making management simpler
Web consoleSimple to use, web based administration for
Distributed, z/OS, Cloud and the Appliance
RESTful administrationAdminister and manage your queue managers over
HTTPS
Logging and monitoringSimplify the streaming of logs and metrics for
centralized storage and analyzes
DISPLAY
UPDATE
GETreceive JSON
POSTsend JSON
DELETE
PATCHsend JSON
HTTP MQSC
DEFINE
DELETE
IBM MQ 9.1 LTS
JSON
31
Managing channel CipherSpecs
Making it easier to keep up-to-date with ever
changing ciphers, simplifying migration
MQ 9.1.1 CD (all platforms) introduced ANY_TLS12
and MQ will negotiate the strongest CipherSpec
available to both ends
For 9.1.1, the distributed platforms also added the
ability to whitelist exactly which CipherSpecs a
queue manager will accept
MQ V9.1.4 adds the first support for TLS 1.3 for
C and C++ applications
MQ now also includes MQ IPT as part of the
distribution enabling more customer usage, and
continuity of support
MQ Advanced now supports MQ IPT with a HSM
CipherSpec A
CipherSpec ANY CipherSpec ANY
CipherSpec A
IBM MQ 9.1.1 CDAll Platforms
32
Advanced Message Security
End-to-end message encryption is now even easier
to adopt, thanks to ever improving performance
MQ 9.0 LTS started to drive down the overhead of
AMS with the introduction of the confidentiality
policy
MQ 9.0.1 CD was the point that all platforms
benefitted fully from those improvements
AMS on z/OS can now be as efficient as TLS just on
the channels
IBM MQ 9.0-9.1 LTS
33
Managed File Transfer MFT manages your file transfers, and now it’s even
easier for you to manage MFT…
IBM MQ 9.1 LTS +
Redistributable MFT agentSimply download and unpack
Simplified MFT Agent licensingNo need to track individual agents with MQ Advanced queue managers
Failed transfer timeoutAutomatically stop transfers after repeated failures
Resource monitor backupsSimple, single command to backup and restore resource monitors
File transfer initiation throughsimple REST call
MFT agent, transfer and resource monitor
monitoring through REST
New in MQ V9.1.4 release – highly available MQ
MFT Agents – active/passive deployments
Also REST support for the ‘Create Monitor’
function of MQ MFT
Queue Manager
Queue Manager
MF
T A
gent
MF
T A
gent
Queue Manager
Queue Manager
MF
T A
gent
MF
T A
gent
34
Helping developers
© 2019 IBM Corporation35
Developing applications
Build your applications simply, with no need for an
MQ installation
Pull Java directly from the Maven repository since
MQ 9.0.4 CD
MQ 9.1.1 CD added the SDK to the MQ
redistributable client
The redistributable client is now available directly, no
need to log into IBM
ibm.biz/mqclientdownload
Develop your applications on the platform of your
choice with the addition of the MacOS version of the
9.1.1 MQ client and SDK for Developers
ibm.biz/mqmacos(The MQ for MacOS toolkit includes runmqsc)
Maven
IBM
Mac for Developers
npm
ibm.biz/mqclientdownload
ibm.biz/mqmacos
36
Writing new applications
REST MessagingProviding a very simple way to get messages in and
out of your MQ system
9.1.2 CD boosted the performance capability
9.1.3 CD added message browse
.NET Core9.1.1 CD brought support for .NET Core on Windows
9.1.2 CD added Linux support
Open Source language bindingsWrite MQI applications in Node.js and Golang
New simpler JMS style API for Golang
github.com/ibm-messaging
.NET Core
Node.js MQI Golang MQI
REST
Golang JMS
Windows
Linux
9.1.2
9.1.2
9.1.1
Put, get, browse9.1.3
github.com/ibm-messaging
37
Demonstrating the simplicity of MQ
There’s nothing like flashing lights and wires to grab
people’s attention. We want everyone to know how
easy it is to write messaging applications and how
powerful MQ is in supporting them
Ever tried Scratch, a graphical way to code, aimed
at kids but ideal to show how easily asynchronous
messaging can improve your applications with an
MQ plugin
Heard of the Raspberry PI? You think MQ is a
heavyweight solution? We run an HA pair of queue
managers on two $5 Raspberry PI Zeros!
ibm.biz/ibmmq-pi
ibm.biz/ibmmq-scratch
38
Getting Started
Teach yourself the basics of MQ
Build on top of simple samples
…and prove your skills
ibm.biz/learn-mq
ibm.biz/mq-dev-patterns
39
40
IBM Messaging ClientsMessaging Modernization Workshop
In addition, we’ll work with you to:
• Discuss industry standards, emerging technologies
and best practices
• Explore hybrid messaging solutions including
container-based deployments
• Perform an interactive review of your digital
transformation goals, objectives and challenges
• Review your existing ecosystem and map it against
our proven Reference Architecture
• Develop a high-level solution architecture
• Follow up with recommended next steps mapped to
the reference architecture
Half-day educational and interactive problem-
solving session at your site. During the workshop
our messaging architects will discuss their
experience of working with customers to develop
hybrid and multi cloud messaging strategies.
Contact: Callum Jackson ([email protected])
IBM Messaging Business PartnersHelping you to delight your customers
How can we make you even more effective building
world class solutions for your customers?
Contact: John Clifton ([email protected])
40
Thank you
Visit my MQ blog
https://leifdavidsen.wordpress.com/
Leif Davidsen
Program Director MQ Offering Management
41