ami automatic mainframe intelligence: a self-managing ... is bmc ami - nedbug final.pdf · • ami...
TRANSCRIPT
1© Copyright 12/6/2018 BMC Software, Inc. - BMC Confidential—Internal Use Only
Shery LarsenWorldwide Db2 Z Solutions,
BMC Software
AMI – Automatic Mainframe Intelligence: a Self-Managing Mainframe
© Copyright 2018 BMC Software, Inc
Pressures Must be Overcome for Business Success
ITOM Executives
Business & IT Architects
BUSINESS
PRESSURE
Customer Experience
Security &
Data Protection
IoTRegulatoryCompliance
New Technology
Skills
Hybrid Multi-cloud
Transaction & Data Growth
Speed &Agility
Cost Efficiency
© Copyright 2018 BMC Software, Inc
KEEP CONFIDENTIAL
You need:
Intelligent software with domain expertise
Proactive early warning
Degradation analysis
Problem remediation, with trusted automation
Mainframe organizations must
take a new approach aimed at self-managing IT.
The Changing Mainframe IT Operations Landscape
© Copyright 2018 BMC Software, Inc
4© Copyright 12/6/2018 BMC Software, Inc. - BMC Confidential—Internal Use Only 4© Copyright 2018 BMC Software, Inc.
AI will be Pervasive by 2020
By 2020, 30% of data centers that fail to
apply AI and machine learning effectively in support of enterprise business will cease to be operationally and economically viable.
Gartner Report: The IT Implications of the 2018 CIO Survey for I&O LeadersBy Dave Russell, Hank Marquis Published: 8 March 2018
Key Technology - AI and Machine Learning
5© Copyright 12/6/2018 BMC Software, Inc. - BMC Confidential—Internal Use Only 5© Copyright 2018 BMC Software, Inc
Key Technology – Machine LearningMachine learning (ML) is a field of computer science that gives computer systems the ability to "learn" (i.e., progressively improve performance on a specific task) with data, without being explicitly programmed.
- Wikipedia
Artificial intelligence (AI) is the intelligence exhibited by machines or software. It is also the name of the academic field of study which studies how to create computers and computer software that are capable of intelligent behavior.
- Wikipedia
6© Copyright 12/6/2018 BMC Software, Inc. - BMC Confidential—Internal Use Only 6© Copyright 12/6/2018 BMC Software, Inc. - BMC Confidential—Internal Use Only
Looking Across Other Industries
Financial Services• “Robo-advisors” in Portfolio
Management• Algorithmic Trading• Fraud Detection
Manufacturing• QA using ML is finding
90% more defects• Reducing supply chain
errors by 50%
Logistics• Lane planning with analytics
on weather or traffic • Natural Language Processing
saves data entry time
7© Copyright 12/6/2018 BMC Software, Inc. - BMC Confidential—Internal Use Only 7© Copyright 2018 BMC Software, Inc
Key Technology – Intelligent Alarms
In data mining, anomaly detection (also outlier detection) is the identification of items, events or observations which do not conform to an expected pattern or other items in a dataset. ... Anomalies are also referred to as outliers, novelties, noise, deviations and exceptions.
- Wikipedia
The Answer is a Self-Managing MainframeThat Adopts New Key Technologies
• Artificial Intelligence• Machine Learning• Intelligent Automation• Domain Expertise• Out-of-the-Box value
© Copyright 2018 BMC Software, Inc
9© Copyright 12/6/2018 BMC Software, Inc. - BMC Confidential—Internal Use Only
AMI’s Advantage BMC• Drive a modern, agile business with AI, machine
learning, predictive analytics, and intelligent automation
• Manage, diagnose, heal, and optimize without manual intervention
We Beat the Competition with a Unique Value Proposition
Super Metrics
Multiple Data Sources
Multiple Products
Multivariate Processing
CLARITY
10© Copyright 12/6/2018 BMC Software, Inc. - BMC Confidential—Internal Use Only
Components of a Self-Managing Mainframe
Real-Time Automated Mainframe Intelligence
Embedded Domain Expertise
EnterpriseConnectors
© Copyright 2018 BMC Software, Inc
11© Copyright 12/6/2018 BMC Software, Inc. - BMC Confidential—Internal Use Only 11© Copyright 2018 BMC Software, Inc
That can Enable Business Outcomes
Seeing Around the Corner, Preventing a Full System Outage
Detecting and Stopping a Security Threats in Real-Time Saving Money with Real-Time Cost Management
Speeding Application Deployments Safely and Securely
z/OS
IMSDB2
Network
Systems
Machine Learning
(MVP)
User account requires
investigation and activity halting
Prescribed Remediation
Users account revoked
and alert raised. In flight FTP cancelled
Intelligent
Automation
User activity profile
does not match normal
Behavioral
Analysis
Privileged user logs on from
unusual IP address and looks to download data
Intelligent Alarms
CICSMQ
Storage
BMC Automated Mainframe Intelligence
z/OS
IMSDB2
Network
Systems
Machine Learning
(MVP)
Fix index access path
Prescribed
Remediation
Automated SQL tuning
prior to system outage
Intelligent Automation
Access path changes causing
increased get pages
Problem Determination
TranATranB
TranC
KPI1 KPI2 KPI3 KPI4
ü
ü ü
üüPredicted to impact
Production on Monday
Predictive Analysis
TranAApplication is changed over
weekend – CPU usage increase
Intelligent Alarms
TranA
CICSMQ
Storage
BMC Automated Mainframe Intelligence
z/OS
IMSDB2
Network
Systems
Machine Learning
(MVP)
Cap test batch LPARs
Prescribed
Remediation
Automated Cap
adjustment to avoid unexpected jump in
monthly MLC bill
Intelligent Automation
Excessive/unexpected batch
testing is driving higher 4HRA
Problem Determination
Predicted to create
new/higher peak 4-hour rolling avg
Predictive Analysis
4-hour rolling avg approaching
new peak for the month
Intelligent Alarms
CICSMQ
Storage
BMC Automated Mainframe Intelligence
z/OS
IMSDB2
Network
Systems
Machine Learning
(MVP)
User account requires
investigation and activity halting
Prescribed Remediation
Users account revoked
and alert raised. In flight FTP cancelled
Intelligent
Automation
User activity profile
does not match normal
Behavioral
Analysis
Privileged user logs on from
unusual IP address and looks to download data
Intelligent Alarms
CICSMQ
Storage
BMC Automated Mainframe Intelligence
12© Copyright 12/6/2018 BMC Software, Inc. - BMC Confidential—Internal Use Only 12© Copyright 2018 BMC Software, Inc
“See Around the Corner”Avoid Full System Outage
Monitor
DB2
IMS
Systems
Network
Machine Learning
Fix index access path
Prescribed Remediation
Automated SQL tuning prior to system outage
Intelligent Automation
Banking application Is changed over weekend – CPU usage increase
Intelligent Alarms
TranA
Predicted to impact Production on Monday
Predictive Analysis
TranA
Access path changes causing increased get pages
Problem Determination
TranA
TranB
TranC
KPI1 KPI2 KPI3 KPI4
✓
✓ ✓
✓✓
13© Copyright 12/6/2018 BMC Software, Inc. - BMC Confidential—Internal Use Only 13© Copyright 2018 BMC Software, Inc
Business Agility
DBA Review / Approve
Compare to Production
Build Change File
Meet Best Practice Standards?
Notify of non-compliance
Change Manager
Yes
No
Ap
plic
atio
n D
eve
lop
me
nt
Orc
he
stra
tio
nJI
RA
, ISP
W, J
enki
ns,
BM
C R
LM
14© Copyright 12/6/2018 BMC Software, Inc. - BMC Confidential—Internal Use Only 14© Copyright 2018 BMC Software, Inc
Foundation of a Self-Managing Mainframe
Deep and Broad
Data Sources
Built-in Domain Expertise
Multivariate AnalysisOut of the Box
Intelligence
Out-of-the-Box Value
Taking the Burden Off of You and Your Teams
or
© Copyright 2018 BMC Software, Inc
Deep and Broad Data Sources
• Different products• Db2• CICS• z/OS• IMS• MQ• Network• Etc …
• Different types• MainView• SMF• Recovery logs• Console logs• Logrec
Depth & Breadth of Data
• Baselining• Predictive analysis• Root cause analysis• Model training
Drives ML and AI effectiveness
© Copyright 2018 BMC Software, Inc
The Advantage of Domain Expertise
• Machine learning is not magic
• Data science can lead to unintended correlations that are believable
• You need Domain Expertise
© Copyright 2018 BMC Software, Inc
18© Copyright 12/6/2018 BMC Software, Inc. - BMC Confidential—Internal Use Only 18© Copyright 2018 BMC Software, Inc.
Multivariate Analysis
Multivariate statistics is a subdivision of statisticsencompassing the simultaneous observation and analysis of more than one outcome variable.
Multivariate statistics concerns understanding the different aims and background of each of the different forms of multivariate analysis, and how they relate to each other.
The ability to watch many different metrics from many different data sources
© Copyright 2018 BMC Software, Inc
Rules vs. Machine Learning
19
Rules
• Learned one outage at a time• Too little too late • Too much to watch - Excessive
amount of KPIs mean data overload and inability to reduce data input
• Root cause still unclear
Machine Learning
• Ability to monitor the systems/transactions in a more efficient way
• More sensitivity to data characteristics• Unearth hidden patterns from the data• Build in domain expertise up front relieves
lack of domain expertise on staff• Intelligent models that self assess and allow
automatic retraining to find a new “normal”
© Copyright 2018 BMC Software, Inc
Training, Deployment, Scoring
Historical Data
Feature Engineering
Train Evaluate Deploy
New data Score Feedback ReevaluateNew
Historical data
© Copyright 2018 BMC Software, Inc
Creating & Using Baseline Models
• Gathers historical data to understand normal - baseline
• Learns special time series data (weekday, weekend, month end , quarter end, “black Friday”.)
• Defines the red, yellow and green range for metrics
• With the baseline, models can now detect anomalies
© Copyright 2018 BMC Software, Inc
22© Copyright 12/6/2018 BMC Software, Inc. - BMC Confidential—Internal Use Only
Real Life Scenario Today
Completely Avoidable Complete System Outage
App rebound
•Access path changed
•Tablespace scan
Application Problems
•Uses extra GetPages
•No extra I/O
Extra CPU
•High priority workload
•ALL applications are effected
Peak Production Workload Arrives
•No CPU available
More Threads Allocated
•Cause MORE Contention
•More CPU & Storage
System Runs out of Storage
•Complete system outage
•$$$M
© Copyright 2018 BMC Software, Inc
23© Copyright 12/6/2018 BMC Software, Inc. - BMC Confidential—Internal Use Only
Same Scenario Tomorrow
100% Detectable & Avoidable
Application Rebound at weekend
•Access path changes
• Tablespace scan
Pages Loaded Correctly
•No extra I/O
Application Corrected
•Hours in Advance
•Saves $$$M
All the pain is gone!
© Copyright 2018 BMC Software, Inc
24© Copyright 12/6/2018 BMC Software, Inc. - BMC Confidential—Internal Use Only 24© © Copyright 2018 BMC Software, Inc
DevOps Drives your Digital Business
Improving Speed is a High Priority
of IT leaders say speed of application/product delivery is a critically or very important KPI
76%
67%
Velocity Gap Slowing Customers Down
of IT leaders say improving the speed of development cycles is a critical or high priority
25© Copyright 12/6/2018 BMC Software, Inc. - BMC Confidential—Internal Use Only 25© © Copyright 2018 BMC Software, Inc
PROD
App Dev Orchestration
• JIRA• ISPW• JENKINS• BMC RLM
Database changes
Change Manager
Compare to Production
CHG FILE
Start over if not compliant
Discuss Changes After
Testing
Review Changes for Compliance
SQL Performance
Start over if performance Issue
Today’s Velocity Gap is Inefficient
Application Developer
DBA
26© Copyright 12/6/2018 BMC Software, Inc. - BMC Confidential—Internal Use Only 26© Copyright 2018 BMC Software, Inc
Automate Database Changes in DevOps
DBA Review / Approve
Compare to Production
Build Change File
Meet Best Practice Standards?
Notify of non-compliance
Change Manager
Yes
No
Ap
plic
atio
n D
eve
lop
me
nt
Orc
he
stra
tio
nJI
RA
, ISP
W, J
enki
ns,
BM
C R
LM
27© Copyright 12/6/2018 BMC Software, Inc. - BMC Confidential—Internal Use Only 27© Copyright 2018 BMC Software, Inc
External: What is AMI?
BMC AMI Enterprise ConnectorsGetting your Z information connected to the rest of your enterprise• AMI Data Extractor for IMS available now• More AMI Data Extractors coming in 1H 2019
BMC AMI Autonomous Solutions*
Intelligent, policy driven, integrated solutions to power self-managing mainframes• AMI Security management• AMI DevOps • AMI Performance and Availability management• AMI Cost and Capacity management
*Multiple products releasing over the next five quarters
Advanced Solutions and Capabilities in the BMC Z Portfolio that Incorporate Automation, Machine Learning, Analytics, and Artificial Intelligence
28© Copyright 12/6/2018 BMC Software, Inc. - BMC Confidential—Internal Use Only 28© © Copyright 2018 BMC Software, Inc
Current Capabilities
✓ Intrusion detection✓Automatic tracing✓ Threshold analytics✓ Smart Alarms✓Performance predictions✓ SQL workbench✓ One-button IPL✓ Secure HMC management✓ Dynamic capping✓ IMS scheduling wizard
✓ Transaction details✓MainView - IMS log integration✓Automated reorg✓Online reorg✓MLC peak reporting✓ MLC predictions✓ Automatic restart✓ Subsystem redundancy✓ NGT SmartSwitch
© Copyright 2018 BMC Software, Inc.