Back to the future
Understand and Optimize your IBM Notes/Domino infrastructure
Daniel Reimann
Introduction • The goal: Thinking about going to the cloud, implementing Connections,
migrating, consolidating or growing your environment? – Crucial data lives in various places in your IT infrastructure – Doing any of the above projects requires you to look at this data in a “big picture”
view
• The challenge: How do you connect the various information silos? – Knowledge is spread out in the environment in numerous repositories on several
servers – In many situations, companies aren't even aware of the information available to
them
• How we can help: Going to back to the future to move forward – Find out how your environment looks today and get surprising results – Use these gathered results to solve existing issues and be well prepared for
implementing or connecting new services and optimizing or extending your infrastructure
Session content: (Some) results of a Domino Network Analysis Health Check
About DNA®
• Service Offering • Unique multi dimensional Insight in Utilisation &
Configuration of IBM Notes/Domino • Overall Health Check / SWOT of Customer Environment • Data Collection -> Analysis -> Reporting • IBM & Business Partners reselling DNA World Wide • Executed remotely by panagenda/Trust Factory
No Installation
No Dependancy
No Footprint
ZERO Impact means:
Nothing to Install
Leave No Footprint
Deliver in a Few Days
Zero Impact means:
No Installation
No Dependancy
No Footprint
ZERO Impact means:
Nothing to Install
Leaves No Footprint
Deliver in a Few Days
Zero Impact:
DNA® Service Modules
Server Consolidation Support
Root Cause & Performance
DNA® Health Check
Source Code Analysis
Starting Point for all DNA Services
Optional Service See slides at the end of
this presentation
Optional Service See slides at the end of
this presentation
Optional Service See slides at the end of
this presentation
What Results will it Provide? • Reveales Realistic Ambitions for:
• Cleanup & Optimization Opportunities • Server Consolidation & Network (Optional Module) • Application Migration (Optional Module) • Performance Optimization (Optional Module)
• Interactive Slide Deck
• Linked to Common Spreadsheets & Check Lists • Recommendations
• Presented Live
• Along with Explanation & Interpretation of Analysis Results by Subject Matter Expert
What can you do with the results? • IT Director / CIO:
• Executive Decision-Making Support • Validation of Business Case • Define Innovation & Cloud Strategy • Current State of Affairs
• Project Manager & Teams:
• DNA Facts & Findings Help Focus & Prioritize • Detailed Helicopter View replaces Micro View • Prepare any Scenario with DNA Data Points
• For Administration & Support:
• Cleanup & Optimize by Means of Actionable Check Lists • Improve Service Levels
Quick Wins
Project Wins
Strategic Wins
Each DNA ® delivers:
Quick Wins
Project Wins
Strategic Wins
Quick Wins
Project Wins
Strategic Wins
Each DNA ® delivers:
Scope
• Activity by Rich Clients • Web users not included
• 7 days • 26 Servers in Scope
Management Summary
• Today:
• Tomorrow:
* Based on observed session concurrency of (clustered, excl. special functions )
26 Domino Servers 4 Different Releases
6 Domino Servers *
2.167
1 Single 9.0 Release22544, GB Storage 8316, GB Storage
102, Integrity Issues1020, Open to Anonymous
Databases:
Directories: 110, Conflicts/Duplicates 18 Weak Passwords
Issues solved
Domino Environment Overview 1 Domino Directory
2,806 Users Registered
46 Servers Registered
589 Groups Registered
2,064 Users Active
2,055 Users sending email
3,345 Databases Touched
26 Servers Analyzed 15,572 Databases Deployed
4 Domino Releases
4 Operating Systems
22,594 Db Storage (GB)
1,177,671 Views Defined
176 View Storage (GB)
149,515 Views Indexed
144,164 ACL Entries
23,605 Group Members
0 %
20 %
40 %
60 %
80 %
100 %
Demo Inc Lowest Customer DNA Average Highest Customer
DNA BenchmarkActive versus Registered Users
Unused Licenses, Web Users, Regular Absense
2,064 active users
-
10
20
30
40
50
60
-
5
10
15
20
25
30
Demo Inc. Lowest Customer DNA Average Highest CustomerSession Duration 3 1 4 28 Online Time 37 5 17 44
Onl
ine
Tim
e(h
ours
per
use
r)
Sess
ion
Dura
tion
(min
s pe
r se
ssio
n)
DNA BechmarkTime Online
-
250
500
750
1.000
-
1.000
2.000
3.000
4.000
Demo Inc. Lowest Customer DNA Average Highest CustomerDocument Reads 1.983 304 2.093 3.652 Document Writes 301 152 385 906
Docu
men
t Writ
es
Docu
men
t Rea
dsDNA Bechmark
Document Reads/Writes
0
2
4
6
8
10
0
10
20
30
40
50
Demo Inc. Lowest Customer DNA Average Highest Customerserver to clients 8,7 1,9 10,3 38,2 clients to server 1,6 0,5 2,1 8,1
clie
nts
to s
erve
r(k
ilobi
ts p
er s
ec)
serv
er to
clie
nts
(kilo
bits
per
sec
)DNA Bechmark
Network Bandwidth Consumption
0%
5%
10%
15%
20%
2 4 6 8 10 12 14 16 18 20 22 24
Distinct Hours Online per Day
User Demand Profiling(Demo Company, 2064, active accounts)
Remote Users < System Accounts> Of f ice Workers
0%
25%
50%
75%
100%
Notes Sessions Document Reads Document Writes Db Transactions Network Traffic Session Durationcheck new mail 19% 0% 0% 4% 0% 3%system dbs 6% 5% 47% 8% 1% 1%mail files 52% 69% 47% 62% 87% 89%directories 17% 22% 2% 23% 6% 3%applications 6% 4% 4% 3% 5% 4%
End User Demand CharacteristicsDemo Company
0
1
10
100
1.000
10.000
100.000
1.000.000
10.000.000
100.000.000
1 10 100 1.000 10.000 100.000 1.000.000 10.000.000 100.000.000
Kilo
Byt
es
Sent
to S
erv
er
KiloBytes Read from Server
User Demand on 3341, DatabasesDemo Company
Application Domino Directory Mailfile Mailin database Server Mail Box System database
0% 25% 50% 75% 100%
User Sessions
Network Traffic(server to client)
Network Traffic(client to server)
DatabaseTransactions
DocumentReads
DocumentWrites
End User Demand at Demo CompanyClassified by Demand Level
Extreme (,0) Intensive (2,0) Moderate (62,0) Light (2000,0)
0
5.000
10.000
15.000
20.000
25.000DD
-Okt
-YY
0 6 12 18
DD-O
kt-Y
Y 0 6 12 18
DD-O
kt-Y
Y 0 6 12 18
DD-O
kt-Y
Y 0 6 12 18
DD-O
kt-Y
Y 0 6 12 18
DD-O
kt-Y
Y 0 6 12 18
DD-O
kt-Y
Y 0 6 12 18
User Activity by Top 10 Accounts(Document Reads)
user_810
user_864
user_1831
user_1364
user_894
user_1950
user_2652
user_996
user_2243
user_657
Very Low< 50
Low50 - 249
Average250 - 749
Normal750 - 1499
High> 1500
18 6 0 2 0
0
5
10
15
20
Domino Servers at Demo CompanyClassified by Maximum Session Concurrency
LevelServers
Redistributing the load can reduce nr. of servers with up to 18,
End User DemandSession Concurrency
0
500
1,000
1,500
2,000
2,50020
10-1
0-21
00
04
08
12
16
20
2010
-10-
22 0
0
04
08
12
16
20
2010
-10-
23 0
0
04
08
12
16
20
2010
-10-
24 0
0 0
4
08
12
16
20
2010
-10-
25 0
0
04
08
12
16
20
2010
-10-
26 0
0
04
08
12
16
20
2010
-10-
27 0
0 0
4
08
12
16
20
Con
curr
ent U
ser S
essi
on
Max Observed Maximum: 2,167
End User DemandDocument Reads
0
500
1,000
1,500
2,000
2,50020
10-1
0-21
00
04
08
12
16
20
2010
-10-
22 0
0
04
08
12
16
20
2010
-10-
23 0
0
04
08
12
16
20
2010
-10-
24 0
0 0
4
08
12
16
20
2010
-10-
25 0
0
04
08
12
16
20
2010
-10-
26 0
0
04
08
12
16
20
2010
-10-
27 0
0 0
4
08
12
16
20
Avg
per
Hou
Max Observed Average: 1,911
End User DemandDocument Writes
0
100
200
300
400
500
600
700
80020
10-1
0-21
00
04
08
12
16
20
2010
-10-
22 0
0
04
08
12
16
20
2010
-10-
23 0
0
04
08
12
16
20
2010
-10-
24 0
0
04
08
12
16
20
2010
-10-
25 0
0
04
08
12
16
20
2010
-10-
26 0
0
04
08
12
16
20
2010
-10-
27 0
0
04
08
12
16
20
Avg
per
Hou
Max Observed Average: 678
End User DemandDatabase Transactions
0
2,000
4,000
6,000
8,000
10,000
12,000
14,000
16,00020
10-1
0-21
00
04
08
12
16
20
2010
-10-
22 0
0
04
08
12
16
20
2010
-10-
23 0
0
04
08
12
16
20
2010
-10-
24 0
0 0
4
08
12
16
20
2010
-10-
25 0
0 0
4
08
12
16
20
2010
-10-
26 0
0 0
4
08
12
16
20
2010
-10-
27 0
0 0
4
08
12
16
20
Avg
per
Hou
Max Observed Average: 13,498
End User DemandNetwork Bandwidth Consumption
0
5,000
10,000
15,000
20,000
25,00020
10-1
0-21
00
04
08
12
16
20
2010
-10-
22 0
0
04
08
12
16
20
2010
-10-
23 0
0
04
08
12
16
20
2010
-10-
24 0
0 0
4
08
12
16
20
2010
-10-
25 0
0 0
4
08
12
16
20
2010
-10-
26 0
0 0
4
08
12
16
20
2010
-10-
27 0
0 0
4
08
12
16
20
Avg
per
Hou
r (kb
ps, t
o cl
ien
Max Observed Average: 23,616
Network Compression How Much is Notes Network Compression Used?
Enabled1% Disabled
99%
Includes Traffic from Users and Servers
# Users making use ofNotes Network Compression
0%
25%
50%
75%
100%
Persons Servers
% A
ctiv
e U
ser
Enabled
Disabled
Deployment Integrity
86 Group Cycles Detected
Integrity check # Databases
Duplicate Replica On Same Server 80Duplicate Template on same Server 0Replicas Acting As Different Template 22Same Replica but Different Inheritance 0
Grand Total 102
Document Type Full Names Name Variations
Group 0 2Mailin / Resource 4 6Person 0 95Other 3 0
Grand Total 7 103
Entries appearing in multiple documents
0%
5%
10%
15%
20%
25%
1 10 100
1.00
0
10.0
00
100.
000
% o
f To
tal
Stor
age
Size (megabytes)
DB Storage Profile for Demo CompanyDistributed by Size
System database
Mailin database
Mailfile
Domino Directory
Application
Dbs > 1 GB: 1,323Dbs > 10 GB: 431
Database Type
Number of
Databases
Total
Storage
Unique
Replicas
Consolidated
Storage
Storage Savings
Domino Directory 79 3 30 - 100%Mailfile 7,832 20,723 2,768 7,517 64%Mailin database 261 107 144 53 50%Server Mail Box 54 8 54 8 0%QuickPlace 165 1 147 1 0%BlackBerry 1,425 11 718 6 45%Application 2,904 1,691 1,200 731 57%
Grand Total 12,720 22,544 5,061 8,316 63%
Database Storage Consolidation Potential
Database Title Db Type Storage (GB)061cc52a3244e8bad944519170c3ff06 Mailfile 42.296140ee5ec036ec69136a74647729a2a Mailfile 32.2cad93d0aa156514e70237f1b370cc9c5 Mailfile 31.9cfef8f68b2847cdd2eea9dda44d94acc Mailfile 30.5861455d1d12b1b2d990fc9e7c41ceea7 Mailfile 28.95128de940e6d560d37723b6448d48e00 Mailfile 28.7d6de2ffe48a037e2e93ff13c688df77c Mailfile 28.3490eeb54ce626d24d63d1038be4de073 Mailfile 28.0928c35784596e9487a0db1304573a310 Mailfile 27.81ab2006c3ef8fe4ba6e7daca15ee29d6 Application 27.3
Top 10 databases ranked by size
0%
2%
4%
6%
8%
10%
12%10
KB
100
KB
1 M
B
10 M
B
100
MB
1 G
B
10 G
B
% o
f Tot
al V
iew
Sto
rage
View Size Distribution for Demo Company
System database
Mailin database
Mailfile
Domino Directory
Application
Views > 100 MB: 234,Views > 1 GB: 8,Showing 148355, views
0%
5%
10%
15%
20%
25%10
KB
100
KB
1 M
B
10 M
B
100
MB
% o
f To
tal
View
Sto
rage
View Size Distribution for Demo CompanyEnd User Mail Files
($Meetings)
($ThreadsEmbed)
($All)
($Sent)
($Inbox)
Views > 100 MB: 13,0Views > 1 GB: ,0Showing 7104, views
Basic Security Checks
Variations found Accounts
Company Name 1First Name 1Last Name 1Short Name 7'password' 8
Grand Total 18
Internet Password Strength
Access Level Databases Templates
Depositor 0 28
Reader 262 80
Author 35 82
Editor 2 0
Manager 0 21
Grand Total 299 211
Grand Total 598 422
Databases with Anonymous Access
Applications Touched by Users
5,507
15,572
1,349
193
Recoding Effort
Databases on all Servers
Unique Replica IDs
Excl. mail and system files
Applications Used in past 7 days
Optimize Platform
Application Migration Effort
Server Health Checks
The following Slides show several higlights of the platform checks that were performed
Namelookup Cache Utilizationon server server_17
0
25
50
75
100
21-O
ct-1
0 0 6 12 18
22-O
ct-1
0 0 6 12 18
23-O
ct-1
0 0 6 12 18
24-O
ct-1
0 0 6 12 18
25-O
ct-1
0 0 6 12 18
26-O
ct-1
0 0 6 12 18
27-O
ct-1
0 0 6 12 18
Set this cache higher to prevent 100% utilization
%
2 other server(s) have similar issues
NSF Events & Monitor Pool Size Utilizationon server server_17
0
25
50
75
100
21-O
ct-1
0 0 6 12 18
22-O
ct-1
0 0 6 12 18
23-O
ct-1
0 0 6 12 18
24-O
ct-1
0 0 6 12 18
25-O
ct-1
0 0 6 12 18
26-O
ct-1
0 0 6 12 18
27-O
ct-1
0 0 6 12 18
Cache Size is Sufficient
%
No issues detected on other servers
Miss Rate on Database BufferPoolon server server_24
0
5
10
15
20
25
21-O
ct-1
0 0 6 12 18
22-O
ct-1
0 0 6 12 18
23-O
ct-1
0 0 6 12 18
24-O
ct-1
0 0 6 12 18
25-O
ct-1
0 0 6 12 18
26-O
ct-1
0 0 6 12 18
27-O
ct-1
0 0 6 12 18
Longer periods of High Miss Rate may indicate Performance Constraint
%5 other server(s) may have similar issues
Database File IO in KBytes per SecondRead activity on server server_16
0
500
1,000
1,500
2,000
2,500
3,000
3,500
21-O
ct-1
0 0 6 12 18
22-O
ct-1
0 0 6 12 18
23-O
ct-1
0 0 6 12 18
24-O
ct-1
0 0 6 12 18
25-O
ct-1
0 0 6 12 18
26-O
ct-1
0 0 6 12 18
27-O
ct-1
0 0 6 12 18
Showing busiest server
Database File IO in KBytes per SecondWrite activity on server server_26
0
100
200
300
400
500
600
700
800
900
1,000
21-O
ct-1
0 0 6 12 18
22-O
ct-1
0 0 6 12 18
23-O
ct-1
0 0 6 12 18
24-O
ct-1
0 0 6 12 18
25-O
ct-1
0 0 6 12 18
26-O
ct-1
0 0 6 12 18
27-O
ct-1
0 0 6 12 18
Showing busiest server
Full Text Index UtilizationSearch activity on server server_17
0:00:00
0:00:04
0:00:09
0:00:13
0:00:17
0:00:2221
-Oct
-10
0 6 12 18
22-O
ct-1
0 0 6 12 18
23-O
ct-1
0 0 6 12 18
24-O
ct-1
0 0 6 12 18
25-O
ct-1
0 0 6 12 18
26-O
ct-1
0 0 6 12 18
27-O
ct-1
0 0 6 12 18
Hour
s:M
inut
Showing busiest server
Mail Delivery Rates Categorized by Msg Size
0
5,000
10,000
15,000
20,000
25,000
30,00021
-Oct
-10
0 6 12 18
22-O
ct-1
0 0 6 12 18
23-O
ct-1
0 0 6 12 18
24-O
ct-1
0 0 6 12 18
25-O
ct-1
0 0 6 12 18
26-O
ct-1
0 0 6 12 18
27-O
ct-1
0 0 6 12 18
under_1kb 1kb_to_10kb 10kb_to_100kb 100kb_to_1mb 1mb_to_10mb 10mb_to_100mb over_100mb
Msgs per Hour, Showing all servers
Mail Transfer Rates Categorized by Msg Size
0
1,000
2,000
3,000
4,000
5,000
6,000
7,000
21-O
ct-1
0 0 6 12 18
22-O
ct-1
0 0 6 12 18
23-O
ct-1
0 0 6 12 18
24-O
ct-1
0 0 6 12 18
25-O
ct-1
0 0 6 12 18
26-O
ct-1
0 0 6 12 18
27-O
ct-1
0 0 6 12 18
under_1kb 1kb_to_10kb 10kb_to_100kb 100kb_to_1mb 1mb_to_10mb 10mb_to_100mb over_100mb
Msgs per Hour, Showing all servers
DNA for Root Cause & Performance:
• Service Offering • Assist Customers with Root Cause Analysis
» Application & Server Performance » Server Stability and Complex Support Topics » Network Latency Impact
• Data Collection -> Analysis -> Reporting • Executed Remotely by panagenda/Trust Factory
• Prerequisite • DNA Health Check Performed
No Installation
No Dependancy
No Footprint
ZERO Impact means:
Nothing to Install
Leave No Footprint
Deliver in a Few Days
Zero Impact means:
No Installation
No Dependancy
No Footprint
ZERO Impact means:
Nothing to Install
Leaves No Footprint
Deliver in a Few Days
Zero Impact:
What Results will it Provide?
• Root Cause Analysis Report: • Server & OS Configuration and Settings • Application Performance • Impact of Network Delay on Applications
• Interactive Slide Deck
• Linked to Common Spreadsheets & Check Lists • Recommendations
• Presented Live
• Along with Explanation & Interpretation of Analysis Results by Subject Matter Expert
What can you do with the results?
• Application Owners: • Improve User Satisfaction
• Developers:
• Improve Source Code of Applications
• Adminstrators:
• Improve Server Performance
DNA Server Consolidation:
• Service Offering • Multi Dimensional Insight into Network Demand,
Consolidation Potential & Data Center Scenarios • Detailed Roadmap to Plan & Execute Server Consolidations • Data Collection -> Analysis -> Reporting • Executed Remotely by BP Trust Factory
• Prerequisite
• DNA Health Check Performed
No Installation
No Dependancy
No Footprint
ZERO Impact means:
Nothing to Install
Leave No Footprint
Deliver in a Few Days
Zero Impact means:
No Installation
No Dependancy
No Footprint
ZERO Impact means:
Nothing to Install
Leaves No Footprint
Deliver in a Few Days
Zero Impact:
What Results will it Provide?
• Calculates Network Bandwidth Requirements • Consolidation Potential & Placement Scenarios • System & User Traffic Reduction & Optimization • Sizing Parameters for Servers, Storage & Network • Data Points for Cloud / Lotus Live
• Interactive Slide Deck
• Linked to Common Spreadsheets & Check Lists • Recommendations
• Presented Live
• Along with Explanation & Interpretation of Analysis Results by Subject Matter Expert
What can you do with the results?
• IT Director / CIO: • Executive Decision-Making Support • Validation of Business Cases & Vendor Proposals • Effective Realization of Cost Reduction
• Project Manager & Teams: • Input for Business Case & Project Proposal • DNA Facts & Findings Help Focus & Prioritize • Define Service Levels • Use Sizing Parameters for RFP’s
DNA Source Code Analysis:
• Service Offering • Multi Dimensional Insight into Entire Application Landscape
» All Design Elements » Source Code
• Real Impact of Application Landscape on Platform Migration » Factual Quantification of Migration Effort for Redevelopment » Identify Applications that Depend on Notes Mail
• Data Collection -> Analysis -> Reporting • Executed Remotely by Trust Factory
• Prerequisite • DNA Health Check Performed
No Installation
No Dependancy
No Footprint
ZERO Impact means:
Nothing to Install
Leave No Footprint
Deliver in a Few Days
Zero Impact means:
No Installation
No Dependancy
No Footprint
ZERO Impact means:
Nothing to Install
Leaves No Footprint
Deliver in a Few Days
Zero Impact:
What Results will it Provide? • Complete Inventory of De-Duplicated Design & Source Code • List of Applications that will Break after Migrating Notes Mail away
from Domino • True Migration Effort based on Cocomo II
• Interactive Slide Deck
• Linked to Common Spreadsheets & Check Lists • Recommendations
• Presented Live • Along with Explanation & Interpretation of Analysis Results by Subject Matter
Expert
What can you do with the results?
• IT Director / CIO: • Executive Decision-Making Support • Validation of Business Cases & Vendor Proposals • Develop Innovation Strategy
• Project Manager & Teams: • Input for Business Case & Project Proposal • Remediate Apps & Code Interacting with Notes Mail • DNA Facts & Findings Help Focus & Prioritize • Consolidate Source Code
Upcoming: panagenda iDNA
The In-house Version of Trust Factory‘s DNA Service
http://www.panagenda.com/en_uk/idna
Instant and Ongoing Analytics for Servers, Clients, Apps & More
• Unique Insights and Instant Value • Executive Decision-Making Support • Validation of Business Cases & Vendor Proposals • Develop Innovation Strategy
• Turn Data into Knowledge • Hassle-free data collection from many different data sources • Instantly turns your data into meaningful reports • Move from reactive to proactive operations • Helps to fix, foresee and prevent problems with root cause
identification • Gain answers to questions you never knew you could ask
Instant and Ongoing Analytics for Servers, Clients, Apps & More
• Facts and Architecture • Up and running in half an hour - turnkey virtual softwareappliance
(Linux/VMWare) • Non-intrusive, agent-less software - no installations required on
analyzed systems • Data ware house access possible for data use with existing
reporting solutions • HTML5 and PDF export for offline reports
Thank you!!!
How to Engage • Master Agreement is in Place with IBM since 2003:
• Global Master Agreement Number: 4902NL0239 • Trust Factory Supplier Number: 1000216663
• panagenda:
• Schreyvogelgasse 3/10 :: 1010 Vienna :: Austria • Web: http://www.panagenda.com • Email: [email protected] • Fax: +43 1 89 012 89 – 15
• Our business partners in Italy: