System Management & onTune

January, 2014

© Copyright TeemStone Corporation 2013

System Administrator’s Roles

• Analyzing system logs and identifying potential issues with computer systems.

• Introducing and integrating new technologies into existing data center environments.

• Performing routine audits of systems and software.

• Performing backups.

• Applying operating system updates, patches, and configuration changes.

• Installing and configuring new hardware and software.

• Adding, removing, or updating user account information, resetting passwords, etc.

• Answering technical queries and assisting users.

• Responsibility for security.

• Responsibility for documenting the configuration of the system.

• Troubleshooting any reported problems.

• System performance tuning.

• Ensuring that the network infrastructure is up and running.

• Configure, add, delete file systems, knowledge of volume management tools such as Veritas, ZFS, LVM.

source : Wikipedia.org

2

System Performance & MonitoringThe overall system performance is dependent upon the component which shows worst performance. So that system tuning based on real performance and/or resource utilization data is very important to improve system performance. The performance of system is affected by various factors.

• Basic system hardware resources• CPU, Memory, Disk, and Network Performance

• Software Resources• Database Engine

• Application Framework

• Applications

• File systems

• Others

• Configuration• Hardware Partitioning, Virtualization

• Load balancing• Nodes

• Disks

• Networks

• Others

• Application configuration

• OS configuration

• Etc.

3

One morning of George

• George was in trouble. A seemingly simple deployment was taking all morning, and there seemed no end in sight. His manager kept coming in to check on his progress, as the customer was anxious to have the deployment done. He was supposed to be leaving for a goodbye lunch for a departing co-worker, adding to the stress. He had called in all kinds of help, including colleagues, an application architect, technical support, and even one of the system developers. He used email, instant messaging, face-to-face contacts, his phone, and even his office mate's phone to communicate with everyone. And George was no novice. He had been working as a Web-hosting administrator for three years, and he had a bachelor's degree in computer science. But it seemed that all the expertise being brought to bear was simply not enough. Why was George in trouble?

• George is a system administrator, one of the people who work behind the scenes to configure, operate, maintain, and trouble-shoot the computer infrastructure that supports much of modern life. Their work is critical and expensive. The human part of total system cost-of-ownership has been growing for decades, now dominating the costs of hardware or software.

Source : By Eben M. Haber, EserKandogan, Paul P. MaglioCommunications of the ACM, Vol. 54 No. 1

The hand of system administrator : System administrators solve issues, getting requests from various route.

4

System administration as usual

System administrators are responsible for well running and maintaining of system services.

• Daily system operation inspection• System resources utilization (CPU, Memory, Disk

I/O, Network I/O)

• Tracing system logs

• Monitoring wasted resource (i.e. Memory leak)

• Tracing unexpected process behavior

• User account management

• Support to develop application programs

(Super-user support, test, execution)

• Applying and integrating new H/W, S/W

• Routine works• Applying system updates, applying patches

• System backups

• Urgent works• Urgent patches

• System configuration changes

• Trouble shooting

• OthersImage source : sachachua.com

5

Activities for troubleshooting system failure

When the system performance is getting down and/or system failure occurs, system administrators try to

solve the problem as soon as possible, and these activities consumes time and human resources.

• Holding an urgent meeting with people related with issue

• System Administrators

• Database Administrators

• Network Administrators

• Hardware Vendor Engineers

• Software Vendor Engineers

• Application Developers

• Ordinary situation till any action taken• Arguing no responsibility on themselves. (If it is hard to

find evidence, few people confess responsibility.)

• Lack of system logs when the issue occurred

• Lack of system performance data

• Long time for taking action

• Following issues• Resources wasted

• Customer complaints for delayed service

6

The wasted money when system issue occurred

When system failure occurs, you have to pay money for recovering.

• One time system failure expense (A pay per a month - $9,000 for Advanced technician)

• 2 weeks for system administrator : $6,000

• Database/Application/Software administrator(each 1 week) : $9,000

• Outsourcing support expense : 3 companies for a week : $9,000

• $24,000 paid in total

• If 6 unexpected system failure occurs per a year, $144,000 is paid for labor expense

• Invisible cost

• Customer dissatisfaction

• Customer call response cost

• Adverse effect on the company reputation

• By reducing system recovery time by 1/3, you can save $100,000 a year. (Customer satisfaction will be improved.)

7

No difference between general System Management Solution and Expert System Performance Analysis solution?Expert System Performance Analysis solution can be a substitute for general System Management Solution, but vice versa can not be. Expert System Performance Solution should provide analysis functions at the time of system failure as well as real-time system monitoring features.

• Common requirements for General tools and Expert tools

• Collecting performance data regularly (every 5min ~ 10min)

• Tracing system logs

• Tracing system events

• Reporting features

• Collecting and analysis for system resource utilization

• Monitoring critical processes

• Distinct requirements for Expert tools (Including System Failure Analysis)

• Collecting very short interval performance data (by second unit)

• Monitoring every single process without certain configuration

• Tracing by user, process, group

• System performance comparison, analysis and tracing for certain period (at the time of system failure.)

• User defined script execution and tracing the outcomes

• Tracing system configuration changes

System failure usually occurs under unexpected conditions.

For instance, database engine process is the most criticalone in database server. Generally, system administratorsconfigure database engine processes should be monitoredin advance. However, if an unexpected process, which innot defined to be monitored in advance, causes databaseserver system failure, the monitoring configurationmentioned above is useless.

In fact, it is impossible for system administrators to defineall the impact factors, which may cause the problem of aserver, whether database servers or application servers orothers, to be monitored in advance.

For this reason, general system management solution cannot trace the root cause of the problem when systemfailure occurred.

onTune, a leading edge Expert System PerformanceAnalysis solution does not need to set extra configuration.Once it installed, all the system environments includingresources, processes, configurations, and others to bemonitored automatically.

8

10 Usability Heuristics for User Interface Designby Jakob Nielsen

The 10 most general principles for interaction design. They are called "heuristics" because they are more in the

nature of rules of thumb than specific usability guidelines. onTune is the product satisfying these principles.

• Visibility of system status : With simple and easy navigation, system performance data of past time and real-time is provided.

• Match between system and the real world : Collecting all data for whatever operating system and showing it in simple words.

• User control and freedom : Simple to exit from a window and take control.

• Consistency and standards : Standardizing various performance data by operating systems, andproviding the data in a single language

• Error prevention : Eliminating error-prone conditions.

• Recognition rather than recall : Easy to understand icons and menus for navigation.

• Flexibility and efficiency of use : Direct access menus, right mouse button menus makes it easyto get information.

• Aesthetic and minimalist design: Simple menu, intuitive icons, easy navigation for beginners

• Help users recognize, diagnose, and recover from errors: Simple messages for user notification

• Help and documentation: Comprehensive documents for installation and how to use.

Image source : realworldusability.tmblr.com. Office.com9

System Analysis & Performance Instrument onTune SPI

onTune is the expert system performance analysis tool, excellent for tracing root cause of problem and/or

system failure. Obviously, it provides functions as general system management solution as well.

onTune is

Brand new leading edge solution

Differentiated from existing solutions, it shows totally new form.

SPI

New solution practically helpful to system administrators.

- Discovery for new area

- SPI : System Analysis & Performance Instrument

onTune Users

Before : Even though they paid big money to build system management solutions, it provided only restrict features.

After : Secures accurate data which helps analyzing the system performance and problems, takes pro-active and proper actions, and spend their time for worthy things instead of wasting

In fact, 90% of customers have decided to use onTune after taking proof of concepts.

TeemStone

Considers engineers and administrators as fellows.

Composed with the astonishing members in the each field.

10

Application

onTune helps user saving problem solving time, improving efficiency of system operating, protecting from spending

much time to create reports.

시스템 성능관리 및 분석

구축내용에서 쓰고자 하는 내용

Virtualization System

Real time monitoring and analyzing on resource migration and usage under virtualization environments.

SMS 연동

긴 모니터링 주기로 인한 데이터의 왜곡으로 정확한 시스템성능관리를 할 수가 없었습니다.

시스템 성능에 영향을 미치는 각종 자원에 대한 모니터링을할 수 있는 솔루션이 없었습니다.

Report

Creating system performance reports in Excel and/or PowerPoint and/or others.

System performance management & Analysis

Forecasting, monitoring and analyzing on all aspects of system operating. System performance data may be collected in second.

Notification to users

Notifying to pre-defined users when certain system conditions happen in real-time with accurate information.

Using accurate real-time performance data, users can analyze every factor which may affect business.

Compared with existing general System Monitoring Solutions, onTune stands at the forefront.

11

Macro Scope• Through collecting and analyzing performance data, onTune monitors and detects the factors affecting business.

12

Micro ScopeThrough collecting and analyzing performance data, onTune monitors and detects the factors affecting business.

• Monitoring • 2 seconds monitoring interval – detailed analysis available

• Realtime search and analysis

• Realtime I/O traffic analysis

• Monitoring user processes in realtime

• Veritas Volume Manager support

• Performance monitoring• Detailed analysis data for performance and system failure

• Performance analysis of each resource in certain time period (bottleneck finding) – tracing changes by time.

• Process resource usage analysis – user, group, command

• Automated reporting tool – PowerPoint, Excel

• Automation• Installation – Centralized automation installation

• Monitoring objects defining – As soon as agent installed and connected to manager, it starts to collect data of all resources and processes.

• Group trace and monitoring

• Virtualized system monitoring

• Event monitoring & notification – When a pre-defined system condition is met, onTune alarms and notifies it to the users.

• Performance analysis report – PowerPoint & Excel

13

Others vs. onTune

Thank You

www.teemstone.co.kr+82 2-2057-7393

#1920, Daelim-Acrovill C. 467-6 Dogok-Dong, Gangnam-Gu, Seoul, Korea

TeemStone Corp.