monitoring vmware vfabric with hyperic and spring insight

© C2B2 Consulting Limited 2012All Rights Reserved

Monitoring VMware vFabric with Hyperic and Spring Insight

Steve Millidge


vFabric tcServer


Why vFabric tcServer?

• Pre-configured Templates• Many instances from a single binary install• High Performance JDBC connection pool• Improved Diagnostics• JMX management enabled by default• Unix & Windows Service Scripts• Server Management Tools• Latest security patches as binaries• Integration with vFabric components


Features over Tomcat• Templates• Single Binary Install• High Performance JDBC Connection Pool• Clustering• Diagnostics• Elastic Memory for Java• Management


Diagnostics• Templates• Single Binary Install• High Performance JDBC Connection Pool• Clustering• Diagnostics• Elastic Memory for Java• Management


Diagnostics Template

./tcruntime-instance.sh create <instance> -t diagnostics


SlowQueryReportJmx

• Reports on SLOW and FAILED Queries• Subscribe for JMX Notifications


ThreadDiagnosticsValve

$CATALINA_BASE/logs/catalina.YYYY-MM-DD.log


+ Extended Logging


JMX Notifications

• Reports on “slow”, “stuck” and “failed” requests• Subscribe for JMX notifications or view log files


EM4J• Templates• Single Binary Install• High Performance JDBC Connection Pool• Clustering• Diagnostics• Elastic Memory for Java• Management


Traditional Best Practice for Virtualised JVM’s

• Reserve 100% of the required VM memory• Tune JVM Heap to occupy minimum• Avoid GC Thrashing “Both ballooning and swapping should be

prevented for Java application”

• No benefit from Virtualisation memory sharing• All resources must be provisioned upfront


ESXi 5.0 Memory Reclamation

• Transparent Page Sharing• Memory Compression• VMware Tools Balloon OR EM4J Balloon• Swap


EM4J Balloon Driver

Guest OS

JVM Heap JVM Heap

Guest OS

JVM Heap JVM Heap

Hypervisor

...


Elastic Memory for Java EM4J

• Requires ESXi 5.0• Redhat / Centos v5 (x32 or x64)• Hotspot JDK 1.6• Heap > 512Mb• Recommend no more than 4 JVMs per VM• JVMs should account for the majority of the

VM memory usage


Switch EM4J On

• Enable EM4J in the VM– sched.mem.pshare.guestHintsSyncEnable=true– sched.mem.maxmemctl=-1 (max balloon size)

• Create EM4J instance– ./tcruntime-instance.sh create instanceName -t elastic-

memory


Troubleshooting your App

• How many database calls does that page generate?• What was the SQL executed?• How long did the query take?• Why does this page take a long time to load?• Which part was slow?• What happened then?!


Spring Insight to the Rescue

What does it provide?• Information on all database queries • Information on all web request and response information• Lists component calls and parameters

Where can I use it?• Agile Development• QA• Load Testing• Production Monitoring


Under the Covers

How does it work?• Agent instruments application code using AspectJ• Reports to “dashboard” (insight.war) component

responsible for rendering statistics

Increased Memory Requirements• Increased memory –Xmx• Increased permgen –XX:MaxPermSize


Applications Summary


Application View


End Point View


Response Time Histogram


Request & Response Summary


JDBC Query


Recent Activity


vFabric Hyperic Integration

More later!


vFabric Hyperic


Overview

• Monitoring & Management Solution• Out-of-box monitors over 75 technologies• Automatic discovery of resources• Metric Collection• Event Tracking• Resource Control• Alerting & Notifications• Access to Live Information


Architecture


Resource Hierarchy

• Platform – Win2008, linux etc

• Platform Services– CPU– File System Mount– Network Interfaces

• Server– tcServer instance– RabbitMQ Server

• Service– tcServer Session Manager– RabbitMQ Queue


Hyperic User Interface


Resource View


Resource Alerts

• Metric Alerting• Event Alerting

– Log file tracking– Config file tracking


tcServer Application Management


vSphere Monitoring

• Server side HQU Extension• Remote agent accesses vSphere vCenter


vCenter Resource Hierarchy

Agent installed on VM• Platform

– Win2008, linux etc

• Platform Services– CPU– File System Mount– Network Interfaces

• Server– tcServer instance– RabbitMQ Server

• Service– tcServer Session Manager– RabbitMQ Queue

Agent monitoring vCenter• vCenter – Software• ESX Host – Platform• VM – PlatformFeatures• Auto disovery of ESX

Hosts and VM’s• Auto detection of new

ESX Hosts and VM’s• Auto detection of

architecture changes e.g. vMotion


ESX Host & VM Metics


Quest

monitoring vmware vfabric with hyperic and spring insight

Documents

instance

mem

slow

tcruntime

linux