biztalk business activity monitoring real world bam

REAL WORLD BAM@DanRosanovaWest Monroe Partners

BIZTALK SUMMIT 2014, LONDON

MARCH 03-04sessions. discussions. networking and

more

brought to you by

WE DON’T ALWAYS KNOW WHAT WE DON’T KNOW

WHAT IS WRONG WITH BIZTALK SOLUTIONS?▪ Lack of visibility

▪ People only care about what they can see

▪ Are business people “impressed” by Integration?

▪ They love apps and websites!

OUR BRAINS ARE VISUAL PROCESSORS

% Recognition

0 10 20 30 40 50 60 70 80 90

42

85

Recognition of concept

Picture Text

BAM IS THE VIEW YOUR USERS NEED…SO WHAT IS BAM?▪ BAM is tracking

▪ BAM is aggregation and analytics (BUZZWORD)

▪ BAM is dynamic alerting

▪ BAM is scalable infrastructure

▪ BAM is code free – if you do it right

▪ BAM is a self service portal

HOW IS BAM DIFFERENT?▪ What we want to see != What our users want to see

▪ Developers & Administrators want to see:▪ Suspended messages

▪ Errors

▪ Health

▪ Message Box throughput / latency

▪ We already have the perfect tool for this:

WHAT DO USERS REALLY WANT TO SEE?▪ How many orders have I

▪ Received

▪ Invoiced

▪ Shipped

▪ What is the total value of orders this week / month / year?

▪ How long is it taking us to fulfill orders?

▪ Where in the process are _____’s orders and what can I tell them when they call and yell at me?

▪ How can I make my business more lean and profitable?

WE ARE IN THE BUSINESS OF TECHNOLOGY

OUR USERS ARE IN THE BUSINESS OF BUSINESS

TYPICAL ORDER PROCESSING FLOW

Customer ERP2 - Invoice

3 - Ship Notice

1 - Purchase Order

THAT WHICH CANNOT BE MEASURED CANNOT BE MANAGED

W. EDWARDS DEMING

EXAMINING THE SOLUTION

Web Receive 1Purchase Order

Web Receive 2ERP Invoice,

ASN

Web Send 1ERP PO

File Send 1Invoice

File Send 2ASN

Customers

MAKING BAM IN 3 STEPS▪ Create Activity in Excel

▪ Create View in Excel

▪ Binding to solution in TPE

2View

1Activity

3Tracking Profile

WHAT DATA WE WANT TO SEE▪ Business Data

▪ Order Total

▪ Buyer Postal Code

▪ PO Reference

▪ Invoice #

▪ Shipping #

▪ Milestones▪ Order Received

▪ Sent to ERP

▪ Invoice Generated

▪ Invoice Delivered

▪ Ship Notice Generated

▪ Ship Notice Delivered

CREATING

ACTIVITIES

WHAT DO WE WANT IN OUR VIEW?▪ What is the Status of an order?

▪ How long does an order take?

▪ How long does it take to invoice?

▪ What is my order count?

▪ What is my max / min fulfillment time?

CREATING

VIEWS

CREATING

VIEWS

CREATING

VIEWS

DEPLOYING THE TRACKING PROFILE▪ bm.exe - located in [BizTalk Install]\Tracking

▪ Do yourself a favor, add this to your path or use BAM GUI

▪ bm deploy-all –defininitionFile:SingleActTracking.xlsx

BINDING TO OUR SOLUTION – 2 WAYS

TPE API

ALWAYS USE THE TPE▪ The TPE binds to multiple points:

▪ Orchestration

▪ Message Content

▪ Message Context

▪ Messaging Properties

▪ TPE is the sandbox / safe room

▪ TPE can bind to many sources and ports concurrently

▪ TPE allows adding / changing BAM without solution changes*

BIND

ING

THE ACTIVITY

CON

TINU

ATION

S

DEPLOYING THE TRACKING PROFILE▪ bttdeploy [Name of .btt file]

RUNNING THE MOCKS – 3 EASY STEPS1. [Solution Root]\ERPMock\bin\debug\ERPMock.exe

2. [Solution Root]\LoadMock\bin\debug\LoadMock.exe

3. Look at the BAM Portal

4. Look at the aggregations

5. From Developer Command Prompt:dtexec /sql BAM_AN_SingleOrderView

6. Look at the aggregations again

INSPECTIN

G TH

E RESULTS

CREATING

ALERTS

MESSIN

G W

ITH TO

RD

HOW DOES THIS MAGIC WORK?

BAM INFRASTRUCTURE▪ Databases

▪ Tables / Views

▪ SSIS

▪ TDDS (BAM Event Bus Service)

MessageBox BAMPrimaryImport BAMArchive

BAMStarSchema

BAMAnalysis

TDDS

SSIS

BAM TABLES & VIEWS▪ BAM Creates Tables

NEVER USE THEM

▪ BAM Create Views

BAM SSIS PACKAGES▪ BAM_DM_[ViewName]

▪ Data Management / archiving

▪ BAM_AN_[ViewName]▪ Processes the cube

BAM DATA MAINTENANCE▪ Every time this job runs it partitions tables

▪ Think about when you want it to run

▪ Normally monthly

▪ Partitions age based on BizTalk settings▪ The entire completed partition archives

▪ 6 month default time

▪ bm get-activitywindow –Activity:SingleOrderView

Table

Table

Table_GUID

Table_GUID

ViewUNION

BAM PRIMARY IMPORT CHANGES

USE [BAMPrimaryImport]GO

/****** Object: View [dbo].[bam_SingleOrderView_CompletedInstances] Script Date: 3/3/2014 4:10:18 AM ******/SET ANSI_NULLS ONGO

SET QUOTED_IDENTIFIER ONGO

CREATE VIEW [dbo].[bam_SingleOrderView_CompletedInstances] AS SELECT * FROM dbo.[bam_SingleOrderView_Completed] WITH (NOLOCK) UNION ALL SELECT * FROM [dbo].[bam_SingleOrderView_C52EE3A6_6C6E_4E47_AF7F_214B9D454BC7] WITH (NOLOCK)GO

TDDS - BAM EVENT BUS SERVICE

You really don’t want to know!No, reallyIF you really feel the need check out the tables that start with “Tracking” in the BizTalkMsgBoxDb

And the “TDDS_” tables in BAMPrimaryImport

You have been warned!

CONCLUSION▪ Always create BAM for your solutions

▪ Create views for each set of users (operations, sales, management)

▪ Create / Schedule BAM jobs (AN / DM)

▪ Teach your users to use BAM effectively

▪ Use BAM views from a custom portal / tool – like Excel

▪ Change the CSS for the portal to not look so 2004

QUESTIONS

?

TO IMPRESS THE BOSSONE LAST THING…

REAL WORLD BAM@DanRosanova

Senior Architect

West Monroe Partners

http://danrosanova.wordpress.com/rwb