biztalk business activity monitoring real world bam
DESCRIPTION
BizTalk Business Activity Monitoring is probably the most powerful feature in the BizTalk solution stack and it is also the least utilized. In concept BAM offers us the ability to offer visibility, audit, tracking, and alerts all without changing our solutions or writing custom code. The reality is BAM has a learning curve that requires both understanding the implementation details and rethinking your approach to integration solutions to focus on business process / flow rather than technical integration. This session will walk through an advanced real world BAM implementation in the EDI space (purchase order, invoice, ship notice) focusing on a diverse but related series of steps in a long running business process to create a true business level view of several disparate integrations. Features covered will include creating tracking activities and views, progress and dimensions, continuations etc BizTalk Bam Step by Step is Explained. BizTalk Summit 2014, London March 03-04 Brought to you by BizTalk360TRANSCRIPT
![Page 1: BizTalk Business Activity Monitoring Real World BAM](https://reader033.vdocuments.us/reader033/viewer/2022061209/548caf5db4795936648b4726/html5/thumbnails/1.jpg)
REAL WORLD BAM@DanRosanovaWest Monroe Partners
BIZTALK SUMMIT 2014, LONDON
MARCH 03-04sessions. discussions. networking and
more
brought to you by
![Page 2: BizTalk Business Activity Monitoring Real World BAM](https://reader033.vdocuments.us/reader033/viewer/2022061209/548caf5db4795936648b4726/html5/thumbnails/2.jpg)
WE DON’T ALWAYS KNOW WHAT WE DON’T KNOW
![Page 3: BizTalk Business Activity Monitoring Real World BAM](https://reader033.vdocuments.us/reader033/viewer/2022061209/548caf5db4795936648b4726/html5/thumbnails/3.jpg)
![Page 4: BizTalk Business Activity Monitoring Real World BAM](https://reader033.vdocuments.us/reader033/viewer/2022061209/548caf5db4795936648b4726/html5/thumbnails/4.jpg)
WHAT IS WRONG WITH BIZTALK SOLUTIONS?▪ Lack of visibility
▪ People only care about what they can see
▪ Are business people “impressed” by Integration?
▪ They love apps and websites!
![Page 5: BizTalk Business Activity Monitoring Real World BAM](https://reader033.vdocuments.us/reader033/viewer/2022061209/548caf5db4795936648b4726/html5/thumbnails/5.jpg)
OUR BRAINS ARE VISUAL PROCESSORS
% Recognition
0 10 20 30 40 50 60 70 80 90
42
85
Recognition of concept
Picture Text
![Page 6: BizTalk Business Activity Monitoring Real World BAM](https://reader033.vdocuments.us/reader033/viewer/2022061209/548caf5db4795936648b4726/html5/thumbnails/6.jpg)
BAM IS THE VIEW YOUR USERS NEED…SO WHAT IS BAM?▪ BAM is tracking
▪ BAM is aggregation and analytics (BUZZWORD)
▪ BAM is dynamic alerting
▪ BAM is scalable infrastructure
▪ BAM is code free – if you do it right
▪ BAM is a self service portal
![Page 7: BizTalk Business Activity Monitoring Real World BAM](https://reader033.vdocuments.us/reader033/viewer/2022061209/548caf5db4795936648b4726/html5/thumbnails/7.jpg)
HOW IS BAM DIFFERENT?▪ What we want to see != What our users want to see
▪ Developers & Administrators want to see:▪ Suspended messages
▪ Errors
▪ Health
▪ Message Box throughput / latency
▪ We already have the perfect tool for this:
![Page 8: BizTalk Business Activity Monitoring Real World BAM](https://reader033.vdocuments.us/reader033/viewer/2022061209/548caf5db4795936648b4726/html5/thumbnails/8.jpg)
WHAT DO USERS REALLY WANT TO SEE?▪ How many orders have I
▪ Received
▪ Invoiced
▪ Shipped
▪ What is the total value of orders this week / month / year?
▪ How long is it taking us to fulfill orders?
▪ Where in the process are _____’s orders and what can I tell them when they call and yell at me?
▪ How can I make my business more lean and profitable?
![Page 9: BizTalk Business Activity Monitoring Real World BAM](https://reader033.vdocuments.us/reader033/viewer/2022061209/548caf5db4795936648b4726/html5/thumbnails/9.jpg)
WE ARE IN THE BUSINESS OF TECHNOLOGY
OUR USERS ARE IN THE BUSINESS OF BUSINESS
![Page 10: BizTalk Business Activity Monitoring Real World BAM](https://reader033.vdocuments.us/reader033/viewer/2022061209/548caf5db4795936648b4726/html5/thumbnails/10.jpg)
TYPICAL ORDER PROCESSING FLOW
Customer ERP2 - Invoice
3 - Ship Notice
1 - Purchase Order
![Page 11: BizTalk Business Activity Monitoring Real World BAM](https://reader033.vdocuments.us/reader033/viewer/2022061209/548caf5db4795936648b4726/html5/thumbnails/11.jpg)
THAT WHICH CANNOT BE MEASURED CANNOT BE MANAGED
W. EDWARDS DEMING
![Page 12: BizTalk Business Activity Monitoring Real World BAM](https://reader033.vdocuments.us/reader033/viewer/2022061209/548caf5db4795936648b4726/html5/thumbnails/12.jpg)
EXAMINING THE SOLUTION
Web Receive 1Purchase Order
Web Receive 2ERP Invoice,
ASN
Web Send 1ERP PO
File Send 1Invoice
File Send 2ASN
Customers
![Page 13: BizTalk Business Activity Monitoring Real World BAM](https://reader033.vdocuments.us/reader033/viewer/2022061209/548caf5db4795936648b4726/html5/thumbnails/13.jpg)
MAKING BAM IN 3 STEPS▪ Create Activity in Excel
▪ Create View in Excel
▪ Binding to solution in TPE
2View
1Activity
3Tracking Profile
![Page 14: BizTalk Business Activity Monitoring Real World BAM](https://reader033.vdocuments.us/reader033/viewer/2022061209/548caf5db4795936648b4726/html5/thumbnails/14.jpg)
WHAT DATA WE WANT TO SEE▪ Business Data
▪ Order Total
▪ Buyer Postal Code
▪ PO Reference
▪ Invoice #
▪ Shipping #
▪ Milestones▪ Order Received
▪ Sent to ERP
▪ Invoice Generated
▪ Invoice Delivered
▪ Ship Notice Generated
▪ Ship Notice Delivered
![Page 15: BizTalk Business Activity Monitoring Real World BAM](https://reader033.vdocuments.us/reader033/viewer/2022061209/548caf5db4795936648b4726/html5/thumbnails/15.jpg)
CREATING
ACTIVITIES
![Page 16: BizTalk Business Activity Monitoring Real World BAM](https://reader033.vdocuments.us/reader033/viewer/2022061209/548caf5db4795936648b4726/html5/thumbnails/16.jpg)
WHAT DO WE WANT IN OUR VIEW?▪ What is the Status of an order?
▪ How long does an order take?
▪ How long does it take to invoice?
▪ What is my order count?
▪ What is my max / min fulfillment time?
![Page 17: BizTalk Business Activity Monitoring Real World BAM](https://reader033.vdocuments.us/reader033/viewer/2022061209/548caf5db4795936648b4726/html5/thumbnails/17.jpg)
CREATING
VIEWS
![Page 18: BizTalk Business Activity Monitoring Real World BAM](https://reader033.vdocuments.us/reader033/viewer/2022061209/548caf5db4795936648b4726/html5/thumbnails/18.jpg)
CREATING
VIEWS
![Page 19: BizTalk Business Activity Monitoring Real World BAM](https://reader033.vdocuments.us/reader033/viewer/2022061209/548caf5db4795936648b4726/html5/thumbnails/19.jpg)
CREATING
VIEWS
![Page 20: BizTalk Business Activity Monitoring Real World BAM](https://reader033.vdocuments.us/reader033/viewer/2022061209/548caf5db4795936648b4726/html5/thumbnails/20.jpg)
DEPLOYING THE TRACKING PROFILE▪ bm.exe - located in [BizTalk Install]\Tracking
▪ Do yourself a favor, add this to your path or use BAM GUI
▪ bm deploy-all –defininitionFile:SingleActTracking.xlsx
![Page 21: BizTalk Business Activity Monitoring Real World BAM](https://reader033.vdocuments.us/reader033/viewer/2022061209/548caf5db4795936648b4726/html5/thumbnails/21.jpg)
BINDING TO OUR SOLUTION – 2 WAYS
TPE API
![Page 22: BizTalk Business Activity Monitoring Real World BAM](https://reader033.vdocuments.us/reader033/viewer/2022061209/548caf5db4795936648b4726/html5/thumbnails/22.jpg)
ALWAYS USE THE TPE▪ The TPE binds to multiple points:
▪ Orchestration
▪ Message Content
▪ Message Context
▪ Messaging Properties
▪ TPE is the sandbox / safe room
▪ TPE can bind to many sources and ports concurrently
▪ TPE allows adding / changing BAM without solution changes*
![Page 23: BizTalk Business Activity Monitoring Real World BAM](https://reader033.vdocuments.us/reader033/viewer/2022061209/548caf5db4795936648b4726/html5/thumbnails/23.jpg)
BIND
ING
THE ACTIVITY
![Page 24: BizTalk Business Activity Monitoring Real World BAM](https://reader033.vdocuments.us/reader033/viewer/2022061209/548caf5db4795936648b4726/html5/thumbnails/24.jpg)
CON
TINU
ATION
S
![Page 25: BizTalk Business Activity Monitoring Real World BAM](https://reader033.vdocuments.us/reader033/viewer/2022061209/548caf5db4795936648b4726/html5/thumbnails/25.jpg)
DEPLOYING THE TRACKING PROFILE▪ bttdeploy [Name of .btt file]
![Page 26: BizTalk Business Activity Monitoring Real World BAM](https://reader033.vdocuments.us/reader033/viewer/2022061209/548caf5db4795936648b4726/html5/thumbnails/26.jpg)
RUNNING THE MOCKS – 3 EASY STEPS1. [Solution Root]\ERPMock\bin\debug\ERPMock.exe
2. [Solution Root]\LoadMock\bin\debug\LoadMock.exe
3. Look at the BAM Portal
4. Look at the aggregations
5. From Developer Command Prompt:dtexec /sql BAM_AN_SingleOrderView
6. Look at the aggregations again
![Page 27: BizTalk Business Activity Monitoring Real World BAM](https://reader033.vdocuments.us/reader033/viewer/2022061209/548caf5db4795936648b4726/html5/thumbnails/27.jpg)
INSPECTIN
G TH
E RESULTS
![Page 28: BizTalk Business Activity Monitoring Real World BAM](https://reader033.vdocuments.us/reader033/viewer/2022061209/548caf5db4795936648b4726/html5/thumbnails/28.jpg)
CREATING
ALERTS
![Page 29: BizTalk Business Activity Monitoring Real World BAM](https://reader033.vdocuments.us/reader033/viewer/2022061209/548caf5db4795936648b4726/html5/thumbnails/29.jpg)
MESSIN
G W
ITH TO
RD
![Page 30: BizTalk Business Activity Monitoring Real World BAM](https://reader033.vdocuments.us/reader033/viewer/2022061209/548caf5db4795936648b4726/html5/thumbnails/30.jpg)
HOW DOES THIS MAGIC WORK?
![Page 31: BizTalk Business Activity Monitoring Real World BAM](https://reader033.vdocuments.us/reader033/viewer/2022061209/548caf5db4795936648b4726/html5/thumbnails/31.jpg)
BAM INFRASTRUCTURE▪ Databases
▪ Tables / Views
▪ SSIS
▪ TDDS (BAM Event Bus Service)
MessageBox BAMPrimaryImport BAMArchive
BAMStarSchema
BAMAnalysis
TDDS
SSIS
![Page 32: BizTalk Business Activity Monitoring Real World BAM](https://reader033.vdocuments.us/reader033/viewer/2022061209/548caf5db4795936648b4726/html5/thumbnails/32.jpg)
BAM TABLES & VIEWS▪ BAM Creates Tables
NEVER USE THEM
▪ BAM Create Views
![Page 33: BizTalk Business Activity Monitoring Real World BAM](https://reader033.vdocuments.us/reader033/viewer/2022061209/548caf5db4795936648b4726/html5/thumbnails/33.jpg)
BAM SSIS PACKAGES▪ BAM_DM_[ViewName]
▪ Data Management / archiving
▪ BAM_AN_[ViewName]▪ Processes the cube
![Page 34: BizTalk Business Activity Monitoring Real World BAM](https://reader033.vdocuments.us/reader033/viewer/2022061209/548caf5db4795936648b4726/html5/thumbnails/34.jpg)
BAM DATA MAINTENANCE▪ Every time this job runs it partitions tables
▪ Think about when you want it to run
▪ Normally monthly
▪ Partitions age based on BizTalk settings▪ The entire completed partition archives
▪ 6 month default time
▪ bm get-activitywindow –Activity:SingleOrderView
Table
Table
Table_GUID
Table_GUID
ViewUNION
![Page 35: BizTalk Business Activity Monitoring Real World BAM](https://reader033.vdocuments.us/reader033/viewer/2022061209/548caf5db4795936648b4726/html5/thumbnails/35.jpg)
BAM PRIMARY IMPORT CHANGES
USE [BAMPrimaryImport]GO
/****** Object: View [dbo].[bam_SingleOrderView_CompletedInstances] Script Date: 3/3/2014 4:10:18 AM ******/SET ANSI_NULLS ONGO
SET QUOTED_IDENTIFIER ONGO
CREATE VIEW [dbo].[bam_SingleOrderView_CompletedInstances] AS SELECT * FROM dbo.[bam_SingleOrderView_Completed] WITH (NOLOCK) UNION ALL SELECT * FROM [dbo].[bam_SingleOrderView_C52EE3A6_6C6E_4E47_AF7F_214B9D454BC7] WITH (NOLOCK)GO
![Page 36: BizTalk Business Activity Monitoring Real World BAM](https://reader033.vdocuments.us/reader033/viewer/2022061209/548caf5db4795936648b4726/html5/thumbnails/36.jpg)
TDDS - BAM EVENT BUS SERVICE
You really don’t want to know!No, reallyIF you really feel the need check out the tables that start with “Tracking” in the BizTalkMsgBoxDb
And the “TDDS_” tables in BAMPrimaryImport
You have been warned!
![Page 37: BizTalk Business Activity Monitoring Real World BAM](https://reader033.vdocuments.us/reader033/viewer/2022061209/548caf5db4795936648b4726/html5/thumbnails/37.jpg)
CONCLUSION▪ Always create BAM for your solutions
▪ Create views for each set of users (operations, sales, management)
▪ Create / Schedule BAM jobs (AN / DM)
▪ Teach your users to use BAM effectively
▪ Use BAM views from a custom portal / tool – like Excel
▪ Change the CSS for the portal to not look so 2004
![Page 38: BizTalk Business Activity Monitoring Real World BAM](https://reader033.vdocuments.us/reader033/viewer/2022061209/548caf5db4795936648b4726/html5/thumbnails/38.jpg)
QUESTIONS
?
![Page 39: BizTalk Business Activity Monitoring Real World BAM](https://reader033.vdocuments.us/reader033/viewer/2022061209/548caf5db4795936648b4726/html5/thumbnails/39.jpg)
TO IMPRESS THE BOSSONE LAST THING…
![Page 40: BizTalk Business Activity Monitoring Real World BAM](https://reader033.vdocuments.us/reader033/viewer/2022061209/548caf5db4795936648b4726/html5/thumbnails/40.jpg)
REAL WORLD BAM@DanRosanova
Senior Architect
West Monroe Partners
http://danrosanova.wordpress.com/rwb