automating your bi administration - microstrategy€¦ · 3. provide parameter file path 1. batch...

Automating Your BI Administration

Presented by: Vikas Bajpai | Product Manager

Date: Wednesday, 29th January, 2014

Session 7 This Session is Part of

MicroStrategy World

Track 2

Analytics: Business

Intelligence

Agenda

• The Need for Automating Administrative Processes

• What is MicroStrategy System Manager

• Creating a System Manager Workflow

• Demonstration

• System Manager – Success Stories

• How will System Manager Benefit Your Organization

• What’s New in System Manager 9.4.1

• Summary

EVER INCREASING ADMINISTRATIVE BURDEN

4

Bulk Manipulation of Objects

Upgrade Metadata Manage Security

Ensure Data Integrity

Manage Daily Operations

Troubleshoot System Errors

Modify Intelligence Server Settings

Monitor User Activity

Manage Scheduled Requests

Fine-tune BI System

Administrators of BI Systems Have To Accomplish Many Processes

Manually

5

Typical Time Spent*

(manual hours)

Server Maintenance 750

Change Migration 1600

Project & Metadata maintenance 500

Customization Deployments 200

Upgrades, Patches Application 100

3150

80 to 90% of Daily Administrative Tasks Can Be Automated

Saving Time and Effort

*Based on sample use cases

THE PROBLEM A Large Number of Tasks are Repetitive, Manual and Laborious and

hence, are Time Consuming

MICROSTRATEGY ADMINISTRATION TOOLS MicroStrategy Leads the Industry with Comprehensive Set of

Administration Tools

Source– Cindi Howson, BI Scorecard® Strategic and Product Summary

http://www.microstrategy.com/Strategy/media/downloads/about-us/microstrategy_bi-scorecard-summary-q4-2013.pdf

MicroStrategy System Manager Create Automated

Administrative Workflows

THE SOLUTION Latest Addition to Automate Repetitive Manual Tasks by closely

integrating with all existing Admin Tools

MicroStrategy

Enterprise Manager

Monitor Performance and

Utilization

MicroStrategy

Object Manager

Coordinate Change

Management

MicroStrategy

Command Manager

Automate MicroStrategy

Metadata Tasks

MicroStrategy

Integrity Manager

Automate Regression

Testing

Design workflows to automate multi-step, manual processes

Agenda




• Demonstration




• Summary

MicroStrategy System Manager is a process automation tool that enables BI

teams to convert a sequential, multi-step, multi-product, manually executed

process into manual or automated coded workflow

• Uses a drag-and-drop graphical user interface to code a manual process

into a workflow

• Executes a process workflow automatically at a scheduled time or on

demand, without any human involvement.

Immediate Benefits seen with System Manager include

• Reduces the IT Personnel effort spent on executing any process drastically

• Improves Process Efficiency by virtually eliminating human error and

reducing reliance on people

• Simplifies BI Application Management that otherwise would require

manual effort and human oversight.

MICROSTRATEGY SYSTEM MANAGER An Introduction

Intelligence Server Maintenance

1. Alert BI team members

2. Re-start Intelligence Server

3. Monitor the system

4. Notify BI team members

310

BI Object Change Migration

1. Download Update Packages

2. Login to Test system

3. Generate rollback packages

4. Apply changes to each project

5. Alert developers to errors

6. Notify BI Test teams

1,175

Daily Report Execution Schedule

1. Monitor ETL completion

2. Publish Cubes

3. Wait for Cubes to publish

4. Trigger Subscription Schedules

5. Notify BI teams

540

Automated Workflows Greatly Reduce IT Personnel Time and Eliminate

Manual Effort

MICROSTRATEGY SYSTEM MANAGER

Agenda




• Demonstration




• Summary

12

Step 1

Download

Update packages

via FTP

Step 2

Copy

image files into

folders

Step 5

Run Integrity

Manager tests

Step 6

Alert

to BI Team

(Run

FTP Client)

(Run

MicroStrategy

Object

Manager)

(Run

MicroStrategy

Integrity

Manager)

Step 3

Generate Roll

Back Package

(Run

File copy

operation)

Step 4

Migrate

Changes to

the Project

(Run

MicroStrategy

Command

Manager)

Test

Environment

MicroStrategy Integrity Manager

Compare SQL

Compare Data

Compare Graphs

Monitor Execution

Store Baseline Results

Compare Excel Output

Compare PDF Output

IMG

Test

Environment

(Run

Email Client)

EXAMPLE – BI CHANGE MIGRATION Without System Manager, Each Step in the Workflow Must be Run by

an Administrator Separately and Manually

13

With

FTP Client

PASS

With

MicroStrategy

Integrity

Manager

With

File copy

operation

With

MicroStrategy

Command

Manager

Send Alert

to

administrator

FAIL

Step 1 Download Update

Package Via

FTP

Step 2 Copy files

Into Folders

Step 5

Run Integrity

Manager tests

Step 6

Alert BI Team

Step 3

Generate

Roll Back

packages

Step 4

Migrate

Changes to

the project

With

MicroStrategy

Object

Manager

Send Email to

BI Team

EXAMPLE – BI CHANGE MIGRATION With System Manager, Each Step Defined in a Single Workflow Runs

Automatically

14

Download

file using

FTP

Execute

Command

Manager

Send Email

to notify user

Exit

Success

?

TRUE FALSE

MicroStrategy

Processes

Cloud Processes

Available

Processes Workflow Designer

Simply, drag and drop operations and link them together in the sequence desired to build a workflow

System Processes

File Operations

ODBC Operations

No Prior Coding

Knowledge

required

SYSTEM MANAGER - GUI Reproduce Any Manual Process into a Workflow with a Graphical Design

Interface

1

5

SYSTEM MANAGER - GUI Left side displays the different Processes, Right side has the Canvas

1

6

SYSTEM MANAGER - GUI Simply DRAG and DROP required Process on the Canvas

1

7

SYSTEM MANAGER - GUI Connect the Processes using Different Connectors

1

8

SYSTEM MANAGER - GUI Connect the Processes using Different Connectors

BI Change Migration Workflow in System Manager

FTP

Process

Programmatic

Elements

Command

Manager

Processes

SYSTEM MANAGER- GUI

A Wide Variety of Processes Enables Creation of Complex Workflows

Command Manager

Object Manager

Integrity Manager

Configuration Wizard

Project Merge

Project Duplicate

Project Mover

Server Status

Installation

Connectivity Wizard

Create Package

Non- MicroStrategy

Processes

Launch/Terminate Amazon

Cloud Instances

Manage VMWare VMs and

VApps

Copy/Delete/Move Files

Find/Replace File Content

Unzip files

Download With FTP

Execute Application

Execute SQL

Send Email in HTML

Create/Rename Files

Programmatic

Elements

Decisions to control

true/false process status

Iterative Retrieval

File Counter

Define global System

Manager Parameters

Update Parameters

Loops to Process Multiple

iterations

Name Nodes and Add

Comments

Split/Merge Execution

Pause

$(x)

Node

SYSTEM MANAGER- PROCESSES

Combine any of these processes in any desired sequence in one workflow

MicroStrategy Administrative

Processes

Each Process In The Workflow is Defined by Properties

FTP Download Process

Property Value =

Global Parameter

Property Name

Property Value

Hidden Passwords

SYSTEM MANAGER – PROCESSES PROPERTIES

PROCESSES PROPERTIES IN GUI

Global

Parameters

Import parameters

from an External File

Export parameters

to an external file

Global

Parameter #1

Global

Parameter #2

SYSTEM MANAGER- GLOBAL PARAMETERS

Global Parameters are Available To Every Processes

2

4


2

5

Global Parameters


2

6

Export to Parameter

File (.smp File)


2

7

C:\Paramaters.smp

Import Parameter File

(.smp File)



Call Parameters in any Process within a Workflow

Global Parameters are Available To Every Processes

Workflow

Global

Parameters


Share Parameters Between Workflows by Exporting to File

Export to file, modify values and re-use the Workflow in different BI Environments

Export

Import &

reuse Modify

values

Export Import

Export to file and import in other Workflows

.smp file

.smp file

BI Env 1

BI Env 2 BI Env 3

Workflow 1

Workflow 2

Workflow 3

Workflow

Execute System Manager Workflows from Command Line

1. Call

MASysMgr.exe…

2. Provide

Workflow path…

3. Provide

Parameter file path

1. Batch Processing with

.bat files

2. Automatically execute

workflows at a specific

time

3. Customize workflow

inputs depending on the

process

4. Augment existing process

automation by invoking

MicroStrategy system

Manager workflows

5. Cross-platform workflows

run on Unix and Windows

OS

WORKFLOWS – AUTOMATION & SCHEDULING

Agenda


• What is System Manager?

• Demonstration




• Summary

32

DEMONSTRATION

Build & Execute a System Manager Workflow for BI Change Migration and

migrate a NEW DASHBOARD to PRODUCTION

Instead of ONE new Dashboard, we will create a Workflow to update our BI Environment with FOUR NEW DASHBOARDS at once

Download

Update Package

With

FTP Client

Generate Roll Back

Packages With

MicroStrategy

Command Manager

Migrate Changes With

MicroStrategy

Object

Manager

Send Email to

BI Team

Alert

Admin

PASS

FAIL

WHAT WE JUST WITNESSED…

• In less the 10 MINUTES we were able to create a FULLY AUTOMATED

System Manager workflow that

• Updates a BI environment with ANY NUMBER of Packages

• GENERATE ROLL BACK PACKAGE for every Update Package

• Sends out instant ALERTS

• Tracks the entire Process STEP BY STEP

• ‘DRAG & DROP’ functionality of System Manager GUI

• Ease of creating HIGHLY VISUAL Workflows in FLOWCHART Format

• Ease of integrating MicroStrategy AND Non-Microstrategy Processes

• Absolutely NO CODING was needed to create the Workflow

Agenda


• What is System Manager


• Demonstration




• Summary

3

5

MicroStrategy License Manager Reporting Process

1. Run Audit Reports with License Manager for all 12 Intelligence Servers

2. Prepare User Group Privileges for each Environment with MicroStrategy Command Manager

3. Create Final reports via MicroStrategy Web

7

Without MicroStrategy System Manager

Entirely Manual License Reporting

High Pain – Tedious planning and reporting

No Historical Trend Analysis of Licenses

Data Accuracy Highly Degraded

With MicroStrategy System Manager

Fully Automated Workflow

Actionable Reports using MicroStrategy Web

Exponential Increase In Data Accuracy

Effective Planning for License Purchases

MicroStrategy System Manager enabled DELL to Convert an Intensely

Manual Quarterly Process into Fully Automated Monthly Audits

120+

SUCCESS STORY: DELL

Automation of MicroStrategy License Management Reporting resulted in

Huge Benefits

Automation

Server

Customer Environment

Cloud Teams

Linux Production 2

Windows Utility

Cloud

Admin

MicroStrategy Cloud

Linux Development

Linux Production 1

Create

Environment

Windows SQL Server Metadata

Notify Users

Automation Engine using System Manager

SUCCESS STORY: MICROSTRATEGY CLOUD

Project Statistics

System

Manager

Workflows

26

System

Manager

Processes

501

Code

Files

195

Code

Lines

9,346

Log

Entries

per Run

15,000+


Benefits with System Manager Automation Engine


• Time Savings

• >20 Hours per

Execution Savings

• Reduced IT Personnel

Effort

• Improved Process

Efficiency

• Improved Process

Tracking and Logging

• Real Time Monitoring of

Processes during run

• Efficient Alerting

Track 5 Session 10: MicroStrategy Cloud Operations

Thursday, 10:45 am – 11:45 am

Agenda


• What is System Manager?


• Demonstration




• Summary

Immediate Benefits and ROI from System Manager

BENEFITS TO YOUR ORGANIZATION

Improved Process

Efficiency & Reliability

Effi

cien

cy

Manual Automated

• Standardized processes

• Human-induced errors eliminated

• Codified tacit knowledge

• Training is easy

• Better Tracking and Alerting

Lowered Administrative

Costs

• Less people required

• Reduced manual effort

• Automation of routine tasks

• No human oversight

necessary

Simplified BI

Administration

Just launch a workflow to perform any routine process!

• Workflows run on schedule

• Proactive alerting

• De-centralization of

processes

• MicroStrategy & third party

tasks

Agenda




• Demonstration




• Summary

What’s New in System Manager 9.4.1

New

Processes

Iterative Retrieval

Count Files

Rename Files

Create Files

New Template - Publish Cubes with Validation

Updates to Existing Templates

Out of the Box

Templates

Enhancements

to Existing

Processes

Decision takes Wild Card Entries

Send Email supports HTML format

Add VM supports Network & IP assignments

Integrity Manager supports new Parameters

Usability Help Menu

Print Workflow

Export Details from Console

MICROSTRATEGY SYSTEM MANAGER – NEW FEATURES

Agenda




• Demonstration




• Summary

44

MicroStrategy System Manager Enables Administrators to Convert Manual

Processes Into Workflows

Workflows with MicroStrategy and Non-MicroStrategy processes, in any

sequence, can easily be created.

Parameterization of workflows enables the same workflow to be used with

different inputs

Workflows run on any OS supported by the MicroStrategy Intelligence Server

System Manager workflows Ensure Consistency, Improve Reliability and Codify

Tacit Knowledge.

Absolutely No Coding experience needed in creating the System Manager

Workflows

SUMMARY

NEXT STEPS…..

Try & Evaluate

MicroStrategy System Manager

for Free

by downloading the

Enterprise Evaluation Edition of

MicroStrategy by visiting…

http://www.microstrategy.com/free/dev

elopers#evaluation-edition

Automation

&

Administrative Self Service: Lessons Learnt

from

MicroStrategy Cloud Operations

on Thursday,

10:45 am – 11:45 am | La Tache

TRACK 5 Session 10

FREE TRIAL

http://www.microstrategy.com/free/developers







QUESTIONS

Vikas Bajpai

Email: [email protected]

automating your bi administration - microstrategy€¦ · 3. provide parameter file path 1. batch...

Documents