automate your bi administration to save millions with ... · automate your bi administration to...

#mstrworld

Automate Your BI Administration to

Save Millions with Command

Manager and System Manager

Presented by: Dennis Liao | Sr. Sales Engineer

Date: 27th January, 2015

#mstrworld

Session 2 This Session is Part of

MicroStrategy World Track 6: Enterprise BI I

#mstrworld

MicroStrategy Leads with a Comprehensive Set of Administration Tools

Source– Cindi Howson, BI Scorecard® Strategic and Product Summary

MicroStrategy’s Administration Product Suite

http://www.microstrategy.com/Strategy/media/downloads/about-us/microstrategy_bi-scorecard-summary-q4-2013.pdf

#mstrworld

MicroStrategy Enterprise Manager Monitor Performance and Utilization

MicroStrategy Object Manager Coordinate Change Management

MicroStrategy Command Manager Create Automated Scripts

MicroStrategy Integrity Manager Automate Regression Testing

MicroStrategy System Manager Create Automated Workflows

MicroStrategy’s Administration Product Suite

`

#mstrworld

Presentation Agenda

Need for & Introduction

Basics & Product Features

Summary

Introduction

Products Features

Benefits & Summary

MicroStrategy Command Manager

MicroStrategy System Manager

Demo

#mstrworld

The Need for Automated Administrative Processes

Bulk Manipulation of Objects

Upgrade Metadata Manage Security

Ensure Data Integrity

Manage Daily Operations

Troubleshoot System Errors

Modify Intelligence Server Settings

Monitor User Activity

Manage Scheduled Requests

Fine-tune BI System

#mstrworld

80 to 90% of Daily Administrative Tasks Can Be Automated

Saving Time and Effort

*Based on sample use cases

Typical Time

Spent*

(manual hours)

Server Maintenance 750

Change Migration 1600

Project & Metadata

maintenance 500

Customization Deployments 200

Upgrades, Patches Application 100

3150

THE PROBLEM: Most Tasks Are Repetitive,

Manual and Laborious, and Time Consuming

#mstrworld


Design workflows to automate

multi-step, manual processes


Create scripts for automated

metadata administration

Agenda Two Administrative Products for Automating Manual Processes

#mstrworld


MicroStrategy Command Manager is a scripting tool that allows

administrators to automate nearly all administrative and maintenance tasks.

‒ Uses an English like scripting language to convert a manual process into an

automated one

‒ Executes a script automatically at a scheduled time without any human

involvement or on demand

#mstrworld

Presentation Agenda



Summary

Introduction

Products Features

Benefits & Summary



Demo

#mstrworld

What is a Command Manager Script?

‒ It is a collection of Command Manager Commands to carry out Intelligence

Server tasks.


Where do I create Command Manager Script?

‒ In the Command Manager Application GUI.

#mstrworld

Really?! How can scripting ever be easy?!

Scripting Made Easy

With Templates (called Outlines)

#mstrworld

Scripting Made Easy

How do I use/apply these outlines?

‒ Simply double click or copy paste the template in the command editor

‒ Modify it to suit your requirements

‒ Check Syntax (as shown below)

‒ Execute or Save Script (to automate execution)

Outline

Command

#mstrworld

Scripting Made Easy

Comments are

highlighted in

green

Auto Capitalization

and Auto Color

Coding of Command

Words

Auto Command

Completion with a

list of options to

choose from

#mstrworld

55 Management Areas – 330+ Commands

Management Area Description

User and User Group Management Create users and groups, and manage application access and

privileges associated with each

Security Management

Change access properties for reports and folders for users, groups,

and roles Set authorization parameters, including management of security

filters

Cluster Management Add or remove Intelligence Server nodes to a cluster

Application Management Change the database instances associated with projects and other

configuration parameters

Database Connection Management Load, unload, idle, or register applications for routine maintenance

Event Management Import project and configuration packages

Database Connection Management List all active database connections

Create, alter, or disconnect specific database connections based on

certain conditions

Event Management Create new event-driven schedules and trigger a specific event

schedule based on certain criteria

Job Management Monitor and kill jobs running on Intelligence Server

Object Management Create, modify, or delete objects through a script

Subscription And Report Delivery

Management

Create and alter users, groups, profiles, and user addresses

Assign privileges to users, groups, profiles, and security roles

Assign access control rights to projects, folders, and objects

Apply security roles and filters to users and user groups

#mstrworld

Execute Scripts via Command Line

Comman

d line help

Call

cmdmgr.exe

Provide

Credentials

Provide

Script Path Provide Log

File Path

#mstrworld

– Sensitive information such as Intelligence Server connection information can

be in the encrypted file

– Encrypted scripts does not require decryption during execution

– Execution Command:

cmdmgr – connlessmstr –f “<encrypted script path>”

Save As

Encrypted

Script

Encrypted

Script

Encryption for added security

#mstrworld

Does it support my OS?

– Runs on all OS supported by Intelligence Server* i.e. deployable

on Windows®, UNIX®, and Linux®

How can I schedule the scripts I have created?

– You can save the script as a Batch/Shell script and use the

Operating System’s Scheduler to schedule it

• For Windows, use Windows Task Scheduler

• For UNIX/Linux, use Cron

– Event Based Scheduling also available

* Small subset of schema related commands are Windows-only


#mstrworld

Enterprise Manager contains Out of the Box reports that generate

Command Manager Scripts based on certain criteria

– Delete Unused Attributes

– Delete / Disable Unused Users / User Groups

– Delete Unused Reports

– Delete Unused Documents

– Delete Unused Filters

– Delete Unused Metrics

– Delete Unused Schedules

– Delete Unused Security Filters

– Delete Unused Templates

– Delete Unused DB Instances

Features: Integration with Enterprise Manager

#mstrworld

Commands can be integrated with logic with the help of Procedures

– Procedures let you harness the power of Java within Command

Manager such as if-then-else analysis, looping, parameterized

procedures

Contains 50+ Sample Procedures

– Delete Caches having low hit counts, larger than certain size etc.

– Kill Jobs having low priority by User

– List DB Logins that have no dependents

Advanced Features: Use of Procedures

#mstrworld

Scripts developed

using Command

Manager UI

MicroStrategy

Open API

Intelligence &

Narrowcast

Server

Script

Execution

Overall Architecture And Workflow Of Command Manager


User Interfaces

(Graphical &

Command Line)

Syntax Validation,

Command Parsing,

Java Compiling

Formatting and

Displaying Results

Command

Execution

#mstrworld

Presentation Agenda



Summary

Introduction

Products Features

Benefits & Summary



Demo

#mstrworld

MicroStrategy Command Manager enables automation of tasks with

no necessary human attention, saving time and money

Apart from automation, Command Manager also helps in Bulk Object

Manipulations/Creation

Integration with 3rd party tools to maintain company standards

Scripts are Cross-Platform and can be executed from the command line

interface.

Encryption ensures that scripts containing sensitive information can be

distributed securely

Procedures extend flexibility of Command Manager by incorporating

logic within the Command Manager commands

Benefits & Summary

#mstrworld

Presentation Agenda



Summary

Introduction

Products Features

Benefits & Summary



Demo

#mstrworld

MicroStrategy System Manager is a process automating tool that enables BI

teams to convert a sequential, multi-step, multi-product, manually executed

process into an automated workflow.


Download

file using

FTP

Execute

Command

Manager

Send

Email to

notify user

Exit

Success? TRUE FALSE

MicroStrategy

Processes

Available

Processes Workflow Designer

Cloud Processes

System Processes

File Operations

ODBC Operations

#mstrworld

Presentation Agenda



Summary

Introduction

Products Features

Benefits & Summary



Demo

#mstrworld

2

7

MicroStrategy System Manager – GUI

Left side displays the different processes, right side has the canvas

#mstrworld

2

8


Simply DRAG and DROP required process on the Canvas

#mstrworld

2

9


Connect the processes using different Connectors

#mstrworld

3

0


Connect the processes using different Connectors

#mstrworld


Process Properties in the GUI

#mstrworld

FTP Download Process

MicroStrategy System Manager – Process Properties

Each process in the workflow is defined by its properties

Property

Name

Property

Value

Passwords

are Hidden

Property Value =

Global

Parameters

#mstrworld

Export

Parameter

File

3

3

MicroStrategy System Manager – Global Parameters

Global

Parameters

#mstrworld

3

4


Export

Parameter

File

#mstrworld

3

5

C:\Paramaters.smp


Import

Parameter File

#mstrworld

Workflow

$(x) Global

Parameters


Global Parameters are available to every process

Call Parameters

in any Process

#mstrworld

Export to file, modify

values and re-use the

Workflow in different BI

Environments

Export Import &

reuse Modify

values

Export Import

Export to file and

import in other

Workflows

BI Env 1

BI Env 2 BI Env 3

Workflow 1

Workflow 2

Workflow 3

Workflow


Share parameters between workflows by exporting them

#mstrworld

Intelligence Server Maintenance

1. Alert BI team members

2. Re-start Intelligence Server

3. Monitor the system

4. Notify BI team members

310

BI Object Change Migration

1. Download Update Packages

2. Login to Test system

3. Generate rollback packages

4. Apply changes to each project

5. Alert developers to errors

6. Notify BI Test teams

1,175

Daily Report Execution Schedule

1. Monitor ETL completion

2. Publish Cubes

3. Wait for Cubes to publish

4. Trigger Subscription Schedules

5. Notify BI teams

540

Automated Workflows Greatly Reduce IT Personnel Time and Eliminate Manual

Effort


#mstrworld

With

FTP

Client PASS

With

MicroStrategy

Integrity

Manager

With

File

copy

operatio

n

With

MicroStrategy

Command

Manager

Send Alert

to

administrat

or

FAIL

Step 1 Download Update

Package Via

FTP

Step 2 Copy files

Into Folders

Step 5

Run Integrity

Manager tests

Step 6

Alert BI Team

Step 3

Generate

Roll Back

packages

Step 4

Migrate

Changes to

the project

With

MicroStrategy

Object

Manager

Send

Email

to BI

Team

EXAMPLE – BI CHANGE MIGRATION With System Manager, Each Step Defined in a Single Workflow Runs Automatically

#mstrworld


BI Change Migration Workflow in System Manager

File

Operations

Programmati

c Elements

Programmatic

Elements

Command

Manager Process

#mstrworld

Presentation Agenda



Summary

Introduction

Products Features

Benefits & Summary



Demo

#mstrworld

Build & Execute a System Manager Workflow for BI Change Migration and migrate

a NEW DASHBOARD to PRODUCTION

Instead of ONE new Dashboard, we will create a Workflow to update our BI Environment with FOUR NEW DASHBOARDS at once

Download Update

Package With FTP Client

Generate Roll Back

Packages With

MicroStrategy

Command Manager

Migrate Changes With

MicroStrategy

Object

Manager

Send Email

to BI Team

Alert

Admin

PASS

FAIL

MicroStrategy System Manager – Demonstration

#mstrworld

Command Manager

Object Manager

Integrity Manager

Configuration Wizard

Project Merge

Project Duplicate

Project Mover

Server Status

Installation

Connectivity Wizard

Create Package

Non - MicroStrategy

Processes

Launch/Terminate Amazon

Cloud Instances

Manage VMWare VMs and

VApps

Copy/Delete/Move Files

Find/Replace File Content

Unzip files

Download With FTP

Execute Application

Execute SQL

Send Email in HTML

Create/Rename Files

Programmatic

Elements

Decisions to control

true/false process status

Iterative Retrieval

File Counter

Define global System

Manager Parameters

Update Parameters

Loops to Process Multiple

iterations

Name Nodes and Add

Comments

Split/Merge Execution

Pause

$(x)

Node

Combine any of these processes in any desired sequence in one workflow

MicroStrategy Administrative

Processes

MicroStrategy System Manager - Processes

A wide variety of processes enables creation of complex workflows

#mstrworld

Command line

help

Call

MaSysMgr.exe

Execute Workflows via Command Line Provide Workflow

Path

Provide

Parameter

File Path

#mstrworld

Presentation Agenda



Summary

Introduction

Products Features

Benefits & Summary



Demo

#mstrworld

Automation

Server

Customer Environment

Cloud Teams

Linux Production 2

Windows Utility

Cloud

Admin

MicroStrategy Cloud

Linux Development

Linux Production 1

Create

Environment

Windows SQL Server Metadata

Notify Users

Success Story – MicroStrategy Cloud

Automation Process Diagram

#mstrworld

Project Statistics

System

Manager

Workflows

26

System

Manager

Processes

501

Code

Files

195

Code

Lines

9,346

Log

Entries

per Run

15,000+

Success Story – MicroStrategy Cloud

#mstrworld

Benefits to Your Organization

Improved Process

Efficiency & Reliability

Effi

cien

cy

Manual Automated

• Standardized processes

• Human-induced errors eliminated

• Training is easy

• Better Process Tracking and

Alerting

Lowered Administrative

Costs

• Less people required

• Reduced manual effort

• No human oversight

necessary

Simplified BI

Administration

Just launch a workflow to perform any routine process!

• Workflows run on schedule

• De-centralization of

processes

#mstrworld

MicroStrategy System Manager Enables Administrators to Convert

Manual Processes Into Automated Workflows

Workflows can incorporate MicroStrategy & Non-MicroStrategy

processes, in any sequence

Parameterization of workflows enable the same workflow to be used

with different inputs

Workflows run on any OS supported by the MicroStrategy Intelligence

Server & can be run via Command Line

Workflows can be scheduled to run automatically, without any human

involvement or can be triggered manually as well

Summary

#mstrworld

QUESTIONS

Dennis Liao

Email: [email protected]