syntrix application development framework

30
www.syntrixconsulting .com Application Development Framework For Qlik Sense® Implementations

Upload: syntrix-consulting-group

Post on 12-Feb-2017

467 views

Category:

Technology


0 download

TRANSCRIPT

Page 1: Syntrix Application Development Framework

www.syntrixconsulting.com

Application Development Framework

For Qlik Sense® Implementations

Page 2: Syntrix Application Development Framework

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749)

About Syntrix

2

Syntrix Consulting Group specializes in data reporting and business

analytics for healthcare organizations.

We provide tools, processes, and expertise to accelerate the production and adoption of analytic applications

in healthcare.

We are a Qlik Implementation Partner with expertise in multiple EMR

systems including Epic.

877-SYNTRIX (796-8749)[email protected]

www.syntrixconsulting.com

Page 3: Syntrix Application Development Framework

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 3

Syntrix Application Development FrameworkQlik Sense Development PathwayRoles and ResponsibilitiesLayered Data EnvironmentMetadata ManagementDesign Best PracticesApplication Certification Process

Content Outline

Page 4: Syntrix Application Development Framework

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 4

Syntrix Application Development Framework

Page 5: Syntrix Application Development Framework

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749)

PurposeTo facilitate adoption of reusable and governed data

constructs for improved self-service capabilities, rapid development cycles, and single-point maintenance

GoalsTo create a methodology to develop and deploy Qlik

Sense® applicationsTo ensure that there is confidence in the data used

in the applicationsTo provide a team structure to maintain a Qlik

Sense® environment

Syntrix Application Development Framework

5

Page 6: Syntrix Application Development Framework

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 6

Key Elements of Syntrix Application Development Framework for Qlik Sense®• Application Architecture – this is the structure of the

data environment, conformed datasets, pre-aggregated metrics, reusable components, data models and the actual presentation layer applications

• Metadata Management – the management of the data about the data is vital to understanding what is in your data environment

• Design Methodology and Best Practices – making sure consistent and well thought out standards will enable you to maximize the reuse in your environment

• Certification Reviews and Processes – this is the process to ensure accuracy and acceptance of published applications

• Role and Responsibilities – understanding the roles and responsibilities on the team will promote accountability

Key Elements

Page 7: Syntrix Application Development Framework

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 7

Qlik Sense® Development Pathway

Page 8: Syntrix Application Development Framework

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 8

Qlik Sense® applications go through the following stages to production• Extract – data is pulled from the source systems at

scheduled time points and a QVD repository is created

• Transform – concepts are conformed and manicured in this environment and provides governed data concepts to be used by your applications

• Design – design the applications on the Qlik Sense® hub using best practices and reusable elements

• Deploy – publish to streams and provide access to the users and groups

Qlik Sense® Development Pathway

Page 9: Syntrix Application Development Framework

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 9

Qlik Sense® Development Pathway

Extract Transform Design Deploy

• Define Sources• Define Data

Requirements• Create

Connection Strings

• Create Extract Data Layer

• Plan Reload Schedule

• Create Apps per source

• Determine Data Security Requirements

• Extract Data• Create

Repository Directory

Acti

viti

es

• Determine Reload Schedule

• Define Metrics• QVD Monitor• QVD Status App• Create Concept

Directory• Create Reusable

Library• Standardize Field

Names• Create Reusable

QVDs

• Transform Data• Define Reusable

Elements• Develop

Reference Repo• Update Library• Define and

Document Requirements

• Test and Validate Application

• Define Data Model Apps

• Define Streams• Define Security

Access• Communicate to

user base• Create Release

Notes• Update Version

Control Library• Validate

Application• Update Code

Library• Publish Apps

Page 10: Syntrix Application Development Framework

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 10

Extract Pathway Outputs• This is a directory on a server that can be accessed by the

QMC• Source level QVDs are housed in this repository• This will enable you to extract metadata about the QVDs• Mapping files for raw level data will be centralized in this

area• Reusable scripts and expressions will reside in this structure

Transform Pathway Outputs• Concept level QVDs will be located in this repository• This is a directory on a server that can be accessed by the

QMC• Mapping files for concept data are centralized in this area• Governed metric library and data sets are curated in this

repository• Robust metadata from QVDs associated with business

definitions can be created in this environment• Reusable scripts and expressions will reside in this structure

Extract and Transform Data Layers

Page 11: Syntrix Application Development Framework

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 11

Design Pathway Outputs• Qlik Sense design is done in the Qlik Sense

Hub from a web browser• All applications in the development phase

reside in the developer’s Work stream.

Design and Deploy

• Applications reside in the centralized repository, but can be exported and reviewed on Qlik Sense desktop

• Images and other content that will be used by the applications will be upload here

• Applications can be tested at this point before being published Deploy Pathway Outputs

• Deployments of applications are done to the Streams in the QMC• Update application versions during this activity• Communicate changes to the community• Administer security and permissions through the QMC

Page 12: Syntrix Application Development Framework

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 12

Roles and Responsibilities

Page 13: Syntrix Application Development Framework

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 13

Roles and Responsibilities

Extract Developer

Data Modeler

Application Developer QA Analyst Business

AnalystSystem

Administrator

• Create and Manage Qlik Extract Application

• Maintain Functional Extract Specs

• Schedule Reload Tasks

• Monitor Repository

• Create and Manage Concept QVDs

• Maintain Functional Specs

• Maintain QVD Dictionary

• Ensure Reuse Assets are Utilized

• Maintain Design Requirements

• Create Qlik Sense Apps

• Meet User UI Requirements

• Update and Maintain Catalogs

• Validate Data Concepts

• Validate Applications

• Develop Test Plans

• Validate Coding Standards

• Document User Requirements

• Conduct User Acceptance Testing

• Manage User Expectations

• Update End User Documents

• Publish Apps• Create and

Maintain Streams

• Provision License and Security

• Maintain QMC Maintenance Plans

Individuals on the Business Intelligence team can fulfill multiple roles.

Page 14: Syntrix Application Development Framework

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 14

Roles and Responsibility Workflow

BusinessAnalyst

Subject Matter Expert

Requirements

DataModeler

ExtractDeveloper

ConformedQVDs

ApplicationDeveloper

Applications QA Analyst BusinessAnalyst

Test Cases

SystemAdministrator

PublishApps

Fail

Pass

Page 15: Syntrix Application Development Framework

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 15

Layered Data Environment

Page 16: Syntrix Application Development Framework

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 16

BenefitsData can be staged and cleansedCreate governed datasets Implement reusable elementsAllows for robust and flexible securityAbility to create metric librariesCreate denormalized dataset for ease of

reportingUpdate and maintain one source of truthAutomate the creation of data dictionaries

Benefits of Layered Environment

Page 17: Syntrix Application Development Framework

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 17

Data Environment• Repository Layer

Load source data into this environment

Create incremental loads Source Mapping Documents

• Concept Layer Sourced from the Repository layer Remove any unnecessary data Conceptualize multiple data sources

into single concept Create a reusable measure library Conform field names for business

use

Data Environment

Page 18: Syntrix Application Development Framework

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 18

Qlik Sense® data connection and security is set up in the QMC

Minimal Security – Open Access• Create connections to the top levels QVD directories (i.e.

Repository, Transform, Concepts)• Provide access to the developers who will be working on the

QVD environment• This is good for developers who should have access to all

data Granular Security – Strict Access

• Create connections to the specific QVD folders• Provide access to each QVD folder individually• This is effective when your developers should only have

access to specific QVD datasets

Security Setup

NOTE: If you are using an LDAP account, it will add your username to the account name. It is recommended to remove that before utilizing that connection. To do that go to the QMC and Edit the data connection name and remove the username information.

Page 19: Syntrix Application Development Framework

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 19

Metadata Management

Page 20: Syntrix Application Development Framework

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 20

Develop metadata management tools• Create tools to monitor the QVD directories• Associate data to QVD metadata to create data

dictionaries

Metadata Management

Repository Concepts

Monitor QVDs Data Dictionary

Page 21: Syntrix Application Development Framework

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 21

Create QVD Profile apps Add business definitions to your fields to create data

dictionary applications Use the XML in the QVDs to get linage and other useful

metadata about the QVD environment

Metadata Tools

Business descriptions provide great value to

the developer

Page 22: Syntrix Application Development Framework

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 22

Design Best Practices

Page 23: Syntrix Application Development Framework

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 23

Rename fields during the transform phase• Make fields business friendly (no underscores or slashes)

Add notes to code changes and if you have a tracking number add that too

Break script up into logical tabs Utilize optimized QVDs properly

• Use preceding load statements Use Qualify selectively and remove fields that are

not needed Develop coding standards and naming

conventions and follow them Use include files for signal point of maintenance

Scripting Best Practices

Page 24: Syntrix Application Development Framework

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 24

Good interface design leads to high adoption rates

Use clear and concise charts

Application Best Practices

This slide provides excellent explanation when to use different chart types.

Page 25: Syntrix Application Development Framework

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 25

Data Model Comparison

Snowflake Schema Star Schema Single Table

Response Time Slowest Medium Fastest

RAM Consumption Lowest Medium Highest

Script Runtime Medium Fastest Slowest

Flexibility Worst Best Best

Complexity Most Moderate Least

Page 26: Syntrix Application Development Framework

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 26

Application Certification Process

Page 27: Syntrix Application Development Framework

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 27

Implement checks and balances for your development process to achieve final signoff

Review, test and signoff on the applications that are published to production

Develop checklists to ensure everything is reviewed for each application

Certification Process

Review Requirements

Review Application

Determine Readiness

Determine Training

Evaluate Feedback

Review Rollout Plan

Certification Meeting

Page 28: Syntrix Application Development Framework

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 28

Roles of the certification process• Review leader (not the developer)

Review the business and functional requirements Helps determine readiness of the application

• Developer Demonstrates the application to the team Explains architecture, design and functionality of the application

• Business Analyst Helps determine readiness of the application Provides feedback

• Subject Matter Expert (customer) Determines if the application is ready for production Helps determine readiness of the application

• Others (Jr developers and designers) Learn and provide feedback

Roles for Certification Process

Page 29: Syntrix Application Development Framework

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 29

Review application and script, things to look for• Naming Standards• Data accuracy• Reload Schedules• Branding• Consistency

Color Navigation Layout

• Performance• Maintenance Support Review• Meeting requirements• Review Master Library• Properly Commented Code

Things to Review

Page 30: Syntrix Application Development Framework

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 30

To learn more, contact us at:877-SYNTRIX (796-8749)

[email protected]

Syntrix Consulting Group