open source business intelligence · 2011-09-09 · open source business intelligence . who am i...
TRANSCRIPT
Open Source
Business Intelligence
Who am I
Stefano Scamuzzo
Senior Technical Manager
Architecture & Consulting
Research & Innovation Division
Engineering Ingegneria Informatica
The SpagoBI Core Team
Grazia Cazzin – Project Leader
Chiara Chiarelli
Davide Zerbetto
Antonella Giachino
Stefano Modroni
Angelo Bernabei Andrea Gioia
Giulio Gavardi
Who is Engineering
!! Leader Company
"! More than 40 premises
"! More than employees
"! More than 800 Customers
"! More than 400 Consultants
!! Activity Domain
"! System Integration
"! Technologies and Products
"! Consultance
"! Services and Software development
"! Training
!! Market segments
"! Banking and Insurances
"! Industry, Telecom et Services
"! Public administration (central and local)
"! Healthcare
"! Utilities
"! Research and Innovation
SpagoBI: a definition
SpagoBI is an integration platform for enterprise BI solutions, entirely developed in FOSS philosophy
What SpagoBI is ?
!! Platform:
"!It covers and satisfies all the BI requirements: KPIs, Reporting, OLAP, Dashboard and charts, Data Mining, Free Inquiring (QbE), Dossier, Geo-referenced analysis, Collaboration
"!Data Management, Profiling and security
"!
Administrator support (versioning, scheduling, approval iter, import/export, etc)!
SpagoBI is an integration platform for enterprise BI solutions,
entirely developed in FOSS philosophy (Free and Open Source Software) !
What SpagoBI is ?
!! Integration platform:
"!Not a product platform, with a predefined set of tools
"!Open to many products for the same/different analytical area, both open source and proprietary
"! It allows the composition of one’s own platform time for time in the best way
"!No binding dependences from products and tools
"!Open standards adoption
"! It allows to give the right answers to analytical questions by means of different products
SpagoBI is an integration platform for enterprise BI solutions,
entirely developed in FOSS philosophy (Free and Open Source Software) !
What SpagoBI is ?
!! Enterprise platform
"!Distributed architecture (scalability) !
"!
Adaptive behaviour of the documents based on the end users’ roles
!! Entirely Open Source
"!It is not the lite OS version of an enterprise commercial version
SpagoBI is an integration platform for enterprise BI solutions,
entirely developed in FOSS philosophy (Free and Open Source Software) !
!! BI platform:
"!Report
"!OLAP
"!Dashboard
"! KPIs
"!Charts
"!Data Mining
"!GEO-referenced analysis
"! Free Inquiry (QbE)
"!Collaboration
"! ETL
!! Enterprise level
"! Integration platform (not a closed product) !
"!Multi engine (also mixing OS and proprietary) !
"! Scalability
"! Security and visibility
What SpagoBI is ?
SpagoBI architecture
SpagoBI 2.1
Architecture
Integration Platform
Analytical Model
Analytical Engines
Man
agem
ent T
ools
SpagoBI – Analytical Model
!! It is the layer that mediates all interactions between the core of the platform (i.e. behavioural model and service components) and external analytical engines
!! It works as a meta model describing all analytical
areas in an abstract way (i.e. implementation independent) !
!! It allows to de-couple users analytical
questions from the actual tools used to answer to them
!!It is a cornerstone in the implementation of the integrability strategy adopted by the
platform (integration platform vs. product) platform) !
SpagoBI – Analytical Model in action
SpagoBI – Behavioural Model
!!It represents the allowed end-user’s behaviour according to his/her business responsabilities
!!It enhances the prominent analytical
concepts and describes how they are showed and checked according to the end-user roles
!!It provides a unique representation of
every analytical concept
SpagoBI – Behavioural Model
!!The behavioural model (BM) represents the allowed end-user’s behaviour in relation to his/her business responsibilities
!!It’s up to the BM to manage
who, when, where and how constraints are related to an actionable functionality provided by the platform
actions
users
BM
SpagoBI – Behavioural Model in action
SpagoBI – Behavioural Model in action
SpagoBI – Behavioural Model in action
SpagoBI – Management Tools
!!A set of back-end services that can be used to support all the other platform components and functionalities.
"!Scheduler
"!Alarms & Notifications
"!Distribution lists
"!Subscriptions
"!Monitoring & Auditing
"!Collaboration module
SpagoBI – Analytical Engines
!!They are the components that actually execute analysis
!!At least one analytical engine exists for each
analytical area (ex. report, olap, datamining, ecc…) !
!!For each analytical area more than one engine type
can exist (ex. Jasper, BIRT and BO for reporting)!
!!One engine type can have
multiple instances to guarantee scalability and reliability
SpagoBI logical architecture
!!The main components of SpagoBI
SpagoBI Metadata
SpagoBI Core
Authorization System
Authentication System
SS
O / S
ecurity
AP
I
SpagoBI Engine
SpagoBI Engine
SpagoBI Engine
SpagoBI Engine
Security connectors
Folders
From SpagoBI 1.9.x to SpagoBI 2.x
!!All the SpagoBI components are now into the SpagoBI Server
SpagoBI SERVER SpagoBI Studio
SpagoBI Meta
Spa
goB
I S
DK
SpagoBI Applications
!!But in the new 2.x Release, some other main modules are coming …
SpagoBI 2.x – Main Modules
!!5 Modules
"!Server
"!Studio
"!Meta
"!SDK
"!Applications
!! 6 NEW Engines "! GEO engine
"! New QbE (multi-schema)
"! Interactive dashboard (Composed Document) !
"! KPI modeller and navigator "! JPalo for OLAP
"! Chart engine
!! Architectural review "! WebApplication and JSR 168
"! SSO with CAS
"! SOA "! SSL
"! Security assessment (OWASP Compliant)!
!! General Features "! Subscriptions
"! Personal folders
"! Rich client "! Data sources configuration
"! Alert and Notification
"! Save Import/export settings
"! ….
SpagoBI Server (the already known platform, with many
news) :
SpagoBI 2.x – Main Modules
!!5 Modules
"!Server
"!Studio
"!Meta
"!Applications
"!SDK
SpagoBI Studio : the integrated environment, to develop, test
and deploy documents into one or more SpagoBI Server
SpagoBI Meta : Business and technical metadata
SpagoBI SDK, to use SpagoBI from external application:
- Tag Lib - Integration API - Web Services
SpagoBI Applications: - BAM - Audit & Monitoring - ….
SpagoBI technological architecture
!!Technological architecture
"!SpagoBI can be deployed in:
#! Tomcat 6.x
#! Jboss 4.x
#! WebSphere 6.x
"!SpagoBI can be installed as a simple WebApplication
"!SpagoBI can be installed in a Portal environment:
#! eXo Platform 2.x
#! Liferay 5.1
#! WebSphere Portal
!!Open Standards
"!JSR 168, JSR 170, JDBC, JDK, Hibernate
SpagoBI for the end-user
SpagoBI 2.1
End-user functionalities
SpagoBI 2.1 - Reporting
SpagoBI 2.1 - Reporting
Template File
Parameters
Report Engine
A typical reporting system
SpagoBI 2.1 - Reporting
SpagoBI 2.1 - Reporting
SpagoBI 2.1 - Reporting
SpagoBI 2.1 – Reporting and behavioural model
SpagoBI 2.1 – Reporting and behavioural model
SpagoBI 2.1 - OLAP
SpagoBI 2.1 - OLAP
A typical OLAP system
Ola
p C
lient
Co
m. A
PI
Co
m. A
PI Com. Protocol
Ola
p S
erv
er
Data Storage
MONDRIAN JPIVOT
SpagoBI 2.1 – OLAP functionalities
SpagoBI 2.1 – OLAP functionalities
SpagoBI 2.1 – OLAP functionalities
SpagoBI 2.1 – OLAP functionalities
SpagoBI 2.1 - GEO
SpagoBI 2.1 – GEO Analysis
GEO Analysis is ...
... a visual representation of some spatial data (typically a geographic map) whose elements, usually called geographical features, are enriched with some graphical information (typically colours) based on the value of some KPI related to the spatial element.
SpagoBI 2.1 – GEO Analysis
GEO spatial data: basic concepts
- features
- attributes
- layers
- maps
SpagoBI 2.1 – GEO Analysis
Geographic features are ...
... geometric entities like points, lines and polygons
that can have a graphical representation. Geographical
features are usually related to some existing entity in the
real world like, for example, cities, streets and regions.
point line
polygon
SpagoBI 2.1 – GEO Analysis
Geographic attributes are ...
... properties related to some geographical features
like for example id, name, population, length, ecc ...
POINT(
Id: MI Name:Milan State: Italy Region:Lombardia Area: 182 km2
)
LINE(
Id: H101 Name:101 Length: 500 km Type: Freeway
)
POLYGON(
Id: IT Name:Italy Population 51M Capital: Rome
)
SpagoBI 2.1 – GEO Analysis
Layers are ...
... group of features, usually of the same geometric
type and usually related to the same kind of real world
entities.
Italy Regions' layer: groups together all the polygonal type features related to regions of Italy
SpagoBI 2.1 – GEO Analysis
Maps are ...
... a portrayal of geographic
information as a digital image file
suitable for display on a computer screen.
A map is not the data itself.
… usually built as a composition of
different geographical layers
SpagoBI 2.1 – GEO Engine goal
GEO Analysis GOAL is ...
... build a bridge between geo-spatial data and datawarehouse informations
SpagoBI 2.1 – GEO Analysis
GEO spatial data: out of scope
- Web Map Server: a system capable of producing
maps from geographic information
- Web Feature Service: a service whose interface
allows to request for geographical features
- Geographical Information System: a system for
capturing, storing, analyzing and managing data and
associated attributes
SpagoBI 2.1 – GEO Analysis
GEO Dimension
- is part of the data warehouse
- is the link between the business data and the geo data
- is structured into one or more hierarchies
SpagoBI 2.1 – GEO in action
SpagoBI 2.1 – GEO in action
SpagoBI 2.1 – GEO in action
SpagoBI 2.1 – Charts
SpagoBI 2.1 – Bar charts
SpagoBI 2.1 – Dial charts
SpagoBI 2.1 – Pie charts
SpagoBI 2.1 – Box charts
SpagoBI 2.1 – Charts in action
SpagoBI 2.1 – Dashboards
SpagoBI 2.1 – Dashboards: Rotate
SpagoBI 2.1 – Dashboards: Live Line
SpagoBI 2.1 – Dashboards in action
SpagoBI 2.1 – Composite Document
SpagoBI 2.1 – Composite document
!!The composite document is a new SpagoBI engine which creates and displays on a single page more SpagoBI documents of any type (maps, reports, charts,…).
!! It can be considered as a new type of instrument panel with the difference that the documents are dynamic and so the users can navigate the displayed information.
SpagoBI 2.1 – Composite document in action
SpagoBI 2.1 – Composite document in action
!!The user clicks on Washington state and then each other document is reloaded taking the new parameter as input:
SpagoBI 2.1 – Composite document in action
!!The same, if the user click on the table, the charts in the lower part will be refreshed according to the new parameter :
SpagoBI 2.1 – Composite document in action
!! Also the last single chart can update other documents, in this case updates the last chart on the right:
!! Note that all documents within the composite document share the same parameters and you can configure it so that everyone can start the update of the other, updating the value of a shared parameter