information builders enterprise information management ... · information builders enterprise...
TRANSCRIPT
Transforming data into business value
1
Information Builders Enterprise Information Management Solution
Fateh NAILIEnterprise Solutions Manager
June 20th, 2017
Agenda
Introduction
Information Builders Solutions
Data Integration
Data Quality
Master Data Management
Roadmap
Summary
Introduction
Enterprise Information Management
We do Enterprise Information Management!
Information Builders helps align, link and leverage people, processes and technology around information assets across the enterprise.
What do we do?
A complete platform
Integration
Write-Back
Data Discovery Reporting Dashboards
High-PerformanceData Store
Data Quality Data Governance
Master DataManagement
Batch ETL
Integrity
Intelligence
Location Analytics
In-DocumentAnalytics
Casting and Archiving
SearchPredictive Analytics
Sentiment and Word Analytics
Performance Management
SocialHot
BadFeedback
Real-Time ESB Hadoop-Based
Natural Language/Narrative BI
ApplicationsLegacy Systems Relational/Cubes Big Data Columnar/In Memory Unstructured Social Media Web Services Trading PartnersIoT
BI Portal Embedded InfoApps™ Mobile
How do we do it?
An optimal implementation approach
Data
Governance
Share
CommunicateAnalyse
PropagateData Distribution
BuildMatch
MergeData Mastering
ImproveStandardise
EnrichData Quality
KnowExplore
ProfileData Analysis
GetConnect
OrchestrateData Integration
Manage
Control
Data Integration
iWay Data Integration SolutionIntroduction
Unique and powerful Integration Platform Real time and Batch Processing Compose, Orchestrate and Automate
complex integration processes Drag and drop interface for pre-built
components Expose processes as reusable
Services (Web Service, REST …) 300+ Pre-Built Integration Adapters
Bi-directional Data, Application, Industry, etc Use any messaging infrastructure
iWay Data Integration Solution
Backbone for all data processingData Quality, Master Data Management, Data Governance, WebFOCUS can all be stacked on top of this real-time data engine for complete data access.
Native XML and JSON processing Automatically transform A2A and B2B messages (IoT)
Complete end-to-end securityauthentication, authorization, encryption
Full API supportGenerate and consume API/REST
Cloud and on-premise
Key Features
iWay Service Manager
iWayRepositories
iWay Web Console
IWay BAM
IWay Sentinel
iWay Service
Designer
IWay Service
Transformer
iWay Application
Explorer
ApplicationServer
BPMApplication
BI Application
Web ServiceApplication
SWIFT Adapter
MySAPAdapter
OracleAdapter
….
iWay Process Flows
Event DrivenReal Time Processing
Web Service
iWay Adapter Framework
CICSAdapter
Mainframe Data, Applications and
Transactions
Applications,ERP, CRM, …
Files, Excel CSV, XML
SWIFT, HIPAA, EDI Formats
Databases, Data Warehouse,
Design Time
Operational Time Run Time
iWay Integration ToolsiWay Operational Tools
Routing Transform Security XA
iWay Data Integration SolutionTools and components
Activity Monitoring
Enhance iWay Data Integration Solutionby monitoring complete components
Provide improved activity visibility Provide detailed message Auditing Provide Alerting Allow user definition metrics
Dashboards, Reports Message Resubmission
Manual Reprocess! Persist monitored activities and events
in database
iWay Data Integration Solution
Data Quality
DQ Rules DQ MonitoringDQ Profiling
Omni-Gen DQ EditionIntroduction
Standalone solution designed to optimize the integrity of informationthroughout the enterprise
Packaged with comprehensive,fully customizable business rulesand a portfolio of libraries
Collaboration
Well defined implementation approach
Data Quality ProfilingAnalyze the quality of the data
Data profiling shows the presence oferrors with Metrics Information
Profiling Features include Patterns/Masking Custom Business Rules Extremes Quantities Frequency Analysis Foreign Key Analysis Localization Charting Grouping/Aggregate Drilldown/Interactive Displays
Most organizations say data quality issues are detected when reported by employees, customers or prospects. Fewer than 50% of companies conduct proactive data audits to discover data quality issues.
Data Quality RulesImplement Data Quality rules
Data Cleansing and Standardization
Data Enrichment
Data Scoring
Internal/external reference data
Matching / Merging Probabilistic and Deterministic Levenshtein distance Golden record
Id column for NamesAlter Format
Remove titlesStrip Titles
Parse NamesGuess Name Surname
Prepare out valuesColumn Assigner
Remove columnsAlter Format
𝒚=𝒇 𝒙
“John”“Smith”
Advanced Profiling
‘Custom’ analysis of data
Defined by user and relevant to data context
Multiple fields can be considered, e.g. Address lines
Complex computation may be required
Output is Binary (true/false) – Data Quality Indicators
Data Quality MonitoringAnalyze data overtime
Operational Dashboard for Data Stewardsand Data Supervisors to investigateand correct data
Provide an ability to do data!
Cleansing, Matching, Merging, Unlinking…
Improved reporting, filtering and searches
Track data quality issues in real time
End-to-end audit trail of all data changes
Workflow interface
Data Quality RemediationManual correction
Extending Data Quality
Avoid dissemination at root (Upstream vs Downstream correction)
Extend the reach of your Data Quality Initiative
Create a firewall protecting your systems from bad data
Data Quality Firewall
Master Data Management
Why Master data Management?
Many silos of data often out-of-sync
Poor data quality affecting BI and reporting
Integration complexity
Point-to-point integration is costly (interfaces, “language”)
Inevitable manual process
Error-prone and inconsistency
No way to audit
No way to rollback changes
Different people involved(Updates “interpreted” by systems experts)
Time and resource consuming
The road to Master Data Management
What are the benefits?The road to Master Data Management
Consistent and comprehensives information across the enterprise:Know your customer, Single view of citizen …
Support data governance and compliance requirements between cross-functional teams
Consolidate and rationalize information from different systems across the enterprise to improve transactional and analytical processes
Enforces data modeling, quality, policies, governance, hierarchical and standardize data across the enterprise
Data of the highest quality to feed into their operational and analytical systems
Omni-Gen MDM EditionProduct View
Omni-Gen
Profiling Integration
Integration Edition
Cleansing
Data Quality Edition
Mastering
Master Data Management Edition
Omni-Gen MDM Edition
Top-down approach centered on business problems
Collaboration between the business and IT
Simplifies data integration and mapping of source systems
Pre-packaged mapping documents
Automates key steps in the MDM process
From data integration to Data Quality processing
Facilitates the implementation of mastering templates and rules
Advanced business user interfaces
Master view, source and instance records for full resolution and 360 °view
Introduction
Omni-Gen MDM EditionOmni Designer
Model driven and multi-domain frameworkto generate the various componentas part of an MDM system
Auto mapping
DQS Plugins
Workflow customization editor
Omni-Gen MDM Edition360 Viewer
360⁰ view of Data Subjects.
Centralised view of all attributes belongingto a mastered record.
View all instance informationand full history.
LifecycleOmni-Gen MDM Edition
Cloud-based systems
Legacy assets
ERP applications
Business partners
Cloud-based systems
Downstream applications
Data warehouses
Business partners
Roadmap
Release 7.0 SP7- Q1 2017
•Service Pack Release
•Customer Issue resolutions
•FTP Updates
•AVRO Enhancements
•MQ/JMS Dynamic Queues
•Oauth Updates
Release 8.0 – Q2 2017
•New L&F Intuitive Design Environment
•Support for themes and visual customization
•New process flow palette & new objects
•Action/Verb approach for process configuration
•Added support for RAML
•Native JSON support and new services
•DB and Queuing Services Upgrades
•Python/JS support as part of process flow
•Support for Tradacoms EDI standard
Release 8.0 SP1 - Q4 2017
•View of the payload across process objects
•Basic and Advance user configuration options
•RAML/Swagger based channels
•API Management Support
•Inherited runtime configurations
•Console monitoring improvements
•SWIFT 2017 support
•HIPAA Updates
iWay Integration - Roadmap 2017
iWay Integration Platform 8.0
Simplicity, Usability & Accessibility at all levels
Automated Deployment and Optimized Maintenance
All-in-one Application Projects supporting Team Work
API Management & Micro-services platform
Product direction
iWay Integration Platform 8.0Summary of New Features – Design Time
Re-architected iWay Integration Tools provides a new Look and Feel for expedited development and enhanced user experience
New Object Palette and new objects such as Console Log & Document provide quick access.More objects introduced with each update simplifying access.
Omni-Gen DQ Edition
31
DQ Workbench - Profiling
Omni-Gen DQ Edition
32
DQ Workbench – Data Grid
iWay Big Data Integrator
33
100% Run “in” Hadoop architecture
Simplifiedinterface
Native Hadoopscript generation
Process mgmt. & governance Simplified easy-to-use interface
to integrate in Hadoop
Marshals Hadoop resources and standards
Takes advantage of performance and resource negotiation
Includes sophisticated process management and governance
Sqo
op
, Flum
e…A
vro, JSO
N…
Traditional applications and data stores
iWay Big Data Integrator
Simplified, modern, native Hadoop integration
Big Data Hadoop
Any distribution, Any data
1. Data Ingestion – Enterprise Data Hub2. ETL / ELT3. Predictive Analytics - RStat
4. Business Intelligence - WebFocus5. Low-cost storage of large data volumes
Summary
Data Governance It’s a process and it’s iterative
Enable the process via technology
Start with Data Integration and grow into MDM
Understand that requirements will change over time
Know that Information Builders can help you
Summary
