etl tool evaluation criteria
DESCRIPTION
ETL tool evaluation criteriaTRANSCRIPT
Comparison Criteria
Comparison is based on following Parameters
• Architecture
• Metadata Support
• Ease of Support
• Transformations
• Performance /Management
• Data Quality & MDM
• Support for Growth
• Advance Data Transformation
• 3rd Party Compatibility
• License and Pricing
• Vendor Information
This document provides various criteria to be considered while evaluating
ETL tool such as Informatica, IBM DataStage, AbInitio, SAP BODI, Pentaho
Kettel, Microsoft SSIS, Oracle ODI ..etc
Architecture Category Criteria
Architecture
Scalable and Extensible Technology
Client Platform
Server Platforms
Which DBMS are supported for extraction and loading
Support for ERP Sources
Support for complex event processing
XML Support
Web Services
Pre built libraries to handle industry messaging formats like
SWIFT, ISO15022
Real Time feature
Real Time CDC
Code Reusability capability within the product
Parallelism
Code Generator
Architecture (Conn..) Category Criteria
Architecture
Data Transformation Method (Engine Based ?)
Building & Managing Aggregates
Support for various data types
Data Quality Check functionality or feature
Debugging and logging features
Exception Handling
How Tool Provides information about exception
Data Archival functionality
Ease of integration with external rules engines like Pega
Restarting an aborted ETL process
Memory (Minimum/ Recommended) requirement at client
machine
Memory (Minimum/ Recommended) requirement at Server
machine
Repository Backup and Recovery
Cloud Integration
Metadata and Setup Category Criteria
Metadata
Metadata Capture
Business View meta data
Meta data security
Web Integration support
Versioning Support
Metadata repository's compliance to one of the industry meta
data standards
Meta data views using query tools
Category Criteria
Ease of setup
Easy installation procedure
Ability to generate Data mart schema similar to source
database
Support for designing data mart
Importing data models from modeling tools
Transformations Category Criteria
Transformation
Filter
Format conversion
Lookup
User Defined / Custom Transformations
Scope for user defined fields
Joins
Support for external procedures
Support for XML
Support for BIG Data Integration
Support for Hadoop
Management & DQ Category Criteria
Management
Scheduling feature
Workflow Capability
Defining calendar and using it for ad-hoc scheduling
Performance monitoring of ETL process
Performance Options
Specifying the atomicity of the updates
Security –Encryption
Impact analysis in-built tool
Category Criteria
Data Quality and MDM
Data Profiling
Data Cleansing
MDM
Integration with external DQ Tool
Growth & Advance Transformation Category Criteria
Support for Growth
Ability to handle various source types from flat to files to major
RDBMS
Incremental upload
Support for External loader
Intermediate file generation during loading
Event based loading
Support for wide range of databases for storing (Target)
information
Familarity with the Tool
Support for multi-user development environment
Category Criteria
Advance Data
Transformation
Re-usability
Support for built in functions
Handling duplicate records
Lookup cache
3rd Party Integration & Pricing Category Criteria
Compatibility with third
party tools
Compatibility of ETL Tools with EAI tools like IBM MQ Series,
TIBCO, Vitria and webMethods as source/ target for the data.
Category Criteria
Licensing & Pricing
Server Licensing
Client Licensing
Cost saving due to Re-use of Existing license
Package Licensing
Category Criteria
Consistency and re-use Global Meta data
Vendor Info Category Criteria
Vendor Info
2 consecutive years of profitability
Significant third party partner support
Global presence and support
Number of Customers
Company financial info readily available
Company focus on ETL segment for the future
Client Base
Gartner, Forrester’s recommendations
About the Author
Asis Mohanty has more than 12 Years of Industry experience on Data
Warehousing and Business Intelligence field. He is a Certified Business
Intelligence Professional from www.tdwi.org and Certified Data
Management Professional from www.dama.org . Asis has worked with
Fortune 100 & IT Service organizations (IBM, Target Corporation, Infosys &
Wipro Technologies) in leadership role.
Email Id: [email protected]