moving and transforming data with pentaho data integration 5.0 ce (aka kettle)
TRANSCRIPT
Moving and Transforming Data with
Pentaho Data Integration
a.k.a. KETTLE
Welcome!
Software engineer
Pentaho
Business Intelligence & Analytics
Full stack
Open coreGPLv2, Apache 2.0
Enterprise and OEM licenses
Java-based
Web front-ends
The Pentaho Stack
Data Integration / ETL
Big Data / NoSQL
Data Modeling
Reporting
OLAP / Analysis
Data Visualization
Dashboarding
Data Mining / Predictive Analysis
(Mobile) Delivery
Bursting, Scheduling, Self Service
Instant AnalyticsBlendingETLFull Stack BI & BA
SourcesModelsReportsOLAPVisualizationDashboardsMining
Data WarehouseTTTT
FDDDDD
Information:
A well-prepared, well-presented meal
Information:
Catching the right data and hauling it in
Extraction:
Disgusting job of validating & cleaning data
Transformation
Store manageable units for later use
Loading:
Store manageable units for later use
Loading:
Pentaho Data Integration
KettleExtract, Transform, Load
Blending
Instant Analytics
Changing input to desired output
Kettle Architecture
Tools and UtilitiesData Integration Engine
Job
Job
EngineTransformation
Engine
Launch:Kitchen, CarteLaunch:PanDevelop: Spoon
Call
Repository(RDBMS)
.ktr
.kjb
Transformation
Jobs & Transformations
Jobs
Synchronous workflow of job entries (tasks)
Transformations
Stepwise parallel & asynchronous processing of a recordstream
Distributed
Sources and Destinations
RDBMS (> 40)
NoSQL / Big Data
OLAP (Mondrian, Palo, XML/A)
Web (REST, SOAP, XML, JSON .)
Files (CSV, Fixed, Excel )
ERP (SAP, Salesforce, OpenERP)
...way Too Many To Mention!
Transformations
String & Date manipulation
Data Validation / Business Rules
Lookup / Join
Calculation, Statistics
Cryptography
Decisions, Flow control
Scripting
...> 150, excluding plugins
Demo
NLUUG Program Webpage
fact_talkdim_room
dim_track
dim_speaker
ETLInput
Output
dim_company
Demo Transformation
Business Model
Open coreMajority is open source
Give and take
Enterprise EditionExtra features, Support, Services
Community
PluginsPentaho Marketplace
Code contributions
Applications & Solutions
Tutorials, Support
Marketplace
Community Meetups
Pentaho Software
Community Edition Binariescommunity.pentaho.com (release)
ci.pentaho.com (development)
Source codegithub.com/pentaho
Enterprise Edition Evaluationpentaho.com/testdrive
Resources
Online documentationinfocenter.pentaho.com (manual)
wiki.pentaho.com (community wiki)
Issue trackerjira.pentaho.com
Community Supportforums.pentaho.com
Freenode IRC: ##pentaho
Books
Thank You
Join the conversation. You can find us on:blog.pentaho.com
@Pentaho
Facebook.com/Pentaho
Pentaho Business Analytics
Click to edit the title text formatClick to edit Master title style
2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555
Click to edit the title text formatClick to edit Master title style
Click to edit the outline text formatSecond Outline LevelThird Outline LevelFourth Outline LevelFifth Outline LevelSixth Outline Level
Seventh Outline LevelClick to edit Master text styles
Second level
Third level
Fourth level
Fifth level
2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555
Click to edit the title text formatClick to edit Master title style
Click to edit the outline text formatSecond Outline LevelThird Outline LevelFourth Outline LevelFifth Outline LevelSixth Outline Level
Seventh Outline LevelClick to edit Master text styles
Second level
Third level
Fourth level
Fifth level
Click to edit the outline text formatSecond Outline LevelThird Outline LevelFourth Outline LevelFifth Outline LevelSixth Outline Level
Seventh Outline LevelClick to edit Master text styles
Second level
Third level
Fourth level
Fifth level
Click to edit the outline text formatSecond Outline LevelThird Outline LevelFourth Outline LevelFifth Outline LevelSixth Outline Level
Seventh Outline LevelClick to edit Master text styles
Click to edit the outline text formatSecond Outline LevelThird Outline LevelFourth Outline LevelFifth Outline LevelSixth Outline Level
Seventh Outline LevelClick to edit Master text styles
2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555
Click to edit the title text formatClick to edit Master title style
2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555