paralellism with db2 for z/os (2010)
TRANSCRIPT
![Page 1: Paralellism with DB2 for z/OS (2010)](https://reader034.vdocuments.us/reader034/viewer/2022042702/55d5189dbb61eb03128b4614/html5/thumbnails/1.jpg)
Copyright © 2010 IBM CorporationAll rights reserved
DB2’s Parallelism
Willie FaveroDynamic Warehouse on System z Swat TeamIBM Silicon Valley Laboratory
Myth Busting
![Page 2: Paralellism with DB2 for z/OS (2010)](https://reader034.vdocuments.us/reader034/viewer/2022042702/55d5189dbb61eb03128b4614/html5/thumbnails/2.jpg)
Copyright © 2010 IBM CorporationAll rights reserved
DB2’s Parallelism
Willie FaveroDynamic Warehouse on System z Swat TeamIBM Silicon Valley Laboratory
Taking a Peak at
![Page 3: Paralellism with DB2 for z/OS (2010)](https://reader034.vdocuments.us/reader034/viewer/2022042702/55d5189dbb61eb03128b4614/html5/thumbnails/3.jpg)
Slide 3 of 38Copyright © 2010 IBM CorporationAll rights reserved
Myth Busting DB2’s ParallelismMyth Busting DB2’s Parallelism
DisclaimerThe information contained in this presentation has not been submitted to any formal IBM review and is
distributed on an "As Is" basis without any warranty either expressed or implied. The use of this information is a customer responsibility.
The materials in this presentation are also subject toenhancements at some future date, a new release of DB2, ora Programming Temporary Fix (PTF)
IBM MAY HAVE PATENTS OR PENDING PATENT APPLICATIONS COVERING SUBJECT MATTER IN THIS DOCUMENT. THE FURNISHING OF THIS DOCUMENT DOES NOT IMPLY GIVING LICENSE TO THESE PATENTS.
TRADEMARKS: THE FOLLOWING TERMS ARE TRADEMARKS OR ® REGISTERED TRADEMARKS OF THE IBM CORPORATION IN THE UNITED STATES AND/OR OTHER COUNTRIES: AIX, AS/400, DATABASE 2, DB2, e-business logo, Enterprise Storage Server, ESCON, FICON, OS/390, OS/400, ES/9000, MVS/ESA, Netfinity, RISC, RISC SYSTEM/6000, iSeries, pSeries, xSeries, SYSTEM/390, IBM, Lotus, NOTES, WebSphere, z/Architecture, z/OS, zSeries, System z.
THE FOLLOWING TERMS ARE TRADEMARKS OR REGISTERED TRADEMARKS OF THE MICROSOFT CORPORATION IN THE UNITED STATES AND/OR OTHER COUNTRIES: MICROSOFT, WINDOWS, WINDOWS NT, ODBC and WINDOWS 95.
For additional information visit the URLhttp://www.ibm.com/legal/copytrade.phtml for “Copyright and trademark information”
![Page 4: Paralellism with DB2 for z/OS (2010)](https://reader034.vdocuments.us/reader034/viewer/2022042702/55d5189dbb61eb03128b4614/html5/thumbnails/4.jpg)
Slide 4 of 38Copyright © 2010 IBM CorporationAll rights reserved
Myth Busting DB2’s ParallelismMyth Busting DB2’s Parallelism
The History ofDB2’s Parallelism
(on the mainframe of course)
![Page 5: Paralellism with DB2 for z/OS (2010)](https://reader034.vdocuments.us/reader034/viewer/2022042702/55d5189dbb61eb03128b4614/html5/thumbnails/5.jpg)
Slide 5 of 38Copyright © 2010 IBM CorporationAll rights reserved
Myth Busting DB2’s ParallelismMyth Busting DB2’s Parallelism
Query Without Parallelism
Part
ition
Tab
le S
pace
SQL Results
Res
pons
e Ti
me
![Page 6: Paralellism with DB2 for z/OS (2010)](https://reader034.vdocuments.us/reader034/viewer/2022042702/55d5189dbb61eb03128b4614/html5/thumbnails/6.jpg)
Slide 6 of 38Copyright © 2010 IBM CorporationAll rights reserved
Myth Busting DB2’s ParallelismMyth Busting DB2’s Parallelism
Query With Parallelism (potentially)
SQL Results
Res
pons
e Ti
me
Partition Table Space
![Page 7: Paralellism with DB2 for z/OS (2010)](https://reader034.vdocuments.us/reader034/viewer/2022042702/55d5189dbb61eb03128b4614/html5/thumbnails/7.jpg)
Slide 7 of 38Copyright © 2010 IBM CorporationAll rights reserved
Myth Busting DB2’s ParallelismMyth Busting DB2’s Parallelism
Batch Program Parallelism
Batch Job Part A
Batch Job Part C
Batch Job Part B
Batch Job Part D
Batch Job Part E
Part A = 1 -10Part B = 11- 20Part C = 21- 30Part D = 31- 40Part E = 40 - ?
1/5 the time, ≈1/5 the contention
…in theoryPartition Table Space
![Page 8: Paralellism with DB2 for z/OS (2010)](https://reader034.vdocuments.us/reader034/viewer/2022042702/55d5189dbb61eb03128b4614/html5/thumbnails/8.jpg)
Slide 8 of 38Copyright © 2010 IBM CorporationAll rights reserved
Myth Busting DB2’s ParallelismMyth Busting DB2’s Parallelism
Parallelism modesIn priority order
SysplexEligible for zIIP redirectEXPLAIN’s PARALLELISM_MODE=‘X'
CPU zIIP eligibleEXPLAIN’s PARALLELISM_MODE=‘C'
I/O Not eligible for zIIP redirectEXPLAIN’s PARALLELISM_MODE=‘I'
Most Common
![Page 9: Paralellism with DB2 for z/OS (2010)](https://reader034.vdocuments.us/reader034/viewer/2022042702/55d5189dbb61eb03128b4614/html5/thumbnails/9.jpg)
Slide 9 of 38Copyright © 2010 IBM CorporationAll rights reserved
Myth Busting DB2’s ParallelismMyth Busting DB2’s Parallelism
How is parallelism plan determined?Parallelism is considered for SELECT onlyIn V8 and prior
Optimizer chooses the lowest cost sequential planAnd then determines what operations of the winning plan can be executed in parallel
Optimizer
ParallelismOne, lowest cost (sequential)
plan survives
How to parallelize this plan?
![Page 10: Paralellism with DB2 for z/OS (2010)](https://reader034.vdocuments.us/reader034/viewer/2022042702/55d5189dbb61eb03128b4614/html5/thumbnails/10.jpg)
Slide 10 of 38Copyright © 2010 IBM CorporationAll rights reserved
Myth Busting DB2’s ParallelismMyth Busting DB2’s Parallelism
How is parallelism plan determined?In DB2 9
Lowest cost is AFTER parallelismOnly a subset of plans are considered for parallelism
Optimizer
Parallelism
One Lowest cost plan survives
How to parallelize
these plans?
![Page 11: Paralellism with DB2 for z/OS (2010)](https://reader034.vdocuments.us/reader034/viewer/2022042702/55d5189dbb61eb03128b4614/html5/thumbnails/11.jpg)
Slide 11 of 38Copyright © 2010 IBM CorporationAll rights reserved
Myth Busting DB2’s ParallelismMyth Busting DB2’s Parallelism
I/O Parallelism
DB2B DB2A DB2CSysplex
1 2
3
SELECT * FROM TAB1 A, TAB2 BWHERE A.COLA=B.COLZ
ORDER BY A.COLM
Introducedin DB2 V3
Not zIIP eligible
Manages concurrent I/O requests for a single query, fetching pages into the buffer pool in parallel. This processing can significantly improve the performance of I/O-bound queries.
![Page 12: Paralellism with DB2 for z/OS (2010)](https://reader034.vdocuments.us/reader034/viewer/2022042702/55d5189dbb61eb03128b4614/html5/thumbnails/12.jpg)
Slide 12 of 38Copyright © 2010 IBM CorporationAll rights reserved
Myth Busting DB2’s ParallelismMyth Busting DB2’s Parallelism
CP ParallelismIntroduced
in DB2 V4.1
Sysplex
1 2
3
DB2B DB2A DB2C
zIIP eligible
SELECT * FROM TAB1 A, TAB2 BWHERE A.COLA=B.COLZ
ORDER BY A.COLM
Enables true multitasking within a query. A large query can be broken into multiple smaller queries. These smaller queries run simultaneously on multiple processors accessing data in parallel reducing the elapsed time for each query. Starting with DB2 V8, the parallel queries exploit zIIPs when they are available on the system thus reducing the costs.
![Page 13: Paralellism with DB2 for z/OS (2010)](https://reader034.vdocuments.us/reader034/viewer/2022042702/55d5189dbb61eb03128b4614/html5/thumbnails/13.jpg)
Slide 13 of 38Copyright © 2010 IBM CorporationAll rights reserved
Myth Busting DB2’s ParallelismMyth Busting DB2’s Parallelism
Parallelism Modes - CPUCPU parallelism is not considered if:
Only one CPUCPU parallelism disabled by RLF
RLFFUNC=‘4‘ in RLF table (for plan/package/authid)
Cursor declared WITH HOLD and RR or RS isolationNo MVS enclave serviceVPPSEQT=0Ambiguous cursor with
CURRENTDATA(YES) and ISOLATION(CS)
CURRENTDATA (NO) default once again as of DB2 9
![Page 14: Paralellism with DB2 for z/OS (2010)](https://reader034.vdocuments.us/reader034/viewer/2022042702/55d5189dbb61eb03128b4614/html5/thumbnails/14.jpg)
Slide 14 of 38Copyright © 2010 IBM CorporationAll rights reserved
Myth Busting DB2’s ParallelismMyth Busting DB2’s Parallelism
Data Sharing
User Data CatalogDirectory
MemberDB2 A
MemberDB2 B
LogsBSDS
LogsBSDS
CF
A really high level view!
![Page 15: Paralellism with DB2 for z/OS (2010)](https://reader034.vdocuments.us/reader034/viewer/2022042702/55d5189dbb61eb03128b4614/html5/thumbnails/15.jpg)
Slide 15 of 38Copyright © 2010 IBM CorporationAll rights reserved
Myth Busting DB2’s ParallelismMyth Busting DB2’s Parallelism
Sysplex Query ParallelismIntroduced in DB2 V5
Sysplex
3-WayData
SharingGroup
77 88
99
44 55
66
11 22
33zIIP eligible?
SELECT * FROM TAB1 A, TAB2 BWHERE A.COLA=B.COLZ
ORDER BY A.COLM
DB2B DB2CDB2AAssistant AssistantCoordinator
DB2 can split a large query across different DB2 members in a data sharing group, known as Sysplex query parallelism.
![Page 16: Paralellism with DB2 for z/OS (2010)](https://reader034.vdocuments.us/reader034/viewer/2022042702/55d5189dbb61eb03128b4614/html5/thumbnails/16.jpg)
Slide 16 of 38Copyright © 2010 IBM CorporationAll rights reserved
Myth Busting DB2’s ParallelismMyth Busting DB2’s Parallelism
Sysplex Parallelism ConsiderationsSysplex parallelism is not considered if:
Data sharing not supportedSysplex parallelism disabled by RLF
RLFFUNC='5‘ in RLF table (for plan/package/authid)
RR or RS isolation specified
Sysplex parallelism degrades to CPU parallelism if:
Star join queryRID access or IN-list parallelismSparse index used
![Page 17: Paralellism with DB2 for z/OS (2010)](https://reader034.vdocuments.us/reader034/viewer/2022042702/55d5189dbb61eb03128b4614/html5/thumbnails/17.jpg)
Slide 17 of 38Copyright © 2010 IBM CorporationAll rights reserved
Myth Busting DB2’s ParallelismMyth Busting DB2’s Parallelism
DimensionTable
DimensionTable
DimensionTable
DimensionTable
DimensionTable
Star Schema
FactTable
Star schema = Snowflake schema
![Page 18: Paralellism with DB2 for z/OS (2010)](https://reader034.vdocuments.us/reader034/viewer/2022042702/55d5189dbb61eb03128b4614/html5/thumbnails/18.jpg)
Slide 18 of 38Copyright © 2010 IBM CorporationAll rights reserved
Myth Busting DB2’s ParallelismMyth Busting DB2’s Parallelism
Product
Store
Date
AssociatePromotion
Star Schema
Three or more tables can be joined at one timeDSNZPARM SJTABLES and STARJOIN must be setzIIP eligible
Sale
Star schema = Snowflake schema
![Page 19: Paralellism with DB2 for z/OS (2010)](https://reader034.vdocuments.us/reader034/viewer/2022042702/55d5189dbb61eb03128b4614/html5/thumbnails/19.jpg)
Slide 19 of 38Copyright © 2010 IBM CorporationAll rights reserved
Myth Busting DB2’s ParallelismMyth Busting DB2’s Parallelism
Pause for
Questions
![Page 20: Paralellism with DB2 for z/OS (2010)](https://reader034.vdocuments.us/reader034/viewer/2022042702/55d5189dbb61eb03128b4614/html5/thumbnails/20.jpg)
Slide 20 of 38Copyright © 2010 IBM CorporationAll rights reserved
Myth Busting DB2’s ParallelismMyth Busting DB2’s Parallelism
Myths?
Parallelism doesn’t work correctly.
IBM recommends “x”.
Corollary 1: PARAMDEG should be…
Corollary 2: Never exceed x degrees of parallelism
Corollary 3: Always use degree of 0 (zero)
No documentation exist for parallelism.
Parallelism is difficult to control?
![Page 21: Paralellism with DB2 for z/OS (2010)](https://reader034.vdocuments.us/reader034/viewer/2022042702/55d5189dbb61eb03128b4614/html5/thumbnails/21.jpg)
Slide 21 of 38Copyright © 2010 IBM CorporationAll rights reserved
Myth Busting DB2’s ParallelismMyth Busting DB2’s Parallelism
Pausesimply for effect
![Page 22: Paralellism with DB2 for z/OS (2010)](https://reader034.vdocuments.us/reader034/viewer/2022042702/55d5189dbb61eb03128b4614/html5/thumbnails/22.jpg)
Slide 22 of 38Copyright © 2010 IBM CorporationAll rights reserved
Myth Busting DB2’s ParallelismMyth Busting DB2’s Parallelism
Enabling Parallelism – Part 1BIND - DEGREE ANY (not 1, the default)CDSSRDEF in macro DSN6SPRM (CURRENT DEGREE on install panel)
1 is default, Valid values are 1 or ANY, Can update online
Consider taking the default
![Page 23: Paralellism with DB2 for z/OS (2010)](https://reader034.vdocuments.us/reader034/viewer/2022042702/55d5189dbb61eb03128b4614/html5/thumbnails/23.jpg)
Slide 23 of 38Copyright © 2010 IBM CorporationAll rights reserved
Myth Busting DB2’s ParallelismMyth Busting DB2’s Parallelism
Enabling Parallelism – Part 2Buffer Pool Affect on Parallelism
VPSEQT - sequential steal threshold Percentage of the total buffer pool size (VPSIZE)Default 80%
VPPSEQT - parallel sequential threshold Percentage of the VPSEQTDefault 50%VPPSEQT shuts down parallelism
VPXPSEQT - assisting parallel sequential threshold Percentage of the VPPSEQTDefault 0%
%
![Page 24: Paralellism with DB2 for z/OS (2010)](https://reader034.vdocuments.us/reader034/viewer/2022042702/55d5189dbb61eb03128b4614/html5/thumbnails/24.jpg)
Slide 24 of 38Copyright © 2010 IBM CorporationAll rights reserved
Myth Busting DB2’s ParallelismMyth Busting DB2’s Parallelism
Enabling Parallelism – Part 3Set Parallelism’s Max. Degree
Macro DSN6SPRM, keyword PARAMDEGMAX DEGREE field on install DSNTIP8 (DB2 9)Default 0Valid range 0 to 254
Online Updatable (YES)
Set the maximum degree between the # of CPs and the # of partitionsCPU intensive queries - closer to the # of CPsI/O intensive queries - closer to the # of partitionsData skew can reduce # of degrees
![Page 25: Paralellism with DB2 for z/OS (2010)](https://reader034.vdocuments.us/reader034/viewer/2022042702/55d5189dbb61eb03128b4614/html5/thumbnails/25.jpg)
Slide 25 of 38Copyright © 2010 IBM CorporationAll rights reserved
Myth Busting DB2’s ParallelismMyth Busting DB2’s Parallelism
Disabling ParallelismDisabling parallelism:
For dynamic SQL:SET CURRENT DEGREE = '1' Install value CURRENT DEGREE sets special register
For DSNZPARM, CDSSRDEF in macro DSN6SPRM
For static SQL:DEGREE(1) at BIND PACKAGE or BIND PLAN
ALTER BUFFERPOOL(BPx) VPPSEQT(0) Resource Limit Facility (RLST)Add row for plan, package, or authid with RLFFUNC
3 disables I/O parallelism 4 disables CP parallelism 5 disables Sysplex query parallelism Need row for each type to disable all types
![Page 26: Paralellism with DB2 for z/OS (2010)](https://reader034.vdocuments.us/reader034/viewer/2022042702/55d5189dbb61eb03128b4614/html5/thumbnails/26.jpg)
Slide 26 of 38Copyright © 2010 IBM CorporationAll rights reserved
Myth Busting DB2’s ParallelismMyth Busting DB2’s Parallelism
EXPLAIN
PARALLELISM_MODE='I', 'C', or 'X'I - parallel I/O operationsC - parallel CP operations X - Sysplex query parallelism
![Page 27: Paralellism with DB2 for z/OS (2010)](https://reader034.vdocuments.us/reader034/viewer/2022042702/55d5189dbb61eb03128b4614/html5/thumbnails/27.jpg)
Slide 27 of 38Copyright © 2010 IBM CorporationAll rights reserved
Myth Busting DB2’s ParallelismMyth Busting DB2’s Parallelism
Parallelism and DSNZPARM PTASKROL in macro DSN6SYSP
YES is default, Valid values are YES or NO, Can update onlineAccounting trace rollupPerformance verses granularity
![Page 28: Paralellism with DB2 for z/OS (2010)](https://reader034.vdocuments.us/reader034/viewer/2022042702/55d5189dbb61eb03128b4614/html5/thumbnails/28.jpg)
Slide 28 of 38Copyright © 2010 IBM CorporationAll rights reserved
Myth Busting DB2’s ParallelismMyth Busting DB2’s Parallelism
DSNZPARM
ZPARM PARAPAR1More aggressive parallel exploitation for IN list predicatesV7 & V8 APAR PQ87352 (April 2004)Removed in DB2 9
These ZPARMs are usually used under IBM’s guidance
![Page 29: Paralellism with DB2 for z/OS (2010)](https://reader034.vdocuments.us/reader034/viewer/2022042702/55d5189dbb61eb03128b4614/html5/thumbnails/29.jpg)
Slide 29 of 38Copyright © 2010 IBM CorporationAll rights reserved
Myth Busting DB2’s ParallelismMyth Busting DB2’s Parallelism
Lower BoundTo avoid parallelism for short running queries
DSNZPARM SPRMPTH on DSN6SPRC macroQuery block with a cost lower than SPRMPTH will not choose parallelism
Default = 120 msec
Parallelism
No Parallelism
120 SPRMPTH
0APAR PQ25135 (V6), APAR PQ45820
![Page 30: Paralellism with DB2 for z/OS (2010)](https://reader034.vdocuments.us/reader034/viewer/2022042702/55d5189dbb61eb03128b4614/html5/thumbnails/30.jpg)
Slide 30 of 38Copyright © 2010 IBM CorporationAll rights reserved
Myth Busting DB2’s ParallelismMyth Busting DB2’s Parallelism
Cost-Based Parallel SortDB2 V8 introduces cost-based consideration to determine if parallel sort for single or multiple (composite) tables should be disabled
Sort data size < 2 MB (500 pages)Sort data per parallel degree < 100 KB (25 pages)
Hidden DSNZPARM OPTOPSEcontrol - default is ONON - cost-based parallel sort considerations for both single table and multi-tableOFF - not cost-based - sort parallelism behavior same as V7, i.e.
Single (composite) table : parallel sortMultiple tables : sequential sort only
Considerations:Elapsed time improvementMore usage of workfiles and virtual storage
![Page 31: Paralellism with DB2 for z/OS (2010)](https://reader034.vdocuments.us/reader034/viewer/2022042702/55d5189dbb61eb03128b4614/html5/thumbnails/31.jpg)
Slide 31 of 38Copyright © 2010 IBM CorporationAll rights reserved
Myth Busting DB2’s ParallelismMyth Busting DB2’s Parallelism
DB2 will use a higher degree of parallelism for read-only queries, batch jobs, and utilities when batch jobs are run in parallel and each job goes after different partitions. Parallel processing is most efficient when you spread the partitions over different disk volumes and allow each I/O stream to operate on a separate channel
![Page 32: Paralellism with DB2 for z/OS (2010)](https://reader034.vdocuments.us/reader034/viewer/2022042702/55d5189dbb61eb03128b4614/html5/thumbnails/32.jpg)
Slide 32 of 38Copyright © 2010 IBM CorporationAll rights reserved
Myth Busting DB2’s ParallelismMyth Busting DB2’s Parallelism
Parallelism Helps Fully Utilize zIIPSQL could be tuned to increase parallelismParallel child task will run on zIIP
Threshold exist that control when child goes to zIIP Parallel child tasks get higher % redirect than DRDA
Applies to local or distributedLocal non-parallel obtains 0% redirectDistributed non-parallel obtains x% redirectParallel obtains x++% redirect
Except first “y” milliseconds
If you want to reduce TCOExploit your zIIP as much as possible
Key is to increase parallelism for your queries
![Page 33: Paralellism with DB2 for z/OS (2010)](https://reader034.vdocuments.us/reader034/viewer/2022042702/55d5189dbb61eb03128b4614/html5/thumbnails/33.jpg)
Slide 33 of 38Copyright © 2010 IBM CorporationAll rights reserved
Myth Busting DB2’s ParallelismMyth Busting DB2’s Parallelism
Tips to Optimize ParallelismPartition size does matter; the closer in size the partitions, the better The more CPs (and zIIPs) available, the better the degree of parallelism that might be achievedSeparating partitions across as many I/O devices & I/O paths as possible can improve parallelism's performanceFor CPU intensive queries, try to make the number of partitions and number of CPs as close as possiblePlace the partitions (table spaces & indexes) on separate disk volumes and separate control units if possible to minimize contention Execute RUNSTATS on a regular basis to maintain accurate partition level stats Monitor buffer pool sizes and thresholds to make sure they are adequate to maximize parallelism’s performance
![Page 34: Paralellism with DB2 for z/OS (2010)](https://reader034.vdocuments.us/reader034/viewer/2022042702/55d5189dbb61eb03128b4614/html5/thumbnails/34.jpg)
Slide 34 of 38Copyright © 2010 IBM CorporationAll rights reserved
Myth Busting DB2’s ParallelismMyth Busting DB2’s Parallelism
Final Disclaimer
Customers can design to encourage parallelism
However, there is no guarantee that parallelism will be achieved
Some restrictions on parallelism still existDB2 Optimizer Development are working to reduce restrictions
Substantial improvements in DB2 9More improvements in DB2 10 And the future?????
![Page 35: Paralellism with DB2 for z/OS (2010)](https://reader034.vdocuments.us/reader034/viewer/2022042702/55d5189dbb61eb03128b4614/html5/thumbnails/35.jpg)
Slide 35 of 38Copyright © 2010 IBM CorporationAll rights reserved
Myth Busting DB2’s ParallelismMyth Busting DB2’s Parallelism
Questions
![Page 36: Paralellism with DB2 for z/OS (2010)](https://reader034.vdocuments.us/reader034/viewer/2022042702/55d5189dbb61eb03128b4614/html5/thumbnails/36.jpg)
Slide 36 of 38Copyright © 2010 IBM CorporationAll rights reserved
Myth Busting DB2’s ParallelismMyth Busting DB2’s Parallelism
More References
My Blog: “Getting the Most out of DB2 for z/OS and System z”
http://blogs.ittoolbox.com/database/db2zos
![Page 37: Paralellism with DB2 for z/OS (2010)](https://reader034.vdocuments.us/reader034/viewer/2022042702/55d5189dbb61eb03128b4614/html5/thumbnails/37.jpg)
Slide 37 of 38Copyright © 2010 IBM CorporationAll rights reserved
Myth Busting DB2’s ParallelismMyth Busting DB2’s Parallelism
![Page 38: Paralellism with DB2 for z/OS (2010)](https://reader034.vdocuments.us/reader034/viewer/2022042702/55d5189dbb61eb03128b4614/html5/thumbnails/38.jpg)
Slide 38 of 38Copyright © 2010 IBM CorporationAll rights reserved
Myth Busting DB2’s ParallelismMyth Busting DB2’s Parallelism
Willie FaveroSenior Certified Consulting IT Software Specialist
Dynamic Warehousing on System z Swat TeamIBM Silicon Valley Laboratory
IBM Academic Initiative Ambassador for System zIBM Certified Database Administrator - DB2 Universal Database V8.1 for z/OS
IBM Certified Database Administrator – DB2 9 for z/OSIBM zChampion