7/28/2019 Bulk Loading

1/2

/16/12 SAP Community Network Wiki - Enterprise Information Management - Bulk Loading

ki.sdn.sap.com/wiki/display/EIM/Bulk+Loading

Added by Brandon Jacobs on, last edited by Richard LeBlanc on Jun 28, 2012

Welcome, GuestLoginRegister

Getting StartedNewslettersStore

SolutionsServices & SupportAbout SCN

DownloadsIndustriesTraining & EducationPartnershipDeveloper CenterLines of BusinessUniversity AlliancesEvents & WebinarsInnovation

Bulk Loading

For improved perf ormance w hen using change data capture (CDC) or auto corr ect load, Data Services uses a temporary s taging table in HANA to load the target table.

Design

Data Services first loads the data into a staging table and then it applies the operation codes (INSERT, UPDATE, and DELETE) to update the target table.

With the Bulk load option selected in the target table editor, any one of the f ollowing conditions triggers the staging mechanism

The data flow contains a Map_CDC_Operation transform

The data flow contains a Map_Operation trans for m that outputs UPDATE or DELETE row s

The data flow contains a Table_Comparison transf orm

The Auto correc t load option in the target table editor is set to Yes

If none of these conditions are met, that means the input data contains only INSERT row s. Therefore Data Services does only a bulk insert operation, w hich does not require a

staging table or the need to execute any additional SQL.

Settings

Template Tables

For template tables, select the appropriate table type f or your SAP HANA target

Column Store (default)

Row Store

http://wiki.sdn.sap.com/wiki/display/EIM/Bulk+Loadinghttp://wiki.sdn.sap.com/community/developer-centerhttp://www.sapstore.com/http://scn.sap.com/community/newslettershttp://scn.sap.com/community/getting-startedhttp://www.sdn.sap.com/irj/scn/registerhttp://www.sdn.sap.com/irj/scn/logon?redirect=/irj/scn/wiki?path=/pages/viewpage.action?pageId=272794229http://wiki.sdn.sap.com/wiki/display/~mefx7sghttp://wiki.sdn.sap.com/wiki/display/~oym9dyu

7/28/2019 Bulk Loading

2/2

/16/12 SAP Community Network Wiki - Enterprise Information Management - Bulk Loading

ki.sdn.sap.com/wiki/display/EIM/Bulk+Loading

All Tables

When bulk loading is enabled, you have the f ollowing options

Mode: Specify the mode for loading data to the target table:

Append: Adds new records to table (default)

Truncate: Deletes all existing records in table then adds new records

Commit Size - The maximum number of row s loaded to the staging and target tables before saving the data

Column Store (default commit size is 10,000)

Row Store (default commit size is 1,000)

Update Method Specify how the input rows are applied to the target table

UPDATE: Issues an UPDATE to the target table (default for Column Store tables)

DELETE-INSERT: Issues a DELETE to the target table f or data that matches the old data in the s taging table, then issues an INSERT with the new data (default for Row Store tables )

Do not use DELETE-INSERT if the update row s do not contain data f or all columns in the target table because Data Services w ill replace missing data w ith NULLs.

Follow SCN

Contact UsSAP Help Portal

PrivacyTerms of UseLegal DisclosureCopyright

http://www.sap.com/corporate-en/our-company/legal/copyright/index.epxhttp://www.sap.com/corporate-en/our-company/legal/impressum.epxhttp://www.sdn.sap.com/irj/scn/policyhttp://www.sdn.sap.com/irj/scn/policy?view=PPhttp://help.sap.com/http://scn.sap.com/docs/DOC-18476http://bit.ly/SCNLnIhttp://bit.ly/SCNyouThttp://bit.ly/SCNFBhttp://bit.ly/SCNTwRhttp://bit.ly/SCNFlr