cancel
Showing results for 
Search instead for 
Did you mean: 

Loading data from Flat file to Staging table

Former Member
0 Kudos

Hi ,

what is the best way in BODS to load bulk data from flat file to staging table in very less time?.

I am using Flat File--->Query--->Staging table in Job with bulk load option checked,Source file has 83 Column and 3 millions records its taking 15 min to load the data.

Any other suggestion for this?.

Thanks-

Amit

Accepted Solutions (0)

Answers (3)

Answers (3)

former_member187605
Active Contributor
0 Kudos

You'll first have to find out where the bottleneck is. Chances are high it's your input file (you can find out by not writing anything to the the db and compare execution times).

If that's really the case, none of the proposed actions (db loaders, DOP, commit size) will work. Your file is read sequentially anyway, only a faster disk will help.

former_member208402
Active Contributor
0 Kudos

Hi Amit,

Try this


1) increasing DOP (Degree of parallelism). You will find this in Dataflow properties.

2) Increase rows per commit in the target table options.

Thanks,

Ravi kiran.

Former Member
0 Kudos

Try changing the Number of default loader.You will find this option in the target table if you double click on it.A value >1 will enable parallel load

you can also check the below link.

The Impact of Number of Loaders - Enterprise Information Management - SCN Wiki