Application Development and Automation Discussions
Join the discussions or start your own on all things application development, including tools and APIs, programming models, and keeping your skills sharp.
cancel
Showing results for 
Search instead for 
Did you mean: 
Read only

DATASET TRANSFER slow

Former Member
0 Likes
1,096

Hi experts,

I come to you with a question that may be abap related or not, I am not sure. We have a extraction program that simply gets records form database and creates a flat text file with them. The performance of the program is pretty decent with certain amounts of data, for example with 1 million records the program creates the file in 12 minutes. But when I execute a job in background, for ~5 million records, the program gets really slow when writing the records. I know the SELECT statement performance is normal, but the LOOP that does the TRANSFER gets really slow, it processes 1000 or 2000 in 10 minutes.

Some details:

- This is a testing environment, there are no other processes running, besides me just 1 or 2 people are working on this environment.

- Windows NT - 6X AMD64

- I am doing a regular OPEN DATASET lv_file FOR OUTPUT MESSAGE lv_msg IN TEXT MODE ENCODING DEFAULT

- Then I just do a TRANSFER

Any suggestion will be appreciatted.

1 ACCEPTED SOLUTION
Read only

Former Member
0 Likes
893

I have figured it out... within my loop I was reading a internal table that had 2 million records, this was slowing down my program,

Hi experts,

I come to you with a question that may be abap related or not, I am not sure. We have a extraction program that simply gets records form database and creates a flat text file with them. The performance of the program is pretty decent with certain amounts of data, for example with 1 million records the program creates the file in 12 minutes. But when I execute a job in background, for ~5 million records, the program gets really slow when writing the records. I know the SELECT statement performance is normal, but the LOOP that does the TRANSFER gets really slow, it processes 1000 or 2000 in 10 minutes.

Some details:

- This is a testing environment, there are no other processes running, besides me just 1 or 2 people are working on this environment.

- Windows NT - 6X AMD64

- I am doing a regular OPEN DATASET lv_file FOR OUTPUT MESSAGE lv_msg IN TEXT MODE ENCODING DEFAULT

- Then I just do a TRANSFER

Any suggestion will be appreciatted.

2 REPLIES 2
Read only

Former Member
0 Likes
893

Hello Carlos,

Can you post your code? Will be easier to analyse whats wrong.

Cya!

Read only

Former Member
0 Likes
894

I have figured it out... within my loop I was reading a internal table that had 2 million records, this was slowing down my program,