topic Re: data transmitting help in Application Development and Automation Discussions

data transmitting help

Former Member — Wed, 16 Jun 2010 17:12:15 GMT

I have a file which consists of around 100 thousand records of Internal Orders.

I need to take that as an input from a text file and upload the same into my report program and get the corresponding records from AUFK table.

Once I get the details I need to prepare a file and upload the same in application server.

We have a middle ware system, which takes the file and send it to downstream systems.

Question here how to handle such a huge file of 100 thousand records or internal order numbers and feed to the report as an input.

Can anyone clarify the same.

I can upload using a file and in the presentation server. Or use application server and take it from there.

Please suggest me.

Re: data transmitting help

Former Member — Wed, 16 Jun 2010 17:31:38 GMT

You could segment your input, creating separate output files, and run single- or multi-thread.

Re: data transmitting help

Former Member — Wed, 16 Jun 2010 18:34:31 GMT

Follow these steps.

1- Create an internal table in your program which corresponds to the columns of ur excel file.

2- Use GUI_UPLOAD to transfer the data to your internal table

3- Fill the rest of the data from SAP table.

4- Now your internal table is ready

5- Upload the file on APP Server using this code;

* Place file on server
    OPEN DATASET v_file FOR OUTPUT IN TEXT MODE ENCODING DEFAULT.

    LOOP AT tbl_itab.
      TRANSFER tbl_itab-text TO v_file.
    ENDLOOP.

    CLOSE DATASET v_file.

Performance could be a problem for this massive data. But there is no way as you need to process all the data. Either you can make the size of file small or use this program in background if it dumps out in foreground.

Thanks,

Re: data transmitting help

Former Member — Wed, 16 Jun 2010 18:55:00 GMT

It may dump in background as well....problem is more likely to be exceeding the max size of the user context than exceeding time limits, unless there's a lot more processing that has been described thus far. But there's little risk of either, based on current description of work to be done...I routinely process >100K records without difficulty using read dataset, etc.

Re: data transmitting help

Former Member — Wed, 16 Jun 2010 19:05:45 GMT

FTP your file to the application server. Then use OPEN and READ DATASET to read and then process it. Finally, write your processed file back to the ap server.

Rob