I am involved in a retail project, and for requirments from of business we have to upload every day two files from each one of POS (point of sales) from 2,000 storages. the size for those files is not up to 7 kb, the real problem is that until today I cannot find a solution to upload this 4,000 files daily.
Let me mentioned, each one of these files are upload to a different cube.
I made some test tried to append the files, creating a one files for each one, that´s was ok, but the test just is using 24 files.
Of course the flat files are on application server and from there are uploaded.
I hope that some of you can help me with some alternative.
Do those files have the same format? If yes, then maybe you can concatenate all those files into 1 file and upload that. 4000 x 7kb is not a very big file anyway. You can then just use 1 InfoPackage for the resulting file.
If the file names of the files have some pattern (e.g. the names are file1.dat, file2.dat, file10.dat etc.) then maybe you can use the CAT command in unix to create the "big" file. For example, to create a final file for all files starting with the string "file" then you can use the following command:
cat file* > final_file.dat
Then load final_file.dat using 1 InfoPackage. Note that you can also use the windows copy command (e.g. copy file*.dat final_file.dat).
You can schedule the command to run in the BW server using SM36/SM37 "External Command" Option. After that, you can trigger your InfoPack.
Hope this helps.
You said "each one of these files are upload to a different cube"
"upload this 4,000 files daily"
I hope you meant 2 cubes, not 4,000 ...lol
See if your ABAP guy can read all the files and upload them into two new tables/files. Then, you can load from new table/new files to infoProviders.
You can run this ABAP in Process Chain also as usual.