Incomplete FTP read

[#1]

Hi,

In my File to Idoc scenario, when I am testing with big file, it gets failed sometimes. The reason being the file is read by the adapter even before it is completely ftped.

I have checked with "Msecs to wait before modification check" but it is not working in my case. I think it works only for NFS.

Pls let me know if there is any work around in XI for this?

regards

Anirudh.

[Former Member]

Hi,

better to handle this within FTP Server level. Create a mother folder which holds all data and schedule a script which will transfer all files which are complete to the source dir from where xi picks up.

this solves the prob

if u know the File dump time then it is better to use CC schedule time

as said u need to adjust with the parties to go ahead

srini

[Former Member]

Hi Venkat,

How to check in shell script if the ftp is complete or not?

Can you suggest any code or link as I can't locate anything?

regards,

Anirudh.

[Former Member]

Hello Aniruddh,

I got this command from one of the blogs. Try to set it in advanced mode

'file.processingLocked=YES|NO'

you need to give the value as yes.

Am not sure whether this would be given in advanced tab or in file content conversion.

Try it in Advanced mode and add these value.

Regars

Krish

[Former Member]

Hi,

This is the best approach.

generally its better idea to get the file to a intermediate directory on same machine before actually moving to the directory being polled by the XI. This way once the entire file is written then it will be moved fast inside the same machine, so u dont get this kind of problems.

Createa shell script that moves from intermeditate drectory to actual directory, it should be fast and wont end up in a problem.

Regards

Krish

[Former Member]

Hi Krish,

I have tried this approach.

To my horror, it doesn't work as expected.

Suppose, CC is polling /tmp/BI

Now if I ftp the file to /tmp and in the middle of FTP if I mv the file to BI, it does gets moved and FTP continues without truncation to this new folder /tmp/BI.

I am now thinking of telling the sender party to ftp the file with tmp extension and then rename it to .txt after completing the ftp.

regards,

Anirudh.

[Former Member]

Hi,

Did you try this option.

'file.processingLocked=YES|NO'

[Former Member]

Hi ,

Check the size of the file continously and if the file size doesnot changed then copy it to the source directory from where xi picks up the file for ftp

see

http://www.unix.com/shell-programming-scripting/32809-have-shell-script-check-file-exist-before-proc...

hope it wud give u a idea. ...am not good at scripts

srini

[Former Member]

Hi Anirudh

You can write script to identify the end of file and then move it to another folder. Let the client system write file in one location and when it it complete you can write it to another folder where PI is polling

This even you can do for your .dat to .txt file script.

Refer

http://www.unix.com/shell-programming-scripting/44888-adding-new-line-end-file.html

Thanks

Gaurav