Automate csv files upload to Datasphere (dynamic filename)

[arpangupta]

Hi,

I have multiple csv in a SFTP location, all with same number of columns. The name of the csv files are based on the current month for example : File_2024_01.csv, File_2024_02.csv and so on. I want to automate this file load in datasphere, so that when data is requested by datasphere, it only picks up the current month file.

Additionally, Is there any way to load all of the csv inside a folder/location to datasphere?

SAP Datasphere 

Regards,

Arpan

[PrasannaL_Kona]

There is this option that could be a potential use case of yours either on premise or on cloud scenarios. Give it a try and Hope it works for you

[arpangupta]

Thanks for your inputs. I already have a SFTP connection. Now the problem is, every month there is a new file, like File_2027_07.csv for July. But the old files for June, may etc are already present there. I want to automate the data load in datasphere, so that, it only picks up the current file to load. Would appreciate, if you have any hints on that. Thanks

[raj_vangala]

Hi Arpan, did you manage to find a solution or workaround to process .csv files with dynamic file names? Thanks Raj