How to Reduce Import Time for 1M Records in SAP Customer Data Cloud Dataflow?

[Rvanjari]

I am using SAP Customer Data Cloud Dataflow to import user accounts into the system (site). However, the import process for 1 million records takes around 20 hours. I am looking for ways to optimize and reduce the import time.

Are there any best practices, configurations, or parallel processing techniques that can help improve performance? Any guidance or recommendations would be greatly appreciated.

Thanks in advance!

[samuelyang]

Hi @Rvanjari 

I'm not sure from which systems and by which methods like API or file you're importing the user accounts to CDC, could you also check the other system and make sure the data extraction and transmission performance of the source system is good.
On the CDC side, you may try splitting the 1M user records to multiple batches and running multiple dataflows in parallel, it might improve the performance.