Data Services Inserts into MySQL cloud instance (CloudSQL) are very slow

Former Member — Sun, 22 Apr 2018 13:41:36 GMT

Hi,

We are using Data Services 4.2sp8 to load data into MySQL in the cloud (CloudSQL in the google cloud). The insert rate is very low ~ 40 rows/sec through a single loader using the standard MySQL driver so is unusable. We believe this due to each insert being sent individually so having a call round trip overhead per insert row.

MySQL has a batch insert construct where multiple row values are supplied in a single call. Does anyone know if this can be configuration and used or indeed any other way to increase load throughput?

We have created manual load via a FF using MySQL's 'LOAD DATA LOCAL INFILE' which is not ideal requiring local storage space, configuration etc.

Thanks in advance

Re: Data Services Inserts into MySQL cloud instance (CloudSQL) are very slow

Former Member — Mon, 23 Apr 2018 12:20:25 GMT

Not sure if the Cloud SQL(Database as a Service) Database service for MySQL is supported. As per the Product Availability attached are the Cloud platforms supported by Data Services

Regards

Arun Sasi

Question Re: Data Services Inserts into MySQL cloud instance (CloudSQL) are very slow in Technology Q&A

Data Services Inserts into MySQL cloud instance (CloudSQL) are very slow

Re: Data Services Inserts into MySQL cloud instance (CloudSQL) are very slow