CI: Persist Message - BTP Object Store

[rupertc]

Hi,

According to Using Data Storage Features When Designing Integration Flows | SAP Help Portal, for the use case "Store data to access it after message processing has finished (for example, for purposes such as error analysis and audit logging)." SAP recommends using either "Message Store" via a Persist step or "Message processing log attachment" via script.

I can successfully persist to message store in an iflow, and retrieve via Message Store API.

Now, according to the page Data Storages | SAP Help Portal under Tenant Database, it says

• Message store content (retention period: 30 days)

  When you use Cloud Integration in the Cloud Foundry environment, message store content is stored in the SAP BTP object store.

• Message processing log attachments

  When you use Cloud Integration in the Cloud Foundry environment, message processing log attachments are stored in the SAP BTP object store.

we are using cloud foundry, and in BTP, i can see that the Object Store Service has not been activated. i would have rather expected to get an error when trying to persist message if BTP object store service is not available. seems not to be in line with the above documentation that states in cloud foundry the message store content is stored in the BTP object store.

1. so where is this data being stored?

2. If we would activate the Object Store service in BTP (see also What Is Object Store? | SAP Help Portal) , how to make cloud integration use it for persist step / MPL attachments instead of whatever storage it is currently using (when BTP Object Store is not activated)?

3. Would it be correct understanding that by using Object Store in BTP that persisted message store data and MPL attachments could be written to Azure Blob Storage (via BTP Object store) and thus the 32GB tenant database storage limitation and 1GB per day MPL Attachment limitation, would no longer be relevant for Message Store (Persist Message) and MPL Attachment storage but rather limits would be dependent on our service plan regarding BTP object store/blob storage.

4. Other than the reference to BTP object store in the documentation linked in my question, i don't find any detailed documentation about the relationship/setup between Message stores / MPL Attachments and BTP Object Store. is there some more information somewhere?

any insights would be much appreciated.

Rupert

[alex_bundschuh]

with MPL I meant persisted message

according to https://help.sap.com/docs/CLOUD_INTEGRATION/368c481cd6954bdfa5d0435479fd4eaf/e12c09cc8e9b4574b092d89... quota is 35GB

Alex

[alex_bundschuh]

Hi Rupert,

the information in the integration flow design guidelines applies to Neo environment only, for CF the figure is not correct, this needs to be updated, for CF the MPL and the MPL attachments are stored in the object store as described here https://help.sap.com/docs/CLOUD_INTEGRATION/368c481cd6954bdfa5d0435479fd4eaf/31efe35bdf65422a8df18a0..., the object store is automatically used, no need to explicitly activate the same.

If you need to store very high number of MPL entries exceeding the quota, you have the option to use the external logging feature providing an integration with Splunk although it stores MPLs only, no MPL attachments, see https://help.sap.com/docs/CLOUD_INTEGRATION/368c481cd6954bdfa5d0435479fd4eaf/ad719c1c2ecb48b6ba275d2...

Alex

[rupertc]

Hi Alex,

thanks for the answer.

so if i understand correctly, we do not need to provision the Object Store Service in our BTP subaccount, nor choose a service plan for it, nor configure object store service to use Azure blob storage? i am curious how object store will connect to azure blob storage if none of that is needed.

you mentioned MPLs are also stored in Object Store .so in summary Message Store Content (e.g. Persisted Messages), MPLs and MPL attachments are all stored via Object store to Azure blob storage?

you mention quotas for MPL entries - what are the quotas regarding object store storage. i only find quotes regarding the tenant database 32 GB and 1GB/day for MPL Attachments. but if message store content, MPLs, and MPL attachments are all being stored (via Object Store service) in storage such as Azure Blob storage associated with object store, what quotas apply there? i see the service plan if we would provision the object store service is in blocks of 100GB. but find no information about quotas. I understood that using object store is scalable.

so its not clear what quotas apply for things stored via object store on BTP rather than in the tenant database.

thanks again for your help (btw, the link you provided was the document i referenced and quoted from in my question so it did not really give me any more info than i already had)