Where to deploy RAG application for SAP Gen AI Hub

[JunTaiPhoon]

Hi,

What are the best practices recommended by SAP regarding hosting the RAG application that is used to provide context for the LLM model being setup in SAP Gen AI Hub?

In one of the SAP training sessions for SAP Generative AI Hub, the SAP trainers had introduced using Business Application Studio (BAS) as the development platform. For the RAG application that is being developed in BAS, must it be containerized through Docker and deployed it in Cloud Foundry to be consume by some other SAP services e.g. SAP Build App? Is there any alternative to this?

Thank you.

[Vitaliy-R]

Could you please share a few more details? What do you mean by the "app": just a back-end service, or front-end as well? What programming language would you use?

[JunTaiPhoon]

Hi @Vitaliy-R ,

Thanks for your response. The app which I am referring to is the backend service app where my RAG implementation will be in. I am coding in Python and using this as a server code. Where can I host this code, so its API is accessible by other services in BTP?

Please refers to the rough visualization below. I would like to know which the best place is to host the Python back-end code. Currently I am looking into containerizing the Python code with Docker and deploy the docker image in SAP Cloud Foundry. Is that a proper way to do it?