While using the sap generative ai hub python sdk to utilize the AI models like GPT 4o, there seems to be an issue regarding the calls. I have utilized the API calls in a loop such that mutiple calls are made one after the other, but the issue I face is that suddenly after some calls, the application just get stuck at fetching the output results. And the reason is unclear as its just random when this happens. Seems no error in the code as there are no exceptions raised as well. It just stops fetching at any random point in the loop. Its true when using embedding models as well. I did go through the documentation for the SDK but found nothing relevant. A help would be appreciated. The application is hosted in SAP BTP cloud foundry environment
Python #SAPGenerativeAIHubSDk #SAPAICORE
Bluesky
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.