SAP AI Core SDK

MarioDeFelipe · ‎2024 Mar 19

In today's fast-paced digital landscape, businesses are increasingly turning to artificial intelligence (AI) to gain a competitive edge. SAP has recognized this trend and has developed a suite of powerful SDKs (Software Development Kits) to help organizations seamlessly integrate AI capabilities into their applications and workflows. In this blog post, we will explore the different SAP AI SDKs, their functionalities, and the value they bring to customers and if I miss any of them, let me know!

SAP AI Core SDK

The [SAP AI Core SDK](https://pypi.org/project/ai-core-sdk/) is a Python-based SDK that allows developers to access and interact with the SAP AI Core service using Python methods and data structures. This SDK provides a comprehensive set of tools to manage AI scenarios and workflows within SAP AI Core.

AI Core Key Features
Scenario Management	Create, update, and manage AI scenarios and executables.
Workflow Execution	Execute pipelines as batch jobs for tasks such as preprocessing, training models, or performing batch inference.
Model Deployment	Deploy trained machine learning models as web services to serve high-performance inference requests.
Infrastructure Integration	Register Docker registries, synchronize AI content from Git repositories, and register object stores for training data and models.
Metrics Tracking	Log and track metrics within workflow executions for monitoring and analysis.

The SAP AI Core SDK simplifies the development process by providing a unified interface to interact with SAP AI Core. This enables developers to focus on building and deploying AI solutions without worrying about the underlying infrastructure complexities.

Captura de pantalla 2024-03-18 a las 16.11.57.png

Key GitHub repositories that leverage the SAP AI SDKs:

[SAP-samples/ai-core-samples](https://github.com/SAP-samples/ai-core-samples)

This repository contains sample code and examples of the SAP AI Core SDK that can be used to interact with SAP AI Core. It demonstrates how to create clients, manage resource groups, track metrics during training, and deploy inference services.

[SAP-samples/azure-openai-aicore-cap-api](https://github.com/SAP-samples/azure-openai-aicore-cap-api)

This repository shows how to deploy an inference service on SAP AI Core that acts as a proxy for Azure OpenAI Services. It leverages the SAP AI Core SDK to create and manage the necessary resources.

[SAP-samples/aicore-multioutput-regression-restaurant-inspections](https://github.com/SAP-samples/aicore-multioutput-regression-restaurant-inspections)

This repository demonstrates a machine learning service that leverages the capabilities of SAP BTP (SAP AI Core and SAP AI Launchpad) for criticality assessments, likely using the SAP AI Core SDK.

[SAP-samples/teched2023-AI269](https://github.com/SAP-samples/teched2023-AI269)

This repository contains materials for a TechEd session on prompt engineering with the SAP Generative AI Hub, suggesting the use of the SAP Generative AI Hub SDK.

[SAP-samples/teched2023-AI266](https://github.com/SAP-samples/teched2023-AI266)

This repository provides a hands-on lab for working with SAP AI Core and SAP AI Launchpad, likely leveraging the SAP AI Core SDK and AI API Client SDK.

These repositories cover various use cases, such as interacting with SAP AI Core, deploying inference services, leveraging generative AI models, and integrating with other services like Azure OpenAI. They serve as valuable resources for developers looking to leverage the capabilities of SAP's AI SDKs in their projects.

AI API Client SDK

The [AI API Client SDK](https://pypi.org/project/ai-api-client-sdk/) is a Python library that allows developers to interact with the AI API, a standardized interface for managing the AI scenario lifecycle across different runtimes, including SAP AI Core and other partner technologies.

AI API Client Key Features
Scenario Lifecycle Management	Create, update, and manage AI scenarios, executables, and configurations.
Execution Management	Trigger and monitor AI workflow executions
Model Management	Deploy, update, and undeploy machine learning models for serving inference requests.
Runtime Agnostic	Interact with AI scenarios across multiple runtimes, including SAP AI Core and partner technologies.

The AI API Client SDK provides a consistent and unified way to manage AI assets, regardless of the underlying runtime environment. This abstraction layer simplifies the development process and promotes portability, allowing organizations to leverage AI capabilities across different platforms and technologies.

SAP Generative AI Hub SDK

The [SAP Generative AI Hub SDK](https://pypi.org/project/generative-ai-hub-sdk/) is a Python library that enables developers to interact with the SAP Generative AI Hub, a platform that provides access to a broad range of large language models (LLMs) from various providers, such as GPT-4 by Azure OpenAI or open-source models like Falcon-40b.

Generative AI Hub Key Features
LLM Access	Submit prompts to multiple LLMs and compare the generated outcomes to identify the best-suited model for a given task.
Prompt Engineering	Leverage tooling for prompt engineering, experimentation, and other capabilities to accelerate the development of applications infused with generative AI.
Prompt History	Gain greater control and transparency with built-in prompt history tracking.
Secure and Trusted	Access LLMs in a secure and trusted environment, ensuring compliance and data privacy.

The SAP Generative AI Hub SDK empowers developers to harness the power of generative AI, enabling them to create innovative applications that leverage the capabilities of state-of-the-art language models while maintaining control, transparency, and compliance.

Captura de pantalla 2024-03-18 a las 16.13.38.png

[SAP-samples/btp-generative-ai-hub-use-cases](https://github.com/SAP-samples/btp-generative-ai-hub-use-cases)

This repository contains samples on how to build industry solutions leveraging generative AI capabilities on top of SAP BTP, integrated with SAP S/4HANA Cloud. It likely utilizes the SAP Generative AI Hub SDK.

AI Core LLM

The [AI Core LLM](https://pypi.org/project/sap-ai-core-llm/) is a Python library that provides a unified interface for interacting with large language models (LLMs) deployed on SAP AI Core. This SDK abstracts away the complexities of working with different LLM providers and models, allowing developers to focus on building applications that leverage the power of language models.

AI Core LLM Key Features
LLM Integration	Seamlessly integrate LLMs from various providers, such as OpenAI, Anthropic, and others, into your applications.
Unified Interface	Interact with different LLMs using a consistent and standardized API, simplifying development and promoting code reusability.
Prompt Management	Manage and version-control prompts, enabling efficient collaboration and reproducibility.
Monitoring and Logging	Monitor and log LLM interactions for auditing, debugging, and performance analysis.

The AI Core LLM SDK streamlines the development process by providing a unified interface for working with LLMs, enabling developers to leverage the power of language models without being tied to specific providers or models.

Conclusion

SAP's suite of AI SDKs empowers organizations to unlock the full potential of artificial intelligence and seamlessly integrate AI capabilities into their applications and workflows. From managing AI scenarios and workflows to deploying machine learning models and leveraging the power of generative AI, these SDKs provide a comprehensive set of tools and utilities to accelerate AI adoption and drive innovation.