- SAP Managed Tags:
Summer slowly comes to an end (at least in the northern hemisphere 😉) which is kind of sad, but this also means, I am happy to announce the third delivery of SAP HANA Cloud in 2024.
Before jumping right into the contents, let me recommend watching this 4-minute video for an overview of the highlights of the release. And now, without further ado, let’s walk through the innovations one by one.
Innovations in SAP HANA Cloud, SAP HANA Database
Cloud Reliability – Backup Compression
We are pleased to introduce backup compression for data, log, and catalog backups for SAP HANA database instances in SAP HANA Cloud. This enhancement reduces the amount of backup storage consumed, providing our users with an efficient and cost-effective solution for managing their backup data. Users can now significantly reduce the costs of cloud storage, while ensuring the integrity and security of their backups.
The enhancement contributes to our ambition to deliver solutions that provide tangible cost savings and operational efficiencies, ultimately enhancing the total cost of ownership within SAP HANA Cloud.
Data Integration
Native SQL on Files
In the evolving data-driven landscape, businesses need to leverage the insights hidden in vast amounts of data from both SAP and non-SAP applications.
Starting with our Q3 2024 release, the SAP HANA Database with SAP HANA Cloud introduces native SQL on Files capabilities, allowing enterprises to directly access structured data stored in common formats like CSV, Parquet, and Delta table (Open Table Format) without moving or loading the data into the database. This feature enables users to create virtual tables for on-the-fly data access, supports advanced query capabilities like time travel on Delta tables, and helps optimize cost-performance balance for data processing workloads.
This blog post by Seungjoon Lee provides more details on SQL on files, its value, and how you can make use of it already today.
Export and import of database objects to and from a Microsoft Azure DNS zone–based object store
As part of our ongoing efforts to enhance interoperability and data management capabilities, we are excited to introduce the ability to export and import database objects to and from a Microsoft Azure DNS zone–based object store. This innovation enables seamless interoperability between Microsoft Azure and the Object Store service on SAP Business Technology Platform (BTP), allowing users to efficiently manage the flow of database objects and data between the two platforms.
This innovation provides our users with the ability to seamlessly transfer database objects, facilitating efficient data exchange and enabling a more streamlined data management process. By enhancing interoperability between SAP HANA Cloud and Microsoft Azure, we empower our users with increased flexibility and efficiency in managing their data assets, ultimately enabling them to make the most of their cloud data management and exchange operations.
Online Migration
With the Q3 delivery, we are excited to introduce online migration capabilities within SAP HANA Cloud, allowing critical business processes to remain operational within the source SAP HANA system during the migration process.
This innovation minimizes migration downtime, automates migration tasks, and reduces the need for manual interventions, delivering a seamless migration experience for our users. The introduction of online migration capabilities represents a significant advancement in migration efficiency and operational continuity for our users. The benefits empower you to execute migrations with minimal disruption to their operations, ensuring a seamless and efficient transition to SAP HANA Cloud.
Guided setup of SAP Datasphere for replicating data from SAP S/4HANA to SAP HANA Cloud using the replication flow
We are thrilled to announce a new mission at the SAP BTP Discovery Center, offering guided, step-by-step setup for replicating data from SAP S/4HANA to SAP HANA Cloud using the replication flow of SAP Datasphere. The SAP BTP Discovery Center is a platform that allows users to explore, try, and deploy various SAP and partner solutions. It helps you to discover and leverage innovative technologies to improve your operations and achieve your strategic goals by leveraging SAP BTP’s broad set of services.
Furthermore, we are also introducing the SAP BTP adoption booster, which provides guided infrastructure setup for using the replication flow of SAP Datasphere from a stand-alone perspective in SAP HANA Cloud. This enables users to intuitively set up SAP Datasphere to utilize the replication flow for data replication into SAP HANA Cloud, via a simplified approach.
The SAP BTP adoption booster reduces complexity and accelerates the setup process. The innovation empowers users to efficiently harness the capabilities of SAP Datasphere for data replication, ultimately enhancing their data management and operational workflows within SAP HANA Cloud.
For more details, please read this blogpost by our expert Alexey Raskatov.
Database Application Development
Automatic propagation of transparent filter to semantics node
We are pleased to announce the introduction of the automatic propagation of transparent filters that are defined in internal nodes to the semantics node in SAP HANA Cloud. The automatic propagation increases model consistency and simplifies the management of transparent filters within the system.
Copying restricted columns to other nodes
Moreover, we are happy to introduce the ability to copy and paste restricted columns to other nodes within the same calculation view in SAP HANA Cloud. This enhancement enables users to refactor elements more easily and efficiently by seamlessly transferring restricted columns to different nodes of the calculation view, streamlining the development process and enhancing the flexibility of data modeling within the platform.
This new capability reduces development efforts and simplifies the process of reorganizing and modifying calculation views. It empowers them to optimize their data models and adapt to evolving business requirements with increased agility and precision, ultimately enhancing their data modeling workflows within SAP HANA Cloud.
Structured filter plug-in for SAP HANA deployment Infrastructure (HDI)
With the recent release, we are introducing support for a structured filter plug-in for SAP HANA Deployment Infrastructure (HDI). This allows users to enable a structured filter on an object and subsequently impact queries and data manipulation language (DML) operations on the object. The structured filter can be defined only on an object with it being explicitly enabled by the object owner. Additionally, the new system view (STRUCTURED_FILTERS) displays structured filter objects. A new flag (HAS_STRUCTURED_FILTER_CHECK) is now available for the target object to be shown to owners or privileged users by individual system views (VIEWS, FUNCTIONS, and TABLES).
The structured filter plug-in allows the separation of content and authorization in view definition, facilitating the monitoring and management of existing structured filters on the object, and providing a clean concept for filtering without a database user context. Users can define structured filters on objects, protect objects using structured filters, and gain increased control over data authorization and access. This feature empowers users to enforce precise data access controls, streamline data governance, and enhance the security and integrity of their data within SAP HANA Cloud.
Using a disk to store intermediate results to avoid out-of-memory errors
We are excited to announce the ability to store intermediate result sets on disk when memory is not available to avoid out-of-memory errors for executions made using the execution engine for SAP HANA Cloud. It ensures resilience in avoiding out-of-memory errors and improves the cost of ownership by using low-cost disk storage instead of high-cost memory.
Additionally, it enhances the overall reliability and stability of data processing and analytics within SAP HANA Cloud. By leveraging low-cost disk storage, users can improve the cost of ownership and optimize resource utilization, ultimately reducing infrastructure expenses and enhancing operational efficiency. This feature empowers users to seamlessly manage and process large datasets, ensuring robust performance, scalability, and cost-effective utilization of resources within SAP HANA Cloud.
Intermediate data preview with alternative database users
In our latest release, we are introducing the ability to perform intermediate data previews with alternative database users to debug in productive systems with reduced privileges in SAP HANA Cloud. This enables users to run intermediate data previews on remote systems, providing the option to reduce the privileges of the connecting user to control permissions on the remote database. It also requires the view and node names of the remote view to correspond to the local view, ensuring seamless data preview operations between systems.
This capability addresses potential issues in productive systems with reduced privileges and enables them to more easily debug and troubleshoot issues from development systems. Ultimately it enables users to maintain and optimize the performance and reliability of their systems within SAP HANA Cloud.
Optimizing view changes for deployment options in the cloud
We are thrilled to announce this latest enhancement to SAP HANA Cloud, aimed at optimizing the user experience and increasing efficiency. Now, with the use of the "create or replace" SQL command in SAP HANA Infrastructure Services, users can streamline the process of modifying views, reducing the need for a "drop or create" approach.
This innovation delivers substantial benefits by improving the total cost of ownership (TCO). Users can now reduce the internal effort required to change a view and significantly decrease the time needed to execute the change, eventually driving greater efficiency and productivity.
Graphical View Modeling
In this section, we will feature some of the new enhancements with regards to SAP HANA Cloud's Graphical View Modeling capabilities. For more details on the latest innovations, please read this blogpost by our expert Jan Zwickel.
Graphical editor for structured filters
We are happy to introduce a graphical user interface for creating and modifying structured filters in SAP HANA Cloud. This intuitive interface provides users with a similar user experience to working on analytic privileges, enabling them to create and manage structured filters with ease and efficiency.
This graphical editor simplifies the creation and maintenance of security artifacts within the platform. By providing a user-friendly interface, it enables users to more easily implement and manage security measures, increasing their control over analytic reporting and ensuring the accurate and secure access to sensitive data. It also streamlines the process of establishing and maintaining robust data access controls within SAP HANA Cloud, ultimately empowering users to strengthen the security posture of their data assets and maintain compliance with regulatory requirements.
Reestablishing connections when deleting intermediate nodes
In our latest release, we are introducing the capability to reestablish connections when deleting intermediate nodes in SAP HANA Cloud. This empowers users to choose to connect adjoining nodes when deleting intermediate nodes, providing the flexibility to retain relevant connections and information, thus simplifying the refactoring process and ensuring a more efficient and precise data model reconfiguration within the platform.
By retaining connections and information when deleting intermediate nodes, users can optimize their data models with greater precision, reducing the effort required for refactoring and enhancing the agility and flexibility of their data modeling workflows within SAP HANA Cloud.
Selective deletion of entries in snapshot tables
We are pleased to announce the introduction of the selective deletion of entries in snapshot tables using generated procedures in SAP HANA Cloud. This feature allows users to pass filter expressions as deletion criteria to selective deletion procedures, enabling them to selectively delete entries in snapshot tables with enhanced precision and efficiency.
The selective deletion of entries in snapshot tables reduces the development effort and improves the lifecycle management of these. By allowing users to define filter expressions as deletion criteria, this feature streamlines the process of managing snapshot data, enabling users to efficiently maintain the integrity of their snapshot tables while optimizing resource utilization. It ultimately enhances the overall data governance and lifecycle management capabilities within SAP HANA Cloud.
Using the “Generate Document” option on multiple calculation views
Beginning with the Q3 release, users now have the "Generate Document" option for multiple calculation views in SAP HANA Cloud, allowing them to generate documents for calculation views that are selected individually or based on folder level.
This simplifies the generation of comprehensive and detailed documents for multiple calculation views. It also improves the description of calculation view models and enables users to gain deeper insights into the structure and functionality of their calculation views. By reducing the effort required to document calculation views, this feature enhances the overall usability and maintainability of models, enabling users to more efficiently document and understand the details of their calculation views within SAP HANA Cloud.
SAP HANA Cloud Multi-Model
Support for schema definition in JSON documents
We are happy to announce support for strict schemas in the document store by defining attributes, domains, data types, and constants in JSON documents. Additionally, we have enabled the support for mixed schemas, allowing both flexible and strict schema definitions in the same JSON document. This enable users to verify input values, avoid typecasting when retrieving values from JSON documents, and ensure that data types, domains, attributes, and constants are predefined in the JSON schema and checked by the document store.
The innovation enhances data integrity and validation capabilities within the document store. By defining strict schemas and supporting mixed schemas, users can ensure the accuracy and consistency of their data, ultimately reducing the risk of invalid or inconsistent data being stored and retrieved from the document store. These capabilities empower users to maintain data quality, enforce data governance, and build reliable applications within SAP HANA Cloud, fostering trust in the accuracy and reliability of their data assets.
Support for vector indexing
In our latest release, we have implemented indexing support for the vector engine in SAP HANA Cloud. This significantly facilitates the handling of large vector datasets and optimizes retrieval, memory use, and query performance for vector data processing within SAP HANA Cloud.
The addition enables efficient nearest-neighbor searches on large data volumes and enhances the overall query performance while improving the vector data processing capabilities and user experience within SAP HANA Cloud. The feature empowers users to efficiently manage and retrieve large vector datasets, ultimately enabling them to derive valuable insights and make informed decisions based on their data.
Machine Learning
New vector clustering and segmented automated machine learning modeling
We are excited to introduce multiple new features to the Predictive Analysis Library (PAL) in SAP HANA Cloud, including the hierarchical density-based clustering of data with noise (HDBSCAN) and support for clustering of vector data using the DBSCAN and HDBSCAN functions. Additionally, we have added segmented, parallel invocation of automated machine learning (AutoML) functions based on a grouping column.
These enhancements enable data scientists and application developers using SAP HANA Cloud to capture clusters in heterogeneous data, identify groups of similar objects or text documents based on embedding vector data, and achieve faster modeling and application of AutoML for scenarios such as automatic, segmented time-series analysis of sales grouped by a product and location dimension. They also enable data scientists and app developers to make informed decisions and derive valuable insights from their data. By facilitating faster modeling and application of AutoML, users can automate and streamline analytics processes, ultimately enhancing productivity and enabling the generation of meaningful, actionable insights from their data within SAP HANA Cloud.
In case you want to get more details about the latest features for Machine Learning in SAP HANA Cloud, make sure to check out the blog post provided by Christoph Morgen.
Data Privacy and Protection
Extending X.509 authentication certificate matching for the SAP HANA database
In the Q3 2024 release, we introduced an extension to the current X.509-based authentication certificate matching in SAP HANA Cloud, SAP HANA database. The enhancement allows users to add wildcards for certificate attributes, effectively ignoring specific attributes when checking a certificate for a match.
This extension increases flexibility and control in configuring X.509 certificate mappings, empowering users to customize certificate matching criteria to best suit their specific security requirements and operational needs within SAP HANA Cloud. The extension of X.509 authentication certificate matching with the addition of wildcards in the subject distinguished name (DN) enhances the usability and configurability of X.509 certificate mappings.
Row-level access control for TUDFs
We are excited to introduce row-level access control for Table User Defined Functions (TUDFs) in SAP HANA Cloud, SAP HANA database. This feature enables fine-grained control of user access to TUDFs, allowing customers to manage access control using structured filters. By providing this capability users are enabled to implement granular access control at the level of the SAP HANA database, ensuring that sensitive data is accessed and utilized in a controlled and secure manner.
This innovation provides users with the tools to enforce granular access control, thereby safeguarding sensitive data and ensuring compliance with security and privacy requirements. Additionally, it empowers users to implement a robust security framework and effectively manage access to TUDFs, reinforcing their confidence in the secure management of data within SAP HANA Cloud.
Identity provisioning via IPS/IAS for SAP HANA Cloud
With the Q3 release of SAP HANA Cloud, we are now providing tight integration with the Identity Provisioning of Identity Authentication services based on the system for Cross-Domain Identity Management (SCIM) API for SAP HANA Cloud, SAP HANA database.
This innovation enables users to automatically handle user provisioning in the SAP HANA database with the help of Identity Provisioning of Identity Authentication services, once again strengthening the security features SAP HANA Cloud offers.
Authentication-method-based connect restrictions for user groups
Moreover, we are introducing the capability to restrict access for all users or subsets based on the specific authentication method used for connecting to SAP HANA Cloud. For example, this feature allows administrators to configure the system to only allow users with SAML- or JWT-based authentication connecting from an external network, thereby providing fine-grained control over user access based on the authentication method being used.
This introduction enables our users to implement segregation-of-duty (SoD) concepts and enforce enhanced security measures in their systems. By restricting user access based on specific authentication methods, users can ensure that their systems are further secured against potential attacks from the internet, safeguarding sensitive data and resources. The feature empowers administrators to configure more granular security settings, enhancing the overall security posture of their SAP HANA Cloud environments.
Innovations in SAP HANA Cloud, data lake
Data Lake consumption Monitor
After the introduction of the consumption monitor for SAP HANA Cloud, SAP HANA database last quarter, we are happy to share that it is now also available for monitoring the consumption of your SAP HANA data lake instance, with a breakdown of how many capacity units each service component utilizes. Users are now able to display consumption from previous months, as well as detailed information (e.g. activity hours and rate) for the current month. One can select the timeframe to display for the current month and check accumulated and detailed cost. Visualization is done using Sankey or bar chart diagram formats to easily determine consumption at a glance.
The consumption monitor streamlines access to consumption data by delivering clear and organized insights into consumption metrics. Through visualizations and detailed information, users can forecast consumption and make informed decisions to optimize resource utilization within SAP HANA Cloud. This feature enhances control over resource management and expenditure, ultimately improving cost-effectiveness and performance optimization.
Further Innovations & Enhancements
Administration and Service Management
Adding a SUM function for Delta-Type Metrics in the Metrics Service
With the latest quarterly delivery of SAP HANA Cloud, we are adding a SUM function for Delta-Type Metrics in the Metrics Service.
This new functionality allows users to generate calculated total values for specified durations, providing a more comprehensive and detailed analysis of their data.
SQL statement library
As part of our continuous efforts to enhance user experience and efficiency, we are proud to introduce the SQL statement library being added to SAP HANA Cloud. This new feature allows users to store and manage frequently used SQL statements effectively when using the SQL console. The library includes SQL statement metadata such as name, description, type, and last modified date, providing users with organized storage and easy access to their SQL statements. The support for importing and exporting one or more SQL statements further adds flexibility to the SQL console functionality, offering our users enhanced control and streamlined management of their SQL operations.
The introduction of the SQL statement library enables users to quickly open or execute frequently used SQL statements and provides organized storage for their SQL operations, ultimately saving time and effort while ensuring seamless operations within the platform. By enhancing the organization and accessibility of SQL statements, it elevates the overall user experience and productivity, equipping our users with the tools they need to efficiently manage and execute their SQL operations within SAP HANA Cloud.
Support for AWS PrivateLink services
A key highlight of the latest quarterly delivery of SAP HANA Cloud is the support for AWS PrivateLink services. This new capability enables users to connect applications running within an Amazon Web Services (AWS) landscape to SAP HANA Cloud, SAP HANA database using private IP endpoints through AWS PrivateLink. Notably, private IP endpoints are addressable exclusively from within a specific hyperscaler network and are not exposed publicly outside of that network. The support for AWS PrivateLink services complements SAP HANA Cloud’s comprehensive security framework, which utilizes strict enforcement of TLS encryption and allows users to optionally configure IP allow or disallow lists.
By reducing the exposure of IP endpoints, the introduction underscores our commitment to providing a secure and robust environment for our users, enabling them to take advantage of enhanced security measures and build a more secure and resilient cloud infrastructure within SAP HANA Cloud.
If you want to learn more about the technical details and dive deeper into an e2e scenario, please have a look at this demo video.
Data Center Availability in the Kingdom of Saudi Arabia on Google Cloud Platform
As part of our commitment to meeting the diverse needs of our customers, we have enabled a new data center in the Kingdom of Saudi Arabia on the Google Cloud Platform.
This additional deployment option empowers our customers to run SAP HANA Cloud in their preferred hyperscaler environments, ensuring that they have the flexibility and control to operate their cloud workloads in a manner that best suits their business needs while also catering for regulatory requirements. Additionally, it demonstrates our dedication to providing our customers with expanded deployment options, unlocking access to the localised infrastructure in the region.
If you are reading this, you’ve made it through the entire What’s New blogpost – congrats! Now, if you are looking for more technical details on the Q3 2024 release, then have a look at our What’s New Viewer in our Technical documentation, which describes the entire scope of the release.
Finally, make sure to follow the SAP HANA Cloud tag to stay updated on all the latest developments. You can also check out the whatsnewinsaphanacloud tag for new blog posts. If you want to watch the What’s New webinar in Q3 2024, you can find it and all future webinars soon in this YouTube playlist. Keep an eye out for our upcoming webcast on new innovations, which will also be available in the same playlist soon.
If you have any questions about SAP HANA Cloud or want to discuss any of the innovations mentioned, feel free to post them in our SAP HANA Cloud Community Q&A or in the comments section.
4 Comments
