DI Cloud comes with a built-in autoscaling feature: you can configure the min and max number of nodes in the BTP Cockpit and the system will automatically spawn new worker nodes when needed. Question: will the newly spawned nodes be shut down when th...
At the moment, there are only two choices for replication flows: either initial load only, or initial + delta.
A delta only option would be really handy in the case a big table is replicated and a maintenance task requires a redeploy of the flow. F...
Dear SAP Data Intelligence community members,
One of our top customers is interested in orchestrating Azure Databricks workloads with SAP Data Intelligence. Data bricks is based on Spark and the request might be an easy one to fulfil since DI alrea...
In the early days of Data Intelligence, I worked with a young intern to test a prototype of the product on a large amount of astronomical data. My student was fascinated by the scenario that involved the ML tagging of pulsar signals collected by som...
When I joined SAP five years ago I became a member of a small team of developers who were hired to obey one single commandment: innovate! But the initial group was so small compared to the size of their goals that an important corollary was immediat...
deepcopy is a python method to make sure you pass a variable to a method by copying it and not by referencing. The copy is only temporary and won't stage anything: it is dropped when the function returns. More details here: https://docs.python.org/...
Hello Saurabh,How do you realize some batches are missing? I am asking because there might be an issue related to the send() function that you use to pipe your data out of the python operator. The send() function is asynchronous and doesn't copy th...
The two modes are fine, but what if I need to modify a flow, say add a column? The only option I have is to perform the initial load again. But for some very big S/4 tables (order of 10^9 records) this is a show stopper. It would be nice to have a...
Yes, I can. I uploaded the file using the Metadata Explorer and registered it with the ML Data Manager.I can also use the Metadata Explorer to preview and profile for instance.No problem from the modeler either, e.g. using the com.sap.file.read oper...