Question Re: JSON String to Table Data Type in Technology Q&A

JSON String to Table Data Type

rajeshps — Mon, 06 Feb 2023 08:48:38 GMT

Hello Team

I may require your inputs to convert JSON string to table data type. I'm building graph in gen 1 operators of SDI on premise 3.2.

node base operator is use for decoding message and data transform is used to perform data operation within graph

Error

The source and target operators are incompatible for connection. The Data Transform operator supports port of type table.

Group: group1; Messages: Graph failure: failed to deserialize data coming from port 'output' of operator 'python3operator1': failed to deserialize bytes representing type 'string' into type 'vtype.basetypeTable'. Make sure you are sending data that is compatible with the port type 'table'

Process(es) terminated with error(s). restartOnFailure==false

Thanks and Regards,

Rajesh PS

Re: JSON String to Table Data Type

rajeshps — Mon, 06 Feb 2023 08:49:42 GMT

Please share your thoughts and insights on this question.

kai-michael.roesner

amish1980_95

indu.khurana18

wolfgang.albert.epting

minhee.sung

eduardo.haussen

veselm

gvglupita

piotr_radzki

Re: JSON String to Table Data Type

rajeshps — Tue, 07 Feb 2023 13:13:36 GMT

thorsten.hapke

Please check this question and kindly revert.

Re: JSON String to Table Data Type

werner_daehn — Thu, 09 Feb 2023 06:58:32 GMT

The first thing that comes to mind is the Kafka standard method of using Kafka Connect for SAP Hana.

https://github.com/SAP/kafka-connect-sap

I assume you know about that, so the next question would be what this approach is lacking for your use case.

Re: JSON String to Table Data Type

werner_daehn — Wed, 15 Feb 2023 12:39:41 GMT

Kafka Connect and SAP DI are two totally different approaches. I never used DI in projects.

Kafka Connect does use the schema registry. To decode/encode Avro messages from/to Kafka, the Schema registry is a must, because the payload in Kafka contains a magic byte and the subject id as integer. With this value the schema registry is queried and only then you know the schema and the payload. All of that happens fully automatically in every system I have ever seen.

Re: JSON String to Table Data Type

rajeshps — Fri, 17 Feb 2023 14:12:38 GMT

thorsten.hapke chris.gruber

Could you please provide your valuable inputs on this query. Thanks!