Data Profiling and automatic metadata tagging

[raghav_jinka]

Hi

In Metadata explorer what I observe is if I have a HANA table staged with personal data and I initiate profiling against the dataset, DI does not automatically tag with any possible metadata tagging even if the field name explicitly states it as date of birth field or name field. So I have to do tag them manually. I also understand from one of the expert sessions that this feature was shown by integrating with BigID tool. But looking to further understand its native capabilities:

1. Is there a way DI can be enabled to do better profiling and automatic tagging ?

2. Is there a way DI can communicate with metadata integrators to do automatic tagging ?

3. Are there any templates to use AI/ML in DI to profile the data and integrate with Metadata explorer ?

Thanks
Raghav

[jmayer · Accepted solution]

Hello Jyothi, one way to address this is with the integration to SAP's partner solution BigID. BigID is an ML-based discovery and classification platform that addresses privacy, security and data governance. There is metadata exchange integration with the Metadata Explorer capabilities of SAP DI. BigID specializes in classifying, profiling and tagging data at scale across all kinds of data (SAP and non-SAP). Have a look at the endorsed app (LINK) or the solution extension (LINK). BigID's web presence is here: LINK. Tagging a couple of colleagues on the SAP side that could give you more info if and as needed. Good luck and I can help you if you want further info on BigID. robert.pickering silvio.arcangeli

[raghav_jinka · Accepted solution]

Hi Jon

Thanks for confirming. Yes, the tool demo was pretty impressive during the expert session to profile and tag unstructured data for data sensitivity and provide stats.

One question : On the technical information, its mentioned that it work with DI and its a solution extension. So does that mean that DI is necessary in order to use BigID on BTP ?

Thanks
Raghav

[jmayer]

Hi Raghav - apologies for the delay in response. Yes, the BigID solution does work with SAP Data Intelligence - there is a metadata exchange integration. Additionally, the solution can be purchased through SAP as a Solution Extension or through BigID (and it is also an Endorsed App on the SAP Store). But to specifically answer your question, SAP DI is not a requirement. BigID can enrich the data within SAP DI and is complementary, but many customers run BigID on its own and/or integrate it with other solutions. Glad to answer more questions if and as needed. Best, Jon