topic Re: May Developer Challenge - SAP AI Services - Week 3 in Application Development and Automation Discussions

May Developer Challenge - SAP AI Services - Week 3

noravonthenen — Wed, 22 May 2024 09:36:28 GMT

Welcome to week 3 of the AI Developer Challenge! I am so excited about every single submission! Now I don’t know about you but in my family, we love avocado! Especially my youngest could eat it all the time. Let’s use the Data Attribute Recommendation service to build an avocado price prediction engine! With Data Attribute Recommendation you can train regression as well as classification models and you can use the SAP AI Launchpad, Postman, Swagger or the AI API Python SDK to implement your use case! With Data Attribute Recommendation you need to specify a model template or a business blueprint to specify what kind of algorithm should be used.

For this challenge we will use the regression model template to implement an avocado price predictor! If you do not like avocado, feel free to come up with another use case and search for a fitting dataset (e.g. here).

This week we start by uploading and preparing our dataset schema and our dataset! For that we will be using the AI API which is a standardized way to interact with different AI runtimes and services such as SAP AI Core or Data Attribute Recommendation.

Go to your BTP trial account and create a DAR instance (you can use the booster): https://developers.sap.com/tutorials/cp-aibus-dar-service-instance.html
Download this dataset
Download the postman collection for the Data Attribute Recommendation service and import the folder to Postman
Go to the environment tab on the left and add the information from your DAR service key from step 1.
1. authUrl = url from the uaa section in your .json file
2. url = url
Make sure to select the correct environment and go back to the Collections tab to create a token with the Get XSUAA OAuth Token GET request in the Authorization folder. If everything is set up correctly it will take the url, username and password from your environmental variables you configured in step 4. It will also assign the token to the correct variable in the environment for further use. Make sure to repeat this step once the token timed out.
Create a dataset_schema.json file
Go back to the Environments tab and assign a folder name (e.g. avocado_price_predictor) and a datasetSchemaFileRegression name (e.g. dataset_schema.json) as well as a datasetFileRegression name (e.g. avocado_data.csv) and also assign the scenarioIdRegression = '35cd9fbc-7290-4042-b6df-178d74c67363' or find the correct Scenario ID here.
Upload a dataset schema with the PUT Upload Dataset Schema Regression request and make sure to upload your dataset_schema.json
Upload this dataset with the PUT Upload Dataset Regression request
Create a dataset schema artifact with the POST Create Dataset Schema Artifact Regression request (the required values were assigned automatically to your environment)
Create a dataset artifact with the POST Create Dataset Artifact Regression request (the required values were assigned automatically to your environment)
Learn more about AI API and the underlying concepts such as artifacts
Submission is again a screenshot of the last POST request and the correct returned result:
Stay tuned for next week to train your model!

Week 1 challenge

Week 2 challenge

Re: May Developer Challenge - SAP AI Services - Week 3

geek61 — Thu, 16 May 2024 09:15:00 GMT

Update: For anybody else who's not a regular Postman user, installing the Desktop Agent fixes this.

Re: May Developer Challenge - SAP AI Services - Week 3

moh_ali_square — Thu, 16 May 2024 05:59:59 GMT

Hi,

Update: I got it right. Thanks to Mio for help .

DAR week 3 submission

I updated the enviorment with value of scenarioIdRegression

Collection environment variables

I had an issue with the last two steps, I uploaded the dataset schema and the dataset. but there is API error related to scenarioID!

Did I miss anything?

below screenshot for my submission, and another screenshot shows that dataset was uploaded, when I tried to upload it again, I got a message that it is already there.

Post request for Dataset.

PUT request for dataset

Re: May Developer Challenge - SAP AI Services - Week 3

MioYasutake — Wed, 15 May 2024 20:27:58 GMT

My submission for week 3.

I encountered the same error as @moh_ali_square posted. As the document says "scenarioId refer to pre-existing values", I tried to find where the scenarioId is defined. I found it by calling the following endpoint. I hope this is the right approach.

Re: May Developer Challenge - SAP AI Services - Week 3

geek61 — Thu, 16 May 2024 15:02:39 GMT

For anyone trying to follow this:

10. Create a dataset schema artifact with the POST Create Dataset Schema Artifact Regression request (the required values were assigned automatically to your environment)

The scenarioid is not automatically assigned.

Re: May Developer Challenge - SAP AI Services - Week 3

geek61 — Thu, 16 May 2024 15:06:22 GMT

After much wailing and gnashing of teeth:

Re: May Developer Challenge - SAP AI Services - Week 3

Nagarajan-K — Thu, 16 May 2024 16:59:37 GMT

Thanks @MioYasutake for the tip in your response which helped in moving forward.

Re: May Developer Challenge - SAP AI Services - Week 3

noravonthenen — Fri, 17 May 2024 05:41:42 GMT

@MioYasutake thanks a lot for catching that! I updated it in the post 🙂

Re: May Developer Challenge - SAP AI Services - Week 3

Alpesa1990 — Fri, 17 May 2024 15:52:28 GMT

My submission for this this task.

Re: May Developer Challenge - SAP AI Services - Week 3

emiliocampo — Sat, 18 May 2024 19:18:39 GMT

Submission for week 3

Re: May Developer Challenge - SAP AI Services - Week 3

M-K — Mon, 20 May 2024 20:52:10 GMT

Here's my submission:

Re: May Developer Challenge - SAP AI Services - Week 3

xavisanse — Tue, 21 May 2024 07:25:25 GMT

Thanks!

Re: May Developer Challenge - SAP AI Services - Week 3

CameronWilson — Tue, 21 May 2024 15:01:50 GMT

Re: May Developer Challenge - SAP AI Services - Week 3

Jordi_C — Tue, 21 May 2024 14:46:19 GMT

Week 3 done and dusted!

Re: May Developer Challenge - SAP AI Services - Week 3

Hira — Wed, 22 May 2024 08:19:21 GMT

Hi @noravonthenen ,

Hope you are doing well.

Below is the screen shot for Week 3 exercise.

Re: May Developer Challenge - SAP AI Services - Week 3

martaseq — Wed, 22 May 2024 16:02:06 GMT

Here's my submission for this week.

Re: May Developer Challenge - SAP AI Services - Week 3

Mikkelj — Thu, 23 May 2024 11:06:00 GMT

My Submission - not sure what i did, but looking forward to week 4 🙂

Re: May Developer Challenge - SAP AI Services - Week 3

thomas_mller13 — Fri, 24 May 2024 08:06:58 GMT

Hi Nora,

thank you for your interesting articles. They are really helpful.

Anyway, to be honest, I don't understand this dataset:

Date,AveragePrice,TotalVolume,PLU4046,PLU4225,PLU4770,TotalBags,SmallBags,LargeBags,XLargeBags,type,year,region

Why is the date needed? The function cannot depend linearly on date.
What unit is this average price? What is PLU*?
How is the algorithm handling the categorical variables?
Why is the year needed? That is actually the same question as for the date. Are these fields ignored by the model?

Of course the pure technical aspects of applying a ML model can be challenging. But in my opinion the decision which is a suitable model and how to handle the data is much more challenging. Therefore it would be interesting to learn a little bit more about these aspects.

Thanks and best regards,

Thomas

Re: May Developer Challenge - SAP AI Services - Week 3

noravonthenen — Fri, 24 May 2024 10:36:47 GMT

@thomas_mller13 All very good questions!

1. Here you can get some more info on the dataset, I would assume US dollars

2. Quick google search on PLU: "A PLU code, or price look up code, is a 4 or 5 digit code that is unique to a particular produce item; based upon the commodity, the variety and the size group; and will typically appear on a small sticker that is applied to the individual piece of fresh produce."

3. In week 4 you will see that we actually will get feature importance scores from the model and we will see that we do not need all the features from the dataset.

4. Good catch! That is one of the benefits of using the DAR service, you do not need to encode categorical text values yourself. DAR does that automatically for you.

Re: May Developer Challenge - SAP AI Services - Week 3

Vitaliy-R — Fri, 24 May 2024 15:28:24 GMT

I am glad I could try out and practice the Postman extension in VS Code. Too bad the same extension is not available on https://open-vsx.org/ to try it in the SAP BAS.