Question Re: Header-data for item-level in Technology Q&A

Header-data for item-level

marco_simon2 — Mon, 22 Jul 2013 16:34:04 GMT

Hi experts,

quite often we've got the requirement, that an item-level report shall contain
the header-information as well. For example the order-date (which is maintained
on the header level) shall be available in item-level-reports as well.

Unfortunately the extractor does not support that scenario.

How do you handle such cases?

One option might be to extend the item-level export-structure and
filling the new field using the extraction-customer-exit.

But this has a hatch: If only the header-field is changed, no item-delta

will be triggered. Hence the item-records refering to this header won't
pass the exit (immedialtely) and won't be updated.

Another option might be a data-staging based solution:

After having loaded the header- and item-deltas, one could forward
the header-records to the item-infoprovider; using a start-routine in
order to clone the header records for each item-level-record.

Futheron this could be used to update only those positions, where
the header changed recently.

Is this the best-practice? Or is there another option I didn't mind?

Best regards,

Marco

Re: Header-data for item-level

RamanKorrapati — Mon, 22 Jul 2013 16:42:58 GMT

Hi Marco,

Rather than enhancing the extract structure, better to go with staging layer solution.

Load header data and item data to Write optimized DSO's. While moving data from item dso to further target level, you may call required information from Header DSO level based on that doc.

Try this at Dev system and check it. do the all test cases and move further if its worked as you needs.

Thanks

Re: Header-data for item-level

Former Member — Mon, 22 Jul 2013 17:31:53 GMT

Thanks raman.. You give me a clue how to do a modelling at write optimized dso.. Never think about that before..

Re: Header-data for item-level

former_member182470 — Tue, 23 Jul 2013 04:43:38 GMT

Hi,

It has to be achieved in Modeling. Load header data and item data in to two standard DSOs.

Create another Standard DSO(which can hold item level data) from the item DSO. Do a lookup of header DSO for every Order in Item DSO and update Order Date in new DSO.

Finally you can report on this third DSO.

Regards,

SUman

Re: Header-data for item-level

RamanKorrapati — Tue, 23 Jul 2013 06:33:05 GMT

Your welcome Edi.

When we need dso for staging then write optimized DSO will be best use. data will be avaible immedaite once we loaded.

Thanks

Re: Header-data for item-level

former_member182470 — Tue, 23 Jul 2013 11:08:30 GMT

For complete understanding about Write optimized DSO, please check the below link:--------

http://scn.sap.com/docs/DOC-11852

Re: Header-data for item-level

marco_simon2 — Tue, 23 Jul 2013 11:14:24 GMT

Hi,

thanks for your clear positioning for the staging-based solution.

I might be wrong, but could it be that the way (both of) you recommend contains a risk for inconsistent data?

Let's say I loaded item Data to ODS_I and header-data to ODS_H.

The ODS_HI contains the union of both data-provider.

At the moment of forwarding the data from ODS_I --> ODS_HI you'd read the
header-information from ODS_H for enhancing the item-record.

Now generaly delta-loading should be prefered, because of the reduced data-loading-times:

Header and items have been loaded till ODS_HI.

Now a user chages a header-record. The source-system will trigger a delta-record, which will be forwared till the ODS_H-InfoProvider. The item-level won't take any note of this change. Neither ODS_I nor ODS_HI will get additonal records. Hence the unioned record in ODS_HI will still show
the outage header-information, while ODS_H contains the correct information.

In the end, this is exactly the same scenario again, as described in my opening-post - only difference is, that the scenario has moved from the source-system to the bw-system.

Re: Header-data for item-level

former_member182470 — Tue, 23 Jul 2013 11:18:22 GMT

If you have read my first reply claerly, i had mentioned to create a thired DSo which can store Item level info by looking up header DSO. Can you re-phrase your doubts with that to understand the procedure?

Re: Header-data for item-level

marco_simon2 — Tue, 23 Jul 2013 11:27:02 GMT

Hi Suman,

yeah, i got that point.

This 3rd DSO is what I labled ODS_HI (=Header + Item).

Let's try some ascii-painting

DS:Header -----------------> ODS:Header

/ \

/ enhance items

/ \

DS:Item -->ODS:Items-/ - - - - -------> ODS:Header+Items

In this case a header-record could find it's way to the ODS:Header,
without a corresponding item-record which makes it's way though the item-staging.

Hence the item (which already found it's way to ODS:Header+Item in the past) won't pass the enhancment-routine again. This will happen only, if a new delta for the item-record is triggered again.

Re: Header-data for item-level

yasemin_kilinc — Tue, 23 Jul 2013 11:32:06 GMT

Hi Marco,

I am not sure if it would cause any performance problem but an easier method would be getting the header data as the master data of the item level data. Then you could directly use the attributes in your query. Just an idea...

Regards

Yasemin...

Re: Header-data for item-level

former_member182470 — Tue, 23 Jul 2013 11:33:18 GMT

I say to write an End routine by looking up header DSO and update the header info before the data is getting stored in 3rd DSO.

Do a fresh load from your sources and try to update all the data to 3rd DSO with that routine.

Re: Header-data for item-level

marco_simon2 — Tue, 23 Jul 2013 11:46:28 GMT

Hi Suman,

Suman Chakravarthy K wrote:
I say to write an End routine by looking up header DSO and update the header info before the data is getting stored in 3rd DSO.

Fully understood that point. But the hatch is, that the end-routine is triggered only if new/updated item-records are forwarded from ODS:Items to ODS:Header+Items.


Do a fresh load from your sources and try to update all the data to 3rd DSO with that routine.

That would certainly work, but daily full-loading item-level data (which could be loaded using delta-method) seems not to be a really recommendable way, is it?

Re: Header-data for item-level

marco_simon2 — Tue, 23 Jul 2013 11:52:13 GMT

Yes, that would be a nice option as well.

That would mean to create master-data-records based on transactional records.

That might have the disadvantace that nav-attributes of the header-characteristics might not be available anymore, because the characteristics themselfe are already the attributes of the header-key (~doc-number). But it would be a nice an very general way to embed the all header-chars into the position.

I crossed that option several times lately, but I'm not yet sure if this is really the best-practice way to solve the simple and imho very general issue described above.

Re: Header-data for item-level

former_member182470 — Tue, 23 Jul 2013 11:55:42 GMT

I appreciate you are understanding all points clearly. But one clarification here.

My idea is to do a full load once with that routine. So that all historical data will be with your desired logic.

Run your regular deltas as usual with that routine. So any changes to your old items will reflect with the routine logic. New records will anyway run through the rotuine. So all your data is with the logic in place.

Re: Header-data for item-level

marco_simon2 — Tue, 23 Jul 2013 12:09:16 GMT

Suman Chakravarthy K wrote:
Run your regular deltas as usual with that routine. [..]. New records will anyway run through the rotuine. So all your data is with the logic in place.

That's exactly the point i doubt...

1) I do a full-update (=Init) for my headers (one of them is doc-nr: 111222)

2) I do a full-update (=Init) for my items (one of them is doc-nr: 111222-010)

3) I forward the items to the 3rd DSO. Items are enhanced (in the end-routine), everything's great.

4) I perform a change to a header-field of doc 111222

5) I do a delta-load for the headers --> doc 111222 is tranfered and updated

6) I do a delta-load for the items --> Nothing is transfered, since no item has been changed.

---> End-Routine of items-transformation is not triggered. Record in 3rd DSO is outaged.

Could you show me up my error in thinking?

Re: Header-data for item-level

former_member182470 — Tue, 23 Jul 2013 12:22:06 GMT

To emphasize on your last point, I am thinking to suggest you to write a small ABAP program in SE38.

The logic would be like below :---

As soon as you do a delta load to Header DSO, you have to select the records in the active table of header DSO(as per the today's date) and update the details to the respective records which are already in the active table of third DSO.

You can include this ABAP program in your process chain right after the delta load to header DSO steps.

Re: Header-data for item-level

RamanKorrapati — Tue, 23 Jul 2013 12:38:02 GMT

Hi Macro,

From header info how many fields information you want into item level dso(ods_hi)? only order date or need some more objects?

Thanks

Re: Header-data for item-level

marco_simon2 — Tue, 23 Jul 2013 12:39:04 GMT

Hi Suman,

that would mean a manipulation to the active-data-table of the item-dso which bypasses the normal data-changing via the standard data-staging. Furtheron it does not take the changelog (which might be needed for data-forwarding to cube) into account.

Is that really the best-practice for the general problem I described initally?

In this case I will stick to the 2nd method I described in my first post. It makes sure that only updated/delta header-items are used as a basis for the item-updating, and it uses the normal datastaging via transformation and activation of records, which makes sure that the changelog is consistent as well.

Are there any disadvantages with this approach?

Re: Header-data for item-level

marco_simon2 — Tue, 23 Jul 2013 12:45:25 GMT

Hi Ramanjaneyulu,

generally I'm searching for a best-practice way to get _all_ header information into the item-level DSO.

The quickliest (but as already described disadvantage-paved) way would certainly be the one Yasemin mentioned.

In my very special case I need that only for the order date.

Best regards,

Marco

Re: Header-data for item-level

former_member182470 — Tue, 23 Jul 2013 12:46:33 GMT

As you are so keen about 5th point, i thought about a workaround and gave you. That doesn't mean you literally do that. Whatever way you are confident about the data accuracy, you should go with that.

I can't suggest you any more. It is up to you. I tried to give all my ideas to make you understand. I think i am not able to..

Thanks,

Suman