none
Staging tables RRS feed

  • Question

  • While Loading the Data into MDS Staging tables daily, do we need to truncate the staging table ?

    I tried to load the data without truncating the table it is taking duplicates. I tried working with Import type but I couldn't understand about daily loading. thanks in advance

    Sunday, November 29, 2015 2:20 PM

Answers

  • From the functionality point of view, you don't have to cleanup the staging tables. Each batch has their owned batch tag and shouldn't affect each other.

    From the performance point of view, you may need periodically clean up the completed batch. You can do it in the WebUI/Integration Management/Clear Batch.

    More information can be found here.
    https://msdn.microsoft.com/en-us/library/ee633854.aspx

    Wednesday, December 2, 2015 7:10 PM
    Moderator

All replies

  • Yes in data warehouse we generally truncate the tables to load the data incrementally, but again it depends on the requirement. In your case if you need to load the delta data on daily basis then you should truncate it first in your staging area.

    Cheers,

    Amit Tomar

    ---------------------------------------------------

    Please mark this as answer if it solved your query

    Please vote this as helpful if it solved your query

    ---------------------------------------------------

    My Blog My Wiki Page

    Monday, November 30, 2015 1:51 AM
  • From the functionality point of view, you don't have to cleanup the staging tables. Each batch has their owned batch tag and shouldn't affect each other.

    From the performance point of view, you may need periodically clean up the completed batch. You can do it in the WebUI/Integration Management/Clear Batch.

    More information can be found here.
    https://msdn.microsoft.com/en-us/library/ee633854.aspx

    Wednesday, December 2, 2015 7:10 PM
    Moderator