Answered by:
Staging tables

Question
-
While Loading the Data into MDS Staging tables daily, do we need to truncate the staging table ?
I tried to load the data without truncating the table it is taking duplicates. I tried working with Import type but I couldn't understand about daily loading. thanks in advance
Answers
-
From the functionality point of view, you don't have to cleanup the staging tables. Each batch has their owned batch tag and shouldn't affect each other.
From the performance point of view, you may need periodically clean up the completed batch. You can do it in the WebUI/Integration Management/Clear Batch.
More information can be found here.
https://msdn.microsoft.com/en-us/library/ee633854.aspx- Proposed as answer by Vincent Chen (X)Moderator Wednesday, December 2, 2015 7:10 PM
- Marked as answer by Charlie LiaoModerator Tuesday, December 8, 2015 9:20 AM
All replies
-
Yes in data warehouse we generally truncate the tables to load the data incrementally, but again it depends on the requirement. In your case if you need to load the delta data on daily basis then you should truncate it first in your staging area.
Cheers,
Amit Tomar
---------------------------------------------------
Please mark this as answer if it solved your query
Please vote this as helpful if it solved your query
---------------------------------------------------
My Blog My Wiki Page -
From the functionality point of view, you don't have to cleanup the staging tables. Each batch has their owned batch tag and shouldn't affect each other.
From the performance point of view, you may need periodically clean up the completed batch. You can do it in the WebUI/Integration Management/Clear Batch.
More information can be found here.
https://msdn.microsoft.com/en-us/library/ee633854.aspx- Proposed as answer by Vincent Chen (X)Moderator Wednesday, December 2, 2015 7:10 PM
- Marked as answer by Charlie LiaoModerator Tuesday, December 8, 2015 9:20 AM