Data Model for Incremental data laod RRS feed

  • Question

  • Hi All,

    I have a request for loading larger set of data on a daily basis. Expecting to get minimum 2.5 lakhs of data per day. We need to generate reports out of it. Basically, we are getting some order details which should be unique but there are chances to get the same order number after some days for some reason. We only need to take the latest order in that case. I need to do some aggregates, summary and details out of the given data. I do not want to load all the data on a daily basis and prefer to load incrementally but when I take an order count for a day i do not want to get that duplicated order in two dates. How can I create a better data model for this?

    Saturday, April 18, 2020 11:00 AM

All replies