none
Azure SQL Merge VS azure sql checksum for Incrmental load RRS feed

  • Question

  • HI ALL,

    We have 40 GB of Data, we want to copy 40 GB data having multiple Tables.

    we need to do a incremental load from On-Prem SQL server to Azure SQL.

    for performance wise which one is good. also we need robust solution

    Thursday, October 10, 2019 3:28 PM

All replies

  • Hello Manish,

    I am assuming 40GB is an initial load and the incremental load wouldn't be that huge. Is this assumption right?

    You can use Azure Data Factory (ADF) to easily implement the same. A tutorial is here



    Friday, October 11, 2019 9:42 AM
    Moderator
  • Thanks for replay,

    we don't have timestamp column in table


    Friday, October 11, 2019 4:09 PM
  • Comparing 40 gigs of data with a checksum or rowversion would be very compute intensive and time consuming.

    Can you add a timestamp column to your tables with an update trigger?

    Do you have primary keys that are auto increment or sequential guids?

    Monday, October 14, 2019 5:51 AM
    Moderator
  • Hi Manish,

    I am going to recommend Kalyan's feedback but if there is a specific solution you choose to implement, please detail this here so that others can potentially find a solution to their similar issue.

    Regards,

    Mike

    Friday, October 18, 2019 1:36 AM
    Moderator