How to log the number of rows uploaded from BCP to Azure SQL Server RRS feed

  • Question

  • Hello

    We have our in-house data warehouse data being uploaded to MS SQL Azure via BCP. We have processing logs to monitor the number of rows transfered "locally" ie from ODS to DWH to DMT but now we'd like to also track the number of rows uploaded to Azure SQL Server to ensure that data has been correctly uploaded. So the row count in our DMT database must be the same as the row count in Azure for example.

    I'm thinking to import the BCP log files into our ETL application and identifying the row count from there. Another option I'm thinking of is to do the row count in Azure once the ETL job for uploading data is done.

    What are your views on this please?


    Monday, July 13, 2020 11:51 AM