Table of Contents


One key element of any successful CRM project is the ability to migrate data and keep data integrated between applications.  In order to have a stable and viable Microsoft Dynamics CRM environment you need to ensure that all your data integration and migration is done using a supported method.  Directly modifying data in the database is not supported for a number of architectural reasons.  This means that  you should not perform direct inserts, updates or deletes. Instead, you should interface with CRM by leveraging the CRM web services and supported methods.  You can find the information needed in the Microsoft Dynamics SDK. There are different supported ways to read data from CRM: one is to use the CRM web service, the other is to use SQL statements to query the CRM filtered views. Note that the second option is not available if using CRMOnline, so you can use the CRM web services to retrieve data from CRMOnline.

Since there would be significant development effort to build code from scratch to use the CRM web services, and others have already created integration applications, most choose to use one of the available tools. One common tool is to use SQL Server Integration Services (SSIS) when combined with one of a few 3rd party CRM-SSIS adapters.  Other ETL vendors have been adding CRM webservice adapters and other supported tools to their own suites.

From a feature perspective  all data integration solutions have some similarities and generally include the following basic features: 

  • Source-to-target mapping
  • Data manipulation and transformation
  • Scheduling (for batch-based processing)
  • Error handling
From a performance perspective, all data integration solutions are designed to be able to scale by taking advantage of the server computing resources.  However, your choice of SSIS adapters might perform differently depending on whether they have been developed to take advantage of the full power of the SSIS platform.  

Another consideration when determining which tool is right for you is to understand the technical resources that are available to you.  Do you have inhouse developers who are familiar with SSIS? Maybe you have CRM business analysts or CRM system administrators who might be more comfortable with Scribe or a similar tool.  Regardless of the tool you select, all will have a learning curve. While SSIS is more likely a “go to” tool for developers, Scribe might be easier for a business analyst type to use.  In either scenario, it is generally a good idea to obtain a trial version of the tool and try it before purchasing.  

Most of the tools are designed around a batch processing model, in which a set of records is read from a source system, transformed (if necessary), then written to a destination system. These tools are normally scheduled to run on a periodic basis. Of the tools listed below, Microsoft Biztalk Server would typically be described as a middleware tool that uses an alternative model, which is message-based. Microsoft Biztalk Server is a powerful tool so one consideration is the expertise of your Biztalk resources. In this model, the source system would typically write data as it is changed as a message to the middleware tool. The middleware would then perform any transformation or routing logic, then update the destination. There are further differences between a batch processing model, and a message-based one, which are beyond the scope of this article, but may also impact your choice of integration tool. In addition to batch you also can consider real-time and near time integration.

Data Integration Solutions

There are many options for integrating your Microsoft Dynamics CRM system with other in-house and third-party systems.  The list below represents some of the data integration solutions available for Microsoft Dynamics CRM:

Microsoft

  1. Microsoft Dynamics CRM Data Import Wizard
  2. Connector for Microsoft Dynamics. Free product supporting integration of Dynamics CRM with Dynamics ERP (GP, AX, NAV, SL). More information available on Dynamics Connector blog.  
  3. Microsoft SQL Server Integration Services
  4. Microsoft BizTalk Server
  5. Microsoft Dynamics CRM 2011 & Sharepoint 2010. Better together [es-ES]
  6. How to integrate Dynamics CRM 2011 and SharePoint 2010 [es-ES]
  7. Microsoft Dynamics CRM 2011 Instance Adapter
  8. The Integration Guide: Microsoft CRM Online and Office 365
  9. Microsoft Dynamics CRM 2016 Customization - Second Edition
  10. Building Dashboards with Microsoft Dynamics GP 2016 - Second Edition

Third-Party Dynamics CRM adapters for BizTalk

  1. SJ Softech BizTalk (2009, 2010 & 2013)  Microsoft Dynamics CRM ( 2011 & 2013) Adapter 
  2. BizTalk-Adapter for Microsoft Dynamics CRM 2011

Third-Party Dynamics CRM adapters for SQL Server Integration Services (SSIS)

  1. KingswaySoft SSIS Integration Toolkit for Microsoft Dynamics CRM
  2. CozyRoc SSIS+ component for Microsoft Dynamics CRM
  3. RSSBus SSIS task for Microsoft Dynamics CRM
  4. Team4 SSIS Connector for Microsoft CRM
  5. PragmaticWorks TaskFactory SSIS Source/Destination for Dynamics CRM 

Third-Party ETL Tools with Dynamics CRM adapters

  1. appStrategy appCompass for Microsoft Dynamics CRM
  2. BlueIntegrator and BlueSSIS with Microsoft CRM transport and connectors
  3. C360 Import Manager for Microsoft Dynamics CRM 2011   
  4. eOne Smart Connect
  5. InaPlex Inaport. Read TechNet case study on using InaPlex Inaport for data integration with Microsoft Dynamics CRM
  6. Informatica PowerExchange for Microsoft Dynamics CRM
  7. Jitterbit
  8. Magic iBOLT for Microsoft Dynamics CRM
  9. Pervasive Data Integrator for Microsoft Dynamics
  10. QuickBix Integration Suite for Microsoft Dynamics CRM
  11. RapidiOnline Microsoft Dynamics CRM Integration
  12. Riva Omni Integration Server for Microsoft Dynamics CRM
  13. Scribe Insight and Scribe Online with adapter for Microsoft Dynamics CRM
  14. Simego Data Sync
  15. Starfish ETL
  16. Synchronicity's ECHO moving from onpremise to online
  17. IBM WebSphere Cast Iron Integration for Microsoft Dynamics
  18. Flow Software Integration Solution
  19. Skyvia - ETL solution for Dynamics CRM 
  20. Connecting Software: Easy Software integration
  21. Integration Tool Free open source tool for Dynamics CRM

See Also

Another important place to find a huge amount of BizTalk related articles is the TechNet Wiki itself. The best entry point is BizTalk Server Resources on the TechNet Wiki.