You would typically connect the Duplicate Detector component after an SSIS source component which reads data from the source system that you would like to analyze the duplicates. (Click here for the detailed matching algorithm of the component) It comes with 7 different matching types to meet your different duplicate detection needs. What is Duplicate Detector?ĭuplicate Detector is an SSIS component which can be used to scan incoming rows from a data source and identify duplicate rows. With that being said, we saw a big need for a better duplicate detection tool, so we recently introduced a Duplicate Detector component in our SSIS Productivity Pack, which is a collection of premium SSIS components that help achieve more when using SSIS as your integration platform.įirst, let’s have a quick look at the Duplicate Detector component. In addition to that, the out-of-box duplicate detection capabilities are limited to certain matching options which makes it very inflexible. It allows you to set up Duplicate Detection Rules which can help reduce the opportunity of importing duplicate records, but this doesn’t guarantee eliminating the duplicates that are already in the system, and also your CRM user could always choose to ignore those duplicate warning by entering duplicate data through CRM UI. When it comes to data quality, Microsoft Dynamics CRM (or Dynamics 365 for Sales as the latest name) provides some out-of-box tools that can help work with duplicate data. For this particular reason, our team has developed a comprehensive solution that can help work with the situation, in a productive way. Living in the data integration space, we understand how important it is to keep your data clean. However, identifying and eliminating duplicate data is not a trivial job without a proper tool, it can be an extraordinary effort, and it can be a frustrating process when not done properly. It is important to make sure that the data in your application system is accurate, complete, and consistent across the application. Data quality is critical to your application system's user adoption.
0 Comments
Leave a Reply. |