How to Find Common Records between Source and Target tables?

This video explores how to leverage reconciliation rules to identify unexpected overlaps between source and target tables.

Maintaining clean and well-organized data is crucial. In this video, we’ll focus on the scenario where you want to verify there are no common records between two tables, like “Permanent Employee” and “Temporary Employee.” This helps ensure data accuracy and avoids inconsistencies.

iceDQ’s reconciliation rules empower you to achieve this. The video demonstrates how to create a rule that establishes connections to both source and target tables, defines a join condition to match corresponding records and utilizes the “Intersection A ∩ B” check to specifically identify any common records present in both tables.

By successfully running the rule, you can identify discrepancies between your expectations and the actual data. This helps you maintain data integrity by uncovering unexpected overlaps between tables that should have distinct data and proactively addressing data quality issues before they impact downstream processes.