All About ETL Testing, Data Migration & Data Warehouse Testing

blog - iCEDQ
QA Challenges in Data Integration Projects Featured - iCEDQ

QA Challenges in Data Integration Projects | Blog

Quality Assurance (QA) is a very important component of any data-centric application project.  Projects such as data warehouse, data migration, ETL, Data Lakes and MDM are no exception. The Majority of these projects are the multi-year and multi-million dollar in nature due to the amount of work and products required. Therefore it’s necessary to have proper planning for QA in place to avoid late discoveries of process and data errors.

While the methodologies of testing have evolved considerably over the years, the science of QA in data integration project has not. In this article, we’ll focus on some of the key challenges with data warehouse testing, data migration testing and ETL testing.

Share On :
Read more
Agile Data Warehouse Testing & Data Migration Testing Featured - iCEDQ

Agile DW Testing & Data Migration Testing | Blog

Development of a data warehouse, ETL, data migration or conversion always faces an ever-decreasing timeline. These implementations can take years to complete and users are not ready to wait that long.

The waterfall development model has been discarded in favor of the agile or development model. However, this has changed only one component of the Data Development Life Cycle. This does not mean that the quality of these processes or the data they produce is of high quality.

Share On :
Read more
Data Migration Testing Techniques to Migrate Data Successfully Featured - iCEDQ

Data Migration Testing Techniques | Blog

We discussed the potential risks involved with the data migration process in our last iCEDQ insight. As previously mentioned, data migration is an important process where data from one system is transferred to a new, target system. The threat of data loss, data corruption, extended downtime, and application crashes make the data migration process risky. Amid these potential risks, a proper quality assurance process must be implemented to test the possibility of various risks of affecting the data migration process.

Share On :
Read more
The Data Migration Process & the Potential Risks Feature - iCEDQ

The Data Migration Process & Potential Risks | Blog

Data migration is the process of transferring data from one system to another system, known as the target system, using a variety of tools and techniques.
Below are the different types of migrations which are encountered in different enterprises: Database Migration: This involves moving from one database software to another. E.g. your organization just bought HP Vertica and is planning to from MySQL to HP Vertica. Database Version Upgrade: This involves upgrading the older version of the database to the latest or most current available database version.

Share On :
Read more
iCEDQ Platform vs Data Quality Tools Featured - iCEDQ

iCEDQ Platform vs Data Quality Tools | Blog

iCEDQ is a Quality Assurance and Test Automation platform for data-centric projects and processes such as data warehouse, CRM, data migration & conversion, ETL. It certifies the ETL processes or migration by effective ETL Testing and Data Migration Testing. The product can be further used for monitoring the data processes in production. The product emphasizes mainly process quality.

The major difference between iCEDQ & other Data Quality tools is the purpose they serve. iCEDQ is a test automation platform for process quality whereas other Data Quality tools are a combination of data profiling & fixing/ correction tool used in production.

Share On :
Read more
How to Test an ETL Process – Basic Concept Featured - iCEDQ

How to Test an ETL Process | Blog

A source table has an individual and corporate customer. The requirement is that an ETL process should take the corporate customers only and populate the data in a target table. The test cases required to validate the ETL process by reconciling the source (input) and target (Output) data. The transformation rule also specifies that output should only have corporate customers.

Share On :
Read more
ETL Testing and Data Quality Governance Software – The Missing Link Featured - iCEDQ

ETL Testing & Data Quality Governance Software | Blog

Data has become critical to the business. Hence, enterprises are investing time, money and resources in data-centric systems such as data warehouse, MDM, CRM & migration projects. However, all research done by independent agencies indicates that, There is such a high failure/delays in implementations of data-centric projects, Users still don’t trust data coming from data warehouses.

Share On :
Read more