All About ETL Testing, Data Migration & Data Warehouse Testing

The Missing Element in Data Management and Data Governance

Auditing -The Missing Element in Data Management and Data Governance

Perhaps the most astonishing fact, however, is that IT has been blind for so long to the need for monitoring and metering (Auditing) for data health, and yet this fundamental engineering concept.  For instance, Figure 1 illustrates a centrifugal steam engine governor. Figure 1: The Centrifugal Steam Engine Governor This device, invented by James Watt,…

Details

QA Challenges in Data Integration Projects

  Download Whitepaper from here QA Challenges Data Integration Projects Quality Assurance (QA) is a very important component of any data-centric application project.  Projects such as data warehouse, data migration, ETL, Data Lakes and MDM are no exception. The Majority of these projects are multi-year and multi-million dollar in nature due to the amount of work…

Details

Agile Data Warehouse Testing & Data Migration Testing

Automate data warehouse etl testing and migration testing the agile way from Sandesh Gawande   Development of a data warehouse, ETL, data migration or conversion always faces an ever-decreasing timeline. These implementations can take years to complete and users are not ready to wait that long. The waterfall development model has been discarded in favor…

Details

Data Testing Techniques to Migrate Data Successfully

We discussed the potential risks involved with the data migration process in our last iCEDQ insight. As previously mentioned, data migration is an important process where data from one system is transferred to a new, target system. The threat of data loss, data corruption, extended downtime, and application crashes make the data migration process risky.…

Details

The Data Migration Process & the Potential Risks

In this week’s iCEDQ insight, we’ll cover the risks associated with the data migration process. What is Data Migration? Data migration is the process of transferring data from one system to another system, known as the target system, using a variety of tools and techniques. Below are the different types of migrations which are encountered…

Details

3 Reasons to Perform ETL Testing

3 Reasons Why You Need to Perform ETL Testing

An ETL process is at the heart of any data centric system/ project be it Data Migration or Data Warehouse. All the data movement, transformation and conversions are done by the ETL process in order to ensure that all the data is uniform in terms of quantity, quality, and format. So, why is ETL testing…

Details

ETL Development & ETL Testing – a Pipeline for Data Warehouse Testing

ETL Development & ETL Testing – a Pipeline for Data Warehouse Testing

ETL is a process of extracting (E), transforming (T) and loading (L) the data in to data warehouse or any other data centric system. The process involved in developing these ETL processes is time consuming and usually follows the steps below: 1. Understand the Business Requirement 2. Create Technical Specification/ Requirement 3. Generate Mapping Document…

Details

iCEDQ Platform vs Data Quality Tools

iCEDQ Platform vs Data Quality Tools

When people hear about iCEDQ, the first reaction is… “Hey,I already have a data quality tool! Why do I need iCEDQ?” In this article let’s contrast iCEDQ with any other data quality tools available in the market.

Basic-Concept-How to test an ETL process

How to test an ETL process – Basic Concept

In the previous blog post the question was raised as to how to test an ETL process? So today we will talk about the basic concept of ETL testing and Data Warehouse testing. The answer lies in the understanding of an ETL process. An ETL process at its core reads data, applies transformation on it…

Details

ETL-Testing-Vs.-Application

ETL Testing Vs. Application Testing – The Fundamental Difference

At the core, quality is the measurement of deviation between what is expected vs. actual. In quality assurance practice, we implement a set of tests to measure this deviation. The extent of the deviation indicates the quality of the software. In any application testing, there are three common terms that we will notice: Requirements Test…

Details

ETL-Testing-and-Data-Quality

ETL Testing and Data Quality Governance Software – The Missing Link

Data has become critical to business. Hence, enterprises are investing time, money and resources in data centric systems such as data warehouse, MDM, CRM & migration projects. However, all research done by independent agencies indicates that There is such a high failure/delays in implementations of data centric projects Users still don’t trust data coming from data…

Details