BI Report Testing & Dashboard Testing with iCEDQ

Ensure data completeness, accuracy, and consistency throughout the life cycle

Now Automate Testing for Business Objects (BOXE), Tableau, MicroStrategy and IBM Cognos. With iCEDQ, you can certify the reports by validating reports against business requirements or by comparing reports against database or data files.

Dashboards and reports are essential for running business. Thousands of reports are either generated daily and used for business decisions. While reports represent data, they are more like a visual component in applications. The look and feel can be visually checked but the data shown by the report is notoriously difficult to test manually. Further:

  • Reports visual can have graphs or tabular
  • Visual aspects can be changed at runtime
  • Reports can have runtime prompts

BI Testing Reports and Dashboards
However, reports get their data from files or database. And reports get their data through pseudo ETL. So, if by certain means if data can be extracted from the reports then it will be theoretically tested against the database or validated against a business rule.
Reports from files or database

The Manual Approach:

  1. Validate the report manually by looking at the report and doing some calculation in a calculator. It is difficult because the data may be rolled-up from millions of rows.
  2. Reconcile the data by visually comparing the data in the report and then manually checking in the database. The difficulty level just multiplied by 100x now.

The Manual Approach of BI Testing

iCEDQ’s Automated Testing of Reports:

  1. Build a Validation Rule in iCEDQ and point an individual report or a specific report in a dashboard.
  2. Build a Reconciliation Rule in iCEDQ that points to a report or to a database/file. iCEDQ can then automatically compare the data and certify the report.

Thus, iCEDQ not only automates report testing but also enables full automation and DevOps Implementation.

iCEDQ Reports Testing & DevOps Implementation
Automate the last leg of data projects with report test automation. While database provides direct access to their data, reporting tools do not. The BI tools were primarily designed to just provide visualization. In fact, a report might be inside a dashboard and have additional filters. This makes testing reports notoriously difficult to test.

Challenges

Benefits

  • Implementing DevOps for BI
  • Automating report testing
  • Testing reports with different visualizations
  • Dealing with the volume of reports
  • Report Prompts
  • iCEDQ integrates Report testing with DevOps solution
  • iCEDQ directly accesses the report API
  • iCEDQ bypasses the visual format and get underlying data
  • With Automation the quantity of reports doesn’t matter
  • iCEDQ can automate the report prompts with parametrization