Frequently Asked Questions

The key differentiator is our in-memory rules engine(s). iCEDQ validates data in the server memory allowing users to test a high volume of data efficiently. iCEDQ also offers an engine based on Apache Spark, which enables users to scale testing of billions of rows on their Spark cluster.

Customer support is also excellent. If you don’t believe it, then sign up for a trial.

While there are many differences between iCEDQ and other ETL Testing Tools, given below are a few that stand out the most.

1. iCEDQ evaluates data in memory; it does not load it into any database.
2. It supports four different types of rules, Recon, Validation, Checksum, and Script.
3. Users can use SQL + Apache Groovy to create advanced transformation checks.
4. Users can write Script rules using Apache Groovy or Java.
5. Governance/ Compliance Users for Governing or Monitoring Production systems
6. It is a server-based platform and does not require any client installations
7. An organization can create custom dashboards and reports using its enterprise reporting tool

You can also read our article “iCEDQ Platform vs Data Quality Tools“

The Script Rule enables a user to automate the testing end to end. Users can write any custom Apache Groovy script or a Java class and execute it from iCEDQ. Below are some of the real-world use cases of Script Rule:

1. Create tables and insert expected data for testing.
2. Read a dynamic parameter from a database and pass it to a Rule.
3. Take a backup of the table and compare it with the actual table post ETL.

You can use iCEDQ in

• Development phase for Quality Assurance/ Testing
• Production phase for Data Monitoring/ Compliance

Following groups of users should be interested in iCEDQ

• Developers for UNIT Testing
• QA Users for Functional Testing, Non-Functional Testing, Regression Testing
• QA Managers for Release Management, Sign Off
• Data Architects, DW Managers to monitor the progress of the project
• Governance/ Compliance Users for Governing or Monitoring the Production system

You can compare millions of rows with iCEDQ. Depending upon the type of audit rule created, iCEDQ can process anywhere between 10k – 20k rows/ sec.

Yes, it can. iCEDQ supports Flat Files, Excel, XML, JSON, Parquet, and other file formats.

No, iCEDQ does not use a database to compare or validate data. It has an in-memory rules engine purely built in Java and Spark.

The software runs on a server where all the data processing happens. Users can access it through the web app; no client installations needed.

No, iCEDQ does not use a database to compare or validate data. It has an in-memory rules engine purely built in Java.

Not at all. The engine pulls data into memory, in chunks, evaluates it, and keeps on doing that till the complete data set is validated.

There are multiple ways to scale iCEDQ based on the requirement. Different options are available:

1. Adding more CPU will allow you to run more Rules in parallel.
2. Using our HA Cluster will enable you to install the engine and app on multiple servers. This will make the app Highly available and increase the number of CPUs.
3. Using High Throughput Edition will allow you to run a Rule on multiple cores, in turn, improving the performance of an individual Rule.
4. Spark Edition will enable the user to scale the performance of an individual Rule based on the size of the cluster.

We do expose an API to execute Rules from any external tool for integration. Users can override connections and parameters on runtime using the API allowing them to reuse the Rules.

Yes. Users can export an individual Rule, a batch of Rules, or a complete project into an export file. And then import it in any instance of iCEDQ.

Below are the requirements for installing iCEDQ.

• Windows or Linux Server
• Java JDK 1.8 or above
• Database Schema (Oracle/ MSSQL/ Postgres)

You can take a look at the pre-installation checklist here.

We recommend a minimum of 16 GB. You can increase it based on your workload and usage.

It takes 30-45 mins to install and get iCEDQ up and running.

It is a straightforward, in-place upgrade. We recommend taking a backup of the database repository before the update.

Yes, you can install iCEDQ on any cloud platform. Customers have installed this on AWS, Azure, and GCP.

Yes, as long as your VPN allows you to do so. We do not put any restrictions on where you can install and what you can connect too.

You can connect to Snowflake, Redshift, S3, and many others. Fnd the complete list here.

It uses JDBC or JDBC-ODBC bridge to connect to various data sources. Sometimes we built custom connectors using the data source SDK in Java. 

It can connect to any JDBC compliant database like SQL Server, Oracle, Postgres SQL, etc. You can look at the complete list of database connectors here.

Users can read data from flat files (delimited or fixed-width), XML, JSON, Excel. You can check out the complete list of supported file types here.

Yes, iCEDQ allows the user to write SQL against an XML file. 

Yes, iCEDQ allows the user to write SQL against a JSON file. 

You can raise a feature request on our support portal or reach out to our sales team to get more information. 

Currently, we support the SAP BO Webi and Tableau. Our roadmap for BI Report connectors is driven by customer request. Next, we are going to release the connector for Microstrategy.

It can connect to Hive, Impala, Cassandra, and many other data sources in your ecosystem. You can find the complete list here.

There is no direct support for PDF files, but customers have converted it into XML and used our connector for XML to compare the data.

You can connect to Snowflake, Redshift, Azure Synapse, and a few others. You can find the complete list here.

No. iCEDQ is a software that is entirely managed by the customer with the help of our support team. It does not communicate with external systems, and our teams do not have access to your instance of iCEDQ.

Yes, iCEDQ comes with an outbox integration with HP ALM 12.5 or above. You can import the Requirement and Test Cases from HP ALM and associate the audit rules. After the execution results will be posted back in HP ALM.

Yes, it can be integrated with ETL Tool out there in the market through command line or web services.

Definitely, you can achieve that using the command line or web service interface of iCEDQ.

We have Rest API’s and a CLI which customers use to trigger test from any external Scheduling, ETL, Workflow, or Scripting tool.

Currently, we have out of the box integrations with HP ALM, JIRA, and Jenkins. Customers can also build their own integrations with tools like Service Now, Slack, Elastic Search through our Integration Hub module.

Yes, you can. We have Rest API to trigger Rules and Regression packs from any external tool.

Absolutely !!! Customers have integrated with Jenkins, Bamboo, and other CI/ CD tools using our APIs, CLI, or plugins.

You can integrate with HP ALM, X-Ray. And we are planning to release support for QTest, TFS, and a few other test case management tool.

Yes, iCEDQ will send email alerts on success or failure of rule depending upon how it is configured.

Yes, we do. Customers can create users, groups, and give different types of grants on connections, projects, and other entities. 

Yes. Customers can support LDAP users as well as local application users at the same time. 

iCEDQ supports two types of connections, generic connections that can use service accounts and user connections in which each user has to provide their credentials. User connection offers an added level of security as other users are not using credentials.

Yes, iCEDQ provides a few pre-packaged dashboards in its reporting and dashboard module.

Yes, you can. We have reporting and dashboard module which allows users to generate any report and dashboards using available templates.

It sends email alerts on the success and failures of the Rules. The email includes execution details as well as the ability to download the data issues in an excel format.

The Rules are configured to send email alerts to users, groups, or distribution lists.

Yes, we give a free 30-day trial, where you will have access to the complete iCEDQ software and support. First we will schedule a demo of the product and answer any questions you have. This ensures that your requirements can be satisfied by iCEDQ.
Request for 30 Day Free Trial.

As part of the trial/ POC, we do a 1.5-hour training session at no cost. We also schedule a weekly standing call to help you with any questions.

We also provide access to our support portal.

Download iCEDQ pre-installation checklist here.

We provide a most recent GA full version iCEDQ software for a trial. Nothing is disabled.

You can install it on-prem or in your private cloud (AWS/ Azure/ GCP).

You can raise a ticket on the iCEDQ support portal. We will also assign a customer success manager to you as part of the trial, who will be responsible for coordinating everything.

We provide email, phone, and WebEx support. In some instances, we offer onsite support too.

Yes, we provide 24×7 support via email, phone, or WebEx.

As part of onboarding, we provide access to our support portal. Users can raise tickets there or send an email to support.

Yes, we do. Once you get access to our support portal, you will get access to the KB too.

Yes, we provide instructor-led training classes that are either online or in person.

Yes, you will receive a certificate as an “iCEDQ Certified Developer” upon the completion of your training program. It is valid for a calendar year, and a refresher course will be required if there are changes in the software.

Yes, we offer an instructor-led online training program. Each class is interactive and offers hands-on exercises. We will soon be launching a self-paced online training program.

Yes, we do. Please contact us for more details.

We offer different licensing options for customers to choose from based on requirements.

• • Server license (Annual Subscription)
    Deploy iCEDQ on a Server with no restriction on the number of users.
  • Enterprise license (Unlimited deployments)
    Customers can deploy unlimited instances of iCEDQ products across the organization.

No, Unlimited users can log in and use iCEDQ.

Yes, we do offer a subscription license for iCEDQ.

We offer custom connectors add-on for certain types of files and cloud systems and also load balancer add-on. Every add-on is charged separately on a la carte basis.

Yes, we do. Please reach out to us for more details.

Yes, we offer a Jumpstart program, Data Testing as a Service (DTaaS), Data Migration Testing Service, and also resources who are experts in Data Testing and iCEDQ.

Along with the installation, configuration, and training, additional work of actually implementing test rules and mentoring for live projects.

iCEDQ resources will be collecting requirements and implementing audit rules and sharing experience with client resources. Eventually, the customer takes over the activities as they will have a complete grasp of the usage because of ongoing mentoring.

Many organizations want to focus on their core activities and would like someone else manages their data testing and monitoring needs. In such cases, simply hiring an external resource does not work. Because the external resource is responsible for tasks but not the failure or success of the project, that risk is still with the customer.

iCEDQ specializes in data related testing and monitoring and offers “Data Testing as a Service” wherein the iCEDQ team ultimately manages the resources and testing activities.

The number of resources and their locations will be planned together with the client. Based on contract resource could be onsite, Nearshore/Offsite or Offshore depending on the options selected by the customer.

Timeframe: Annual /Project

A lot of organizations are moving to cloud platforms like Snowflake, Redshift, Azure DW, and many other similar platforms. These Data Migration projects have short project timelines, and that is why customers need help with accelerating the testing of it.

This is where the iCEDQ team comes in and offers its expertise on how to do Data Migration testing. We can completely manage the Data Migration Testing or provide resources that are experts in iCEDQ and testing.

We have successfully helped customers migrate their on-prem databases to Redshift and Snowflake.

Please reach out to us for further details.

Yes, we do. We offer services around Data Testing, ETL, Data Modeling, BI Analytics.

Yes, our services team has built tools and processes to help organizations test their migrations quickly and effectively.

Yes, you can. We have an inbuilt scheduling application. But you can also use any external scheduling tools like airflow, Control-M, or Tiday for executing iCEDQ jobs.