In this video, Sandesh Gawande, CEO of iceDQ, tackles a pressing question: If data teams have been tracking quality for over 20 years, why do AI projects still fail? Drawing on his engineering background and factory floor analogies, he reveals why measuring data quality too late undermines AI success.
He argued that the real problem isn’t a lack of measuring data quality, but measuring it too late. By the time issues like poor accuracy, missing data, or inconsistencies are found, the damage is already done. Just like factories need good raw materials and smooth processes, AI models need reliable data and stable systems, if either fails, the whole system can break down.
Watch the video below for a clearer understanding of these insights in action.
Key Topics Covered
- What is iceDQ?
- Why Data Quality Matters in the Age of AI
- Introducing the Concept of a Data Factory
- The Persistent Problem with Data Quality
- Data Quality Metrics: Are They Enough?
- Real-World Case
- Data Quality vs Data Reliability
- What Is Data Reliability?
- Quality vs Reliability: Knife and Sword Analogy
- The 3 Pillars: People, Process, and Tools
- The Data Factory Model Explained
- Data Testing: What Needs to Be in Place?
- Embedding White-Box Monitoring
- Data Monitoring: Are You Doing It Right?
- Reconciliation and Business Rule Checks
- Observability and Final Product Checks
- Final Thought: Reliable vs Quality Sword
Key Takeaways:
- The shift from traditional data quality to data reliability
- Building proactive systems that detect and prevent issues before they reach production
- Core practices: migration testing, pipeline certification, anomaly
- Detection, defect prediction, and compliance tracking
- Why engineering quality at the source is essential for AI success