SQAI Suite & QA Company: AI Quality put to the test with Evaluaite
SQAI Suite delivers its AI-native SaaS solution to customers worldwide. QA Company was asked to thoroughly assess the quality of the product in a realistic customer setting using Evaluaite as a risk-based quality framework for AI systems.
Timothy Algera (QA Company) & Gilles Dondorp (Qblox)
Customer
SQAI Suite
Sector
AI-native SaaS
Service
AI quality assessment
From challenge to approach
1
AI-native product, new quality questions
SQAI Suite delivers its AI-native SaaS solution to customers worldwide. As AI systems take on an increasingly significant role in critical business processes, the demand for demonstrable quality grows alongside. Traditional testing methods are insufficient for non-deterministic AI systems. SQAI Suite asked QA Company to thoroughly and systematically assess the quality of the product in a realistic customer setting.
2
Evaluaite as a risk-based quality framework
QA Company applied its proprietary Evaluaite methodology: a risk-based quality framework designed specifically for AI systems. Evaluaite makes AI quality measurable through eight quality pillars, collectively covering the full breadth of potential risks from input robustness and output reliability to bias, security and explainability.
Assessment techniques applied
LLM-as-a-judge - Automated evaluation of AI output on relevance, correctness and consistency using a second language model as evaluator.
Deterministic checks - Structured validations against fixed expectations: format, structure, thresholds and invariants.
Non-deterministic checks - Repeated measurements across multiple runs to assess the stability and reproducibility of AI output.
For us, Evaluaite by QA Company provides directly actionable insights into the quality, reliability and areas for improvement of SQAI Suite, resulting in concrete issues that our team can address and work on.
This project once again confirms the conceptual strength of Evaluaite. It provides our customers with an effective and practical approach to making AI quality measurable, auditable and manageable.
Together, SQAI Suite and QA Company demonstrate how a structured, risk-driven approach to AI quality delivers immediate value — in the form of concrete findings, a usable audit trail and a foundation for continuous quality improvement.
Facing a similar challenge?
We'd be happy to help you further
Get in touch for a no-obligation initial conversation.
About SQAI Suite
SQAI Suite delivers an AI-native SaaS solution to customers worldwide. The platform enables organisations to streamline and automate AI-driven processes.