Deequ
Open-source library from AWS Labs for defining unit tests for data on Apache Spark.
Deequ is the top-ranked open-source data quality tool of the 3 we ranked (8.4/10, free plan), best for spark and Scala/Python engineers validating large datasets in batch pipelines. Elementary is the runner-up (8.4/10).
Open-source data quality tools are free to use and can be run inside your own pipelines, with the checks stored as code next to your transformations. You host and maintain them yourself; some vendors also sell a paid cloud version with a user interface and alerting.
Included if: The core product is released under an open-source licence. We apply this rule to the same data as the full data quality tools ranking, so positions follow the overall score.
| Tool | Score | Free plan | Paid from (annual) | Data profiling | Custom rule checks | ML anomaly detection | Data cleansing / correction | Open source |
|---|---|---|---|---|---|---|---|---|
| Deequ | 8.4/10 | Yes | See vendor | Yes | Yes | Not confirmed | Not confirmed | Yes |
| Elementary | 8.4/10 | Yes | See vendor | Not confirmed | Yes | Yes | Not confirmed | Yes |
| Great Expectations (GX Core) | 7.9/10 | Yes | See vendor | Not confirmed | Yes | Not confirmed | Not confirmed | Yes |
Open-source library from AWS Labs for defining unit tests for data on Apache Spark.
dbt-native data observability with an open-source package and CLI plus a paid cloud platform.
Open-source Python library for testing data with declarative 'Expectations'.
How many Open-Source data quality tools publish their prices? 2 of the 3 we ranked publish a price or a free plan; 1 is quote-only: Elementary.
How many Open-Source data quality tools have a free plan? All 3 we ranked have a free plan: Deequ (8.4/10), Elementary (8.4/10), Great Expectations (GX Core) (7.9/10).
Which features set Open-Source data quality tools apart? Data profiling: 1 of 3 (Deequ). ML anomaly detection: 1 of 3 (Elementary). Every tool we ranked confirms custom rule checks, open source, so these do not separate them.
Deequ ranks first (8.4/10) among the 3 data quality tools that meet this rule: the core product is released under an open-source licence. Elementary is second (8.4/10).
Scores come from published, repeatable data (features, free plan, entry price, pricing transparency). No vendor can pay to change a score. Read the methodology · Disclosure.