SparkDQ
Everything you need to evaluate SparkDQ for data testing: what it is, pricing, features, integrations and the best alternatives.
By Ari Bajo - data engineer turned writer.
Updated on November 13, 2026
- Product
- SparkDQ
- Category
- Data testing
- Pricing
- Free, open source
What is SparkDQ?
SparkDQ is an open-source, declarative PySpark data quality framework with 30+ built-in row and aggregate checks, defined in Python or as dicts, YAML, or JSON, and run in a single pass in your Spark pipelines. It's used to add data quality checks to PySpark pipelines without adopting a platform.
SparkDQ pricing
SparkDQ is free under Apache 2.0, with no paid edition.
SparkDQ features
SparkDQ appears in my lists of the best open-source and data testing tools. It isn't in the feature matrix, so this page covers what it does on each list.
SparkDQ open source
SparkDQ is a declarative PySpark data quality framework under the Apache 2.0 license, maintained by the sparkdq-community project on GitHub, with no paid edition.
Compare: open-source tools
SparkDQ data testing
It has 30+ built-in data testing checks, null, range, pattern, schema, uniqueness, and referential integrity, run on DataFrames in a single pass.
Compare: data testing tools
SparkDQ integrations
SparkDQ lists 1 integration in total.
- Data Transformation: Apache Spark
SparkDQ alternatives
The closest SparkDQ alternatives and most popular competitors are Deequ, Spark Expectations, DQX by Databricks, Great Expectations and Soda Core. They share SparkDQ's main use cases and features, from the closest match down, and each one says when to consider it instead.
SparkDQ FAQ
Is SparkDQ open source?
Yes. SparkDQ is a declarative PySpark data quality framework under the Apache 2.0 license, maintained by the sparkdq-community project on GitHub, with no paid edition.
How much does SparkDQ cost?
SparkDQ is free under Apache 2.0, with no paid edition.
What are the best SparkDQ alternatives and competitors?
The closest alternatives are Deequ, Spark Expectations, DQX by Databricks, Great Expectations and Soda Core. The Alternatives section above says when to consider each one over SparkDQ.
Browse all 102 tool profiles, grouped by category.
Evaluating data tools in 2026?
I curate the most comprehensive lists of data tools, up-to-date comparison tables, and actionable market guides for data teams. More useful than a Gartner report. More reliable than asking AI. Next up: Data FinOps.