SparkDQ

    Everything you need to evaluate SparkDQ for data testing: what it is, pricing, features, integrations and the best alternatives.

    By Ari Bajo - data engineer turned writer.

    Updated on November 13, 2026

    Product
    SparkDQ
    Category
    Data testing
    Pricing
    Free, open source
    On this page

    What is SparkDQ?

    SparkDQ is an open-source, declarative PySpark data quality framework with 30+ built-in row and aggregate checks, defined in Python or as dicts, YAML, or JSON, and run in a single pass in your Spark pipelines. It's used to add data quality checks to PySpark pipelines without adopting a platform.

    SparkDQ pricing

    SparkDQ is free under Apache 2.0, with no paid edition.

    SparkDQ features

    SparkDQ appears in my lists of the best open-source and data testing tools. It isn't in the feature matrix, so this page covers what it does on each list.

    SparkDQ open source

    SparkDQ is a declarative PySpark data quality framework under the Apache 2.0 license, maintained by the sparkdq-community project on GitHub, with no paid edition.

    Compare: open-source tools

    SparkDQ data testing

    It has 30+ built-in data testing checks, null, range, pattern, schema, uniqueness, and referential integrity, run on DataFrames in a single pass.

    Compare: data testing tools

    SparkDQ integrations

    SparkDQ lists 1 integration in total.

    SparkDQ alternatives

    The closest SparkDQ alternatives and most popular competitors are Deequ, Spark Expectations, DQX by Databricks, Great Expectations and Soda Core. They share SparkDQ's main use cases and features, from the closest match down, and each one says when to consider it instead.

    SparkDQ FAQ

    Is SparkDQ open source?

    Yes. SparkDQ is a declarative PySpark data quality framework under the Apache 2.0 license, maintained by the sparkdq-community project on GitHub, with no paid edition.

    How much does SparkDQ cost?

    SparkDQ is free under Apache 2.0, with no paid edition.

    What are the best SparkDQ alternatives and competitors?

    The closest alternatives are Deequ, Spark Expectations, DQX by Databricks, Great Expectations and Soda Core. The Alternatives section above says when to consider each one over SparkDQ.

    Browse all 102 tool profiles, grouped by category.

    Evaluating data tools in 2026?

    I curate the most comprehensive lists of data tools, up-to-date comparison tables, and actionable market guides for data teams. More useful than a Gartner report. More reliable than asking AI. Next up: Data FinOps.