dbqcore

DataBridge Quality Core library is a part of dbqctl.

Available check functions:

• Schema:
  • expect_columns_ordered: Validate table columns match an ordered list
  • expect_columns: Validate table has one of columns from unordered list
  • columns_not_present: Validate table doesn't have any columns from the list or matching pattern
• Table:
  • row_count: Count of rows in the table
  • raw_query: Custom SQL query for complex validations
• Column:
  • not_null: Check for null values in a column
  • freshness: Check data recency based on timestamp column
  • uniqueness: Check for unique values in a column
  • min/max: Minimum and maximum values for numeric columns
  • sum: Sum of values in a column
  • avg: Average of values in a column
  • stddev: Standard deviation of values in a column

Operators supported:

• Comparison: <, >, <=, >=, ==, !=
• Range: between X and Y
• Function-only checks (like not_null, uniqueness)

Changelog