v1.9.0

1.9.0

• SAP HANA support
• IBM DB2 support
• Improvements to the anomaly rules
• Missing UI for the data domains added
• Incident histogram shows time periods, not the execution day
• Incident notifications fixed to send notifications used a dedicated queue and work even when fallback addresses are not configured
• Data lineage flow diagrams
• Table similarity search to build data lineage
• Table and column screens have a new primary tab to show the data observability status, which is a shortened status
• Basic statistics are scheduled by CRON and reuse the profiling schedule
• Connections support configuring a CRON expression to import new tables

v1.8.0

1.8.0

• Small layout fixes in the UI, mostly related to the colors of issue severity colors
• Documentation for the data quality process and rule mining
• Duplicate record detection check
• Some column-level checks fixed to skip NULL values, instead of treating them as invalid (not passing checks)
• Store data lineage definition (links to source tables)
• Default observability check patterns renamed to data quality policies
• Default quality policy named "default" deleted, and replaced with multiple smaller policies to allow more control

v1.7.0

1.7.0

• Rule miner that proposes data quality rule configuration
• Notifications can be filtered by various parameters, allowing to send notifications to the correct teams
• Estimated word count checks added to support analyzing data for GenAI use cases
• Some pattern validation checks renamed to use a unified naming convention "invalid" in the check names

v1.6.2

1.6.2

• Race condition in the table status cache fixed.

v1.6.1

1.6.1

• Incident notification supports emails
• Small bug fixes in the check editor
• Additional check to detect empty columns
• Copying data quality check patterns

v1.6.0

1.6.0

• Fixes to some error sampling templates
• Redesigned data quality check editor to work in a simplified mode
• JDBC drivers are pre-loaded to avoid issues with automatic registration of JDBC drivers by Java
• Delta Lake and Iceberg support
• Global incident screen redesigned to show the counts of incidents

v1.5.0

1.5.0

• Error sampling
• DuckDB 1.0.0 upgrade
• Global incident management screen
• Support for analyzing flat files on GCP
• Freshness anomaly check
• Filtering tables by name on the table import screen

v1.4.1

1.4.1

• Small fixes to the code that calculates the current data quality status of tables and columns
• Fixed permalinks to screens
• Small changes to handling empty tables in column level data quality checks
• Incident generation fixed for monitoring checks (full table scan checks)

v1.4.0

1.4.0

• Ensure that only one instance of DuckDB engine is loaded
• Profiling and monitoring checks do not render the group by time period (current time)
• Small UI fixes
• Default check patterns (profiles) support disabling and targeting multiple tables and columns
• Global search screens to show tables and columns, filtered by labels
• Data quality check recalibration for failed data quality checks initiated from an incident details screen

v1.3.0

1.3.0

• Screens that show a list of tables and the data quality status divided by data quality dimensions
• Analyze nested values in JSON fields
• Analyze files on Azure storage buckets, using the az:// prefix.