Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat(schema-compiler): custom granularity support #8537

Merged
merged 84 commits into from
Sep 12, 2024
Merged

feat(schema-compiler): custom granularity support #8537

merged 84 commits into from
Sep 12, 2024

Commits on Sep 12, 2024

  1. remove unneeded filter for granularities

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    d6f5355 View commit details
    Browse the repository at this point in the history

  2. dedup month in standardGranularitiesParents

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    3b86c53 View commit details
    Browse the repository at this point in the history

  3. feat(schema-compiler): update cube's schema to allow granularities fo… 

    …r time dimensions
    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    ecd648e View commit details
    Browse the repository at this point in the history

  4. fix custom granularity processing in time dimension

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    747da06 View commit details
    Browse the repository at this point in the history

  5. update yaml schema compiler to process custom granularities

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    306309f View commit details
    Browse the repository at this point in the history

  6. Add custom granularities support to time dimension and base query

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    7193911 View commit details
    Browse the repository at this point in the history

  7. feat(schema-compiler): update cube's schema to allow granularities fo… 

    …r time dimensions (simple syntax)
    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    868c0ee View commit details
    Browse the repository at this point in the history

  8. Add custom granularities simple syntax support to the time dimension … 

    …and base query
    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    db95c27 View commit details
    Browse the repository at this point in the history

  9. Rename baseGranularity → rollupGranularity

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    5e41356 View commit details
    Browse the repository at this point in the history

  10. fix schema validation

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    57db063 View commit details
    Browse the repository at this point in the history

  11. fix custom granularity processing in BaseTimeDimension

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    acbf61a View commit details
    Browse the repository at this point in the history

  12. Moved custom granularity processing from time dimension to base query

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    22295cb View commit details
    Browse the repository at this point in the history

  13. Revert: deep evaluateSymbolSql processing

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    68b2cf9 View commit details
    Browse the repository at this point in the history

  14. Implement dimensionTimeGroupedColumn for Snowflake

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    747a04f View commit details
    Browse the repository at this point in the history

  15. Implement dimensionTimeGroupedColumn for MySQL

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    ad78b11 View commit details
    Browse the repository at this point in the history

  16. Add custom granularity time intervals generation (used in rollups)

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    5146ce4 View commit details
    Browse the repository at this point in the history

  17. Rewrite parseSqlInterval from regex to split

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    26bb1ad View commit details
    Browse the repository at this point in the history

  18. Add tests for timeSeriesFromCustomInterval

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    340ee72 View commit details
    Browse the repository at this point in the history

  19. Add tests for yaml schema compiler

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    f0bc42e View commit details
    Browse the repository at this point in the history

  20. Add tests for cube validator

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    06eea5e View commit details
    Browse the repository at this point in the history

  21. Fix overTimeSeriesQuery with custom granularities

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    0e97d89 View commit details
    Browse the repository at this point in the history

  22. Add tests for sql query generation for queries with custom granularities

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    d021769 View commit details
    Browse the repository at this point in the history

  23. return back deleted test

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    56a43d0 View commit details
    Browse the repository at this point in the history

  24. Remove comment, add types

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    ecfd06c View commit details
    Browse the repository at this point in the history

  25. update cube validation scheme: remove sql, add origin

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    6689cd1 View commit details
    Browse the repository at this point in the history

  26. add tests for cube validator

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    0c05cdf View commit details
    Browse the repository at this point in the history

  27. add another test for yaml schema compiler

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    b26abc9 View commit details
    Browse the repository at this point in the history

  28. move isGranularityNaturalAligned() to utils to be reused

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    8040780 View commit details
    Browse the repository at this point in the history

  29. Add Granularity entity and move all related processing there 

    also implement date_bin for postgres
    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    4cf64af View commit details
    Browse the repository at this point in the history

  30. temporary comment out dimensionTimeGroupedColumn

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    41f9e9f View commit details
    Browse the repository at this point in the history

  31. Fix timeSeriesFromCustomInterval generation

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    c31a55c View commit details
    Browse the repository at this point in the history

  32. Fix tests timeSeriesFromCustomInterval

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    a71ef83 View commit details
    Browse the repository at this point in the history

  33. Add more tests for timeSeriesFromCustomInterval

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    441fd90 View commit details
    Browse the repository at this point in the history

  34. Fix Granularity constructor

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    4cb2ce3 View commit details
    Browse the repository at this point in the history

  35. Add integration tests for Custom Granularities for PostgreSQL

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    e23b3b2 View commit details
    Browse the repository at this point in the history

  36. Fix Custom Granularities tests in CI (needs order by)

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    410b50a View commit details
    Browse the repository at this point in the history

  37. Implement date_bin for Snowflake

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    6a316e5 View commit details
    Browse the repository at this point in the history

  38. Move BaseDbRunner from postgres to separate folder

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    fd3290d View commit details
    Browse the repository at this point in the history

  39. fix customGranularity.origin init

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    c41ecdd View commit details
    Browse the repository at this point in the history

  40. implement dateBin in MySQL

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    c510ae6 View commit details
    Browse the repository at this point in the history

  41. fix interval math ops in MySQL

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    5c59bde View commit details
    Browse the repository at this point in the history

  42. fix postgres custom granularities tests

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    23b1237 View commit details
    Browse the repository at this point in the history

  43. Add tests for custom granularities in MySQL

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    d81dfb0 View commit details
    Browse the repository at this point in the history

  44. move granularityFromIntervalString from BaseQuery → Granularity

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    8cd6c0d View commit details
    Browse the repository at this point in the history

  45. fix granularityFromIntervalString

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    32ee114 View commit details
    Browse the repository at this point in the history

  46. improve addInterval / subtractInterval in MS SQL Query (now supports … 

    …intervals with >1 time units)
    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    d198127 View commit details
    Browse the repository at this point in the history

  47. Implement dateBin for MS SQL

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    fa8f60b View commit details
    Browse the repository at this point in the history

  48. Add tests for custom granularities in MS SQL

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    98b6418 View commit details
    Browse the repository at this point in the history

  49. fix 2 granularities test (actually revert the bad changes back)

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    39c4b08 View commit details
    Browse the repository at this point in the history

  50. add comment for dateBin in postgresql query

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    8ebc08c View commit details
    Browse the repository at this point in the history

  51. Implement dateBin for Databricks

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    3ed167f View commit details
    Browse the repository at this point in the history

  52. Implement dateBin for DuckDB

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    58f5890 View commit details
    Browse the repository at this point in the history

  53. implement dateBin for BigQuery

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    e4c18d9 View commit details
    Browse the repository at this point in the history

  54. extend testing fixtures with custom granularities

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    60756e4 View commit details
    Browse the repository at this point in the history

  55. fix TimeDimensionGranularity type to allow custom granularities

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    700dced View commit details
    Browse the repository at this point in the history

  56. Add more unit tests for granularities

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    6350fc1 View commit details
    Browse the repository at this point in the history

  57. fix writing yaml with test cubes definitions containing origin with d… 

    …ashes
    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    eaac9fa View commit details
    Browse the repository at this point in the history

  58. add tests for custom granularities in testing drivers

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    251ded8 View commit details
    Browse the repository at this point in the history

  59. skip custom granularities tests for athena

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    7775927 View commit details
    Browse the repository at this point in the history

  60. skip custom granularities tests for clickhouse

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    fb82b5c View commit details
    Browse the repository at this point in the history

  61. add test snapshots for custom granularities tests for postgres

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    9e4081f View commit details
    Browse the repository at this point in the history

  62. skip custom granularities tests for mysql (some)

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    4d939f8 View commit details
    Browse the repository at this point in the history

  63. add test snapshots for custom granularities tests for ms sql

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    49a2665 View commit details
    Browse the repository at this point in the history

  64. skip custom granularities tests for mssql (some)

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    0186c6b View commit details
    Browse the repository at this point in the history

  65. add test snapshots for custom granularities tests for snowflake

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    1224869 View commit details
    Browse the repository at this point in the history

  66. add test snapshots for custom granularities tests for bigQuery

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    389c7ea View commit details
    Browse the repository at this point in the history

  67. skip custom granularities tests for databricks (some)

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    fcbf366 View commit details
    Browse the repository at this point in the history

  68. add test snapshots for custom granularities tests for Databricks

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    39f96e2 View commit details
    Browse the repository at this point in the history

  69. Implement dateBin for ClickHouse

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    7a4aecc View commit details
    Browse the repository at this point in the history

  70. Add custom granularities integration tests for ClickHouse

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    8b96ae5 View commit details
    Browse the repository at this point in the history

  71. unskip custom granularities tests for clickhouse (some)

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    d2a5fa8 View commit details
    Browse the repository at this point in the history

  72. add test snapshots for custom granularities tests for ClickHouse

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    f048888 View commit details
    Browse the repository at this point in the history

  73. fix linting

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    8c82e27 View commit details
    Browse the repository at this point in the history

  74. fix integration tests for clickhouse v22.x

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    6bf8aa6 View commit details
    Browse the repository at this point in the history

  75. fix in dateBin for Postgresql and Bigquery

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    1bdec91 View commit details
    Browse the repository at this point in the history

  76. Add char limits for granularities names in queries

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    e62cfc4 View commit details
    Browse the repository at this point in the history

  77. Add time series date range limit checking before generating

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    e021cad View commit details
    Browse the repository at this point in the history

  78. add tests for limit checking in time series generation

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    ad8f395 View commit details
    Browse the repository at this point in the history

  79. Improve error message for time series limit

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    dab2a49 View commit details
    Browse the repository at this point in the history

  80. fix tests for time series limit

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    e8596c2 View commit details
    Browse the repository at this point in the history

  81. Refactor: move isGranularityNaturalAligned from Basequery → Granulari… 

    …ty class
    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    535e9db View commit details
    Browse the repository at this point in the history

  82. add test snapshots for custom granularities tests for MySQL

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    4f5e6cc View commit details
    Browse the repository at this point in the history

  83. move diffTimeUnitForInterval to BaseQuery

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    93ea144 View commit details
    Browse the repository at this point in the history

  84. fix in choosing minGranularity for granularity with origin point

    @KSDaemon
    KSDaemon committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    dde3c25 View commit details
    Browse the repository at this point in the history