Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DM-38498: improve follow-up query support for QG generation use cases #876

Merged
merged 8 commits into from
Aug 24, 2023

Commits on Aug 22, 2023

  1. Configuration menu
    Copy the full SHA
    3a8a388 View commit details
    Browse the repository at this point in the history

Commits on Aug 24, 2023

  1. Add support for data ID follow-up queries for calibration datasets.

    This is the butler functionality that will finally let us avoid the
    death-by-many-tiny-queries performance problem in QuantumGraph
    generation for (in particular) ISR.
    TallJimbo committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    a1c3ca3 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    edffe23 View commit details
    Browse the repository at this point in the history
  3. Relax requirement on dimensions in followup dataset queries.

    This will allow reference catalog queries in QG generation to be
    vectorized as long as they use the common skypix system.
    TallJimbo committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    1ea680d View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    16e67b0 View commit details
    Browse the repository at this point in the history
  5. Improve error messages for dataset import conflicts.

    Just had to debug some of these, and found the integer primary keys
    embedded in the old messages hard to use.  Unfortunately I couldn't get
    rid of all of them: this code has no access to the general mapping
    from dataset type ID to dataset type name.  But I think that's the
    least likely field to be causing the conflict here, so it's not a huge
    loss.
    TallJimbo committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    347af20 View commit details
    Browse the repository at this point in the history
  6. Cache dimension records when serializing

    Make use of the serialization caches when calling `to_simple` on
    dimension records.
    natelust authored and TallJimbo committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    1e767ac View commit details
    Browse the repository at this point in the history
  7. Add changelog entry.

    TallJimbo committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    fd2474a View commit details
    Browse the repository at this point in the history