Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

~Add nixos-unstable based outputs, bdwgc 8.2.4~, Nixpkgs lib tests, cleanup #9900

Draft
wants to merge 9 commits into
base: master
Choose a base branch
from

Conversation

roberth
Copy link
Member

@roberth roberth commented Feb 1, 2024

Warning

Most of this got reused in #10835, except for the multi-nixpkgs flake, which I'm not sure whether that's the right solution.

Motivation

Nixpkgs currently has a failing test in

This might be a regression.

This PR

The goal of this PR is to update the Nixpkgs pin so that we can run the latest tests again, including @infinisil's extensive filesets tests that found the change in behavior.

TODO

Follow-up?

  • Also run pkgs/test/release/default.nix?

Context

Priorities and Process

Add 👍 to pull requests you find important.

The Nix maintainer team uses a GitHub project board to schedule and track reviews.

@infinisil
Copy link
Member

Tracked down the regression: #9901

Copy link

dpulls bot commented Feb 23, 2024

⚠️ Dpulls not installed on repository NixOS/nixpkgs. Checkout our quickstart for how to install.

@roberth roberth changed the title Nixpkgs lib tests Nixpkgs lib tests update Feb 23, 2024

This comment was marked as duplicate.

roberth added a commit to hercules-ci/nixpkgs that referenced this pull request Feb 23, 2024

This comment was marked as duplicate.

@roberth roberth changed the title Nixpkgs lib tests update Update: bdwgc 8.2.4, Nixpkgs lib tests, cleanup Feb 27, 2024
@roberth roberth marked this pull request as ready for review February 27, 2024 21:19
@roberth roberth requested a review from edolstra as a code owner February 27, 2024 21:19
@roberth
Copy link
Member Author

roberth commented Feb 28, 2024

Marking as draft again while waiting for

which unfortunately wasn't completed yet, and I've duplicated some part of that work independently :(

@roberth roberth marked this pull request as draft February 28, 2024 00:55
pull bot pushed a commit to b-/nixpkgs that referenced this pull request Feb 28, 2024
@roberth roberth mentioned this pull request Feb 28, 2024
@thufschmitt thufschmitt requested a review from tomberek February 28, 2024 20:19
@thufschmitt
Copy link
Member

Discussed during the Nix maintainers meeting on 2024-02-28.
No agreement as to whether we want to follow nixos-unstable, to discuss

  • Originally just wanted to add a nixpkgs lib test

  • Also tracking nixos-unstable

  • Agreement on following nixos-unstable rather than the latest release?

@nixos-discourse
Copy link

This pull request has been mentioned on NixOS Discourse. There might be relevant details there:

https://discourse.nixos.org/t/2024-02-28-nix-team-meeting-129/40499/1

github-actions bot pushed a commit to nix-community/nixpkgs.lib that referenced this pull request Mar 3, 2024
@thufschmitt
Copy link
Member

Discussed during the Nix maintainers meeting on 2024-03-04.
We won't track nixos-unstable as the primary target, but we also want to test against it. Opened #10156 for that.

  • Need to have a job that builds against nixos-unstable so that we don't spend three months updating to the latest release against
    • Can be a side job, not the main one
    • A bit tricky because hydra doesn't have --override-input. But will find a way

@nixos-discourse
Copy link

This pull request has been mentioned on NixOS Discourse. There might be relevant details there:

https://discourse.nixos.org/t/2024-03-04-nix-team-meeting-minute-130/40830/1

roberth added 9 commits March 5, 2024 14:26
Flake lock file updates:

• Added input 'nixpkgs-nixos-unstable':
    'github:NixOS/nixpkgs/b8697e57f10292a6165a20f03d2f42920dfaf973' (2024-03-03)
Since they're generated by autoreconfPhase, we don't need to commit
them (and update them whenever they change upstream).
We didn't provide configure anyway, so having to run something like
autoreconfPhase is already expected by users.
Manually tested by printing to stderr in both branches (sp in os
stack, or not), and triggering a GC in a filterSource function,
e.g.:

    let
      generateTree = n: if n == 0 then "ha" else { left = generateTree (n - 1); right = generateTree (n - 1); };
    in
      builtins.deepSeq (generateTree 18) ...

Note that the darwin still uses the strategy of disabling GC, despite
having an implementation that compiles. The proper solution will be
enabled and tested later.
This re-enables support for older bwdgc versions without complicating
the code too much.
Coroutines generally only interfere with GC during source filtering,
so it's not too bad of a regression on older bdwgc.
This seems preferable over conditional compilation to enable the patch
etc; we've already spent a lot of complexity budget on this GC-coroutine
interaction...
@roberth roberth force-pushed the nixpkgs-lib-tests branch from 81fc556 to e198417 Compare March 5, 2024 16:23
@roberth roberth changed the title Update: bdwgc 8.2.4, Nixpkgs lib tests, cleanup Add nixos-unstable based outputs, bdwgc 8.2.4, Nixpkgs lib tests, cleanup Mar 6, 2024
@roberth roberth marked this pull request as ready for review March 6, 2024 21:13
github-actions bot pushed a commit to arcnmx/nixpkgs-lib that referenced this pull request Mar 10, 2024
@nixos-discourse
Copy link

This pull request has been mentioned on NixOS Discourse. There might be relevant details there:

https://discourse.nixos.org/t/2024-03-06-nix-team-meeting-131/42959/1

@roberth roberth self-assigned this Jan 1, 2025
@roberth roberth marked this pull request as draft January 1, 2025 02:02
@roberth roberth changed the title Add nixos-unstable based outputs, bdwgc 8.2.4, Nixpkgs lib tests, cleanup ~Add nixos-unstable based outputs, bdwgc 8.2.4~, Nixpkgs lib tests, cleanup Jan 1, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
with-tests Issues related to testing. PRs with tests have some priority
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Test Nix using nixos-unstable on the CI
4 participants