Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[WIP] Next-generation CI/CD pipelines with RunsOn #11001

Draft
wants to merge 48 commits into
base: master
Choose a base branch
from
Draft

[WIP] Next-generation CI/CD pipelines with RunsOn #11001

wants to merge 48 commits into from
+3,477 −3,732

Commits on Oct 17, 2024

  1. Remove existing GH workflows

    @hcho3
    hcho3 committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    1fa8c70 View commit details
    Browse the repository at this point in the history

  2. First RunsOn example

    @hcho3
    hcho3 committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    78c4d8c View commit details
    Browse the repository at this point in the history

  3. Test custom runner config

    @hcho3
    hcho3 committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    92fd6a2 View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2024

  1. Try out GPU support

    @hcho3
    hcho3 committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    d6761cb View commit details
    Browse the repository at this point in the history

Commits on Oct 23, 2024

  1. Add Windows

    @hcho3
    hcho3 committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    3331cd6 View commit details
    Browse the repository at this point in the history

  2. Fix Windows build

    @hcho3
    hcho3 committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    61f207d View commit details
    Browse the repository at this point in the history

  3. Custom image for Linux

    @hcho3
    hcho3 committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    6b78a12 View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2024

  1. New Docker wrapper with S3 caching

    @hcho3
    hcho3 committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    000be18 View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2024

  1. Create utility script to build CI container

    @hcho3
    hcho3 committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    e1e3b41 View commit details
    Browse the repository at this point in the history

Commits on Oct 27, 2024

  1. Migrate some tasks from BuildKite

    @hcho3
    hcho3 committed Oct 27, 2024
    Configuration menu
    Copy the full SHA
    5373276 View commit details
    Browse the repository at this point in the history

Commits on Oct 30, 2024

  1. Move more pipelines; refine stash_artifacts

    @hcho3
    hcho3 committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    fa96af1 View commit details
    Browse the repository at this point in the history

  2. Simplify stash_artifacts

    @hcho3
    hcho3 committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    f387555 View commit details
    Browse the repository at this point in the history

  3. Migrate Python tests

    @hcho3
    hcho3 committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    91eee2d View commit details
    Browse the repository at this point in the history

Commits on Oct 31, 2024

  1. Mass renaming; Migrate R GPU pkg build + MacOS

    @hcho3
    hcho3 committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    26fff38 View commit details
    Browse the repository at this point in the history

Commits on Nov 1, 2024

  1. Fix dmlc#10752

    @hcho3
    hcho3 committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    bf4b8ea View commit details
    Browse the repository at this point in the history

  2. Fix clang-tidy + rpkg build

    @hcho3
    hcho3 committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    80a883e View commit details
    Browse the repository at this point in the history

Commits on Nov 5, 2024

  1. [WIP] Properly handle shaded JARs

    @hcho3
    hcho3 committed Nov 5, 2024
    Configuration menu
    Copy the full SHA
    d86deda View commit details
    Browse the repository at this point in the history

Commits on Nov 13, 2024

  1. [CI] Pin Dask to 2024.10.0 (dmlc#10995)

    @hcho3
    hcho3 committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    125b7e9 View commit details
    Browse the repository at this point in the history

Commits on Nov 14, 2024

  1. Refactor JVM tests

    @hcho3
    hcho3 committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    f3ccc6f View commit details
    Browse the repository at this point in the history

  2. [jvm-packages] resolve spark compatibility issue (dmlc#10917) 

    ---------

Co-authored-by: Hyunsu Cho <[email protected]>
    @wbo4958 @hcho3
    wbo4958 and hcho3 committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    67d0cc6 View commit details
    Browse the repository at this point in the history

Commits on Nov 15, 2024

  1. Test GPU JVM packages

    @hcho3
    hcho3 committed Nov 15, 2024
    Configuration menu
    Copy the full SHA
    b65e2cc View commit details
    Browse the repository at this point in the history

  2. Disable the host numa virtual memory allocator for now. (dmlc#10934)

    @trivialfis @hcho3
    trivialfis authored and hcho3 committed Nov 15, 2024
    Configuration menu
    Copy the full SHA
    f4d94a1 View commit details
    Browse the repository at this point in the history

Commits on Nov 16, 2024

  1. Run GPU tests with privilege escalation

    @hcho3
    hcho3 committed Nov 16, 2024
    Configuration menu
    Copy the full SHA
    e1c7e24 View commit details
    Browse the repository at this point in the history

Commits on Nov 17, 2024

  1. Reboot after install driver; use proprietary driver for now

    @hcho3
    hcho3 committed Nov 17, 2024
    Configuration menu
    Copy the full SHA
    11b0427 View commit details
    Browse the repository at this point in the history

  2. Try removing --privileged flag

    @hcho3
    hcho3 committed Nov 17, 2024
    Configuration menu
    Copy the full SHA
    49eaec1 View commit details
    Browse the repository at this point in the history

  3. Revert "Disable the host numa virtual memory allocator for now. (dmlc… 

    …#10934)"

This reverts commit f4d94a1.
    @hcho3
    hcho3 committed Nov 17, 2024
    Configuration menu
    Copy the full SHA
    d3482e1 View commit details
    Browse the repository at this point in the history

Commits on Nov 18, 2024

  1. Build JVM docs

    @hcho3
    hcho3 committed Nov 18, 2024
    Configuration menu
    Copy the full SHA
    130d303 View commit details
    Browse the repository at this point in the history

  2. Re-org test scripts

    @hcho3
    hcho3 committed Nov 18, 2024
    Configuration menu
    Copy the full SHA
    a45b24f View commit details
    Browse the repository at this point in the history

  3. More reorg

    @hcho3
    hcho3 committed Nov 18, 2024
    Configuration menu
    Copy the full SHA
    6dc0df2 View commit details
    Browse the repository at this point in the history

  4. Disable the host numa virtual memory allocator for now. (dmlc#10934)

    @trivialfis @hcho3
    trivialfis authored and hcho3 committed Nov 18, 2024
    Configuration menu
    Copy the full SHA
    d1d82bc View commit details
    Browse the repository at this point in the history

  5. Fix run flags to Python tests

    @hcho3
    hcho3 committed Nov 18, 2024
    Configuration menu
    Copy the full SHA
    ad75358 View commit details
    Browse the repository at this point in the history

Commits on Nov 19, 2024

  1. Separate workflow for JVM packages

    @hcho3
    hcho3 committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    06d060b View commit details
    Browse the repository at this point in the history

  2. Rename workflow files

    @hcho3
    hcho3 committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    588dd67 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'upstream/master'

    @hcho3
    hcho3 committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    30c1470 View commit details
    Browse the repository at this point in the history

  4. Consolidate workflow defs

    @hcho3
    hcho3 committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    cb8f63f View commit details
    Browse the repository at this point in the history

  5. Various fixes

    @hcho3
    hcho3 committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    9f9db2b View commit details
    Browse the repository at this point in the history

  6. Disable dependabot for now

    @hcho3
    hcho3 committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    dce4f7b View commit details
    Browse the repository at this point in the history

  7. Fixes

    @hcho3
    hcho3 committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    dfd5624 View commit details
    Browse the repository at this point in the history

  8. Don't upload artifacts from pull requests

    @hcho3
    hcho3 committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    0ee55c2 View commit details
    Browse the repository at this point in the history

  9. Merge branch 'master' into xgboost-ci-ng

    @hcho3
    hcho3 authored Nov 19, 2024
    Configuration menu
    Copy the full SHA
    90594ff View commit details
    Browse the repository at this point in the history

  10. Fix

    @hcho3
    hcho3 committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    cb55d7a View commit details
    Browse the repository at this point in the history

  11. Merge remote-tracking branch 'upstream/master'

    @hcho3
    hcho3 committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    377b3e7 View commit details
    Browse the repository at this point in the history

  12. Fix merge conflict

    @hcho3
    hcho3 committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    6641f7d View commit details
    Browse the repository at this point in the history

  13. Fix

    @hcho3
    hcho3 committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    0727cf5 View commit details
    Browse the repository at this point in the history

  14. Remove unneeded matrix; set max-parallel

    @hcho3
    hcho3 committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    3c2e5c8 View commit details
    Browse the repository at this point in the history

Commits on Nov 20, 2024

  1. Formatting fixes

    @hcho3
    hcho3 committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    32f7406 View commit details
    Browse the repository at this point in the history

  2. Fix update_rapids.sh

    @hcho3
    hcho3 committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    e148e29 View commit details
    Browse the repository at this point in the history

  3. Add JVM deploy

    @hcho3
    hcho3 committed Nov 20, 2024
    Configuration menu
    Copy the full SHA
    d8abb3c View commit details
    Browse the repository at this point in the history