Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Sparse GPU OPFLOW Model: Assemble Jacobian and Hessian on device #90

Draft
wants to merge 35 commits into
base: develop
Choose a base branch
from
Draft

Sparse GPU OPFLOW Model: Assemble Jacobian and Hessian on device #90

wants to merge 35 commits into from

Commits on Dec 6, 2023

  1. OPFLOW: initial implementation of RAJA/HiOp sparse GPU-based solver 

    WIP - HIOP Sparse solver with GPU model

OPFLOW: Started work on support for HIOP sparse solver interface for GPUs.

Added a copy of hiop sparse solver interface.

OPFLOW: Added model skeleton for GPU sparse version (copying from pbpolrajahiop)

Fixed build

Did some copy paste to add a test for HIOPSPARSE. This test is not actually
functional yet.

Started updating the hiopsparse model and solver code.

More work on updating the solver and model

Added scalar and vector unit tests for model to be used with HIOP sparse solver on GPU

Apply cmake lint

Fix unit tests.

Set the size of array when using Umpire memset.

Code formatting

Some minor changes to get PBPOLRAJAHIOPSPARSE model code to compile

Separate BUS/LINE/GEN/.../Param structs into reusable module

Minor edit

Rename files

Fix typo

Use BUS/LINE/GEN/.../Param structs in Raja HiOp Sparse model (compiles)

Updating HIOP sparse solver GPU API

Completed bounds kernels

Completed scalar and vector functions

WIP - HIOP Sparse solver with GPU model

OPFLOW: Started work on support for HIOP sparse solver interface for GPUs.

Added a copy of hiop sparse solver interface.

OPFLOW: Added model skeleton for GPU sparse version (copying from pbpolrajahiop)

Fixed build

Did some copy paste to add a test for HIOPSPARSE. This test is not actually
functional yet.

Started updating the hiopsparse model and solver code.

More work on updating the solver and model

Added scalar and vector unit tests for model to be used with HIOP sparse solver on GPU

Apply cmake lint

Fix unit tests.

Set the size of array when using Umpire memset.

Code formatting

Rename files

Use BUS/LINE/GEN/.../Param structs in Raja HiOp Sparse model (compiles)

Updating HIOP sparse solver GPU API

Completed bounds kernels

Jacobian and Hessian for sparse model (CPU --> GPU copy)

Use correct array lengths in Eq. Jacobian

Fix bug in Jacobian.

Fix unused variable/parameter errors

OPFLOW: rework solution callback for RAJA/HIOP GPU-based solver

Formatting changes
    @wperkins
    Abhyankar, Shrirang G authored and wperkins committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    d3e0ac0 View commit details
    Browse the repository at this point in the history

  2. Spit out sparse Jacobian indexes for debugging

    @wperkins
    wperkins committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    80e8599 View commit details
    Browse the repository at this point in the history

  3. Count equality Jacobian nonzeros and assign bus/gen/load locations

    @wperkins
    wperkins committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    8670724 View commit details
    Browse the repository at this point in the history

  4. Equality Jacobian nonzero count matches

    @wperkins
    wperkins committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    0287bd7 View commit details
    Browse the repository at this point in the history

  5. Inequality Jacobian nonzero count matches

    @wperkins
    wperkins committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    02d6619 View commit details
    Browse the repository at this point in the history

  6. Log event begin/end unbalanced in equality Jacobian for some reason

    @wperkins
    wperkins committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    33902a5 View commit details
    Browse the repository at this point in the history

  7. Checkpoint - Equality Jacobian assembly runs

    @wperkins
    wperkins committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    cd0bd76 View commit details
    Browse the repository at this point in the history

  8. Checkpoint: equality Jacobian indexes correct (w/o lines)

    @wperkins
    wperkins committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    8acb1d9 View commit details
    Browse the repository at this point in the history

  9. Add line to/from locations for sparse equality Jacobian

    @wperkins
    wperkins committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    3bf98af View commit details
    Browse the repository at this point in the history

  10. GPU computed sparse equality Jacobian indexes correct

    @wperkins
    wperkins committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    335ddd1 View commit details
    Browse the repository at this point in the history

  11. Add some additional line information for sparse Jacobian assembly

    @wperkins
    wperkins committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    94ddd33 View commit details
    Browse the repository at this point in the history

  12. Sparse GPU equality Jacobian assembly is coded and running (results u… 

    …ntested)
    @wperkins
    wperkins committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    46efbde View commit details
    Browse the repository at this point in the history

  13. Streamline debug printing of equality Jacobian

    @wperkins
    wperkins committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    84a45be View commit details
    Browse the repository at this point in the history

  14. Equality Jacobian is correct, but apparently needs to be reordered

    @wperkins
    wperkins committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    fae9cd9 View commit details
    Browse the repository at this point in the history

  15. Inequality Jacobian indexes are correct (for lines)

    @wperkins
    wperkins committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    6890b32 View commit details
    Browse the repository at this point in the history

  16. Inequality Jacobian values for line limits added

    @wperkins
    wperkins committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    d60a5ff View commit details
    Browse the repository at this point in the history

  17. Minor changes to inequality Jacobian line limit values

    @wperkins
    wperkins committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    523932d View commit details
    Browse the repository at this point in the history

  18. Sort Jacobian indexes, but not values.

    @wperkins
    wperkins committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    fd65166 View commit details
    Browse the repository at this point in the history

  19. Correctly reorder Jacobian values, but using the wrong method

    @wperkins
    wperkins committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    067469f View commit details
    Browse the repository at this point in the history

  20. Actually use GPU-computed Jacobian; reduce steps to reorder Jacobian … 

    …values
    @wperkins
    wperkins committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    8fb2e2c View commit details
    Browse the repository at this point in the history

  21. Print (CPU) Hessian non-zero count, indexes, and values

    @wperkins
    wperkins committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    fe0b6ea View commit details
    Browse the repository at this point in the history

  22. Add Hessian indexes to line params; make sure Hessian index is allocated

    @wperkins
    wperkins committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    fcf9074 View commit details
    Browse the repository at this point in the history

  23. Attempt to count Hessian non-zeros (wrong, of course)

    @wperkins
    wperkins committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    8a2c4d3 View commit details
    Browse the repository at this point in the history

  24. Temporarily capture and report Hessian row/col indexes used

    @wperkins
    wperkins committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    eaa1cf0 View commit details
    Browse the repository at this point in the history

  25. GPU Hessian indexes match model but not resulting matrix?

    @wperkins
    wperkins committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    d241781 View commit details
    Browse the repository at this point in the history

  26. First shot at GPU computed Hessian values (untested)

    @wperkins
    wperkins committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    d15445b View commit details
    Browse the repository at this point in the history

  27. Sort Hessian indexes and permute values; clean up allocations

    @wperkins
    wperkins committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    ca85561 View commit details
    Browse the repository at this point in the history

  28. Add some minor debug messages about Hessian size

    @wperkins
    wperkins committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    8e11b60 View commit details
    Browse the repository at this point in the history

  29. Allocate Hessian differently to avoid unnecessary structure

    @wperkins
    wperkins committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    86f787d View commit details
    Browse the repository at this point in the history

  30. Add an entry for generator reactive power even if it's unused

    @wperkins
    wperkins committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    e3905c7 View commit details
    Browse the repository at this point in the history

  31. GPU assembled Hessian non-zero count and indexes are correct

    @wperkins
    wperkins committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    1e78787 View commit details
    Browse the repository at this point in the history

  32. Mark Hessian contributions with a code

    @wperkins
    wperkins committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    86ff70d View commit details
    Browse the repository at this point in the history

  33. Checkpoint: GPU Hessian values incorrect -- new approach maybe?

    @wperkins
    wperkins committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    718359f View commit details
    Browse the repository at this point in the history

  34. Fix Hessian indexing problems in line limits

    @wperkins
    wperkins committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    baa1c9d View commit details
    Browse the repository at this point in the history

  35. Apply pre-commmit fixes

    @wperkins
    wperkins committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    f05b8d7 View commit details
    Browse the repository at this point in the history