Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Unifies SD pipeline APIs, adds sd3 support, punet integration #706

Merged
merged 175 commits into from
Jul 12, 2024
Merged

Unifies SD pipeline APIs, adds sd3 support, punet integration #706

merged 175 commits into from
Jul 12, 2024

Commits on Jun 17, 2024

  1. Small fixes to SDXL compilation and SD unet script fix.

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    b72ebfb View commit details
    Browse the repository at this point in the history

  2. Formatting and compile flag fixes.

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    ccbe1dd View commit details
    Browse the repository at this point in the history

  3. Enable e2e sdxl test on mi250.

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    76cc4db View commit details
    Browse the repository at this point in the history

  4. Don't decompose attention in sdxl tests by default.

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    5feaf4d View commit details
    Browse the repository at this point in the history

  5. Remove xfails for rocm on submodels.

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    15c46f0 View commit details
    Browse the repository at this point in the history

  6. Change default attention spec path string in unet script.

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    452ff7c View commit details
    Browse the repository at this point in the history

  7. Move attn spec and simplify parsing.

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    9e3a153 View commit details
    Browse the repository at this point in the history

  8. Fix attn spec handling a bit more.

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    e97421c View commit details
    Browse the repository at this point in the history

  9. compile VAE last and disable decomp_attn entirely by default.

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    21f71cd View commit details
    Browse the repository at this point in the history

  10. Update SDXL readme.

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    4a18301 View commit details
    Browse the repository at this point in the history

  11. Remove print statement.

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    7918824 View commit details
    Browse the repository at this point in the history

  12. Add flags to compile step for gfx90a

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    d8839bb View commit details
    Browse the repository at this point in the history

  13. Add support table for gfx targets to sdxl readme.

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    73a6328 View commit details
    Browse the repository at this point in the history

  14. Switch MI250 run to cfg B

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    ead97cf View commit details
    Browse the repository at this point in the history

  15. Update xfails

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    1915ad9 View commit details
    Browse the repository at this point in the history

  16. formatting

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    b582ef0 View commit details
    Browse the repository at this point in the history

  17. tolerance adjust for vae test and flag tweaks

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    110a648 View commit details
    Browse the repository at this point in the history

  18. Remove --decomp_attn from mi250 CI job.

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    3461f91 View commit details
    Browse the repository at this point in the history

  19. Reduce number of sdxl inference steps for CPU CI

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    ed6eca5 View commit details
    Browse the repository at this point in the history

  20. turn off const eval on cpu

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    2a182aa View commit details
    Browse the repository at this point in the history

  21. Remove xfails from rocm sdxl unet+t2i tests

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    b8efd3c View commit details
    Browse the repository at this point in the history

  22. xfails

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    a709214 View commit details
    Browse the repository at this point in the history

  23. Update README.md

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    65a1cb6 View commit details
    Browse the repository at this point in the history

  24. Update sdxl_test.py

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    3d94c81 View commit details
    Browse the repository at this point in the history

  25. Remove vector distribution, pad to intrinsics for now

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    a827c9a View commit details
    Browse the repository at this point in the history

  26. Update flags, deepcopy decomposition defaults

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    cd223e4 View commit details
    Browse the repository at this point in the history

  27. Formatting

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    46925c6 View commit details
    Browse the repository at this point in the history

  28. xfail t2i test on rocm for now.

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    b831643 View commit details
    Browse the repository at this point in the history

  29. add return_imgs option to sdxl pipeline image generate fn.

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    4120122 View commit details
    Browse the repository at this point in the history

  30. Fix default ireec flags.

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    5ba3c35 View commit details
    Browse the repository at this point in the history

  31. Tweak scheduler names in utils

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    29e2506 View commit details
    Browse the repository at this point in the history

  32. Inline pipeline .mlir in python scripts for pip package inclusion.

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    0d6486c View commit details
    Browse the repository at this point in the history

  33. Add attention decomposition option to stateless_llama.py

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    13b068d View commit details
    Browse the repository at this point in the history

  34. Remove old rocm flags

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    f1e150c View commit details
    Browse the repository at this point in the history

  35. Add a few options for argmax to stateless_llama

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    0577d55 View commit details
    Browse the repository at this point in the history

  36. Remove --verify=false from VAE compilation flags and move pipeline IRs

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    b44cd16 View commit details
    Browse the repository at this point in the history

  37. Remove unused import and revert change to sdxl unet correctness toler… 

    …ance.
    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    f23f56d View commit details
    Browse the repository at this point in the history

  38. Formatting

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    6577345 View commit details
    Browse the repository at this point in the history

  39. Relax unet numerics tolerance in sdxl tests.

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    393bfe3 View commit details
    Browse the repository at this point in the history

  40. Update sdxl compile flags.

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    1b0bff6 View commit details
    Browse the repository at this point in the history

  41. Update default_mfma_attn_spec.mlir

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    1cb45b0 View commit details
    Browse the repository at this point in the history

  42. Reorganize some compile flags.

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    d59b909 View commit details
    Browse the repository at this point in the history

  43. formatting

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    660b563 View commit details
    Browse the repository at this point in the history

  44. Update spec for nod-ai/SHARK-TestSuite@072e8b7

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    c3cbf93 View commit details
    Browse the repository at this point in the history

  45. Update README.md

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    54c5283 View commit details
    Browse the repository at this point in the history

  46. (WIP) Unifies SD/SDXL pipelines

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    30469fe View commit details
    Browse the repository at this point in the history

  47. (WIP): More refactoring, setup for split schedulers implementation

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    b7a3f7b View commit details
    Browse the repository at this point in the history

  48. Update test_models.yml

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    3df8532 View commit details
    Browse the repository at this point in the history

  49. Update requirements.txt

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    bd851e3 View commit details
    Browse the repository at this point in the history

  50. Try only pinning brevitas in requirements.

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    66e19f6 View commit details
    Browse the repository at this point in the history

  51. DNM: remove brevitas from models requirements

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    aab85d5 View commit details
    Browse the repository at this point in the history

  52. DNM: Remove brevitas from setup.py

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    e449bb2 View commit details
    Browse the repository at this point in the history

  53. Update utils.py

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    49b1937 View commit details
    Browse the repository at this point in the history

  54. use np.testing.assert_allclose in unet_runner

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    cd44eec View commit details
    Browse the repository at this point in the history

  55. fixup typo.

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    ef53b08 View commit details
    Browse the repository at this point in the history

  56. update tolerances

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    c85b00a View commit details
    Browse the repository at this point in the history

  57. formatting

    @eagarvey-amd @monorimet
    eagarvey-amd authored and monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    25fd6c4 View commit details
    Browse the repository at this point in the history

  58. Enable multiple batch size test.

    @eagarvey-amd @monorimet
    eagarvey-amd authored and monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    7f84246 View commit details
    Browse the repository at this point in the history

  59. Simplify test_shark setup.

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    12ca4c6 View commit details
    Browse the repository at this point in the history

  60. Update requirements.txt

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    af3fc0c View commit details
    Browse the repository at this point in the history

  61. Fix batch size configurability for submodels.

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    82363c5 View commit details
    Browse the repository at this point in the history

  62. Revert change to clip export function signature

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    f1f37e3 View commit details
    Browse the repository at this point in the history

  63. TD spec fixes

    @eagarvey-amd @monorimet
    eagarvey-amd authored and monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    86561e0 View commit details
    Browse the repository at this point in the history

  64. Small fixes.

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    8309b68 View commit details
    Browse the repository at this point in the history

  65. Shore up SD1.5/2.1 implementations to match SDXL pipeline API / struc… 

    …ture
    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    7646f42 View commit details
    Browse the repository at this point in the history

  66. Updates to cpu scheduling fallback.

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    7e80dd7 View commit details
    Browse the repository at this point in the history

  67. Fix arg parsers

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    ed52227 View commit details
    Browse the repository at this point in the history

  68. Formatting.

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    7d30d31 View commit details
    Browse the repository at this point in the history

  69. Fix scheduler api in test.

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    f6e1d8e View commit details
    Browse the repository at this point in the history

  70. Black version fix.

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    c6767fd View commit details
    Browse the repository at this point in the history

  71. add scipy and fix scheduler init

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    93ab363 View commit details
    Browse the repository at this point in the history

  72. Small fixes

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    c8014fc View commit details
    Browse the repository at this point in the history

  73. Fixes to match test function calls.

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    0ad9050 View commit details
    Browse the repository at this point in the history

  74. Enable fetch of wmma spec.

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    dd13911 View commit details
    Browse the repository at this point in the history

  75. Small fixes.

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    bd222b8 View commit details
    Browse the repository at this point in the history

  76. Fixes for gfx1100, WIP sd1/2 pipe fixes

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    5a83242 View commit details
    Browse the repository at this point in the history

  77. turbo fixes

    @eagarvey-amd @monorimet
    eagarvey-amd authored and monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    815da51 View commit details
    Browse the repository at this point in the history

  78. various sd1.5/2.1 fixes

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    8348ff7 View commit details
    Browse the repository at this point in the history

  79. Turbo support #2

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    11430ee View commit details
    Browse the repository at this point in the history

  80. Disable CFG-free turbo exports, small fixes

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    b8a39fe View commit details
    Browse the repository at this point in the history

  81. Fix test instantiation of scheduling model.

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    10a8ceb View commit details
    Browse the repository at this point in the history

  82. fixes to sd tests

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    253a14e View commit details
    Browse the repository at this point in the history

  83. fixup commented attr

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    3986a1e View commit details
    Browse the repository at this point in the history

  84. Add DpmSolverSDE scheduler and fix formatting

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    50c6c0d View commit details
    Browse the repository at this point in the history

  85. Remove one more CFG conditional from unet export.

    @eagarvey-amd @monorimet
    eagarvey-amd authored and monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    4424d99 View commit details
    Browse the repository at this point in the history

  86. Remove breakpoint

    @eagarvey-amd @monorimet
    eagarvey-amd authored and monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    e94b8dd View commit details
    Browse the repository at this point in the history

  87. Get wmma spec for gfx1150

    @eagarvey-amd @monorimet
    eagarvey-amd authored and monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    ecf824b View commit details
    Browse the repository at this point in the history

  88. Make sizes dynamic for some in pipeline IR

    @eagarvey-amd @monorimet
    eagarvey-amd authored and monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    45040bf View commit details
    Browse the repository at this point in the history

  89. Fixes for inlined weights

    @eagarvey-amd @monorimet
    eagarvey-amd authored and monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    5ddd898 View commit details
    Browse the repository at this point in the history

  90. Fixes to inlined weights, llm compilation flexibility

    @eagarvey-amd @monorimet
    eagarvey-amd authored and monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    2def6fb View commit details
    Browse the repository at this point in the history

  91. Add default triple to stateless_llama

    @eagarvey-amd @monorimet
    eagarvey-amd authored and monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    5df2716 View commit details
    Browse the repository at this point in the history

  92. Switch vecdist back on for instinct

    @eagarvey-amd @monorimet
    eagarvey-amd authored and monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    68c7a57 View commit details
    Browse the repository at this point in the history

  93. Workaround prompt/neg prompt switching for turbo mode

    @eagarvey-amd @monorimet
    eagarvey-amd authored and monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    258be08 View commit details
    Browse the repository at this point in the history

  94. Inlined weights fix for sd1.5/2.1

    @eagarvey-amd @monorimet
    eagarvey-amd authored and monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    a4f2391 View commit details
    Browse the repository at this point in the history

  95. Fix inline weights again.

    @eagarvey-amd @monorimet
    eagarvey-amd authored and monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    d7dabfa View commit details
    Browse the repository at this point in the history

  96. Make getter for static pipeline IRs.

    @eagarvey-amd @monorimet
    eagarvey-amd authored and monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    e8dcd8a View commit details
    Browse the repository at this point in the history

  97. Fix pipeline ir import from sdxl_scheduled_unet script

    @eagarvey-amd @monorimet
    eagarvey-amd authored and monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    5dc4e3c View commit details
    Browse the repository at this point in the history

  98. fix format() issue with pipeline IRs

    @eagarvey-amd @monorimet
    eagarvey-amd authored and monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    c75ebe4 View commit details
    Browse the repository at this point in the history

  99. Turn on const eval for triples for which we inline weights.

    @eagarvey-amd @monorimet
    eagarvey-amd authored and monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    a6796b2 View commit details
    Browse the repository at this point in the history

  100. More fixes to pipeline IR

    @eagarvey-amd @monorimet
    eagarvey-amd authored and monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    88b8df8 View commit details
    Browse the repository at this point in the history

  101. Add flag to disable transform dialect jit for llvmgpu

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    75cd61c View commit details
    Browse the repository at this point in the history

  102. Add znver4 compile options.

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    f246282 View commit details
    Browse the repository at this point in the history

  103. Disable consteval.

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    76c9f23 View commit details
    Browse the repository at this point in the history

  104. QOL fixes to unet scripts.

    @eagarvey-amd @monorimet
    eagarvey-amd authored and monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    5bb12ba View commit details
    Browse the repository at this point in the history

  105. Adds batch size to prompt encoder and fixes 

     - Adds batch size support for prompt encoder output to enable batched text to image support
 - Fixes for pipeline_ir and sdxl_command_pipeline for batch size support
 - Testing 1,2,4,8,12,16 batch sizes. 8 and 16 currently have compile time issues through iree compile, otherwise all works
    @IanNod @monorimet
    IanNod authored and monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    1993b0c View commit details
    Browse the repository at this point in the history

  106. formatting

    @eagarvey-amd @monorimet
    eagarvey-amd authored and monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    a126867 View commit details
    Browse the repository at this point in the history

  107. Fix resnet test.

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    b262081 View commit details
    Browse the repository at this point in the history

  108. Add a very simple gfx1100 resnet test.

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    036179e View commit details
    Browse the repository at this point in the history

  109. A few more resnet fixups for testing hip numerics, add winograd flags… 

    … to znver4 compile flags
    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    81181fa View commit details
    Browse the repository at this point in the history

  110. Updates to scheduled unet runner

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    0d1a4b9 View commit details
    Browse the repository at this point in the history

  111. More sched unet runner fixes, remove bf16/winograd flags from default… 

    … znver4 flags
    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    df896a6 View commit details
    Browse the repository at this point in the history

  112. Remove SDE scheduler for now, model fixes 

    - Removes a scheduler we don't use yet from the schedulers init
- Updates static resnet example to use aot.export API
- Simplifies and fixes scheduled unet runner
    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    7e250c7 View commit details
    Browse the repository at this point in the history

  113. Establish support for split scheduling. 

    This completes the first push for a "split scheduler" implementation that lets us delegate all
step count and scheduling dynamicism into nice little modules that
compile in a flash, instead of parametrizing unet compile (and weights
if you're inlining) on those dynamic parameters.

For what it's worth, it also marks the first time scheduled unet runner
isn't a complete stinking mess -- now it gives results that match the
standalone unet numerics comparison with torch as a baseline.

Worth mentioning also that sdxl unet, sdxl scheduler unet, and the new
schedulers are all migrated to the FxProgramBuilder export methodology
in this commit.
    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    667282d View commit details
    Browse the repository at this point in the history

  114. Add cpu scheduling to schedulers.py and runner, small fixes

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    8817f5c View commit details
    Browse the repository at this point in the history

  115. Bump diffusers fork version.

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    9b97666 View commit details
    Browse the repository at this point in the history

  116. Fixes for cpu schedulers, add split scheduler support to sdxl pipeline

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    2500d14 View commit details
    Browse the repository at this point in the history

  117. Start fixing tests

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    52473eb View commit details
    Browse the repository at this point in the history

  118. SD3 text encoding and diffusion modeling.

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    9798fd7 View commit details
    Browse the repository at this point in the history

  119. Achieve basic functionality for sd3 txt2img

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    d3f06f6 View commit details
    Browse the repository at this point in the history

  120. Update mmdit runner inputs, small attn reproducer, pad attention flag

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    ac5fd3f View commit details
    Browse the repository at this point in the history

  121. SD3 small tweaks for numerics

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    cd50bbe View commit details
    Browse the repository at this point in the history

  122. Attn debugging tools

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    81ee093 View commit details
    Browse the repository at this point in the history

  123. Attn debugging, piping for multi-device in sd3

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    b793686 View commit details
    Browse the repository at this point in the history

  124. Fixes for multi-device (SD3)

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    7754609 View commit details
    Browse the repository at this point in the history

  125. comment trace tensor

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    9656135 View commit details
    Browse the repository at this point in the history

  126. Multi-device support (SDXL)

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    f6ab086 View commit details
    Browse the repository at this point in the history

  127. Fix formatting

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    7b861a7 View commit details
    Browse the repository at this point in the history

  128. adds PEFT req. for lora scaling export issue and fix diffusers

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    8048683 View commit details
    Browse the repository at this point in the history

  129. Add scheduler_id to sd3 api for unified signature

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    05660c0 View commit details
    Browse the repository at this point in the history

  130. Remove sentencepiece from reqs.

    @monorimet
    monorimet committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    4692e11 View commit details
    Browse the repository at this point in the history

Commits on Jun 18, 2024

  1. Temporarily comment out create_hal_driver usage for old iree version … 

    …compat (DNM)
    @monorimet
    monorimet committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    8b775aa View commit details
    Browse the repository at this point in the history

  2. Fixes for vae precision/attn decomposition, numerics validation

    @monorimet
    monorimet committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    fd2a2ba View commit details
    Browse the repository at this point in the history

Commits on Jun 19, 2024

  1. Fix numerics, add some features to VAE runner, add cpu scheduling opt… 

    …ions
    @monorimet
    monorimet committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    b1f20f1 View commit details
    Browse the repository at this point in the history

  2. Point to azure links for specs and fix timesteps dim in gpu scheduler.

    @monorimet
    monorimet committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    618d01f View commit details
    Browse the repository at this point in the history

  3. Fixes to filename handling and model loading.

    @monorimet
    monorimet committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    92be65b View commit details
    Browse the repository at this point in the history

  4. add clip test poc

    @dan-garvey
    dan-garvey committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    fd1543b View commit details
    Browse the repository at this point in the history

  5. add it to workflow to test

    @dan-garvey
    dan-garvey committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    fc6833d View commit details
    Browse the repository at this point in the history

  6. add tests for mmdit and vae

    @dan-garvey
    dan-garvey committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    4e2c3cc View commit details
    Browse the repository at this point in the history

Commits on Jun 20, 2024

  1. Allow schedulers to load/reload at generate_images

    @monorimet
    monorimet committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    3c83a21 View commit details
    Browse the repository at this point in the history

  2. Update linter and reformat.

    @monorimet
    monorimet committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    9bbbafc View commit details
    Browse the repository at this point in the history

  3. SDXL: fix scheduled unet modes

    @monorimet
    monorimet committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    7388e14 View commit details
    Browse the repository at this point in the history

Commits on Jun 21, 2024

  1. Make pipeline mode names mutually exclusive and fixes to weights loading

    @monorimet
    monorimet committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    fd2185b View commit details
    Browse the repository at this point in the history

  2. Add new keys to weights skip

    @monorimet
    monorimet committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    3786061 View commit details
    Browse the repository at this point in the history

  3. xfail llama test.

    @monorimet
    monorimet committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    37c3368 View commit details
    Browse the repository at this point in the history

Commits on Jun 23, 2024

  1. Add a base class for turbine-models pipelines.

    @monorimet
    monorimet committed Jun 23, 2024
    Configuration menu
    Copy the full SHA
    5846d10 View commit details
    Browse the repository at this point in the history

Commits on Jun 24, 2024

  1. Flag-guard padded attention preprocessing instruction, start adding t… 

    …ests for abstracted pipeline
    @monorimet
    monorimet committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    7fabc3c View commit details
    Browse the repository at this point in the history

  2. Add missing comma.

    @monorimet
    monorimet committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    74f677f View commit details
    Browse the repository at this point in the history

  3. propagate change to pipeline wrapper names.

    @monorimet
    monorimet committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    bac7c63 View commit details
    Browse the repository at this point in the history

  4. Add paths to downloads for specs without masked attention.

    @monorimet
    monorimet committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    4eca3b2 View commit details
    Browse the repository at this point in the history

  5. Add test to and fixes for pipeline base

    @monorimet
    monorimet committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    4906549 View commit details
    Browse the repository at this point in the history

  6. Flag-guard pad attention for instinct as well.

    @monorimet
    monorimet committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    9eff443 View commit details
    Browse the repository at this point in the history

Commits on Jun 25, 2024

  1. Verify metadata results exactly and fix pass invocation to match upst… 

    …ream.
    @monorimet
    monorimet committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    df40309 View commit details
    Browse the repository at this point in the history

Commits on Jun 28, 2024

  1. Bug fix for specified device when exporting submodels 

    Exporting models was using "devices" instead of "driver" which caused errors on compiling given a specified rocm://<> device. Changed to fix bug
    @IanNod
    IanNod authored Jun 28, 2024
    Configuration menu
    Copy the full SHA
    39d8551 View commit details
    Browse the repository at this point in the history

  2. Missed device specified when exporting pipeline models 

    Missed a couple "devices" instead of "driver" changes
    @IanNod
    IanNod authored Jun 28, 2024
    Configuration menu
    Copy the full SHA
    2da9215 View commit details
    Browse the repository at this point in the history

Commits on Jul 1, 2024

  1. Adds option for prompt encoder to use batched inputs 

    New flag batch_prompt_input determines if prompt encoder uses batchsize flag to concat output, or to batch the input shapes
    @aviator19941
    aviator19941 committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    f330d25 View commit details
    Browse the repository at this point in the history

  2. Minor bug fix in batching 

    Fixed typo for sdxl_prompt_encoder arg
    @IanNod
    IanNod authored Jul 1, 2024
    Configuration menu
    Copy the full SHA
    79a094f View commit details
    Browse the repository at this point in the history

Commits on Jul 10, 2024

  1. Consolidates SD pipelines and adds support for sharktank unet. (#766)

    @monorimet
    monorimet authored Jul 10, 2024
    Configuration menu
    Copy the full SHA
    d534cd4 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into ean-unify-sd

    @monorimet
    monorimet authored Jul 10, 2024
    Configuration menu
    Copy the full SHA
    8cec78d View commit details
    Browse the repository at this point in the history

Commits on Jul 11, 2024

  1. [SD3] Fix text encoder impls import in text encoder runner.

    @eagarvey-amd
    eagarvey-amd committed Jul 11, 2024
    Configuration menu
    Copy the full SHA
    323ecf4 View commit details
    Browse the repository at this point in the history

  2. Minor fixes for SDXL/unet (#770) 

    The reason for updating the revision hash is this PR by Stella in
sharktank: nod-ai/SHARK-Platform#93. Because we are
using sharktank TOM, we need to update here too so that it gives
sharktank the expected quant_params.json.

---------

Signed-off-by: saienduri <[email protected]>
    @saienduri
    saienduri authored Jul 11, 2024
    Configuration menu
    Copy the full SHA
    4bef98b View commit details
    Browse the repository at this point in the history

  3. [WIP] add SDXL ml-perf harness model directory to choose correct mode… 

    …l_map

Signed-off-by: aviator19941 <[email protected]>
    @aviator19941 @eagarvey-amd
    aviator19941 authored and eagarvey-amd committed Jul 11, 2024
    Configuration menu
    Copy the full SHA
    027b615 View commit details
    Browse the repository at this point in the history

  4. [WIP] Fix naming issue for punet external weights file 

    Signed-off-by: aviator19941 <[email protected]>
    @aviator19941 @eagarvey-amd
    aviator19941 authored and eagarvey-amd committed Jul 11, 2024
    Configuration menu
    Copy the full SHA
    08a1488 View commit details
    Browse the repository at this point in the history

  5. Fix is_sdxl not checking the base_model_name properly 

    Signed-off-by: aviator19941 <[email protected]>
    @aviator19941 @eagarvey-amd
    aviator19941 authored and eagarvey-amd committed Jul 11, 2024
    Configuration menu
    Copy the full SHA
    8a1bda1 View commit details
    Browse the repository at this point in the history

  6. Fix sd_inference/vae case for SDXL 

    Signed-off-by: aviator19941 <[email protected]>
    @aviator19941 @eagarvey-amd
    aviator19941 authored and eagarvey-amd committed Jul 11, 2024
    Configuration menu
    Copy the full SHA
    beb2c13 View commit details
    Browse the repository at this point in the history

  7. Update SD3 tests and exports.

    @eagarvey-amd
    eagarvey-amd committed Jul 11, 2024
    Configuration menu
    Copy the full SHA
    672f3e6 View commit details
    Browse the repository at this point in the history

  8. Only setup export weights filepath if weights need to be created.

    @eagarvey-amd
    eagarvey-amd committed Jul 11, 2024
    Configuration menu
    Copy the full SHA
    021948f View commit details
    Browse the repository at this point in the history

  9. Add a model map attribute for models that need weights for exports.

    @eagarvey-amd
    eagarvey-amd committed Jul 11, 2024
    Configuration menu
    Copy the full SHA
    6396df1 View commit details
    Browse the repository at this point in the history

  10. Only pop pipeline wrappers from model map if they exist.

    @eagarvey-amd
    eagarvey-amd committed Jul 11, 2024
    Configuration menu
    Copy the full SHA
    4814c92 View commit details
    Browse the repository at this point in the history

Commits on Jul 12, 2024

  1. Fix gpu scheduling for sdxl, fixup for batched clip metadata

    @eagarvey-amd
    eagarvey-amd committed Jul 12, 2024
    Configuration menu
    Copy the full SHA
    4468ed8 View commit details
    Browse the repository at this point in the history

  2. Use amd-shark/sdxl-quant-models for F16 VAE weights

    @eagarvey-amd
    eagarvey-amd committed Jul 12, 2024
    Configuration menu
    Copy the full SHA
    f922d05 View commit details
    Browse the repository at this point in the history

  3. small fixes to ensure specs are used where needed

    @eagarvey-amd
    eagarvey-amd committed Jul 12, 2024
    Configuration menu
    Copy the full SHA
    ec4bc05 View commit details
    Browse the repository at this point in the history

  4. fix typo

    @eagarvey-amd
    eagarvey-amd committed Jul 12, 2024
    Configuration menu
    Copy the full SHA
    931b70c View commit details
    Browse the repository at this point in the history

  5. Update models/requirements.txt to install editable sharktank package 

    Signed-off-by: aviator19941 <[email protected]>
    @aviator19941
    aviator19941 committed Jul 12, 2024
    Configuration menu
    Copy the full SHA
    7e580c9 View commit details
    Browse the repository at this point in the history

  6. Fix guidance conditional on cpu scheduler init.

    @eagarvey-amd
    eagarvey-amd committed Jul 12, 2024
    Configuration menu
    Copy the full SHA
    b58d16a View commit details
    Browse the repository at this point in the history

  7. Use the correct variable in input metdata for prompt encoder with bs>1

    @eagarvey-amd
    eagarvey-amd committed Jul 12, 2024
    Configuration menu
    Copy the full SHA
    c035f61 View commit details
    Browse the repository at this point in the history