Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[core] Layerwise Upcasting #10347

Merged
merged 55 commits into from
Jan 22, 2025
Merged

[core] Layerwise Upcasting #10347

Changes from 7 commits
Commits
Show all changes
55 commits
Select commit Hold shift + click to select a range
36b0c37
update
a-r-r-o-w Dec 22, 2024
42046c0
update
a-r-r-o-w Dec 22, 2024
7dc739b
make style
a-r-r-o-w Dec 22, 2024
7ed7141
Merge branch 'main' into layerwise-upcasting-hook
a-r-r-o-w Dec 23, 2024
1fa4ee5
remove dynamo disable
a-r-r-o-w Dec 23, 2024
da4907e
add coauthor
a-r-r-o-w Dec 23, 2024
bc2ada4
update
a-r-r-o-w Dec 23, 2024
91bfc3d
Merge branch 'main' into layerwise-upcasting-hook
a-r-r-o-w Jan 2, 2025
7c31bb0
update
a-r-r-o-w Jan 2, 2025
8975bbf
update
a-r-r-o-w Jan 2, 2025
341fbfc
update mixin
a-r-r-o-w Jan 2, 2025
5f898a1
add some basic tests
a-r-r-o-w Jan 2, 2025
558c64e
update
a-r-r-o-w Jan 4, 2025
7858f2c
update
a-r-r-o-w Jan 12, 2025
2663026
Merge branch 'main' into layerwise-upcasting-hook
a-r-r-o-w Jan 12, 2025
3d84b9e
non_blocking
a-r-r-o-w Jan 12, 2025
9372647
improvements
a-r-r-o-w Jan 12, 2025
a0f1de7
Merge branch 'main' into layerwise-upcasting-hook
a-r-r-o-w Jan 14, 2025
e586ef3
update
a-r-r-o-w Jan 13, 2025
cfe6318
norm.* -> norm
a-r-r-o-w Jan 14, 2025
9235f77
Merge branch 'main' into layerwise-upcasting-hook
a-r-r-o-w Jan 15, 2025
7627415
apply suggestions from review
a-r-r-o-w Jan 15, 2025
b9e1217
add example
a-r-r-o-w Jan 15, 2025
bde103c
update hook implementation to the latest changes from pyramid attenti…
a-r-r-o-w Jan 15, 2025
64e6c9c
deinitialize should raise an error
a-r-r-o-w Jan 15, 2025
7037133
update doc page
a-r-r-o-w Jan 15, 2025
f1b46d6
Merge branch 'main' into layerwise-upcasting-hook
a-r-r-o-w Jan 15, 2025
390742b
Apply suggestions from code review
a-r-r-o-w Jan 16, 2025
19901e7
update docs
a-r-r-o-w Jan 17, 2025
3ae32b4
update
a-r-r-o-w Jan 17, 2025
bf797e7
refactor
a-r-r-o-w Jan 17, 2025
d22465a
Merge branch 'main' into layerwise-upcasting-hook
a-r-r-o-w Jan 17, 2025
5956a9e
fix _always_upcast_modules for asym ae and vq_model
a-r-r-o-w Jan 17, 2025
93bd8ee
fix lumina embedding forward to not depend on weight dtype
a-r-r-o-w Jan 21, 2025
77a32a7
refactor tests
a-r-r-o-w Jan 21, 2025
1335d7e
add simple lora inference tests
a-r-r-o-w Jan 21, 2025
a263e1a
_always_upcast_modules -> _precision_sensitive_module_patterns
a-r-r-o-w Jan 21, 2025
93e36ba
Merge branch 'main' into layerwise-upcasting-hook
a-r-r-o-w Jan 21, 2025
245137f
remove todo comments about review; revert changes to self.dtype in un…
a-r-r-o-w Jan 21, 2025
b713511
check layer dtypes in lora test
a-r-r-o-w Jan 21, 2025
4450b1c
Merge branch 'main' into layerwise-upcasting-hook
a-r-r-o-w Jan 21, 2025
ed14d26
fix UNet1DModelTests::test_layerwise_upcasting_inference
a-r-r-o-w Jan 21, 2025
2c9c33f
_precision_sensitive_module_patterns -> _skip_layerwise_casting_patte…
a-r-r-o-w Jan 21, 2025
08211f7
skip test in NCSNppModelTests
a-r-r-o-w Jan 21, 2025
59e04c3
skip tests for AutoencoderTinyTests
a-r-r-o-w Jan 21, 2025
0a16826
skip tests for AutoencoderOobleckTests
a-r-r-o-w Jan 21, 2025
1d306b8
skip tests for UNet1DModelTests - unsupported pytorch operations
a-r-r-o-w Jan 21, 2025
a9364bd
layerwise_upcasting -> layerwise_casting
a-r-r-o-w Jan 21, 2025
c4d5a2b
skip tests for UNetRLModelTests; needs next pytorch release for curre…
a-r-r-o-w Jan 21, 2025
d175d93
add layerwise fp8 pipeline test
a-r-r-o-w Jan 21, 2025
bf11691
use xfail
a-r-r-o-w Jan 21, 2025
1c523b2
Apply suggestions from code review
a-r-r-o-w Jan 22, 2025
7803364
Merge branch 'main' into layerwise-upcasting-hook
a-r-r-o-w Jan 22, 2025
376adf9
add assertion with fp32 comparison; add tolerance to fp8-fp32 vs fp32…
a-r-r-o-w Jan 22, 2025
719e8d3
add note about memory consumption on tesla CI runner for failing test
a-r-r-o-w Jan 22, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading
Loading