Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Dev] Fix FP8 Codegen Issue for tilelang backend #291

Merged
merged 20 commits into from
Feb 4, 2025

Conversation

LeiWang1999
Copy link
Contributor

This pull request includes several changes to the bitblas project, focusing on updating type mappings, improving data type handling, and modifying backend configurations. Below are the most important changes grouped by theme:

Type Mapping Updates:

  • Updated type mappings in TLCUDASourceWrapper to use new type names for float16, bfloat16, e4m3_float8, and e5m2_float8 in bitblas/builder/wrapper/tl.py.

Data Type Handling:

  • Improved data type handling in gemv_simt.py by ensuring that elements are cast to accum_dtype before accumulation.

Backend Configuration:

  • Changed the backend from "tir" to "tl" in test_general_matmul_fp8.py for both matmul_torch_forward and matmul_torch_forward_weight_dequantize functions to align with the new backend configuration. [1] [2]

Submodule Update:

  • Updated the submodule commit reference in 3rdparty/tilelang to the latest commit.

@LeiWang1999 LeiWang1999 merged commit 812b98d into microsoft:main Feb 4, 2025
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant