Skip to content

Issues: iree-org/iree-comparative-benchmark

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

22 Open 18 Closed
22 Open 18 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

SD_PIPELINE_FP16_JAX benchmark executes in FP32
#176 opened Apr 20, 2024 by ekuznetsov139
Output 0 exceeds tolerance?
#174 opened Apr 18, 2024 by ekuznetsov139
Update JAX/IREE benchmarks to point to the right repo
#169 opened Mar 12, 2024 by mariecwhite
[Tracking Bug] List of disabled workloads.
#125 opened Aug 23, 2023 by mariecwhite
1
[PyTorch] Unable to generate large batch size PyTorch FP16 models.
#122 opened Aug 17, 2023 by mariecwhite
[JAX] Unable to generate artifacts for BertLarge batch >= 1024
#121 opened Aug 16, 2023 by mariecwhite
[XLA-HLO:GPU] Type errors on BERT_LARGE_FP16_JAX_* models bug Something isn't working
#117 opened Aug 4, 2023 by pzread
Incompatible version between JAX and transformers bug Something isn't working
#111 opened Aug 1, 2023 by pzread
1
Automate artifact generation in CI
#104 opened Jul 27, 2023 by pzread
@pzread
[Doc] Add example benchmarks for JAX and Tensorflow
#99 opened Jul 24, 2023 by pzread
[Doc] Document what exported models are generated for what models
#98 opened Jul 24, 2023 by pzread
Evaluate if we want to move to BuildKit for automatic Docker image handling
#89 opened Jul 20, 2023 by beckerhe
1
[Goal] Document process to onboard models and benchmarks goal Issue to track a goal
#83 opened Jul 18, 2023 by pzread
[PT-Inductor:GPU] Models failed with quantile() input tensor must be either float or double dtype bug Something isn't working
#62 opened Jul 7, 2023 by pzread
[PT-Inductor:GPU] Out of memory on BERT_LARGE FP32 with large batch sizes bug Something isn't working
#61 opened Jul 7, 2023 by pzread
1
Support data types in model template
#54 opened Jul 5, 2023 by pzread
@pzread
[Goal] Show benchmark results in dashboard goal Issue to track a goal
#48 opened Jul 3, 2023 by pzread
Support multiple raw inputs
#44 opened Jul 2, 2023 by mariecwhite
Finalize benchmark id format
#41 opened Jul 1, 2023 by pzread
@pzread
1
[Migration] Update dashboard to process results from openxla-benchmark
#39 opened Jul 1, 2023 by pzread Comparative Benchmark Migration
@beckerhe
5
Change Python formatter to Black
#17 opened Jun 22, 2023 by pzread
Support multi-model framework benchmarks
#2 opened Jun 7, 2023 by pzread
ProTip! Exclude everything labeled bug with -label:bug.