Skip to content

Issues: ztxz16/fastllm

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

233 Open 137 Closed
233 Open 137 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

项目支持的平台列表有吗
#504 opened Feb 18, 2025 by torsilver
希望作者考虑按照我的设计思路增加对deepseek-R1-671B及类deepseek-R1-671B的Moe模型的支持
#503 opened Feb 12, 2025 by a793181018
转换 Llama-2-7b 模型出错
#501 opened Dec 23, 2024 by JocelynPanPan
Main.exe compiled with w64devkit v.1.21.0 silently terminates after launching.
#499 opened Dec 13, 2024 by JohnClaw
Thanks for great llm inference engine. Could you make a dll version of it, please?
#498 opened Dec 13, 2024 by JohnClaw
如何配置参数使服务处理请求并发数最大化
#494 opened Oct 21, 2024 by xiaoshizijiayou
error: no suitable user-defined conversion from "__half" to "__nv_bfloat16" exists
#493 opened Oct 9, 2024 by xiaoshizijiayou
如何通过参数方式直接加载adapter?
#491 opened Sep 26, 2024 by xiaoshizijiayou
28
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xce in position 4411: invalid continuation byte
#489 opened Sep 19, 2024 by huqiangDu
1
加速llama3-sqlcoder-8b (Finetuned from model: [Meta-Llama-3-8B-Instruct])模型时，输出内容错误，全部是"!!!!!"
#487 opened Sep 15, 2024 by Juvember
1
模型权重转化之后和原来的模型回答的内容不一致
#486 opened Sep 11, 2024 by Whylickspittle
1
chatglm 失去 function calling 能力
#485 opened Aug 16, 2024 by NingRiCheng
请问一下国产显卡Ascend 910 and Hygon DCU如何安装fastllm？
#482 opened Jul 30, 2024 by cgq0816
1
GLM4-V-9B什么时候会出部署代码呢？
#481 opened Jul 29, 2024 by GalSang17
如何多卡部署
#480 opened Jul 22, 2024 by longcheng183
1
OSError: libcublas.so.ll: cannot open shared odject file: No such file or directory
#471 opened Jun 28, 2024 by lichengyang666
1
Meta-Llama-3-70B-Instruct
#470 opened Jun 26, 2024 by longcheng183
5
qwen1.5 int4模型回复出现解码问题：UnicodeDecodeError: 'utf-8' codec can't decode bytes in position 72-73: invalid continuation byte
#461 opened Jun 5, 2024 by zhang415
make -j过程中报错
#459 opened Jun 4, 2024 by AIlaowong
3
[CMakeFiles/Makefile2:100: CMakeFiles/pyfastllm.dir/all]
#454 opened May 9, 2024 by ttaop
结果返回一直是<unk>
#452 opened May 8, 2024 by VincentLore
3
chatglm3 相同提示词生成结果一致
#450 opened Apr 29, 2024 by ttaop
Do you have a plan to implement the CudaCatOp?
#448 opened Apr 25, 2024 by dp-aixball
千问qwen1.5-14B-chat解码错误
#446 opened Apr 23, 2024 by yiguanxian
2
cmake -j报错
#445 opened Apr 23, 2024 by gggdroa
2
ProTip! Add no:assignee to see everything that’s not assigned.