Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] [Module Name] Bug title 如何提高知识抽取时的并发数,现在始终保持在5个并发,速度太慢了。 #289

Open
2 tasks done
su400 opened this issue Jan 16, 2025 · 4 comments

Comments

@su400
Copy link

su400 commented Jan 16, 2025

Search before asking

  • I had searched in the issues and found no similar issues.

Operating system information

Windows

What happened

1、如何提高知识抽取时的并发数,现在始终保持在5个并发,速度太慢了,请告知在哪里设置。
2、构建完知识库后,构建时所采用的模型就不能更换,在全局设置里更换无效。我预期的场景是使用商业模型构建图谱,推理时采用本地模型,希望能够更换。

How to reproduce

v.0.6版本,win11

Are you willing to submit PR?

  • Yes I am willing to submit a PR!
@zzyyll2
Copy link

zzyyll2 commented Jan 16, 2025

docker-compose.yml里有个配置,你改一下看是否有效:
image

@caszkgui
Copy link
Collaborator

Search before asking

  • I had searched in the issues and found no similar issues.

Operating system information

Windows

What happened

1、如何提高知识抽取时的并发数,现在始终保持在5个并发,速度太慢了,请告知在哪里设置。 2、构建完知识库后,构建时所采用的模型就不能更换,在全局设置里更换无效。我预期的场景是使用商业模型构建图谱,推理时采用本地模型,希望能够更换。

How to reproduce

v.0.6版本,win11

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

In developer mode, User can set concurrency by modifying num_chain and num_threads_per_chain in kag_config.yaml:

Image

If you are dealing with one large size documents,you can increase the num of num_threads_per_chain. In other scenarios such as hotpotqa dataset, which stores multi items in one json file, you can increase the num of num_chain.

@caszkgui
Copy link
Collaborator

Search before asking

  • I had searched in the issues and found no similar issues.

Operating system information

Windows

What happened

1、如何提高知识抽取时的并发数,现在始终保持在5个并发,速度太慢了,请告知在哪里设置。 2、构建完知识库后,构建时所采用的模型就不能更换,在全局设置里更换无效。我预期的场景是使用商业模型构建图谱,推理时采用本地模型,希望能够更换。

How to reproduce

v.0.6版本,win11

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

In developer mode, user can set multi LLM model service in different stage.
For example, in example_config.yaml, KAG provide the openie_llm and chat_llm, which are referenced in kag-builder-pipeline and kag-solver-pipeline separately.

Image

@someone132s
Copy link

Search before asking

  • I had searched in the issues and found no similar issues.

Operating system information

Windows

What happened

1、如何提高知识抽取时的并发数,现在始终保持在5个并发,速度太慢了,请告知在哪里设置。 2、构建完知识库后,构建时所采用的模型就不能更换,在全局设置里更换无效。我预期的场景是使用商业模型构建图谱,推理时采用本地模型,希望能够更换。

How to reproduce

v.0.6版本,win11

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

In developer mode, user can set multi LLM model service in different stage. For example, in example_config.yaml, KAG provide the openie_llm and chat_llm, which are referenced in kag-builder-pipeline and kag-solver-pipeline separately.

Image

您好,我在linux下使用docker部署,我想知道这个配置文件在哪呢?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants