Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Chore] Configuration for Max chunk size in Split Vector Strategy of mongodb #120

Open
zriyanshdz opened this issue Mar 4, 2025 · 1 comment
Open

[Chore] Configuration for Max chunk size in Split Vector Strategy of mongodb #120

zriyanshdz opened this issue Mar 4, 2025 · 1 comment

Comments

@zriyanshdz
Copy link
Collaborator

Problem

{Key: "maxChunkSize", Value: 1024},

Right now the maxChunkSize is hardcoded. For data <1GB, it only makes 1 running thread even if the max_threads value is passed as 10.

Solution

We need to take max_chunk_size value from the user
@mrmagicpotato007
Copy link
Contributor

@zriyanshdz i can take this

@hash-data hash-data changed the title maxChunkSize value should be taken as a param from config.json file [Chore] Configuration for Max chunk size in Split Vector Strategy of mongodb Mar 6, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
Olake Roadmap 2024-25
Status: No status
Milestone
No milestone
Development

No branches or pull requests
2 participants
@mrmagicpotato007 @zriyanshdz