Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support Creating Ollama Model from Local Files #191

Open
BruceMacD opened this issue Jan 9, 2025 · 0 comments
Open

Support Creating Ollama Model from Local Files #191

BruceMacD opened this issue Jan 9, 2025 · 0 comments
Labels
enhancement New feature or request help wanted Extra attention is needed

Comments

@BruceMacD
Copy link
Collaborator

Current Situation

The Ollama API supports creating models from local files via its REST endpoints
The ollama-js SDK currently does not implement this functionality
Implementation is blocked by Node.js file upload streaming challenges

Technical Details

The main blocker is handling large file uploads efficiently in Node.js when streaming to the Ollama API. Specific challenges include:

  • Maintaining memory efficiency with large model files, we can't just read them into memory
  • Handling chunked uploads consistently, checksums were failing in previous implementations
  • Managing proper content-type and multipart form data boundaries
  • Ensuring reliable error handling during long-running uploads
@BruceMacD BruceMacD added the enhancement New feature or request label Jan 9, 2025
@BruceMacD BruceMacD added the help wanted Extra attention is needed label Jan 9, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

1 participant