Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Getting socket hangup error on POST request after starting service model on Windows platform #2476

Closed
cbr7 opened this issue Feb 4, 2025 · 0 comments · Fixed by #2482
Closed
Assignees

Comments

@cbr7
Copy link
Contributor

cbr7 commented Feb 4, 2025

Bug description

Starting up a service model using 'instructlab/granite-7b-lab-GGUF' via script causes the service to not start correctly and responds with Error: Socket hanged up message to any post request made.

The issue only seems to be reproducible when the startup is done automatically via e2e test, so the steps are executed fairly quickly, if the users does the setup manually the issue does not reproduce.

Operating system

Windows

Installation Method

from ghcr.io/containers/podman-desktop-extension-ai-lab container image

Version

next (development version)

Steps to reproduce

No response

Relevant log output

Additional context

No response

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: ✔️ Done
Development

Successfully merging a pull request may close this issue.

3 participants