You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
In the code located at this line, there is an issue where even if the model download process fails, it incorrectly reports success. This issue results in the condition in the code: utils.HasModelWeightFile(config.Config.TritonServer.ModelStore, tritonModels) returning true.
As a consequence, the system keeps attempting to deploy the model repeatedly, but it never succeeds. To replicate this error, you can set your disk size limit to a value insufficient for a successful DVC pull of the full model. For example, if the model size is 15GB, but you only have 7GB of disk space available to run the image, this issue becomes apparent.
Describe Your Proposed Improvement
To resolve this problem, we need to ensure that failed DVC pulls or other errors do not incorrectly update the space status, and they should provide informative error messages instead.
The text was updated successfully, but these errors were encountered:
tonywang10101
changed the title
[bug] Ensure Status Update Only Occurs on Successful GitHub and DVC Pulls
[INS-2426] [bug] Ensure Status Update Only Occurs on Successful GitHub and DVC Pulls
Oct 27, 2023
Is There an Existing Issue for This?
Project
Instill Model
Is your Proposal Related to a Problem?
In the code located at this line, there is an issue where even if the model download process fails, it incorrectly reports success. This issue results in the condition in the code:
utils.HasModelWeightFile(config.Config.TritonServer.ModelStore, tritonModels)
returning true.As a consequence, the system keeps attempting to deploy the model repeatedly, but it never succeeds. To replicate this error, you can set your disk size limit to a value insufficient for a successful DVC pull of the full model. For example, if the model size is 15GB, but you only have 7GB of disk space available to run the image, this issue becomes apparent.
Describe Your Proposed Improvement
To resolve this problem, we need to ensure that failed DVC pulls or other errors do not incorrectly update the space status, and they should provide informative error messages instead.
Highlight the Benefits
No response
Anything Else?
No response
INS-2426
The text was updated successfully, but these errors were encountered: