You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I'm experiencing performance issues with cold starts after deploying the project to AWS Lambda using the Python 3.12 runtime on ARM architecture. After investigating, it appears the issue lies in importing modules, which cannot be easily minimized.
I understand that this project needs to be versatile, but it would be beneficial if we could load only the modules required for each specific context.
For example, I only use Bedrock and don’t need to load the entire Anthropic module due to the presence of the Anthropic Classifier. For reference, the Anthropic module takes around 0.7 seconds to load, which significantly impacts the initialization phase during cold starts.
Have you experienced the same thing?
Solution/User Experience
Perhaps into "init.py" on classifiers folder test if module "anthropic" is installed or not and then load or not Anthropic Classifier.
Alternative solutions
No response
The text was updated successfully, but these errors were encountered:
Use case
Hi,
I'm experiencing performance issues with cold starts after deploying the project to AWS Lambda using the Python 3.12 runtime on ARM architecture. After investigating, it appears the issue lies in importing modules, which cannot be easily minimized.
I understand that this project needs to be versatile, but it would be beneficial if we could load only the modules required for each specific context.
For example, I only use Bedrock and don’t need to load the entire Anthropic module due to the presence of the Anthropic Classifier. For reference, the Anthropic module takes around 0.7 seconds to load, which significantly impacts the initialization phase during cold starts.
Have you experienced the same thing?
Solution/User Experience
Perhaps into "init.py" on classifiers folder test if module "anthropic" is installed or not and then load or not Anthropic Classifier.
Alternative solutions
No response
The text was updated successfully, but these errors were encountered: