Error Encountered During Query Processing in Sakhi Activity Service

[allwin-winfred]

Hello team,
we deployed our AI assistant in AWS but got an error in the activitysakhi API service due to undefined variables in config/gcp.json.
Please let us know if this GCP config is necessary for AWS deployment or if is it independent of the cloud environment used.
For translation_type, we are using bhashini , not Google.

2024-04-03 08:18:43 - 139759739643712 - MainThread - sakhi_activity - INFO - {'label': 'query', 'query_text': 'what is python?', 'index_id': 'sakhi_parent_activities', 'audience_type': 'parent', 'input_language': 'en', 'output_format': 'text', 'audio_url': None}
2024-04-03 08:18:43 - 139759739643712 - MainThread - sakhi_activity - ERROR - Exception occurred: The file /config/gcp.json does not have a valid type. Type is, expected one of ('authorized_user', 'service_account', 'external_account', 'external_account_authorized_user', 'impersonated_service_account', 'gdch_service_account').
Traceback (most recent call last):
File "/code/./io_processing.py", line 36, in process_incoming_text
english_text = translator.translate_text(text=regional_text, source=input_language, destination='en')
File "/code/./translation/utils.py", line 241, in translate_text
client = translate.Client()
File "/usr/local/lib/python3.8/site-packages/google/cloud/translate_v2/client.py", line 80, in init
super(Client, self).init(credentials=credentials, _http=_http)
File "/usr/local/lib/python3.8/site-packages/google/cloud/client/init.py", line 178, in init
credentials, _ = google.auth.default(scopes=scopes)
File "/usr/local/lib/python3.8/site-packages/google/auth/_default.py", line 657, in default
credentials, project_id = checker()
File "/usr/local/lib/python3.8/site-packages/google/auth/_default.py", line 650, in
lambda: _get_explicit_environ_credentials(quota_project_id=quota_project_id),
File "/usr/local/lib/python3.8/site-packages/google/auth/_default.py", line 270, in _get_explicit_environ_credentials
credentials, project_id = load_credentials_from_file(
File "/usr/local/lib/python3.8/site-packages/google/auth/_default.py", line 126, in load_credentials_from_file
return _load_credentials_from_info(
File "/usr/local/lib/python3.8/site-packages/google/auth/_default.py", line 213, in _load_credentials_from_info
raise exceptions.DefaultCredentialsError(
google.auth.exceptions.DefaultCredentialsError: The file /config/gcp.json does not have a valid type. Type is , expected one of ('authorized_user', 'service_account', 'external_account', 'external_account_authorized_user', 'impersonated_service_account', 'gdch_service_account').
2024-04-03 08:18:43 - 139759739643712 - MainThread - sakhi_activity - INFO - {'Query': None}
2024-04-03 08:18:43 - 139759739643712 - MainThread - sakhi_activity - ERROR - {'index_id': 'sakhi_parent_activities', 'query': 'what is python?', 'input_language': 'en', 'output_format': 'text', 'audio_url': None, 'status_code': 503, 'error_message': 'Indic translation to English failed'}
2024-04-03 08:18:43 - 139759739643712 - MainThread - sakhi_activity - INFO - {'label': 'api_call', 'event': {'status_code': 503, 'duration': 11, 'body': {'input': {'language': 'en', 'text': 'what is python?', 'audienceType': 'parent'}, 'output': {'format': 'text'}}, 'method': 'POST', 'url': URL('http://activitysakhi:8080/v1/query'), 'host': 'activitysakhi:8080', 'user-agent': 'python-requests/2.31.0', 'accept-encoding': 'gzip, deflate', 'accept': '/', 'connection': 'keep-alive', 'x-source': 'telegram', 'x-request-id': '249', 'x-device-id': 'd1167495001', 'x-consumer-id': '1167495001', 'content-length': '112'}}
2024-04-03 08:18:43 - 139759739643712 - MainThread - sakhi_activity - INFO - Telemetry event: {'eid': 'LOG', 'ets': 1712132323440, 'ver': '3.1', 'mid': 'LOG:1712132323', 'actor': {'id': 'sakhi-api-service', 'type': 'System'}, 'context': {'channel': 'ejp', 'pdata': {'id': 'ejp.sakhi.api.service', 'ver': '1.0', 'pid': ''}, 'env': 'dev', 'sid': '249', 'did': 'd1167495001', 'cdata': [{'id': '1167495001', 'type': 'ConsumerId'}, {'id': 'telegram', 'type': 'Source'}]}, 'edata': {'type': 'api_access', 'level': 'ERROR', 'message': 'failed', 'params': [{'method': 'POST'}, {'url': 'http://activitysakhi:8080/v1/query'}, {'status': 503}, {'duration': 11}, {'input_language': 'en'}, {'input_text': 'what is python?'}, {'input_audienceType': 'parent'}, {'output_format': 'text'}]}}
INFO: 10.0.63.38:55232 - "POST /v1/query HTTP/1.1" 503 Service Unavailable

[vineetUpadhayay]

Hello, can you please share the values of the following keys in your sakhi-api/activity-service:
TRANSLATION_TYPE=
BUCKET_TYPE=

[allwin-winfred]

Hello @vineetUpadhayay ,

TRANSLATION_TYPE= bhashini
BUCKET_TYPE=aws
We changed the translation type to Bhashini from Google, I guess there was no reload in the pod to reflect that. Now, we get the following error,

2024-04-04 09:15:34 - 140392875112256 - MainThread - sakhi_activity - INFO - {'label': 'query', 'query_text': 'What is python ?', 'index_id': 'sakhi_parent_activities', 'audience_type': 'parent', 'input_language': 'en', 'output_format': 'text', 'audio_url': None}
2024-04-04 09:15:34 - 140392875112256 - MainThread - sakhi_activity - INFO - {'Query': 'What is python ?'}
2024-04-04 09:15:35 - 140392875112256 - MainThread - sakhi_activity - INFO - Score filtered documents : [(Document(page_content='Python is a versatile programming language used for various applications, including web development, data analysis, artificial intelligence, and more. It is known for its simplicity and readability, making it a popular choice among developers.', metadata={'page_label': None, 'file_name': 'document3.txt', 'file_path': 'input_data/document3.txt', 'file_type': 'text/plain'}), 0.8831148)]
2024-04-04 09:15:35 - 140392875112256 - MainThread - httpx - INFO - HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 404 Not Found"
2024-04-04 09:15:35 - 140392875112256 - MainThread - sakhi_activity - ERROR - {'index_id': 'sakhi_parent_activities', 'query': 'What is python ?', 'input_language': 'en', 'output_format': 'text', 'audio_url': None, 'status_code': 503, 'error_message': 'Server is overloaded or unable to answer your request at the moment. Please try again later'}
2024-04-04 09:15:35 - 140392875112256 - MainThread - sakhi_activity - INFO - {'label': 'api_call', 'event': {'status_code': 503, 'duration': 1021, 'body': {'input': {'language': 'en', 'text': 'What is python ?', 'audienceType': 'parent'}, 'output': {'format': 'text'}}, 'method': 'POST', 'url': URL('http://activitysakhi:8080/v1/query'), 'host': 'activitysakhi:8080', 'user-agent': 'python-requests/2.31.0', 'accept-encoding': 'gzip, deflate', 'accept': '/', 'connection': 'keep-alive', 'x-source': 'telegram', 'x-request-id': '310', 'x-device-id': 'd727422592', 'x-consumer-id': '727422592', 'content-length': '113'}}
2024-04-04 09:15:35 - 140392875112256 - MainThread - sakhi_activity - INFO - Telemetry event: {'eid': 'LOG', 'ets': 1712222135620, 'ver': '3.1', 'mid': 'LOG:1712222136', 'actor': {'id': 'sakhi-api-service', 'type': 'System'}, 'context': {'channel': 'ejp', 'pdata': {'id': 'ejp.sakhi.api.service', 'ver': '1.0', 'pid': ''}, 'env': 'dev', 'sid': '310', 'did': 'd727422592', 'cdata': [{'id': '727422592', 'type': 'ConsumerId'}, {'id': 'telegram', 'type': 'Source'}]}, 'edata': {'type': 'api_access', 'level': 'ERROR', 'message': 'failed', 'params': [{'method': 'POST'}, {'url': 'http://activitysakhi:8080/v1/query'}, {'status': 503}, {'duration': 1021}, {'input_language': 'en'}, {'input_text': 'What is python ?'}, {'input_audienceType': 'parent'}, {'output_format': 'text'}]}}
INFO: 10.0.63.38:47538 - "POST /v1/query HTTP/1.1" 503 Service Unavailable

[vineetUpadhayay]

Hello, can you also share which openai type you are using ??

[allwin-winfred]

Hello @vineetUpadhayay ,
we're using these config,
openai_type: "openai"

[kameshbhr]

@allwin-winfred Are you using a valid OpenAI key?
@sajeshkayyath Can you please check if this error is because of openai key or something else?

[sajeshkayyath]

@allwin-winfred - The endpoint looks correct

Can you please retry this and see the behaviour with the Open AI Key credentials directly with the postman or curl and see if that is going through.

https://platform.openai.com/docs/api-reference/making-requests

[allwin-winfred]

@sajeshkayyath - We're using free credits API to check, it only had 3.5,
After we changed GPT model 4.0 to 3.5-turbo it's working fine.