Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] Adding Cloudwatch + stderr logs to dbt log using python models #750

Open
1 task done
CommonCrisis opened this issue Jan 23, 2025 · 0 comments
Open
1 task done
Labels
pkg:dbt-athena Issue affects dbt-athena

Comments

@CommonCrisis
Copy link
Contributor

Is this your first time submitting a feature request?

  • I have searched the existing issues, and I could not find an existing issue for this feature

Describe the feature

We should stream the cloud watch logs created by the athena_user_logger and athena_shared_logger into the log file.

Right now it is annoying to always check the error in the AWS console.

Ideally we add the stderr output to the log as well by reading the output file in s3://<bucket_name>/<path>/session/<session_name>/stderr.

Describe alternatives you've considered

No response

Who will this benefit?

Everyone working with the python models

Are you interested in contributing this feature?

sure - can someone point to the logging logic?

Anything else?

No response

@mikealfare mikealfare added the pkg:dbt-athena Issue affects dbt-athena label Jan 27, 2025
@mikealfare mikealfare transferred this issue from dbt-labs/dbt-athena Jan 27, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
pkg:dbt-athena Issue affects dbt-athena
Projects
None yet
Development

No branches or pull requests

2 participants