Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AIP-72: Add support for outlet_events in Task Context #45727

Merged
merged 1 commit into from
Jan 17, 2025

Conversation

kaxil
Copy link
Member

@kaxil kaxil commented Jan 17, 2025

part of #45717

This PR adds support for outlet_events in Context dict within the Task SDK by adding an endpoint on the API Server which is fetched when outlet_events is accessed.


^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.

@ashb
Copy link
Member

ashb commented Jan 17, 2025

Did you consider sending these via the initial context we send in the response to the Run request?

Copy link
Member

@ashb ashb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A couple of comments/alternate URL designs, but code LGTM

part of apache#45717

This PR adds support for `outlet_events` in Context dict within the Task SDK by adding an endpoint on the API Server which is fetched when outlet_events is accessed.
@kaxil kaxil merged commit 418b701 into apache:main Jan 17, 2025
85 of 86 checks passed
@kaxil kaxil deleted the add-asset-outlet branch January 17, 2025 20:21
@kaxil
Copy link
Member Author

kaxil commented Jan 17, 2025

Following failure is unrelated

FAILED providers/tests/common/sql/hooks/test_dbapi.py::TestDbApiHook::test_run_no_log 

kaxil added a commit to astronomer/airflow that referenced this pull request Jan 17, 2025
Follow-up of apache#45727 to use Protocol to allow auto-completion on IDE while not introducing runtime dep
kaxil added a commit to astronomer/airflow that referenced this pull request Jan 18, 2025
Follow-up of apache#45727 to use Protocol to allow auto-completion on IDE while not introducing runtime dep
Comment on lines +793 to +800
elif isinstance(msg, GetAssetByName):
asset_resp = self.client.assets.get(name=msg.name)
asset_result = AssetResult.from_asset_response(asset_resp)
resp = asset_result.model_dump_json(exclude_unset=True).encode()
elif isinstance(msg, GetAssetByUri):
asset_resp = self.client.assets.get(uri=msg.uri)
asset_result = AssetResult.from_asset_response(asset_resp)
resp = asset_result.model_dump_json(exclude_unset=True).encode()
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I was just wondering what would happen if both were provided. Nicely handled

kaxil added a commit to astronomer/airflow that referenced this pull request Jan 20, 2025
Follow-up of apache#45727 to use Protocol to allow auto-completion on IDE while not introducing runtime dep
kaxil added a commit to astronomer/airflow that referenced this pull request Jan 20, 2025
Follow-up of apache#45727 to use Protocol to allow auto-completion on IDE while not introducing runtime dep
kaxil added a commit that referenced this pull request Jan 20, 2025
Follow-up of #45727 to use Protocol to allow auto-completion on IDE while not introducing runtime dep
dauinh pushed a commit to dauinh/airflow that referenced this pull request Jan 24, 2025
part of apache#45717 and apache#45752

This PR adds support for `outlet_events` in Context dict within the Task SDK by adding an endpoint on the API Server which is fetched when outlet_events is accessed.
dauinh pushed a commit to dauinh/airflow that referenced this pull request Jan 24, 2025
Follow-up of apache#45727 to use Protocol to allow auto-completion on IDE while not introducing runtime dep
got686-yandex pushed a commit to got686-yandex/airflow that referenced this pull request Jan 30, 2025
part of apache#45717 and apache#45752

This PR adds support for `outlet_events` in Context dict within the Task SDK by adding an endpoint on the API Server which is fetched when outlet_events is accessed.
got686-yandex pushed a commit to got686-yandex/airflow that referenced this pull request Jan 30, 2025
Follow-up of apache#45727 to use Protocol to allow auto-completion on IDE while not introducing runtime dep
niklasr22 pushed a commit to niklasr22/airflow that referenced this pull request Feb 8, 2025
part of apache#45717 and apache#45752

This PR adds support for `outlet_events` in Context dict within the Task SDK by adding an endpoint on the API Server which is fetched when outlet_events is accessed.
niklasr22 pushed a commit to niklasr22/airflow that referenced this pull request Feb 8, 2025
Follow-up of apache#45727 to use Protocol to allow auto-completion on IDE while not introducing runtime dep
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Development

Successfully merging this pull request may close these issues.

3 participants