fix(airflow): support inlet datajobs correctly in v1 plugin #9331

hsheth2 · 2023-11-29T02:38:38Z

Fix a regression on the v1 plugin from feat(ingestion/airflow): support datajobs as task inlets #9211. This only would cause issues when using DataJobs as inlets.
Make the golden files less prone to change.
Update the docs on automatic lineage extraction with Airflow.

Checklist

The PR conforms to DataHub's Contributing Guideline (particularly Commit Message Format)
Links to related issues (if applicable)
Tests for the changes have been added/updated (if applicable)
Docs related to the changes have been added/updated (if applicable). If a new feature has been added a Usage Guide has been added for the same.
For any breaking change/potential downtime/deprecation/big changes an entry has been made in Updating DataHub

treff7es

lgtm

treff7es

There is a linter error.

fixed the lint issues

hsheth2 added 2 commits November 28, 2023 21:15

fix(airflow): support inlet datajobs correctly in v1 plugin

ab0591d

update docs

97b8430

github-actions bot added ingestion PR or Issue related to the ingestion of metadata docs Issues and Improvements to docs labels Nov 29, 2023

vercel bot deployed to Preview November 29, 2023 02:56 View deployment

treff7es approved these changes Nov 29, 2023

View reviewed changes

treff7es previously requested changes Nov 29, 2023

View reviewed changes

fix lint issue

cb46871

vercel bot deployed to Preview November 29, 2023 17:09 View deployment

hsheth2 requested a review from treff7es November 29, 2023 17:55

hsheth2 added the merge-pending-ci A PR that has passed review and should be merged once CI is green. label Nov 29, 2023

treff7es approved these changes Nov 30, 2023

View reviewed changes

hsheth2 merged commit a8476ee into datahub-project:master Nov 30, 2023
52 checks passed

hsheth2 deleted the airflow-plugin-v1-fix branch November 30, 2023 23:34