Skip to content

Conversation

@harels
Copy link
Contributor

@harels harels commented Nov 11, 2025

Summary

This PR updates the Kubernetes section of the Airflow documentation to:

  • Add Option 1: Datadog Transport (recommended) with proper version requirements
  • Add Option 2: Composite Transport for users who need multiple destinations
  • Add Option 3: Simple Configuration (backward compatible with all versions)

Changes

  • Updated Kubernetes section to use Datadog Transport configuration
  • Added version requirements: apache-airflow-providers-openlineage >= 1.11.0 and openlineage-python >= 1.37.0 for transport options
  • Added composite transport option similar to Astronomer section
  • Preserved original simple configuration as Option 3 for backward compatibility

References

…mposite transport option

- Add Option 1: Datadog Transport (recommended) with version requirements
- Add Option 2: Composite Transport for multiple destinations
- Add Option 3: Simple Configuration (backward compatible)
- Specify version requirements: apache-airflow-providers-openlineage >= 1.11.0 and openlineage-python >= 1.23.0 for transport options
@harels harels requested a review from a team as a code owner November 11, 2025 20:10
@github-actions
Copy link
Contributor

Preview links (active after the build_preview check completes)

Modified Files

Copy link
Contributor

@warrierr warrierr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@cswatt cswatt self-assigned this Nov 11, 2025
Copy link
Contributor

@iadjivon iadjivon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi there, I added some suggestion here to to solve some Vale issues. Let me know if you have any questions.

harels and others added 2 commits November 11, 2025 17:59
Co-authored-by: Ida Adjivon <65119712+iadjivon@users.noreply.github.com>
Co-authored-by: Ida Adjivon <65119712+iadjivon@users.noreply.github.com>
@harels
Copy link
Contributor Author

harels commented Nov 11, 2025

Hi there, I added some suggestion here to to solve some Vale issues. Let me know if you have any questions.

Thanks! Updated

@harels harels merged commit a3785bf into master Nov 11, 2025
18 of 19 checks passed
@harels harels deleted the harel.shein/update-kubernetes-airflow-datadog-transport branch November 11, 2025 23:43
dussault-antoine pushed a commit that referenced this pull request Nov 13, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants