apache/airflow

Improve Operators Documentation Page about 19 hours ago

good first issue kind:documentation area:core

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Combined length of DAG tags cannot exceed 100 characters 1 day ago

kind:bug kind:feature good first issue priority:low area:core needs-triage

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Improve the error message when a required field from the API is not provided 1 day ago

area:API good first issue area:airflow-ctl

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Allow jinja templating connection ids for all third party operators 2 days ago

kind:feature good first issue

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Move template-field validation/transformation out of operator __init__ (exemption-list burn-down) 2 days ago

area:providers good first issue kind:meta area:core-operators

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Add missing tests for `cncf.kubernetes` script and delete utilities 3 days ago

area:providers good first issue provider:cncf-kubernetes

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Add missing tests for `common.compat.standard` Operators andTtriggers 3 days ago

area:providers good first issue

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Deferrable HttpSensor does not move to Triggerer when using `response_check` 5 days ago

kind:bug good first issue provider:http

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Add REST API metrics (latency, QPS, errors) 6 days ago

kind:feature area:API good first issue

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

FAB 3.6.0 can't create a cookies. TypeError: cannot use a string pattern on a bytes-like object 8 days ago

kind:bug area:providers good first issue provider:fab

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Expose an API which can return dagRun status in most optimized time 9 days ago

kind:feature area:API good first issue

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Update Security model documentation to explain our approach for sensitive data exposure over API 9 days ago

good first issue kind:documentation

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Helm chart: Git-sync v4 incorrect mix of branch, ref, rev 10 days ago

kind:bug good first issue area:helm-chart

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

DateTimeSensorAsync crashes Dag parsing with templated target_time + start_from_trigger=True 10 days ago

kind:bug good first issue provider:standard

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Add proper coverage for K8S tests 10 days ago

good first issue provider:cncf-kubernetes kind:task

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Add declarative configuration to define custom roles 10 days ago

area:providers kind:feature good first issue provider:fab

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Add a `has_events` filter to the Assets search view 11 days ago

kind:feature area:API good first issue area:UI

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Add Real-World DAG Debugging Strategies to Airflow Docs 11 days ago

good first issue kind:documentation

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Don't have session.commit() when @provide_session decorator is used 11 days ago

area:MetaDB good first issue priority:medium kind:task

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Update SQLAlchemy documentation links from 1.4 (en/14) to 2.0 (en/20) 12 days ago

good first issue kind:documentation

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

DatabricksRunNowOperator(deferrable=True) crashes in triggerer: AsyncToSync used inside running event loop (Airflow 3.0.6) 14 days ago

kind:bug area:providers good first issue area:async-operators provider:databricks

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

control state of individual taskflow in mapped task-group 14 days ago

kind:feature good first issue area:dynamic-task-mapping area:TaskGroup

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Connection port field does not validate that the value is a valid port number 14 days ago

kind:bug good first issue area:core

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

skip_archive should actually skip archive in db clean command 15 days ago

kind:feature good first issue kind:meta area:db-migrations

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

DagBag Processing SIGSEGV causes runaway tasks with LocalExecutor 15 days ago

kind:bug good first issue area:core area:Executors-core

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Add Additional Techniques for Airflow Troubleshooting 16 days ago

kind:feature good first issue kind:documentation

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Forward hook config to `OpenSearchServerlessCollectionActiveTrigger` 16 days ago

kind:bug provider:amazon area:providers good first issue

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Fix Pill for Last Run State 17 days ago

kind:bug good first issue area:UI

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Add missing tests for `sftp` exceptions 17 days ago

area:providers good first issue provider:sftp

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Add missing tests for `edge3` worker API app and auth 17 days ago

area:providers good first issue

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Remove the dead `cloudant_fake` module, or add its missing tests 17 days ago

area:providers good first issue provider:cloudant

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

unclear docs on custom decorators 17 days ago

good first issue kind:documentation contributors-workshop

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

The "docker is not running" error when using a GitHub codespace 17 days ago

kind:bug area:dev-env good first issue kind:documentation needs-triage

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Replace azure-cosmos by azure-mgmt-cosmosdb 18 days ago

provider:microsoft-azure kind:feature good first issue

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Replace azure-batch by azure-mgmt-batch 18 days ago

provider:microsoft-azure kind:feature good first issue

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

ReDoS in SparkSubmitHook._mask_cmd() via user-controlled application_args (apache-airflow-providers-apache-spark) 18 days ago

kind:bug area:providers good first issue provider:apache-spark

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Bound and harden the task-UUID scan fallback 18 days ago

provider:amazon area:providers good first issue

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Add test to verify parameters match between operator and decorator 19 days ago

area:providers good first issue kind:meta provider:cncf-kubernetes

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Jinja templating capability is not working for the parameter (additional args) in spark job submit for DatabricksWorkflowTaskGroup 21 days ago

kind:bug area:providers good first issue provider:databricks

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Forward hook config to the `SageMakerUnifiedStudioNotebookTrigger` 21 days ago

kind:bug provider:amazon area:providers good first issue contributors-workshop

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Add missing test modules in our unit test suite 21 days ago

good first issue kind:meta contributors-workshop

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

GCSToGCSOperator: move_object=True raises NotFound (404) exception on task retry when source object was already deleted 21 days ago

kind:bug provider:google area:providers good first issue

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

[AIP-94] airflowctl tasks: add TasksOperations and TaskInstancesOperations to operations.py 21 days ago

area:CLI kind:feature area:API good first issue kind:meta area:airflow-ctl

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Warning about invisible connections/variable in the Web UI 21 days ago

kind:feature good first issue

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

InfluxDB3Operator: add deferrable variant 23 days ago

kind:feature good first issue area:async-operators provider:influxdb

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Enable Streaming from SFTP to GCS in `SFTPToGCSOperator` 23 days ago

provider:google area:providers kind:feature good first issue provider:sftp

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Databricks: add SQL endpoint operators 26 days ago

area:providers kind:feature good first issue provider:databricks

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

job table missing `dag_id` and `executor_class` for BackfillJob type 27 days ago

kind:bug good first issue area:backfill

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Use Kubernetes-recommended labels for airflow helm chart 28 days ago

kind:feature good first issue area:helm-chart

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Add Triggers to provider information 28 days ago

good first issue kind:meta

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

AIP-82: Add common messaging system providers 29 days ago

provider:google provider:microsoft-azure provider:amazon kind:feature good first issue kind:meta provider:redis AIP-82

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Improve ExternalTaskSensor execution date pattern 30 days ago

kind:feature good first issue provider:standard

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

PgBouncer integration should auto-configure metadata connection about 1 month ago

kind:bug good first issue area:helm-chart

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Allow task to depend on specific tasks from previous dag_run about 1 month ago

kind:feature good first issue area:core needs-triage

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

[webui] DateTimeInput broken on Firefox about 1 month ago

kind:bug good first issue priority:medium area:UI affected_version:3.0 affected_version:3.1

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Support for podman in breeze tooling about 1 month ago

kind:feature good first issue area:dev-env-Breeze2

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Five "otel_*" options appear twice in the "Configuration Reference" about 1 month ago

kind:bug good first issue kind:documentation needs-triage

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Improve default task failure email template for readability and operational clarity about 1 month ago

area:providers kind:feature good first issue provider:smtp

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

SSO docs show incorrect redirect path about 1 month ago

kind:bug area:providers good first issue kind:documentation provider:fab

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

GlueJobCompleteTrigger's verbose branch still treats STOPPED as success, disagreeing with the waiter and the operator about 1 month ago

kind:bug provider:amazon area:providers good first issue

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Add deferrable mode to SFTPOperator about 1 month ago

area:providers kind:feature good first issue provider:sftp

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Autolabel "tests" PRs with a new github label about 1 month ago

kind:feature good first issue area:CI kind:meta

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Add API Support for Filtering Unscheduled DAGs about 1 month ago

kind:feature area:API good first issue

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

airflow/utils/email.py def send_mime_email doesn't take all values from connection about 1 month ago

kind:bug good first issue area:core

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

KubernetesPodOperator with multiple containers hangs if container other than base container is still running about 1 month ago

kind:bug area:providers good first issue provider:cncf-kubernetes

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

[Filters] Add filters to Search - Assets about 1 month ago

kind:feature area:API good first issue area:UI

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Automatic reference to configuration reference docs about 1 month ago

kind:feature good first issue kind:documentation

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Azure Virtual Analysis Services Operator about 1 month ago

provider:microsoft-azure area:providers kind:feature good first issue

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Add a time range selector for the Gantt view about 1 month ago

good first issue type:new-feature area:UI

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

[AIP-94] airflowctl tasks: add state command about 2 months ago

area:CLI kind:feature good first issue kind:meta area:airflow-ctl

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

`runAndTaskActions.options.preventRunningTasks` shows when clearing Tasks rather than proper display text about 2 months ago

kind:bug good first issue area:UI

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Add SRV DNS record support to http connections about 2 months ago

kind:feature good first issue provider:http

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Separate JWT Secret Env from Standard Airflow Environment Variables about 2 months ago

kind:feature good first issue area:helm-chart

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Missing docs for logging about 2 months ago

area:logging good first issue kind:documentation contributors-workshop

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Add Support for Filtering DAGs by Timetable Type about 2 months ago

kind:feature area:API good first issue area:UI

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

DatabricksRunNowOperator always pass parameters to Databricks Job about 2 months ago

kind:bug area:providers good first issue provider:databricks

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Support Native Kubernetes sidecars in our Chart about 2 months ago

good first issue area:helm-chart kind:meta

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Sensitive data from extra fields is visible in Edit Connection window about 2 months ago

kind:feature good first issue area:core area:UI

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Hide "Run with latest bundle version" checkbox for non-versioned bundles when clearing about 2 months ago

kind:bug good first issue area:UI affected_version:3.2

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Optional support for static Extra Links without XCom dependency about 2 months ago

kind:feature good first issue area:core needs-triage

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

DAG-level `on_failure_callback` never fires about 2 months ago

kind:bug good first issue area:core needs-triage affected_version:3.1

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Feature request: Add deferrable support for invoking/waiting on Google Cloud Functions / Cloud Run functions about 2 months ago

provider:google area:providers kind:feature good first issue

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

dagProcessor in helm chart doesn't have a labels section about 2 months ago

kind:feature good first issue area:helm-chart

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

SQLExecuteQueryOperator not timing out within expected timeframe 2 months ago

kind:bug area:providers good first issue provider:common-sql needs-triage

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Databricks: sensor for jobs 2 months ago

area:providers kind:feature good first issue provider:databricks

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

AIP - 68 AI Rules for templated react projects 2 months ago

kind:feature good first issue type:improvement

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Define translation agent skill guidelines for Arabic (ar) locale 2 months ago

good first issue area:translations translation:ar

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Google Stackdriver Logging not working as expected 2 months ago

kind:bug provider:google area:providers area:logging good first issue

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Hash Virtual Environment Cache Based on Actual Package Versions in `PythonVirtualEnvOperator` 2 months ago

kind:feature good first issue area:core provider:standard

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

SSHRemoteJobOperator: inconsistent "remote_base_dir" validation 2 months ago

kind:bug area:providers good first issue provider:ssh

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Add dag run deadlines to API and UI 2 months ago

kind:feature area:API good first issue area:UI area:deadline-alerts

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Calling a BigQuery Stored Procedure aggregates all inputs & outputs at the Airflow Task level 2 months ago

provider:google area:providers kind:feature good first issue provider:openlineage

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Airflow 3.0.x : Bring back from Airflow 2.x "Status of all previous DAG runs" column in DAGS main page 2 months ago

kind:feature good first issue area:UI

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Secrets with slashed IDs return AirflowNotFoundException 2 months ago

kind:bug area:API good first issue area:core affected_version:3.1

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Creating a backfill via Airflow API results in internal server error if SQLite is used 2 months ago

kind:bug area:API good first issue area:core area:backfill

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Enable kubernetes_pod_operator to reattach_on_restart when the worker dies 3 months ago

area:providers kind:feature good first issue provider:cncf-kubernetes

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

XCom unable to parse tuple response from DatabricksSQLOperator on SQL query execution 3 months ago

kind:bug area:providers good first issue provider:databricks

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Migrate exasol provider to pyexasol 2.x and remove the <2 cap 3 months ago

area:providers good first issue provider:exasol

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Dataset DEL/POST API should also check the access_control at DAG level if defined 3 months ago

kind:bug area:API good first issue priority:low

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Deferrable BeamRunPythonPipelineOperator (DataflowRunner) fails with "400 Request must contain a job and project id" when launcher stdout has no job-id line 3 months ago

kind:bug provider:google area:providers good first issue provider:apache-beam

apache/airflow

46.0K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

#airflow#apache#apache-airflow#automation#dag#data-engineering#data-integration#data-orchestrator#data-pipelines#data-science#elt#etl#machine-learning#mlops#orchestration#python#scheduler#workflow#workflow-engine#workflow-orchestration

Open Issues Need Help