Skip to content

Airbyte Connection Required Fields missing on Airflow 3 #55841

@g-dailey

Description

@g-dailey

Apache Airflow Provider(s)

airbyte

Versions of Apache Airflow Providers

apache-airflow-providers-airbyte==5.2.3

Apache Airflow version

3

Operating System

Operating System: Debian GNU/Linux 12 (bookworm) (via Astro Runtime 3.0.10 container)

Deployment

Astronomer

Deployment details

I am using Airflow version 3.0.6 (via Astro Runtime) for local development (Docker).

I also tested with Airflow version 2.10.3 and 2.11.0. In those Airflow 2 versions, the Airbyte provider page shows the correct fields (client_id and client_secret). However, in Airflow 3, those fields are missing and replaced with the standard connection fields.

Image

What happened

When using apache-airflow-providers-airbyte==5.2.3 with Airflow 2, the provider correctly requires the client_id and client_secret fields.

However, in Airflow 3, these fields are missing and instead replaced by the standard connection fields (host, login, password, port, schema). This mapping is incorrect for Airbyte connections.

I also attempted to add client_id and client_secret under Extra JSON Fields, but the connection still failed between Airbyte and Airflow.

What you think should happen instead

The client_id and client_secret fields should be available to use Airbyte connection successfully.

How to reproduce

Add apache-airflow-providers-airbyte==5.2.3 to your Airflow 3 deployment and attempt to create Airbyte Connection to see the missing fields.

Anything else

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions