Hardcoded zooKeeperNamespace in URL doesn't allow to use custom name for zooKeeperNamespace

[ada-nilova]

Apache Airflow Provider(s)

apache-hive

Versions of Apache Airflow Providers

apache-airflow-providers-apache-hive==8.1.1

Apache Airflow version

2.8.4

Operating System

Debian GNU/Linux 12

Deployment

Docker-Compose

Deployment details

No response

What happened

In #38651 to airflow/providers/apache/hive/hooks/hive.py was added hardcoded URL part with "zooKeeperNamespace=hiveserver2".
Unfortunately, "hiveserver2" is not the once namespace name that can be. In some Hadoop installations zooKeeperNamespace can have any custom name.

In the same change was added ssl using always and only when using HA. But in some Hadoop installations we can set using ssl, but not using HA. And now we cannot use one option separately from another.

What you think should happen instead

If we check HA checkbox, it should be better to have a field for custom zooKeeperNamespace name in a connection form, not hardcoded.

And it should be better to have a special checkbox for ssl setting, separately from a HA checkbox

How to reproduce

If we have another zooKeeperNamespace (not hiveserver2) we cannot use HiveOperator with it.

If we have Hive with SSL, but without Zookeeper we cannot use HiveOperator with it.

Anything else

No response

Are you willing to submit PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[boring-cyborg]

Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval.

[eladkal]

cc @nevcohen would you like to take a look?

[nevcohen]

It's look like from this PR of @amoghrajesh that we need to remove the HA checkbox and add three params ​​of

• serviceDiscoveryMode
• ssl (true or false)
• zooKeeperNamespace

Can there be other params ​​in the jdbc_url except these?

[ada-nilova]

There are some other params might used in an JDBC URL too.
For example sslTrustStore=<TrustStore_path>;trustStorePassword=<TrustStore_password>

Here are some other params
https://docs.cloudera.com/cdw-runtime/1.5.1/securing-hive/topics/hive_connection_string_url_syntax.html

Maybe field "extras" would be useful for extra URL params?

[amoghrajesh]

Self assigning this. I will take a look next week

[amoghrajesh]

There was an "extra" field earlier which was removed by #37043 to simplify the connection

[amoghrajesh]

From what i see here, there are couple of issues in this issue:

1. zookeeperNamespace is not a constant and needs to be configurable
2. ssl option should be configurable
3. Some other options on demand basis

[amoghrajesh]

From what i see here, there are couple of issues in this issue:

1. zookeeperNamespace is not a constant and needs to be configurable
2. ssl option should be configurable
3. Some other options on demand basis