incubator-doris Hadoop high availability is currently not supported[Bug]

bmp9r5qi 于 2022-04-22 发布在 Java

关注(0)|答案(2)|浏览(188)

Search before asking

I had searched in the issues and found no similar issues.

Version

1.0

What's Wrong?

use hive external table on thrift ,but response message: ERROR 1105 (HY000): errCode = 2, detailMessage = connect failed. hdfs://nameservice2

What You Expected?

use hive external table on thrift ,but response message: ERROR 1105 (HY000): errCode = 2, detailMessage = connect failed. hdfs://nameservice2

How to Reproduce?

No response*

Anything Else?

No response*

Are you willing to submit PR?

Yes I am willing to submit a PR!

Code of Conduct

I agree to follow this project's Code of Conduct

来源：https://github.com/apache/incubator-doris/issues/9129

2条答案

按热度按时间

e7arh2l61#

The following hdfs ha related configuration items are missing.

("dfs.nameservices", "hacluster");
        ("dfs.ha.namenodes.hacluster", "3,4");
        ("dfs.namenode.rpc-address.hacluster.3", "192.168.0.93:8020");
        ("dfs.namenode.rpc-address.hacluster.4", "192.168.0.189:8020");
        ("dfs.client.failover.proxy.provider.hacluster", "org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider");

Need to find a way to pass the above parameters to Doris hive external table. We will fix this very soon.

赞(0）回复(0）举报 2022-04-22

ercv8c1e2#

以下hdfs ha相关配置项缺失。

("dfs.nameservices", "hacluster");
        ("dfs.ha.namenodes.hacluster", "3,4");
        ("dfs.namenode.rpc-address.hacluster.3", "192.168.0.93:8020");
        ("dfs.namenode.rpc-address.hacluster.4", "192.168.0.189:8020");
        ("dfs.client.failover.proxy.provider.hacluster", "org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider");

需要想办法把上面的参数传给Doris hive外部表。我们将很快解决这个问题。