Skip to content

我这要配了，无效，我的集群的nameservices就叫cluster，报错java.lang.IllegalArgumentException: java.net.UnknownHostException: cluster #197

New issue
New issue
Open
Open
我这要配了，无效，我的集群的nameservices就叫cluster，报错java.lang.IllegalArgumentException: java.net.UnknownHostException: cluster#197
@lijufeng2016

Description

@lijufeng2016
lijufeng2016
opened on Oct 10, 2018

"name": "hdfswriter",
"parameter": {
"defaultFS": "hdfs://cluster",
"hadoopConfig": {
"dfs.nameservices": "cluster",
"dfs.ha.namenodes.cluster": "nn1,nn2",
"dfs.namenode.rpc-address.cluster.nn1": "ha01:8020",
"dfs.namenode.rpc-address.cluster.nn2": "ha04:8020",
"dfs.client.failover.proxy.provider.cluster": "org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider"
},
"fieldDelimiter": "\u0001",
"fileName": "data",
"fileType": "orc",
"path": "/apps/hive/warehouse/mlg.db/ad_info_tao",
"writeMode": "truncate",

Activity

jiaomb

jiaomb commented on Oct 29, 2018

@jiaomb
jiaomb
on Oct 29, 2018

/etc/hosts配一下

ZzzzZzreal

ZzzzZzreal commented on Nov 7, 2018

@ZzzzZzreal
ZzzzZzreal
on Nov 7, 2018

同问。hdfsreader上面那样的配置，报相同的错

lijufeng2016

lijufeng2016 commented on Nov 8, 2018

@lijufeng2016
lijufeng2016
on Nov 8, 2018
Author

我已经解决了，把hdfs-site.xml,core-site.xml,hive-site.xml三个文件放到hdfswriter.jar文件里面去

yinxs2003

yinxs2003 commented on Dec 14, 2018

@yinxs2003
yinxs2003
on Dec 14, 2018 · edited by yinxs2003

用winrar把hdfs-site.xml,core-site.xml,hive-site.xml三个文件压缩到datax/plugin/reader/hdfsreader/hdfsreader-0.0.1-SNAPSHOT.jar里面， 感谢🙏@lijufeng2016

Victer-python

Victer-python commented on Sep 23, 2019

@Victer-python
Victer-python
on Sep 23, 2019

有效，hdfs-site.xml,core-site.xml,hive-site.xml可以从cloudrea manager 中下载hive 客户端配置
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

      Development

      No branches or pull requests

        Participants

        @jiaomb@yinxs2003@lijufeng2016@Victer-python@ZzzzZzreal

        Issue actions
          我这要配了，无效，我的集群的nameservices就叫cluster，报错java.lang.IllegalArgumentException: java.net.UnknownHostException: cluster · Issue #197 · alibaba/DataX