flume代理抛出java.net.connectexception:连接被拒绝

gstyhher  于 2021-06-04  发布在  Flume
关注(0)|答案(1)|浏览(643)

我已经使用flume有一段时间了,我让代理和收集器在同一台机器上运行。

配置

agent: exec("/usr/bin/tail -n +0 -F /path/to/file") | agentE2ESink("hostname", 35855)
collector: collectorSource(35855) | collector(10000) { collectorSink("/hdfs/path/to/sink","name") }

代理节点中面临的问题:

2012-06-04 19:13:33,625 [naive file wal consumer-27] INFO debug.InsistentOpenDecorator: open attempt 0 failed, backoff (1000ms): Failed to open thrift event sink to hostname:35855 : java.net.ConnectException: Connection refused
2012-06-04 19:13:34,625 [logicalNode hostname-19] ERROR connector.DirectDriver: Expected ACTIVE but timed out in state OPENING
2012-06-04 19:13:34,632 [naive file wal consumer-27] INFO debug.InsistentOpenDecorator: open attempt 1 failed, backoff (2000ms): Failed to open thrift event sink to hostname:35855 : java.net.ConnectException: Connection refused
2012-06-04 19:13:36,635 [naive file wal consumer-27] INFO debug.InsistentOpenDecorator: open attempt 2 failed, backoff (4000ms): Failed to open thrift event sink to hostname:35855 : java.net.ConnectException: Connection refused

然后将连续发送空ack

2012-06-04 19:19:56,960 [Roll-TriggerThread-0] INFO endtoend.AckListener$Empty: Empty Ack Listener began 20120604-191956958+0530.881565921235084.00000026
2012-06-04 19:20:07,043 [Roll-TriggerThread-0] INFO hdfs.SeqfileEventSink: closed /tmp/flume-user1/agent/hostname/writing/20120604-191956958+0530.881565921235084.00000026

我不明白为什么连接被拒绝。是否需要进行系统级更改?
注意:收集器正在侦听端口,但代理无法通过35855端口发送数据。
有人能帮我解决这个问题吗。
谢谢

pod7payv

pod7payv1#

如果在同一个框中同时运行代理和收集器,则应该使用localhost作为地址。

agentE2ESink("localhost", 35855)

相关问题