具有多个代理的flume:不从一个代理服务器接收任何数据

bqujaahr  于 2021-05-31  发布在  Hadoop
关注(0)|答案(0)|浏览(202)

我正在尝试在flume中配置两个代理:
第一个代理=>
来源type:exec
渠道type:memory
Flumetype:avro
下面是.conf文件中的代码

exec-memort-avro.sources = exec-source
exec-memory-avro.sinks = avro-sink
exec-memory-avro.channels = memory-channel

exec-memory-avro.sources.exec-source.type = exec
exec-memory-avro.sources.exec-source.command=tail -F /root/data/data.log
exec-memory-avro.sources.exec-source.shell=/bin/sh -c

exec-memory-avro.sinks.avro-sink.type = avro
exec-memory-avro.sinks.avro-sink.hostname = localhost
exec-memory-avro.sinks.avro-sink.port = 44444

exec-memory-avro.channels.memory-channel.type = memory

exec-memory-avro.sources.exec-source.channels = memory-channel
exec-memory-avro.sinks.avro-sink.channel = memory-channel

第二个代理=>
来源type:avro
渠道type:memory
Flumetype:logger
以下是.conf文件中的代码:

avro-memory-logger.sources = avro-source
avro-memory-logger.sinks = logger-sink
avro-memory-logger.channels = memory-channel

avro-memory-logger.sources.avro-source.type = avro
avro-memory-logger.sources.avro-source.bind=localhost
avro-memory-logger.sources.avro-source.port=44444

avro-memory-logger.sinks.logger-sink.type = logger

avro-memory-logger.channels.memory-channel.type = memory

avro-memory-logger.sources.avro-source.channels = memory-channel
avro-memory-logger.sinks.logger-sink.channel = memory-channel

两个启动命令:

flume-ng agent -n avro-memory-logger -c $FLUME_HOME/conf -f $FLUME_HOME/conf/avro-memory-logger.conf -Dflume.root.logger=INFO,console

flume-ng agent -n exec-memory-avro -c $FLUME_HOME/conf -f $FLUME_HOME/conf/exec-memory-avro.conf -Dflume.root.logger=INFO,console

两个命令都工作,一切似乎都很好,我可以看到两个代理都启动了它们的源、汇和通道。
但在我这么做之后 echo hello world >> data.log ,在agent2(avro内存记录器)中不会发生任何事情。它应该在屏幕上显示“你好世界”。
仅在第二个代理中收到:

2020-03-01 06:49:57,395 (New I/O server boss #1 ([id: 0x9ba59b05, /127.0.0.1:44444])) [INFO - org.apache.avro.ipc.NettyServer$NettyServerAvroHandler.handleUpstream(NettyServer.java:171)] [id: 0x3516365a, /127.0.0.1:59086 => /127.0.0.1:44444] OPEN
2020-03-01 06:49:57,397 (New I/O  worker #1) [INFO - org.apache.avro.ipc.NettyServer$NettyServerAvroHandler.handleUpstream(NettyServer.java:171)] [id: 0x3516365a, /127.0.0.1:59086 => /127.0.0.1:44444] BOUND: /127.0.0.1:44444
2020-03-01 06:49:57,397 (New I/O  worker #1) [INFO - org.apache.avro.ipc.NettyServer$NettyServerAvroHandler.handleUpstream(NettyServer.java:171)] [id: 0x3516365a, /127.0.0.1:59086 => /127.0.0.1:44444] CONNECTED: /127.0.0.1:59086

我不知道是什么port:59086.

暂无答案!

目前还没有任何答案,快来回答吧!

相关问题