我在中添加了一些事件头属性 Flume 但是我不知道如何在flumeagent配置文件中访问它例如:我添加了fileheader使用 flumeagent.sinks.sinkname.hdfs.fileHeader = true 目标是能够在路径中添加事件头属性,例如: flumeagent.sinks.sinkname.hdfs.path = /user/name/flumedir/%y-%m-%d/event-attribute
Flume
flumeagent.sinks.sinkname.hdfs.fileHeader = true
flumeagent.sinks.sinkname.hdfs.path = /user/name/flumedir/%y-%m-%d/event-attribute
huus2vyu1#
发现可以使用以下方法添加文件名或绝对文件路径flumeagent.sources.src1.fileHeader = true flumeagent.sources.src1.fileHeaderKey = file flumeagent.sources.src1.basenameHeader = true flumeagent.sources.src1.basenameHeaderKey = basename 注:以上是在源中添加的,但在汇中使用 flumeagent.sinks.sinkname.hdfs.path = /user/name/flumedir/%y-%m-%d/%{file} 或者 flumeagent.sinks.sinkname.hdfs.path = /user/name/flumedir/%y-%m-%d/%{basename}
flumeagent.sources.src1.basenameHeader = true flumeagent.sources.src1.basenameHeaderKey = basename
flumeagent.sinks.sinkname.hdfs.path = /user/name/flumedir/%y-%m-%d/%{file}
flumeagent.sinks.sinkname.hdfs.path = /user/name/flumedir/%y-%m-%d/%{basename}
1条答案
按热度按时间huus2vyu1#
发现可以使用以下方法添加文件名或绝对文件路径
flumeagent.sources.src1.fileHeader = true flumeagent.sources.src1.fileHeaderKey = file
flumeagent.sources.src1.basenameHeader = true flumeagent.sources.src1.basenameHeaderKey = basename
注:以上是在源中添加的,但在汇中使用flumeagent.sinks.sinkname.hdfs.path = /user/name/flumedir/%y-%m-%d/%{file}
或者flumeagent.sinks.sinkname.hdfs.path = /user/name/flumedir/%y-%m-%d/%{basename}