Flume1.3.1配置-日志节点
发布日期:2021-11-04 22:04:15 浏览次数:7 分类:技术文章

本文共 1564 字,大约阅读时间需要 5 分钟。

#====flume1.3.1带负载均衡的配置==========================================================================================
newlog-agent.sources=updatelog
newlog-agent.sinks=updatelog updatelog2
newlog-agent.channels=updatelog
newlog-agent.sinkgroups = updatelog
#----updatelog----
# Describe/configure the source
newlog-agent.sources.updatelog.type = spooldir
newlog-agent.sources.updatelog.spoolDir = /data0/flume-ng-log/updatelog
# 支持压缩的AvroSink
newlog-agent.sinks.updatelog.type = com.xxxx.flume.sink.AvroSink
newlog-agent.sinks.updatelog.compression-type = deflate
newlog-agent.sinks.updatelog.hostname = newlogcollector
newlog-agent.sinks.updatelog.port = 11000
newlog-agent.sinks.updatelog2.type = com.xxxx.flume.sink.AvroSink
newlog-agent.sinks.updatelog2.compression-type = deflate
newlog-agent.sinks.updatelog2.hostname = newlogcollector2
newlog-agent.sinks.updatelog2.port = 11000
newlog-agent.sinkgroups.updatelog.sinks = updatelog updatelog2
newlog-agent.sinkgroups.updatelog.processor.type = load_balance
newlog-agent.sinkgroups.updatelog.processor.backoff = true
newlog-agent.sinkgroups.updatelog.processor.selector = random
# Describe the channel
newlog-agent.channels.updatelog.type = file
newlog-agent.channels.updatelog.checkpointDir = /data0/flume-ng-channel/updatelog/checkpoint
newlog-agent.channels.updatelog.dataDirs = /data0/flume-ng-channel/updatelog/data
# Bind the source and sink to the channel
newlog-agent.sources.updatelog.channels = updatelog
newlog-agent.sinks.updatelog.channel = updatelog
newlog-agent.sinks.updatelog2.channel = updatelog

转载地址:https://blog.csdn.net/xiaochawan/article/details/8986811 如侵犯您的版权,请留言回复原文章的地址,我们会给您删除此文章,给您带来不便请您谅解!

上一篇:Flume1.3.1配置-汇聚节点
下一篇:使用Flume NG构建数据收集系统(第一部分 Flume介绍)

发表评论

最新留言

很好
[***.229.124.182]2024年03月29日 06时46分23秒

关于作者

    喝酒易醉,品茶养心,人生如梦,品茶悟道,何以解忧?唯有杜康!
-- 愿君每日到此一游!

推荐文章