《大数据: Flume 负载均衡(Load balancing Sink Processor)》

it2025-01-09  6

一、Flume 负载均衡

Load balancing Sink Processor 维持了sink组中active状态的sink,使用round_robin 或 random 算法,来分散sink组中存活的sink之间的负载, 每隔一段时间随机选取某个sink

 

1. 组件选择

①. Load balancing Sink Processor 

Load balancing sink processor provides the ability to load-balance flow over multiple sinks. It maintains an indexed list of active sinks on which the load must be distributed. Implementation supports distributing load using either via round_robin or random selection mechanisms. The choice of selection mechanism defaults to round_robin type, but can be overridden via configuration. Custom selection mechanisms are supported via cus

最新回复(0)