Memory Channel
E705299
Memory Channel is an in-memory data buffer used in Apache Flume to temporarily store events for high-throughput, low-latency data ingestion.
Statements (48)
| Predicate | Object |
|---|---|
| instanceOf |
Apache Flume channel
ⓘ
in-memory data buffer ⓘ software component ⓘ |
| alternativeTo |
File Channel
ⓘ
Spillable Memory Channel NERFINISHED ⓘ |
| belongsToCategory |
message queue
ⓘ
stream processing infrastructure component ⓘ |
| configuredVia | Flume configuration file ⓘ |
| definedIn | Apache Flume core NERFINISHED ⓘ |
| developedBy | Apache Software Foundation NERFINISHED ⓘ |
| hasConfigurationParameter |
byteCapacity
ⓘ
byteCapacityBufferPercentage ⓘ capacity ⓘ keep-alive ⓘ transactionCapacity ⓘ |
| hasLimitation |
data lost if Flume agent process crashes
ⓘ
not suitable for strict durability requirements ⓘ |
| hasMetric |
channelCapacity
ⓘ
channelSize ⓘ eventPutAttemptCount ⓘ eventPutSuccessCount ⓘ eventTakeAttemptCount ⓘ eventTakeSuccessCount ⓘ |
| hasProperty |
bounded capacity
ⓘ
fast ⓘ in-memory storage ⓘ low latency ⓘ non-durable ⓘ |
| implementedIn | Java NERFINISHED ⓘ |
| interactsWith |
Flume sinks
ⓘ
Flume sources ⓘ |
| monitoredBy | Flume metrics system ⓘ |
| optimizedFor | throughput over durability ⓘ |
| partOf | Apache Flume NERFINISHED ⓘ |
| requires | sufficient heap memory ⓘ |
| stores | Flume events ⓘ |
| supports | Flume transactions ⓘ |
| tradeoff | risk of data loss on agent failure ⓘ |
| usedFor |
high-throughput data ingestion
ⓘ
low-latency data ingestion ⓘ temporarily storing events in memory ⓘ |
| usedIn |
data ingestion pipelines
ⓘ
log collection systems ⓘ streaming data workflows ⓘ |
| usedWith |
Avro source
ⓘ
HDFS sink ⓘ Kafka sink ⓘ Syslog source ⓘ |
Referenced by (1)
Full triples — surface form annotated when it differs from this entity's canonical label.