Key Value DB
RabbitMQ
"RabbitMQ is an open-source message-broker software that originally implemented the Advanced Message Queuing Protocol and has since been extended with a plug-in architecture to support Streaming Text Oriented Messaging Protocol, MQ Telemetry Transport, and other protocols."
Apache ActiveMQ™ is the most popular open source, multi-protocol, Java-based messaging serve
Kafka
Apache Kafka is a distributed event store and stream-processing platform.
Kafka 101 youtube, event sourcing & event storage with Kafka - confluent
Kafka in a nutshell - But even these solutions came up short in some cases. For example, RabbitMQ stores messages in DRAM until the DRAM is completely consumed, at which point messages are written to disk, severely impacting performance.
Also, the routing logic of AMQP can be fairly complicated as opposed to Apache Kafka. For instance, each consumer simply decides which messages to read in Kafka.
In addition to message routing simplicity, there are places where developers and DevOps staff prefer Apache Kafka for its high throughput, scalability, performance, and durability; although, developers still swear by all three systems for various reasons.
Apache Kafka Kafka is a pub-sub messaging system. It uses Zookeeper to detect crashes, to implement topic discovery, and to maintain production and consumption state for topics.
KSQLDB
KSQLDB 101 uses Kafka streams to run queries over kafka, youtube
Zoo keeper
Intro 1, 2 - use cases, 3*, 4
Last updated