Tech - Kafka

Queues vs logs https://jack-vanlightly.com/blog/2023/10/2/the-advantages-of-queues-on-logs

• From Lambda to Kappa architecture
• Event based, real-time “central nervous system”

https://www.kai-waehner.de/blog/2021/09/23/real-time-kappa-architecture-mainstream-replacing-batch-lambda/

https://www.kai-waehner.de/blog/2021/04/20/comparison-open-source-apache-kafka-vs-confluent-cloudera-red-hat-amazon-msk-cloud/

Compared to RabbitMQ

https://eranstiller.com/rabbitmq-vs-kafka-an-architects-dilemma-part-1

https://eranstiller.com/rabbitmq-vs-kafka-an-architects-dilemma-part-2

Ordering

”However, a producer can set a partition key on each message to create logical streams of data (such as messages from the same device, or message belonging to the same tenant)“

Alternatives

Redpanda

https://www.redpanda.com/data-streaming

Stream Store (S2)

Intro: https://s2.dev/blog/intro

Tansu

https://tansu.io/ https://github.com/tansu-io/tansu