Skip to content
CAI
Software that uses CAICheck a score

evolution-gaming/kafka-journal

52.5

Adequate · 8 November 2026

18.9k

lines of production code

Scala

primary language

7

measurements over time

CAI band scale
CAI trend line
CAI lens gauges

What this system is

Features

Add Circe-based JSON event serialization for Akka Persistence

Users can now serialize and deserialize Akka Persistence events using Circe JSON codecs. This change introduces a new \KafkaJournalCirce\ component that provides a \JsonEventSerializer\, enabling support for both raw JSON and text payloads within persistent journal entries, along with corresponding test coverage for serialization round-trips and error handling.

akka/persistence-circe · high confidence

Add Circe-based JSON serialization support for Kafka and Cassandra journal operations

This change introduces a new Circe integration module that provides JSON codecs and Kafka read/write instances using the Circe library. Users can now serialize and deserialize journal events and payloads as Circe JSON, including support for converting between Play JSON and Circe formats. The module also adds Cassandra serialization support for BufferNr and SeqNr types, enabling these types to be encoded/decoded by name and index in Cassandra tables. Additionally, helper utilities for Skafka byte conversion and Pekko actor system origin detection are included.

(repo-wide) · high confidence

Added local development scripts for Zookeeper and a 3-broker Kafka cluster

New shell scripts and configuration files have been added to the scripts directory to facilitate running a local development environment. This includes a Zookeeper instance (zookeeper.sh, zookeeper.properties) and three Kafka broker instances (broker.0.sh through broker.2.sh, and their respective .properties files). The brokers are configured with unique IDs (0, 1, 2), distinct listener ports (9092, 9093, 9094), and separate log directories, enabling users to start a multi-broker cluster locally for testing and development purposes.

scripts · high confidence

Introduce Circe-based JSON serialization for Pekko Persistence events

The \pekko/persistence-circe\ module now provides a \KafkaJournalCirce\ implementation that serializes persistence events to and from JSON using the Circe library. This allows users to leverage Circe's type-class-based encoding and decoding for event payloads, supporting both JSON and text payload types, and includes corresponding tests to verify serialization round-trips and error handling for unsupported payload types.

pekko/persistence-circe · high confidence

Introduce snapshot storage abstractions and types

Added core types and interfaces for managing journal snapshots, including the \SnapshotStore\ trait for saving, loading, and deleting snapshots, along with supporting data models like \Snapshot\, \SnapshotRecord\, and \SnapshotSelectionCriteria\. The \BufferNr\ type was also introduced to represent indices within a stored ring buffer, ensuring valid range checks and instance reuse.

snapshot · high confidence

Journal API extends with mark operation and refactors core data models

The Journal trait now supports a mark operation, allowing users to record markers in addition to appending, deleting, and purging events. This change introduces a new Action type hierarchy (Action, ActionHeader, ActionRecord) and associated components (AppendMarker, ConsumeActionRecords) to handle these markers, while also refactoring internal data structures like Bounds and Event to support the updated journaling capabilities.

journal/src/main/scala/com/evolution/kafka/journal · high confidence

New Akka Persistence plugin for Kafka-backed event sourcing

This release introduces a new Akka Persistence journal plugin that stores events in Kafka (with eventual consistency via Cassandra). Users can enable it by setting \akka.persistence.journal.plugin\ to \evolutiongaming.kafka-journal.persistence.journal\. The plugin provides a default configuration in \reference.conf\ (under \evolutiongaming.kafka-journal.persistence\) covering Kafka producer/consumer settings, Cassandra client options, circuit-breaker thresholds, and a dynamic consumer pool for recovery. It exposes an ActorSystem extension (\KafkaJournalsRef\) so external components can share the same Journals instance for actions like purge/mark, ensuring visibility to the plugin's HeadCache. Serialization is handled via Play JSON or Akka serialization, with configurable JSON codecs (Default, PlayJson, Jsoniter) and batching strategies (disabled, all, or by event count).

akka/persistence/src/main · high confidence

New Cassandra persistence layer with configurable consistency and schema migration

This release introduces a new Cassandra-based storage backend for the journal, replacing previous implementations. The new layer includes automatic keyspace and table creation, a built-in schema migration system that tracks and applies versioned CQL changes, and configurable read/write consistency levels (defaulting to LOCAL\_QUORUM). It also provides a settings store backed by Cassandra for managing schema versions and other metadata, along with comprehensive type encoders/decoders for journal entities like Key, SeqNr, and PayloadType.

cassandra · high confidence

New journal conversion and logging adapters

This change introduces a new set of conversion utilities in the journal module to handle the serialization and deserialization of Kafka records, including converting between internal Action types and Kafka Producer/Consumer records, as well as metrics tracking for read and write operations. Additionally, it adds Pekko persistence adapters that bridge the application's logging interface to Pekko's LoggingAdapter, enabling structured logging within the journal subsystem.

journal/src/main/scala/com/evolution/kafka/journal/conversions, pekko/persistence/src/main/scala/com/evolution/kafka/journal · high confidence

Replicator core logic and configuration introduced

The replicator module now includes the core implementation for consuming Kafka topics and replicating records to Cassandra. This adds the \Replicator\ service entry point, \ConsumeTopic\ for polling and committing offsets, \ReplicateRecords\ for batching and writing to the eventual store, and \PurgeExpired\ for handling expiration. It also introduces \ReplicatorConfig\ for tuning discovery intervals and cache settings, along with supporting components like \DistributeJob\ for node distribution, \Cache\/\CacheOf\ for key caching, and \TopicCommit\/\TopicConsumer\ for Kafka consumer management.

replicator/src/main/scala · high confidence

Behavioural changes

Core journal types and execution infrastructure rewritten

The core journal module has been refactored to introduce explicit, strongly-typed domain models and a new execution infrastructure. New value types such as \SeqNr\, \DeleteTo\, \ExpireAfter\, \Key\, \Origin\, and \Version\ replace raw primitives to improve type safety, while \Payload\ and \PayloadType\ provide a structured way to handle binary, text, and JSON data. Serialization is now handled by a pluggable \JsonCodec\ that supports both Play JSON and Jsoniter, and a new \Settings\ trait manages configuration with logging and mapping capabilities. Additionally, the \execution\ package introduces managed thread pools (ForkJoin, Scheduled, and Fixed) via \Resource\, ensuring proper lifecycle management for background tasks.

core · high confidence

Default configuration for Pekko Persistence Journal

A new reference configuration file has been added for the Pekko persistence module, establishing default settings for the Kafka journal. This includes the fully qualified class name for the journal implementation, Kafka producer and consumer parameters (such as LZ4 compression and idempotence), Cassandra query consistency levels, circuit breaker thresholds, and a dynamic consumer pool configuration for recovery scenarios.

pekko/persistence/src/main/resources · high confidence

Default configuration for the Topic Replicator service

A new default configuration file (reference.conf) is introduced for the replicator module, defining baseline settings for Kafka and Cassandra interactions. For Kafka, the consumer is configured to use the CooperativeStickyAssignor to minimize latency during redeployments, with specific buffer sizes, LZ4 compression for producers, and a group ID of 'replicator'. For Cassandra, the client is named 'replicator' and configured with LOCAL\_QUORUM consistency and default idempotence enabled.

replicator/src/main/resources · high confidence

Demo applications moved to a separate module

The demo applications (AppendReplicateApp and ReadEventsApp) have been relocated into a dedicated demo module. This change includes the addition of specific configuration files (AppendReplicateApp.conf and logback.xml) to support the demos in their new location, ensuring they retain their previous logging levels and Kafka/Cassandra connection settings.

demo · high confidence

Eventual Cassandra journal storage rewritten for version 5.0.0

The eventual-cassandra module has been completely rewritten for the 5.0.0 release, introducing a new schema structure that replaces the legacy \pointer\ table with a new \pointer2\ table and adds a \meta\_journal\ table for journal metadata. This change includes new encoding/decoding extensions for \PartitionOffset\, \RecordMetadata\, and other core types, along with new configuration classes (\EventualCassandraConfig\, \SchemaConfig\) and services (\ExpiryService\) to manage journal lifecycle, consistency, and data integrity. The implementation now supports automatic schema creation and migration, and exposes the schema version in metrics.

eventual-cassandra/src/main · high confidence

Introduce hierarchical structure for replicated journal operations

The eventual journal implementation has been restructured to use a hierarchical API for write operations, replacing the previous flat interface. The new \ReplicatedJournal\ trait acts as a factory for topic-specific \ReplicatedTopicJournal\ instances, which in turn provide partition-specific \ReplicatedPartitionJournal\ resources, finally yielding \ReplicatedKeyJournal\ instances for individual key operations. This change improves resource management and modularity for replicating events from Kafka to eventual storage (Cassandra). The legacy \ReplicatedJournalFlat\ interface is retained only for backward compatibility with existing unit tests.

journal/src/main/scala/com/evolution/kafka/journal/eventual · high confidence

Major version 5.0.0 release with package migration and Pekko support

This release introduces version 5.0.0, which migrates the project's package namespace from \com.evolutiongaming\ to \com.evolution\ and renames the Akka persistence module to \kafka-journal-akka-persistence\. It also adds a new \kafka-journal-pekko-persistence\ module to support Pekko, updates the README with a migration guide and new setup instructions, and switches the CI pipeline from Travis CI to GitHub Actions.

(repo-wide) · high confidence

Pekko persistence plugin refactored with new extension-based architecture

The Pekko persistence plugin has been restructured to use a new \ActorSystemRef\ extension mechanism, making the underlying \Journals\ instance directly accessible to external components via the actor system. This change introduces a new base package (\com.evolution.kafka.journal.pekko.persistence\) and refactors core components like \KafkaJournal\, \JournalAdapter\, and \EventSerializer\ to support this extension-based wiring, while also adding configuration options for JSON codecs and batch sizes.

pekko/persistence/src/main/scala/com/evolution/kafka/journal/pekko/persistence · high confidence

Test coverage

Added benchmarks for journal read worst-case scenarios and replicator batch processing; Added test coverage for journal serialization, actions, and concurrency primitives; Added test coverage for the Kafka journal replicator; Added test suite for Akka Persistence Kafka Journal; Added tests for Cassandra journal schema, configuration, and replication logic; Added tests for Pekko persistence journal components; Refactored Kafka-Journal integration test infrastructure.

Dependencies

Major dependency and build infrastructure overhaul

This change updates the project's build configuration to use SBT 2.0.10 and significantly refreshes the dependency graph. Key library upgrades include Kafka clients to 4.3.1, Pekko to 1.7.1, Cats Effect to 3.7.1, and Logback to 1.6.5. The build also introduces new plugins for version policy checking, JMH benchmarking, and Scala 3 support, while removing older plugins like sbt-bintray and sbt-coveralls.

project · high confidence

Migrate build to sbt 2 and upgrade to Scala 2.13.18 and 3.3.8

The project has migrated its build infrastructure to sbt 2, enabling support for Scala 2.13.18 and Scala 3.3.8. This update includes restructured build settings with common configurations for organization, licensing, and compiler options, as well as the introduction of binary compatibility checks via MiMa. The root project now aggregates multiple submodules including core, journal, snapshot, replicator, cassandra, and various persistence integrations (Akka, Pekko, Circe), reflecting a more modular architecture.

(dependencies) · high confidence

Written by cca.canine.dev from the codebase's own history, inside the signed delivery this page is composed from.

How this codebase got here

Score

  • CAI 57 → 52 (-4.7)
  • Rubric changed (rubric-2026.10.5 → rubric-2026.11.2) — scores are not directly comparable.

Lenses

  • Code Health 68 → 67 (-0.1)
  • Architecture 88 → 88 (+0.1)
  • Maturity 50 → 59 (+9.2)
  • Readiness 55 → 54 (-0.8)
  • Security 65 → 42 (-23.3)
  • Performance 86 → 91 (+4.9)

Resolved (4)

  • Dependency hygiene PARTLY measured — sbt declarations read, dependency currency not (Maven Central unreachable)
  • Duplicated block (12 lines × 3) (journal/src/main/scala/com/evolution/kafka/journal/eventual/EventualJournal.scala)
  • Duplicated block (16 lines × 2) (journal/src/main/scala/com/evolution/kafka/journal/eventual/EventualJournal.scala)
  • Off-boarding risk: anonymized user #1

New (4)

  • Duplicated block (12 lines × 3) (journal/src/main/scala/com/evolution/kafka/journal/eventual/EventualJournal.scala)
  • FileTooLong: cassandra/ReplicatedCassandra.scala (eventual-cassandra/src/main/scala/com/evolution/kafka/journal/eventual/cassandra/ReplicatedCassandra.scala)
  • Off-boarding risk: anonymized user #1
  • Outdated: com.datastax.cassandra:cassandra-driver-core

Changes since last survey

  • 13 commits — 13 feature/other, 0 fixes

By area

  • project/Dependencies.scala — 6 commits
  • (root) — 3 commits
  • project/build.properties — 2 commits
  • .github/workflows — 1 commit
  • eventual-cassandra/src — 1 commit

Notable commits

  • change: Update jackson-core, jackson-databind to 2.22.4 (#1022)
  • change: Update logback-classic, logback-core to 1.6.6 (#1032)
  • change: Update lz4-java to 1.12.1 (#1028)
  • change: Update lz4-java to 1.13.0 (#1042)
  • change: Update pureconfig-cats, pureconfig-core, ... to 0.17.11 (#1025)
  • change: Update sbt to 2.0.11 (#1027)
  • change: Update sbt to 2.0.12 (#1034)
  • change: Update scala3-library to 3.3.9 (#1033)
  • change: Update scassandra to 5.8.0 (#1030)
  • change: Update scassandra to 5.9.0 (#1038)
  • change: Update workflows to 7.2.0 (#1035)
  • change: journal brain split / fork detection mechanism (#963)
  • change: remove guava from versionPolicyIgnored list (#1031)

Written by cca.canine.dev from the codebase's own history, inside the signed delivery this page is composed from.

Survey your own repository

evolution-gaming/kafka-journal was measured the same way every project in this corpus was: the same rubric, at a pinned commit, with the result published in full. Point a surveyor at a repository you know and see whether you agree with it.

About this page

  • The score is its most recent published measurement, taken on 8 November 2026 at a pinned commit. It is not a live figure and does not change until the project is measured again.
  • Measured at commit d55c7169b7be6e608d0f98a8d2fc075185b1aa6c — the exact code this score is about.
  • Scored under rubric-2026.11.2 — the same rubric and the same method as every other entry in this index.
  • Measured by Canine Code Analyzer (cca.canine.dev) using cca measure-2026.11.3+preprod-45ab2cab63de.