airbnb/chronon
49.7
Weak · 14 November 2026
33.9k
lines of production code
Scala
with Python
5
measurements over time
What this system is
Features
Added Bazel project configuration for IntelliJ
A new \.bazelproject\ file has been added to the \.ijwb\ directory to enable Bazel-based builds within IntelliJ IDEA. This configuration automatically derives targets from the workspace directories and explicitly enables support for Python, Scala, and Java languages, allowing users to leverage Bazel alongside sbt for their development workflow.
.ijwb · high confidence
Initial Airflow integration for Chronon orchestration
This change introduces the initial set of Airflow components required to orchestrate Chronon jobs, including DAG constructors for GroupBy backfills/uploads, Join backfills, Staging Queries, and Online/Offline consistency metrics. It provides the core Python operators (ChrononOperator) to download and execute Chronon packages, helper utilities for task dependency management and scheduling logic, and configuration constants for concurrency and upload cadence.
airflow · high confidence
Initial Bazel build system support for tools
This change introduces Bazel as a build system for the \tools\ directory, adding \BUILD\ files and Starlark rules in \tools/build\_rules\ to handle JVM/Scala compilation, Maven artifact resolution, Python testing via pytest, and Thrift code generation. It also adds configuration settings in \tools/flags\ to enable conditional compilation for specific versions of Flink (1.16, 1.19, 2.0) and Spark (2.4, 3.1, 3.2, 3.5).
tools · high confidence
Introduce Flink-based streaming GroupBy execution
Adds a new Flink module that provides a streaming implementation for Chronon GroupBy jobs, supporting both untiled (raw event) and tiled (pre-aggregated) processing modes. The implementation includes operators for Spark expression evaluation, Avro serialization, and async writes to the KV store, along with custom windowing triggers and watermark strategies to handle event-time processing and late data.
flink/src · high confidence
Introduction of Bazel build system alongside SBT
Chronon now supports building with Bazel in addition to the existing SBT build system. This change introduces Bazel configuration files (including WORKSPACE, BUILD.bazel, .bazelrc, and .bazeliskrc) that define build rules for Scala, Java, and Python dependencies, allowing users to compile the project using the Bazel toolchain.
(repo-wide) · high confidence
Java API overhaul: builder pattern, structured data, and stats support
The Java online API has been significantly refactored to improve usability and expand capabilities. JavaFetcher now uses a builder pattern, allowing users to configure optional parameters like callerName, flagStore, and disableErrorThrows. The API now supports structured data fetching via JavaStructuredResponse and provides new JavaStatsRequest/JavaStatsResponse classes for retrieving feature statistics. Additionally, a new FlagStore interface enables runtime feature flagging, and JavaExternalSourceHandler simplifies custom external source integration. Under the hood, Thrift decoding for complex types is now handled by TBaseDecoderFactory and ThriftDecoder, replacing previous ad-hoc conversion logic.
online/src/main/java · high confidence
MongoDB-backed online serving implementation for the quickstart
The quickstart now includes a complete MongoDB-based online serving implementation, allowing users to serve feature lookups and log responses using MongoDB instead of the default in-memory or other stores. This adds a new \mongo-online-impl\ module containing a \ChrononMongoOnlineImpl\ API adapter, a \MongoKvStore\ for key-value operations, and utilities like \Spark2MongoLoader\ and \MongoLoggingDumper\ to sync batch data and logs into MongoDB. The setup is supported by a new Dockerfile that installs Spark, Hadoop, Thrift, and Scala, along with configuration files for the quickstart environment.
quickstart · high confidence
New Chronon Feature Fetching Service for external feature lookups
A new standalone feature service module has been added to allow non-JVM applications to retrieve features via HTTP. Built on the Vert.x framework, this service exposes REST endpoints at \/v1/features/groupby/:name\ and \/v1/features/join/:name\ to support bulk feature lookups. It dynamically loads a concrete \Api\ implementation (such as a MongoDB connector) from a specified JAR file at startup, enabling users to quickly deploy a feature serving layer without managing the full JVM stack.
service · high confidence
New Flink streaming module and Java API surface
Introduces a new Flink module for streaming feature computation, including \AvroCodecFn\ for serializing data to the KV store and \FlinkRowAggregators\ for windowed aggregation. Adds a Java-friendly \JavaFeatureRecord\ class to expose feature values and errors via typed getters, and a \JTry\ utility for Java-side error handling. Includes \ApiSerializationCheck\ to validate that API objects survive Spark driver-to-executor serialization, and \DataStreamBuilder\ to apply queries to Spark DataFrames.
repository · high confidence
New Python APIs for lineage tracking, model transforms, and PySpark notebook execution
This change introduces several new capabilities in the Python API. First, it adds a Lineage Parser that extracts column-level lineage metadata from Chronon configurations, enabling impact analysis and data quality tracing. Second, it provides a new Model API (model.py) with helper functions to define InferenceSpec, Model, and ModelTransform objects for integrating ML models into feature pipelines. Third, it introduces a PySpark Interface that allows users to execute GroupBy, Join, and StagingQuery operations directly within notebook environments like Databricks and Jupyter, facilitating rapid prototyping and iteration.
api/py/ai · high confidence
New Spark runtime components and configuration for joins, labels, and local testing
This change introduces several new capabilities and infrastructure components for the Spark engine. It adds a LogFlattenerJob for processing log data, a LocalDataLoader for importing local CSV/JSON files into Spark tables, and a LocalTableExporter for exporting tables to local files in CSV, Parquet, or JSON formats. It also introduces a LabelJoin class to support joining features with labels, and a BootstrapInfo class to manage schema metadata for join bootstrapping. Additionally, it provides a configurable log4j.properties file for controlling log verbosity and adds Kryo serializers (ChrononKryoRegistrator) to optimize Spark serialization performance for specific types like sketches and internal Spark structures.
spark/src/main · high confidence
New online feature-serving components for derivations, external sources, and model inference
This change introduces several new Scala components in the online serving layer: CatalystUtil and DerivationUtils to execute SQL-based feature derivations using a pooled Spark Catalyst session; ExternalSourceFactory and ExternalSourceRegistry to dynamically register and fetch from external feature sources; ModelBackend to abstract online and batch model inference; JoinCodec to handle schema merging and derivation logic for joins; and supporting utilities like LRUCache, FlexibleExecutionContext, SparkInternalRowConversions, MetadataDirWalker, and Extensions. These additions enable the online fetcher to apply complex derivations, integrate external data sources, and run model transforms at serving time.
online/src/main/scala · high confidence
Support for vector and map aggregations with NaN/Infinity sanitization
The aggregator now supports element-wise aggregation for tensor (list) inputs via the new ElementWiseAggregator, allowing operations like vector averages, and map-based aggregation via MapColumnAggregator for nested map values. Additionally, DirectColumnAggregator now sanitizes floating-point results, replacing NaN or Infinity values with null to prevent data corruption during average operations, and RowAggregator now implements the SimpleAggregator trait to support bulk merging and incremental output schemas.
aggregator/src/main/scala/ai/chronon/aggregator/row · high confidence
Behavioural changes
Added Scala 2.11-specific compatibility helpers
New Scala 2.11-specific source files have been added to the online module to support version-specific APIs. This includes a helper for converting between Scala Futures and Java CompletionStages, and a Catalyst helper to evaluate filter predicates using the InterpretedPredicate API, ensuring compatibility with Spark 2.4.0 on Scala 2.11.
online/src/main/scala-2.11 · high confidence
Added Scala 2.12 and 2.13 specific online helper utilities
New version-specific source files have been added for the online module to handle Scala version differences. For Scala 2.12, \FutureConverters\ uses \scala.compat.java8\ for \Future\/\CompletionStage\ conversion, while Scala 2.13 uses \scala.jdk\. Additionally, \ScalaVersionSpecificCatalystHelper\ provides a consistent API for evaluating Spark Catalyst predicates, with the Scala 2.13 version explicitly handling \Seq\ conversion for attributes. These files are now exported via new \BUILD\ targets in both version directories.
online/src/main/scala-2.12, online/src/main/scala-2.13 · high confidence
Configurable logging via log4j properties
The application now uses a log4j configuration file to manage logging behavior. By default, log messages are set to the INFO level and are output to the console (System.out) with a specific timestamp and pattern, allowing users to see structured log entries directly in the application output.
online/src/main/resources · high confidence
Improved logging, timestamp formatting, and window resolution utilities in the aggregator
The windowing aggregator now uses SLF4J for structured logging instead of println statements, replacing debug output in HopsAggregator with proper logger calls. Timestamp formatting in TsUtils switches from SimpleDateFormat to FastDateFormat for better thread safety and performance. Additionally, a new ResolutionUtils helper is introduced to calculate the smallest tail window resolution for a GroupBy, and HopsAggregator's boundary check logic is refactored to use exists() for cleaner code.
aggregator/src/main/scala/ai/chronon/aggregator/windowing · high confidence
Python API build, release, and documentation overhaul
The Python API build process has been migrated from a legacy shell script to Bazel, introducing new BUILD.bazel rules for packaging (py\_wheel) and publishing (twine\_upload) alongside a new python-api-build.sh script that supports build and release actions. The setup.py versioning logic has been updated to be PEP440 compliant, handling branch names and SNAPSHOT suffixes via environment variables. Additionally, the API documentation has been significantly expanded to include user-facing examples for Sources, Group Bys, and Joins, and pre-commit hooks (black, isort, autoflake) have been added to enforce code style.
api/py · high confidence
Refactor Scala Java/Scala collection conversions and expand API model builders
The API layer replaces the deprecated \scala.collection.JavaConverters\ with version-specific \ScalaJavaConversions\ (using \scala.jdk.CollectionConverters\ for Scala 2.12/2.13) to improve compatibility and remove deprecation warnings. This change is accompanied by a significant expansion of the \Builders\ object, which now supports constructing \Join\ configurations with \externalParts\, \labelPart\, \bootstrapParts\, \derivations\, \modelTransforms\, and \skewKeys\, as well as \GroupBy\ with \derivations\. New API types like \ExternalJoinPart\, \ExternalSource\, and \FetchException\ are introduced to support external feature joins and more granular error handling, while \Constants\ and \Extensions\ are updated to reflect new table naming conventions (e.g., \\_bootstrap\, \\_labels\) and metadata fields.
api/src/main · high confidence
Thrift API schema expansion and build system integration
The Thrift API definition has been significantly expanded to support new data modeling capabilities, including the addition of a \JoinSource\ struct to allow joins to feed into other computations, an \ExternalSource\ struct with factory configuration for dynamic handler creation, and new aggregation operations such as \SKEW\, \KURTOSIS\, \APPROX\_HISTOGRAM\_K\, and \BOUNDED\_UNIQUE\_COUNT\. The \StagingQuery\ struct now supports \createView\ flags and additional date macros like \{{ latest\_date }}\ and \{{ max\_date }}\, while \EventSource\ and \Query\ structs have gained new fields for subpartitioning and partition columns. Alongside these schema changes, a Bazel build file has been introduced to generate Python and Java libraries from the Thrift definition, enabling consistent code generation across languages.
api/thrift · high confidence
Test coverage
Added Python unit tests for Chronon configuration and runtime components; Added Scala unit tests for API data types, extensions, and macros; Added sample GroupBy definitions for the quickstart test suite; Added sample join configuration files for testing; Added sample join configurations for unit testing; Added sample scripts for testing Chronon workflows; Added sample staging query definitions for testing; Added sample test data for checkout, purchase, return, and user entities; Added test coverage for Kaggle Outbrain GroupBys and Joins; Added test coverage for Kaggle Outbrain source definition; Added test coverage for new aggregation operations and utilities; Added test coverage for online fetcher, serialization, and caching components; Added test coverage for online serving components; Added test fixtures for staging query and real-time event sources; Added test fixtures for standalone staging queries; Added test sample for Chronon join training set configuration; Added tests for lineage metadata parsing; Added unit test fixtures for group-by configurations; CI test execution and environment overhaul; Expanded sample GroupBy definitions for test coverage; Expanded sample join definitions for comprehensive test coverage; Expanded test coverage for Spark feature components; Updated sample group-by test fixtures for validation.
Dependencies
51 commits updating dependencies (5 manifests)
A dependency / build maintenance change in (dependencies) — 51 commits (11 fixs), 5 files.
(dependencies) · medium confidence · unverified
Added PySpark and SQLGlot dependencies for feature development
The Python API environment now includes PySpark (version 3.3.1) and SQLGlot (version 26.16.1) as new dependencies, enabling PySpark and notebook integration for Chronon feature development. This change also updates several existing packages, including Click (8.1.3 to 8.1.8), Six (1.16.0 to 1.17.0), and various development tools like Black, Pytest, and Tox, while adding pre-commit hooks and related linting tools (isort, autoflake) to the development requirements.
api/py/requirements · high confidence
Build infrastructure modernization and logging improvements
The SBT build system has been upgraded from version 1.2.8 to 1.8.2, and the sbt-assembly plugin has been updated from 0.14.10 to 2.1.1. Several new SBT plugins were added to enhance the build process, including sbt-scalafmt for code formatting, sbt-release for release management, sbt-git for versioning, sbt-buildinfo for build information generation, and sbt-sonatype for publishing. Additionally, internal build scripts (FolderCleaner and ThriftGen) now use SLF4J logging instead of println statements, and a new VersionDependency utility was introduced to manage Scala version-specific dependencies.
project · high confidence
Written by cca.canine.dev from the codebase's own history, inside the signed delivery this page is composed from.
How this codebase got here
Score
- CAI 49 → 50 (+1.0)
- Rubric changed (rubric-2026.10.5 → rubric-2026.11.4) — scores are not directly comparable.
Lenses
- Code Health 51 → 51 (-0.3)
- Architecture 84 → 84 (+0.0)
- Maturity 70 → 71 (+1.7)
- Readiness 37 → 39 (+2.0)
- Security 57 → 54 (-3.6)
- Performance 78 → 100 (+21.7)
Resolved (5)
- Duplicated block (10–11 lines × 2) (airflow/helpers.py)
- Duplicated block (5 lines × 2) (spark/src/main/scala/ai/chronon/spark/JoinBase.scala)
- No ADRs found
- Off-boarding risk: anonymized user #1
- Orphaned file (online/src/main/scala/ai/chronon/online/FetcherCache.scala)
New (24)
- Edited copies of one member (3 members, 30+ corresponding lines) (api/py/ai/chronon/pyspark/jupyter.py)
- Edited copies of one member (3 members, 8+ corresponding lines) (online/src/main/java/ai/chronon/online/JavaFetcher.java)
- Edited copy of a member (10 corresponding lines) (quickstart/mongo-online-impl/src/main/scala/ai/chronon/quickstart/online/QuickstartMutationDecoder.scala)
- Edited copy of a member (10 corresponding lines) (spark/src/main/scala/ai/chronon/spark/KvRdd.scala)
- Edited copy of a member (11 corresponding lines) (api/py/ai/chronon/repo/compile.py)
- Edited copy of a member (11 corresponding lines) (api/py/ai/chronon/repo/dependency_tracker.py)
- Edited copy of a member (12 corresponding lines) (aggregator/src/main/scala/ai/chronon/aggregator/row/DirectColumnAggregator.scala)
- Edited copy of a member (13 corresponding lines) (online/src/main/scala/ai/chronon/online/Extensions.scala)
- Edited copy of a member (14 corresponding lines) (aggregator/src/main/scala/ai/chronon/aggregator/windowing/SawtoothMutationAggregator.scala)
- Edited copy of a member (19 corresponding lines) (online/src/main/scala/ai/chronon/online/FetcherCache.scala)
- Edited copy of a member (20 corresponding lines) (api/src/main/scala/ai/chronon/api/Extensions.scala)
- Edited copy of a member (28 corresponding lines) (airflow/helpers.py)
- Edited copy of a member (31 corresponding lines) (api/py/ai/chronon/pyspark/executables.py)
- Edited copy of a member (32 corresponding lines) (aggregator/src/main/scala/ai/chronon/aggregator/row/BucketedColumnAggregator.scala)
- Edited copy of a member (39 corresponding lines) (spark/src/main/scala/ai/chronon/spark/JoinBase.scala)
- Edited copy of a member (53 corresponding lines) (api/py/ai/chronon/pyspark/executables.py)
- Edited copy of a member (6 corresponding lines) (online/src/main/java/ai/chronon/online/JavaSeriesStatsResponse.java)
- Edited copy of a member (78 corresponding lines) (api/py/ai/chronon/pyspark/executables.py)
- Edited copy of a member (8 corresponding lines) (spark/src/main/scala/ai/chronon/spark/Driver.scala)
- Edited copy of a member (9 corresponding lines) (online/src/main/scala/ai/chronon/online/serde/AvroConversions.scala)
- …and 4 more
Changes since last survey
- 4 commits — 4 feature/other, 0 fixes
By area
- (root) — 1 commit
- api/py — 1 commit
- online/src — 1 commit
- spark/src — 1 commit
Notable commits
- change: Allow shared production Joins to retain experimental dependencies (#1173)
- change: Chronon release 0.0.116 (#1174)
- change: [Analyzer] Respect end date on table permission check (#1168)
- change: [Online] Serve as of the batch value's own batch end to support GroupBy upload rollback (#1171)
Architecture
- Unchanged — 0 containers · 1 contexts · 0 edges
Written by cca.canine.dev from the codebase's own history, inside the signed delivery this page is composed from.
Survey your own repository
airbnb/chronon was measured the same way every project in this corpus was: the same rubric, at a pinned commit, with the result published in full. Point a surveyor at a repository you know and see whether you agree with it.
About this page
- The score is its most recent published measurement, taken on 14 November 2026 at a pinned commit. It is not a live figure and does not change until the project is measured again.
- Measured at commit 9a14748724730727146e4153734487d16b8f542e — the exact code this score is about.
- Scored under rubric-2026.11.4 — the same rubric and the same method as every other entry in this index.
- Measured by Canine Code Analyzer (cca.canine.dev) using cca measure-2026.11.65+preprod-e1a3b69fc8ee.