Skip to content
CAI
Software that uses CAICheck a score

apache/hbase-connectors

53.4

Adequate · 6 November 2026

14.7k

lines of production code

Scala

with Java

4

measurements over time

CAI band scale
CAI trend line
CAI lens gauges

What this system is

Features

Add HBaseKafkaEvent Avro schema

The HBase Kafka model now includes a new Avro schema file defining the HBaseKafkaEvent record. This schema specifies the structure for events exchanged between HBase and Kafka, including fields for the row key, timestamp, delete flag, value, qualifier, column family, and table name, enabling standardized serialization for these data changes.

kafka/hbase-kafka-model · high confidence

Added Spark filter protocol buffer definitions

The hbase-spark-protocol module now includes a new SparkFilter.proto file defining the SQLPredicatePushDownFilter message and its associated SQLPredicatePushDownCellToColumnMapping structure. This establishes the protocol buffer schema used for passing SQL predicate push-down filter information between Spark and HBase.

spark/hbase-spark-protocol · high confidence

Added code formatting and license header configuration files

The dev-support directory now includes configuration files to standardize code style and licensing: a .scalafmt.conf file for Scala code formatting (based on Apache Spark's template), an eclipse.importorder file for Java import organization, an hbase\_eclipse\_formatter.xml file defining the 'HBase Apache Current' Eclipse code formatter profile, and a license-header file containing the standard Apache 2.0 license text.

dev-support · high confidence

Initial Spark 4 module for HBase integration

This change introduces the new spark4 module, porting core HBase-Spark capabilities to support Spark 4. It includes the HBaseContext for managing HBase connections and performing bulk operations (put, get, delete, scan) via RDDs, a DataSource V2 implementation for SparkSQL support, and bulk load functionality with region-aware partitioning. The module also provides necessary infrastructure such as connection caching, schema conversion, and data type parsing to enable these features.

spark4/hbase-spark4 · high confidence

Introduce HBase-to-Kafka Proxy for replication routing

Adds the core implementation for the HBase Kafka Proxy, a service that acts as a replication peer to capture HBase mutations and route them to Kafka topics. This location provides the \KafkaProxy\ entry point, the \KafkaBridgeConnection\ and \KafkaTableForBridge\ classes that intercept HBase client operations, and the \TopicRoutingRules\ engine that parses XML configuration to determine which cells to route to specific topics or drop entirely based on table, column family, and qualifier patterns.

kafka/hbase-kafka-proxy/src/main · high confidence

New HBase Connectors command-line scripts

Added the \hbase-connectors\ entry script, its configuration helper \hbase-connectors-config.sh\, and the daemon manager \hbase-connectors-daemon.sh\ to the bin directory. These scripts provide the user-facing interface for managing HBase Connectors components, including starting and stopping the Kafka Proxy server and handling environment configuration, classpaths, and logging.

bin · high confidence

New HBase Spark connector examples and core infrastructure

The HBase Spark connector now includes a comprehensive set of Java example applications demonstrating bulk operations (put, get, delete, load), distributed scanning, and streaming bulk puts via HBaseContext. To support these features and improve internal efficiency, the connector introduces new Scala infrastructure classes including a BulkLoadPartitioner for region-aware data distribution, ByteArrayWrapper and ColumnFamilyQualifierMapKeyWrapper for optimized map key handling, and FamiliesQualifiersValues for structured cell storage. Additionally, a new HBaseConnectionCache manages connection lifecycle and pooling, while the DefaultSource and HBaseRelation classes provide the foundational Spark SQL DataSource integration for reading and writing HBase tables. Also in this area: Initial Spark 4 module for HBase integration.

repository · high confidence

New Jenkins pre-commit pipeline for HBase Connectors

The HBase Connectors project now has a dedicated pre-commit CI pipeline located in dev-support/jenkins. This change introduces a new Jenkinsfile and Dockerfile that run pre-commit checks using Apache Yetus within a containerized environment based on Maven 3.9 and JDK 8, with JDK 17 installed for Spark 4 support. The pipeline includes a custom Yetus personality script to handle Spark module builds and a driver script to orchestrate the checks, ensuring consistent testing for pull requests against the connectors codebase.

dev-support/jenkins · high confidence

New code coverage analysis script with SonarQube integration

Added a new \run-coverage.sh\ script and documentation in \dev-support/code-coverage\ that automates the generation of Java and Scala test coverage reports using JaCoCo and SCoverage. The script runs Maven with the coverage profile to produce reports in \test-reporting/target/code-coverage/\, and optionally uploads results to a SonarQube server when host URL, login credentials, and project key are provided.

dev-support/code-coverage · high confidence

Behavioural changes

18 commits (4 fixes) modifying spark/hbase-spark/src/main

A change to existing behaviour in spark/hbase-spark/src/main — 18 commits (4 fixs), 38 files: “HBASE-28534 Fix Kerberos authentication failure in local mode (\#128)”; “HBASE-25326 Allow running and building with Apache Spark 3.0 (\#75)”; “HBASE-30189 Implement SparkSQL support in the spark4 module using DataSource V2 API- \#167”; and 12 more (refs \#128, \#75, \#167, \#109, \#108, …).

spark/hbase-spark/src/main · medium confidence · unverified

Added default logging configuration for HBase Connectors

A new log4j.properties file has been added to the configuration directory to provide default logging settings for the HBase Connectors assembly. This configuration establishes INFO-level logging for the connector root logger and specific components like Kafka integration, while setting metrics-related logs to WARN, ensuring consistent and appropriate log output for users running the connectors.

conf · high confidence

The HBase connectors assembly now bundles a META-INF/LEGAL file and a supplemental-models.xml configuration. This ensures that third-party license information for dependencies such as stax-api, jettison, and bcprov-jdk18on is correctly included in the distribution, and provides the necessary metadata for Maven to resolve license details for these artifacts.

hbase-connectors-assembly/src/main/resources · high confidence

Refactored Spark SQL push-down filter to support multi-version connectors

The Spark SQL push-down filter logic has been moved into the common \hbase-spark-pushdown\ module to decouple it from specific Scala \Field\ types. This change introduces a new \PushdownMappedField\ Java interface, allowing both Spark 3 and Spark 4 connector modules to contribute column mappings without tight coupling. The \SparkSQLPushDownFilter\ now accepts this interface to build family/qualifier mappings, and supporting classes like \ByteArrayComparable\ and \DynamicLogicExpression\ have been added or updated to facilitate this shared, version-agnostic filter execution.

spark/hbase-spark-pushdown · high confidence

Test coverage

Added comprehensive test suites for HBase-Spark connector; Added integration test for Spark-based bulk loading; Added test suite for Java HBaseContext; Added tests for NaiveEncoder encoding and filtering logic; Added unit tests for HBase Kafka Proxy routing and drop rules.

Dependencies

Initial release of HBase Connectors with Kafka and Spark modules

The HBase Connectors project is introduced as a new Maven multi-module build, establishing the foundational structure for integrating HBase with external systems. The root POM defines three primary modules: \kafka\, \spark\, and \hbase-connectors-assembly\. The Kafka module (\kafka/hbase-kafka-proxy\ and \kafka/hbase-kafka-model\) provides a proxy to forward HBase replication events to Kafka, relying on dependencies like Curator 4.2.0, Avro, and Hadoop 2.10.0. The Spark module (\spark/hbase-spark\ and related sub-modules) delivers the Spark connector, including SQL pushdown capabilities and a shaded protocol layer, configured against Spark and Hadoop 3.4.1. The assembly module handles the packaging of these components into a distributable binary archive.

(dependencies) · high confidence

Written by cca.canine.dev from the codebase's own history, inside the signed delivery this page is composed from.

How this codebase got here

Score

  • CAI 54 → 53 (-0.4)
  • Rubric changed (rubric-2026.10.5 → rubric-2026.11.2) — scores are not directly comparable.

Lenses

  • Code Health 64 → 63 (-0.5)
  • Architecture 100 → 100 (+0.0)
  • Maturity 45 → 44 (-1.1)
  • Readiness 51 → 51 (+0.0)
  • Security 93 → 95 (+1.8)
  • Performance 65 → 66 (+1.0)

Resolved (16)

  • Dependency hygiene PARTLY measured — Maven build resolved part of the dependency graph, currency reported but not scored
  • Duplicated block (13 lines × 2) (spark/hbase-spark/src/main/scala/org/apache/hadoop/hbase/spark/datasources/SchemaConverters.scala)
  • High CVE: [GHSA redacted] (kafka/hbase-kafka-model/pom.xml)
  • High CVE: [GHSA redacted] (kafka/hbase-kafka-model/pom.xml)
  • Most significant orphaned file (spark/hbase-spark/src/main/scala/org/apache/hadoop/hbase/spark/DefaultSource.scala)
  • Off-boarding risk: anonymized user #1
  • Orphaned file (spark/hbase-spark/src/main/scala/org/apache/hadoop/hbase/spark/datasources/HBaseTableScanRDD.scala)
  • Outdated (compile -- module com.fasterxml.jackson.annotation): com.fasterxml.jackson.core:jackson-annotations
  • Outdated (compile -- module com.fasterxml.jackson.core): com.fasterxml.jackson.core:jackson-core
  • Outdated (compile -- module com.fasterxml.jackson.databind): com.fasterxml.jackson.core:jackson-databind
  • Outdated (compile -- module org.apache.avro [auto]): org.apache.avro:avro
  • Outdated (compile -- module org.apache.commons.codec): commons-codec:commons-codec
  • Outdated (compile -- module org.apache.commons.compress): org.apache.commons:commons-compress
  • Outdated (compile -- module org.apache.commons.io): commons-io:commons-io
  • Outdated (compile -- module org.apache.commons.lang3): org.apache.commons:commons-lang3
  • Outdated (compile -- module org.slf4j [auto]): org.slf4j:slf4j-api

New (12)

  • Dependency hygiene PARTLY measured — Maven/Gradle declarations read, no dependency graph resolved
  • Documentation: no build, run or usage example (README.md)
  • Duplicated block (10 lines × 2) (spark/hbase-spark/src/main/scala/org/apache/hadoop/hbase/spark/datasources/SchemaConverters.scala)
  • Duplicated block (12 lines × 2) (spark/hbase-spark/src/main/scala/org/apache/hadoop/hbase/spark/DefaultSource.scala)
  • Duplicated block (33 lines × 2) (spark/hbase-spark/src/main/scala/org/apache/hadoop/hbase/spark/DefaultSource.scala)
  • Duplicated block (7 lines × 2) (spark/hbase-spark/src/main/scala/org/apache/hadoop/hbase/spark/DefaultSource.scala)
  • Hotspot: spark4/hbase-spark4/src/main/scala/org/apache/hadoop/hbase/spark/SchemaConverters.scala (spark4/hbase-spark4/src/main/scala/org/apache/hadoop/hbase/spark/SchemaConverters.scala)
  • Hotspot: spark4/hbase-spark4/src/main/scala/org/apache/hadoop/hbase/spark/datasources/HBaseDataWriter.scala (spark4/hbase-spark4/src/main/scala/org/apache/hadoop/hbase/spark/datasources/HBaseDataWriter.scala)
  • MethodTooLong: SchemaConverters.createConverterToAvroFromInternalRow (spark4/hbase-spark4/src/main/scala/org/apache/hadoop/hbase/spark/SchemaConverters.scala)
  • Off-boarding risk: anonymized user #1
  • SchemaConverters.createConverterToAvroFromInternalRow (cognitive 64) (spark4/hbase-spark4/src/main/scala/org/apache/hadoop/hbase/spark/SchemaConverters.scala)
  • SchemaConverters.createConverterToAvroFromInternalRow (cyclomatic 28) (spark4/hbase-spark4/src/main/scala/org/apache/hadoop/hbase/spark/SchemaConverters.scala)

Changes since last survey

  • 4 commits — 2 feature/other, 2 fixes

By area

  • spark4/hbase-spark4 — 4 commits

Notable commits

  • fix: HBASE-30413 Fix composite row key encoding in Spark connectors (#171)
  • fix: HBASE-30511 Fix date and timestamp conversion in Spark 4 writes (#173)
  • change: HBASE-30401 Add avro schema fields support to sparkSQL write path (#169)
  • change: HBASE-30509 Deduplicate overlapping row-key reads in Spark connectors (#172)

Architecture

  • Unchanged — 0 containers · 1 contexts · 0 edges

Written by cca.canine.dev from the codebase's own history, inside the signed delivery this page is composed from.

Survey your own repository

apache/hbase-connectors was measured the same way every project in this corpus was: the same rubric, at a pinned commit, with the result published in full. Point a surveyor at a repository you know and see whether you agree with it.

About this page

  • The score is its most recent published measurement, taken on 6 November 2026 at a pinned commit. It is not a live figure and does not change until the project is measured again.
  • Measured at commit 82fed6e57fcd00ab6ba167f8482b6cc5a31c418c — the exact code this score is about.
  • Scored under rubric-2026.11.2 — the same rubric and the same method as every other entry in this index.
  • Measured by Canine Code Analyzer (cca.canine.dev) using cca measure-2026.11.3+preprod-410a2463fa58.