Skip to content
CAI
Software that uses CAICheck a score

omnimind-ai/OmniInfer

60.8

Adequate · 16 November 2026

46.1k

lines of production code

Rust

with Python, C, Kotlin

1

measurement over time

CAI band scale
CAI lens gauges

What this system is

Behavioural changes

1 commit (0 fixes) modifying android/omniinfer-server/src/main/jniLibs

A change to existing behaviour in android/omniinfer-server/src/main/jniLibs — 1 commit, 1 file: “chore(android): bump ET QNN prebuilt version to 3 (attention sink runner)”.

android/omniinfer-server/src/main/jniLibs · low confidence · unverified

1 commit (0 fixes) modifying scripts/lib

A change to existing behaviour in scripts/lib — 1 commit, 1 file: “refactor(install): clarify installer entry points”.

scripts/lib · low confidence · unverified

100 commits (38 fixes) modifying crates/omniinfer-cli/src

A change to existing behaviour in crates/omniinfer-cli/src — 100 commits (38 fixs), 9 files: “fix(backend): provide managed Python development headers”; “fix: remove python control fallback”; “fix(catalog): detect macOS memory safely”; and 97 more.

crates/omniinfer-cli/src · medium confidence · unverified

11 commits (3 fixes) modifying scripts/platforms/common

A change to existing behaviour in scripts/platforms/common — 11 commits (3 fixs), 4 files: “feat(cli): add desktop integration contracts”; “feat(release): package rust cli”; “ci: add cli release workflow”; and 8 more.

scripts/platforms/common · medium confidence · unverified

110 commits (13 fixes) modifying (repo-wide)

A change to existing behaviour in (repo-wide) — 110 commits (13 fixs), 10 files: “docs: reorganize public docs and add README logo assets”; “feat: add interactive cross-platform install scripts”; “fix(windows): add powershell source launcher”; and 91 more.

(repo-wide) · low confidence · unverified

12 commits (3 fixes) modifying crates/omniinfer-cli/src/benchmark

A change to existing behaviour in crates/omniinfer-cli/src/benchmark — 12 commits (3 fixs), 6 files: “fix(benchmark): preserve native decode token scoring”; “feat(gateway): adapt ds4 thinking, unified memory budget and timings”; “feat(bench): support fixed-length generation with ignore EOS”; and 9 more.

crates/omniinfer-cli/src/benchmark · medium confidence · unverified

16 commits (5 fixes) modifying crates/omniinfer-cli/src/advisor

A change to existing behaviour in crates/omniinfer-cli/src/advisor — 16 commits (5 fixs), 6 files: “feat(cli): add desktop integration contracts”; “feat(gateway): adapt ds4 thinking, unified memory budget and timings”; “refactor(vla): resolve integration lints”; and 13 more.

crates/omniinfer-cli/src/advisor · medium confidence · unverified

18 commits (0 fixes) modifying crates/omniinfer-core/src

A change to existing behaviour in crates/omniinfer-core/src — 18 commits, 1 file: “feat(rust): add read only serve commands”; “feat(rust): build model load payloads”; “feat(rust): parse load extra args”; and 15 more.

crates/omniinfer-core/src · medium confidence · unverified

25 commits (8 fixes) modifying crates/omniinfer-cli/src/tui

A change to existing behaviour in crates/omniinfer-cli/src/tui — 25 commits (8 fixs), 6 files: “fix: render model picker in alternate screen”; “feat: improve tui model picker”; “fix: recover from tui model load failures”; and 22 more.

crates/omniinfer-cli/src/tui · medium confidence · unverified

26 commits (5 fixes) modifying python

A change to existing behaviour in python — 26 commits (5 fixs), 6 files: “feat(rust): generate shell completions”; “feat(rust): add read only serve commands”; “fix: harden Windows validation tooling”; and 23 more.

python · medium confidence · unverified

29 commits (12 fixes) modifying scripts/platforms/windows

A change to existing behaviour in scripts/platforms/windows — 29 commits (12 fixs), 20 files: “fix(release): rename portable cli binary”; “feat(backend): add ik\_llama.cpp as Linux and Windows backend”; “fix(build): target Windows 10 for diffusion server”; and 24 more.

scripts/platforms/windows · medium confidence · unverified

3 commits (0 fixes) modifying crates/omniinfer-core/src/support

A change to existing behaviour in crates/omniinfer-core/src/support — 3 commits, 5 files: “feat(gateway): attach external runtimes safely”; “feat(gateway): add stable-diffusion.cpp protocol”; “refactor(core): organize domain modules”.

crates/omniinfer-core/src/support · medium confidence · unverified

30 commits (12 fixes) modifying scripts/platforms/macos

A change to existing behaviour in scripts/platforms/macos — 30 commits (12 fixs), 9 files: “fix(install): use shared models directory across desktop platforms”; “feat(platform): add new llama.cpp backends and android runtime installer”; “fix: reset stale macOS CMake builds”; and 25 more.

scripts/platforms/macos · medium confidence · unverified

4 commits (0 fixes) modifying android/omniinfer-server/src/litertLm

A change to existing behaviour in android/omniinfer-server/src/litertLm — 4 commits, 2 files: “feat(android): add LiteRT tool calls”; “build(android): make LiteRT LM optional”; “feat(android): enable LiteRT SD vision”; and 1 more.

android/omniinfer-server/src/litertLm · medium confidence · unverified

5 commits (1 fix) modifying crates/omniinfer-cli/src/backend\_installer

A change to existing behaviour in crates/omniinfer-cli/src/backend\_installer — 5 commits (1 fix), 8 files: “refactor(installer): separate platform responsibilities”; “refactor(cli): separate large test suites”; “feat(cli): resolve backend selectors across installation and runtime workflows”; and 2 more.

_crates/omniinfer-cli/src/backend\installer · medium confidence · unverified

57 commits (22 fixes) modifying scripts/platforms/linux

A change to existing behaviour in scripts/platforms/linux — 57 commits (22 fixs), 31 files: “fix(vllm): include runtime library paths”; “fix(release): rename portable cli binary”; “feat(backend): add ik\_llama.cpp as Linux and Windows backend”; and 50 more.

scripts/platforms/linux · medium confidence · unverified

61 commits (5 fixes) modifying framework

A change to existing behaviour in framework — 61 commits (5 fixs), 15 files: “chore(deps): update ik\_llama.cpp source”; “chore(deps): update MLX”; “feat(backend): add ik\_llama.cpp as Linux and Windows backend”; and 42 more.

framework · medium confidence · unverified

7 commits (1 fix) modifying crates/omniinfer-core/src/backend/registry

A change to existing behaviour in crates/omniinfer-core/src/backend/registry — 7 commits (1 fix), 1 file: “feat(gateway): add stable-diffusion.cpp protocol”; “refactor(core): separate large test suites”; “test(backends): cover selectors across platforms and preserve integration contracts”; and 4 more.

crates/omniinfer-core/src/backend/registry · medium confidence · unverified

7 commits (2 fixes) modifying crates/omniinfer-core/src/runtime

A change to existing behaviour in crates/omniinfer-core/src/runtime — 7 commits (2 fixs), 6 files: “feat(gateway): add stable-diffusion.cpp protocol”; “refactor(core): separate large test suites”; “fix(gateway): reconcile partial offload resources”; and 4 more.

crates/omniinfer-core/src/runtime · medium confidence · unverified

8 commits (1 fix) modifying crates/omniinfer-core/src/backend

A change to existing behaviour in crates/omniinfer-core/src/backend — 8 commits (1 fix), 11 files: “feat(gateway): add stable-diffusion.cpp protocol”; “refactor(core): separate large test suites”; “fix(gateway): reconcile partial offload resources”; and 5 more.

crates/omniinfer-core/src/backend · medium confidence · unverified

8 commits (2 fixes) modifying crates/omniinfer-core/src/model

A change to existing behaviour in crates/omniinfer-core/src/model — 8 commits (2 fixs), 5 files: “feat(models): discover split GGUF sets”; “feat: add no-mmproj model loading option”; “test(catalog): assert pinned asset metadata”; and 5 more.

crates/omniinfer-core/src/model · medium confidence · unverified

Fixes

10 commits (6 fixes) fixing crates/omniinfer-cli/src/serve

A fix in crates/omniinfer-cli/src/serve — 10 commits (6 fixs), 4 files: “fix: harden CUDA admission and projector restore”; “feat: add no-mmproj model loading option”; “test(cli): fix Windows smoke assumptions”; and 7 more.

crates/omniinfer-cli/src/serve · medium confidence · unverified

123 commits (72 fixes) fixing android/omniinfer-server/src/main/cpp

A fix in android/omniinfer-server/src/main/cpp — 123 commits (72 fixs), 11 files: “fix(android): distinguish graceful stop vs hard cancel via graceful\_stop flag in C++”; “feat(android): add omniinfer-server library module and fix MNN streaming crashes”; “feat(android): add KV cache prefix reuse for MNN backend”; and 84 more (refs \#62, \#60).

android/omniinfer-server/src/main/cpp · medium confidence · unverified

164 commits (109 fixes) fixing scripts

A fix in scripts — 164 commits (109 fixs), 16 files: “fix(backend): provide managed Python development headers”; “feat: add interactive cross-platform install scripts”; “fix(windows): add powershell source launcher”; and 127 more.

scripts · medium confidence · unverified

17 commits (9 fixes) fixing examples

A fix in examples — 17 commits (9 fixs), 6 files: “fix(examples): harden VLA LIBERO demo”; “fix(examples): protect VLA gateway credentials”; “feat(examples): add VLA LIBERO demo”; and 14 more.

examples · medium confidence · unverified

28 commits (15 fixes) fixing crates/omniinfer-cli/src/gateway/runtime\_manager

A fix in crates/omniinfer-cli/src/gateway/runtime\_manager — 28 commits (15 fixs), 6 files: “feat(gateway): attach external runtimes safely”; “test(windows): isolate CUDA resource probes”; “fix(ik-llama): recognize cpu-moe short aliases”; and 25 more.

_crates/omniinfer-cli/src/gateway/runtime\manager · medium confidence · unverified

4 commits (3 fixes) fixing crates/omniinfer-core/src/state

A fix in crates/omniinfer-core/src/state — 4 commits (3 fixs), 4 files: “fix: harden CUDA admission and projector restore”; “refactor(core): organize domain modules”; “fix(serve): respect external runtime ownership”; and 1 more.

crates/omniinfer-core/src/state · medium confidence · unverified

41 commits (22 fixes) fixing omniinfer-server

A fix in omniinfer-server — 41 commits (22 fixs), 6 files: “fix(android): catch port bind failure and verify server health before returning from loadModel”; “fix(android): honor explicit backend selection”; “fix(android): distinguish graceful stop vs hard cancel via graceful\_stop flag in C++”; and 26 more.

omniinfer-server · medium confidence · unverified

52 commits (30 fixes) fixing crates/omniinfer-cli/src/gateway

A fix in crates/omniinfer-cli/src/gateway — 52 commits (30 fixs), 8 files: “feat(models): support vllm hf public models”; “fix(vllm): include runtime library paths”; “feat(gateway): attach external runtimes safely”; and 49 more.

crates/omniinfer-cli/src/gateway · medium confidence · unverified

6 commits (4 fixes) fixing ios

A fix in ios — 6 commits (4 fixs), 13 files: “feat(ios): add MLX backend via mlx-swift-lm with unified InferenceEngine abstraction”; “fix(ios): multi-turn history, thinking mode, and n\_gpu\_layers support”; “fix(ios): correct mlx-swift-lm version, iOS 17 minimum, and API usage”; and 3 more.

ios · medium confidence · unverified

65 commits (38 fixes) fixing android/omniinfer-server/src/main/java

A fix in android/omniinfer-server/src/main/java — 65 commits (38 fixs), 4 files: “fix(android): catch port bind failure and verify server health before returning from loadModel”; “fix(android): distinguish graceful stop vs hard cancel via graceful\_stop flag in C++”; “feat(android): add omniinfer-server library module and fix MNN streaming crashes”; and 34 more.

android/omniinfer-server/src/main/java · medium confidence · unverified

8 commits (5 fixes) fixing android

A fix in android — 8 commits (5 fixs), 1 file: “feat(android): add consumer proguard rules for JNI bridge preservation”; “build(android): guard aar dependencies”; “fix(android): preserve stream callbacks in release builds”; and 3 more.

android · medium confidence · unverified

Test coverage

12 commits adding/updating tests in crates/omniinfer-cli/src/gateway/tests; 15 commits adding/updating tests in crates/omniinfer-cli/tests/fixtures; 4 commits adding/updating tests in android/omniinfer-server/src/test; 50 commits adding/updating tests in crates/omniinfer-cli/tests; 56 commits adding/updating tests in crates/omniinfer-cli/tests/cli\_smoke; 58 commits adding/updating tests in tests.

Dependencies

96 commits updating dependencies (11 manifests)

A dependency / build maintenance change in (dependencies) — 96 commits (19 fixs), 11 files: “build(android): add lite packaging and downloadable engine package bundle”; “chore(release): prepare v0.3.21”; “fix(serve): propagate explicit roots to gateway”; and 87 more (refs \#62, \#60).

(dependencies) · medium confidence · unverified

Written by cca.canine.dev from the codebase's own history, inside the signed delivery this page is composed from.

How this codebase got here

Baseline

  • First survey — no prior run to compare against. CAI 60.8.

Lenses

  • Code Health 85.5
  • Architecture 93.5
  • Maturity 80.0
  • Readiness 43.1
  • Security 68.8
  • Performance 82.1

Changes since last survey

  • 300 commits — 194 feature/other, 106 fixes

By area

  • (repo) — 73 commits
  • crates/omniinfer-cli — 68 commits
  • (root) — 27 commits
  • .github/workflows — 15 commits
  • crates/omniinfer-core — 15 commits
  • android/omniinfer-server — 10 commits
  • scripts/install-from-source.ps1 — 9 commits
  • docs/assets — 7 commits
  • examples/vla-libero — 7 commits
  • docs/android — 6 commits
  • docs/benchmark-environment.md — 6 commits
  • docs/build.md — 6 commits
  • framework/llama.cpp — 6 commits
  • framework/executorch — 4 commits
  • framework/ik_llama.cpp — 4 commits
  • framework/mlx — 4 commits
  • scripts/platforms — 4 commits
  • docs/API.md — 3 commits
  • framework/llama-cpp-turboquant — 3 commits
  • framework/mnn — 3 commits

Notable commits

  • fix: Merge pull request #200 from omnimind-ai/fix/macos-ci-runtime-log-sync
  • fix: Merge pull request #201 from omnimind-ai/fix/serve-tui-startup
  • fix: Merge pull request #203 from omnimind-ai/fix/request-defaults
  • fix: Merge pull request #204 from omnimind-ai/fix/serve-state-ownership
  • fix: Merge pull request #214 from omnimind-ai/fix/benchmark-tg
  • fix: Merge pull request #217 from omnimind-ai/fix/benchmark-cache-isolation
  • fix: Merge pull request #219 from omnimind-ai/fix/memory-budget-calculation
  • fix: Merge pull request #221 from omnimind-ai/fix/pr-219-portable-resource-test
  • fix: Merge pull request #223 from omnimind-ai/fix/tui-thinking-runtime-forwarding
  • fix: Merge pull request #230 from omnimind-ai/fix/issue-229-partial-offload
  • fix: Merge pull request #240 from omnimind-ai/fix/external-runtime-stop-lifecycle
  • fix: Merge pull request #241 from omnimind-ai/fix/issue-209-multi-gpu-placement
  • fix: Merge pull request #243 from omnimind-ai/fix/issue-218-windows-contract
  • fix: Merge pull request #245 from omnimind-ai/fix/issue-244-catalog-sizes
  • fix: Merge pull request #247 from omnimind-ai/fix/vla-install-finalization
  • fix: Merge pull request #248 from omnimind-ai/fix/ik-llama-cpu-moe-placement
  • fix: Merge pull request #249 from omnimind-ai/fix/benchmark-scored-decode-tokens
  • fix: Merge pull request #261 from omnimind-ai/fix/benchmark-resource-placement
  • fix: Merge pull request #262 from omnimind-ai/fix/benchmark-environment-evidence
  • fix: Merge pull request #263 from omnimind-ai/fix/vulkan-placement-accounting
  • …and 280 more

Architecture

  • 0 containers · 2 bounded contexts · 0 dependency edges (baseline)

Written by cca.canine.dev from the codebase's own history, inside the signed delivery this page is composed from.

Survey your own repository

omnimind-ai/OmniInfer was measured the same way every project in this corpus was: the same rubric, at a pinned commit, with the result published in full. Point a surveyor at a repository you know and see whether you agree with it.

About this page

  • The score is its most recent published measurement, taken on 16 November 2026 at a pinned commit. It is not a live figure and does not change until the project is measured again.
  • Measured at commit 27930b453576a7130a1454f802ea754f8dcd8aed — the exact code this score is about.
  • Scored under rubric-2026.11.4 — the same rubric and the same method as every other entry in this index.
  • Measured by Canine Code Analyzer (cca.canine.dev) using cca measure-2026.11.83+preprod-a489942cf94b.