omnimind-ai/OmniInfer
60.8
Adequate · 16 November 2026
46.1k
lines of production code
Rust
with Python, C, Kotlin
1
measurement over time
What this system is
Behavioural changes
1 commit (0 fixes) modifying android/omniinfer-server/src/main/jniLibs
A change to existing behaviour in android/omniinfer-server/src/main/jniLibs — 1 commit, 1 file: “chore(android): bump ET QNN prebuilt version to 3 (attention sink runner)”.
android/omniinfer-server/src/main/jniLibs · low confidence · unverified
1 commit (0 fixes) modifying scripts/lib
A change to existing behaviour in scripts/lib — 1 commit, 1 file: “refactor(install): clarify installer entry points”.
scripts/lib · low confidence · unverified
100 commits (38 fixes) modifying crates/omniinfer-cli/src
A change to existing behaviour in crates/omniinfer-cli/src — 100 commits (38 fixs), 9 files: “fix(backend): provide managed Python development headers”; “fix: remove python control fallback”; “fix(catalog): detect macOS memory safely”; and 97 more.
crates/omniinfer-cli/src · medium confidence · unverified
11 commits (3 fixes) modifying scripts/platforms/common
A change to existing behaviour in scripts/platforms/common — 11 commits (3 fixs), 4 files: “feat(cli): add desktop integration contracts”; “feat(release): package rust cli”; “ci: add cli release workflow”; and 8 more.
scripts/platforms/common · medium confidence · unverified
110 commits (13 fixes) modifying (repo-wide)
A change to existing behaviour in (repo-wide) — 110 commits (13 fixs), 10 files: “docs: reorganize public docs and add README logo assets”; “feat: add interactive cross-platform install scripts”; “fix(windows): add powershell source launcher”; and 91 more.
(repo-wide) · low confidence · unverified
12 commits (3 fixes) modifying crates/omniinfer-cli/src/benchmark
A change to existing behaviour in crates/omniinfer-cli/src/benchmark — 12 commits (3 fixs), 6 files: “fix(benchmark): preserve native decode token scoring”; “feat(gateway): adapt ds4 thinking, unified memory budget and timings”; “feat(bench): support fixed-length generation with ignore EOS”; and 9 more.
crates/omniinfer-cli/src/benchmark · medium confidence · unverified
16 commits (5 fixes) modifying crates/omniinfer-cli/src/advisor
A change to existing behaviour in crates/omniinfer-cli/src/advisor — 16 commits (5 fixs), 6 files: “feat(cli): add desktop integration contracts”; “feat(gateway): adapt ds4 thinking, unified memory budget and timings”; “refactor(vla): resolve integration lints”; and 13 more.
crates/omniinfer-cli/src/advisor · medium confidence · unverified
18 commits (0 fixes) modifying crates/omniinfer-core/src
A change to existing behaviour in crates/omniinfer-core/src — 18 commits, 1 file: “feat(rust): add read only serve commands”; “feat(rust): build model load payloads”; “feat(rust): parse load extra args”; and 15 more.
crates/omniinfer-core/src · medium confidence · unverified
25 commits (8 fixes) modifying crates/omniinfer-cli/src/tui
A change to existing behaviour in crates/omniinfer-cli/src/tui — 25 commits (8 fixs), 6 files: “fix: render model picker in alternate screen”; “feat: improve tui model picker”; “fix: recover from tui model load failures”; and 22 more.
crates/omniinfer-cli/src/tui · medium confidence · unverified
26 commits (5 fixes) modifying python
A change to existing behaviour in python — 26 commits (5 fixs), 6 files: “feat(rust): generate shell completions”; “feat(rust): add read only serve commands”; “fix: harden Windows validation tooling”; and 23 more.
python · medium confidence · unverified
29 commits (12 fixes) modifying scripts/platforms/windows
A change to existing behaviour in scripts/platforms/windows — 29 commits (12 fixs), 20 files: “fix(release): rename portable cli binary”; “feat(backend): add ik\_llama.cpp as Linux and Windows backend”; “fix(build): target Windows 10 for diffusion server”; and 24 more.
scripts/platforms/windows · medium confidence · unverified
3 commits (0 fixes) modifying crates/omniinfer-core/src/support
A change to existing behaviour in crates/omniinfer-core/src/support — 3 commits, 5 files: “feat(gateway): attach external runtimes safely”; “feat(gateway): add stable-diffusion.cpp protocol”; “refactor(core): organize domain modules”.
crates/omniinfer-core/src/support · medium confidence · unverified
30 commits (12 fixes) modifying scripts/platforms/macos
A change to existing behaviour in scripts/platforms/macos — 30 commits (12 fixs), 9 files: “fix(install): use shared models directory across desktop platforms”; “feat(platform): add new llama.cpp backends and android runtime installer”; “fix: reset stale macOS CMake builds”; and 25 more.
scripts/platforms/macos · medium confidence · unverified
4 commits (0 fixes) modifying android/omniinfer-server/src/litertLm
A change to existing behaviour in android/omniinfer-server/src/litertLm — 4 commits, 2 files: “feat(android): add LiteRT tool calls”; “build(android): make LiteRT LM optional”; “feat(android): enable LiteRT SD vision”; and 1 more.
android/omniinfer-server/src/litertLm · medium confidence · unverified
5 commits (1 fix) modifying crates/omniinfer-cli/src/backend\_installer
A change to existing behaviour in crates/omniinfer-cli/src/backend\_installer — 5 commits (1 fix), 8 files: “refactor(installer): separate platform responsibilities”; “refactor(cli): separate large test suites”; “feat(cli): resolve backend selectors across installation and runtime workflows”; and 2 more.
_crates/omniinfer-cli/src/backend\installer · medium confidence · unverified
57 commits (22 fixes) modifying scripts/platforms/linux
A change to existing behaviour in scripts/platforms/linux — 57 commits (22 fixs), 31 files: “fix(vllm): include runtime library paths”; “fix(release): rename portable cli binary”; “feat(backend): add ik\_llama.cpp as Linux and Windows backend”; and 50 more.
scripts/platforms/linux · medium confidence · unverified
61 commits (5 fixes) modifying framework
A change to existing behaviour in framework — 61 commits (5 fixs), 15 files: “chore(deps): update ik\_llama.cpp source”; “chore(deps): update MLX”; “feat(backend): add ik\_llama.cpp as Linux and Windows backend”; and 42 more.
framework · medium confidence · unverified
7 commits (1 fix) modifying crates/omniinfer-core/src/backend/registry
A change to existing behaviour in crates/omniinfer-core/src/backend/registry — 7 commits (1 fix), 1 file: “feat(gateway): add stable-diffusion.cpp protocol”; “refactor(core): separate large test suites”; “test(backends): cover selectors across platforms and preserve integration contracts”; and 4 more.
crates/omniinfer-core/src/backend/registry · medium confidence · unverified
7 commits (2 fixes) modifying crates/omniinfer-core/src/runtime
A change to existing behaviour in crates/omniinfer-core/src/runtime — 7 commits (2 fixs), 6 files: “feat(gateway): add stable-diffusion.cpp protocol”; “refactor(core): separate large test suites”; “fix(gateway): reconcile partial offload resources”; and 4 more.
crates/omniinfer-core/src/runtime · medium confidence · unverified
8 commits (1 fix) modifying crates/omniinfer-core/src/backend
A change to existing behaviour in crates/omniinfer-core/src/backend — 8 commits (1 fix), 11 files: “feat(gateway): add stable-diffusion.cpp protocol”; “refactor(core): separate large test suites”; “fix(gateway): reconcile partial offload resources”; and 5 more.
crates/omniinfer-core/src/backend · medium confidence · unverified
8 commits (2 fixes) modifying crates/omniinfer-core/src/model
A change to existing behaviour in crates/omniinfer-core/src/model — 8 commits (2 fixs), 5 files: “feat(models): discover split GGUF sets”; “feat: add no-mmproj model loading option”; “test(catalog): assert pinned asset metadata”; and 5 more.
crates/omniinfer-core/src/model · medium confidence · unverified
Fixes
10 commits (6 fixes) fixing crates/omniinfer-cli/src/serve
A fix in crates/omniinfer-cli/src/serve — 10 commits (6 fixs), 4 files: “fix: harden CUDA admission and projector restore”; “feat: add no-mmproj model loading option”; “test(cli): fix Windows smoke assumptions”; and 7 more.
crates/omniinfer-cli/src/serve · medium confidence · unverified
123 commits (72 fixes) fixing android/omniinfer-server/src/main/cpp
A fix in android/omniinfer-server/src/main/cpp — 123 commits (72 fixs), 11 files: “fix(android): distinguish graceful stop vs hard cancel via graceful\_stop flag in C++”; “feat(android): add omniinfer-server library module and fix MNN streaming crashes”; “feat(android): add KV cache prefix reuse for MNN backend”; and 84 more (refs \#62, \#60).
android/omniinfer-server/src/main/cpp · medium confidence · unverified
164 commits (109 fixes) fixing scripts
A fix in scripts — 164 commits (109 fixs), 16 files: “fix(backend): provide managed Python development headers”; “feat: add interactive cross-platform install scripts”; “fix(windows): add powershell source launcher”; and 127 more.
scripts · medium confidence · unverified
17 commits (9 fixes) fixing examples
A fix in examples — 17 commits (9 fixs), 6 files: “fix(examples): harden VLA LIBERO demo”; “fix(examples): protect VLA gateway credentials”; “feat(examples): add VLA LIBERO demo”; and 14 more.
examples · medium confidence · unverified
28 commits (15 fixes) fixing crates/omniinfer-cli/src/gateway/runtime\_manager
A fix in crates/omniinfer-cli/src/gateway/runtime\_manager — 28 commits (15 fixs), 6 files: “feat(gateway): attach external runtimes safely”; “test(windows): isolate CUDA resource probes”; “fix(ik-llama): recognize cpu-moe short aliases”; and 25 more.
_crates/omniinfer-cli/src/gateway/runtime\manager · medium confidence · unverified
4 commits (3 fixes) fixing crates/omniinfer-core/src/state
A fix in crates/omniinfer-core/src/state — 4 commits (3 fixs), 4 files: “fix: harden CUDA admission and projector restore”; “refactor(core): organize domain modules”; “fix(serve): respect external runtime ownership”; and 1 more.
crates/omniinfer-core/src/state · medium confidence · unverified
41 commits (22 fixes) fixing omniinfer-server
A fix in omniinfer-server — 41 commits (22 fixs), 6 files: “fix(android): catch port bind failure and verify server health before returning from loadModel”; “fix(android): honor explicit backend selection”; “fix(android): distinguish graceful stop vs hard cancel via graceful\_stop flag in C++”; and 26 more.
omniinfer-server · medium confidence · unverified
52 commits (30 fixes) fixing crates/omniinfer-cli/src/gateway
A fix in crates/omniinfer-cli/src/gateway — 52 commits (30 fixs), 8 files: “feat(models): support vllm hf public models”; “fix(vllm): include runtime library paths”; “feat(gateway): attach external runtimes safely”; and 49 more.
crates/omniinfer-cli/src/gateway · medium confidence · unverified
6 commits (4 fixes) fixing ios
A fix in ios — 6 commits (4 fixs), 13 files: “feat(ios): add MLX backend via mlx-swift-lm with unified InferenceEngine abstraction”; “fix(ios): multi-turn history, thinking mode, and n\_gpu\_layers support”; “fix(ios): correct mlx-swift-lm version, iOS 17 minimum, and API usage”; and 3 more.
ios · medium confidence · unverified
65 commits (38 fixes) fixing android/omniinfer-server/src/main/java
A fix in android/omniinfer-server/src/main/java — 65 commits (38 fixs), 4 files: “fix(android): catch port bind failure and verify server health before returning from loadModel”; “fix(android): distinguish graceful stop vs hard cancel via graceful\_stop flag in C++”; “feat(android): add omniinfer-server library module and fix MNN streaming crashes”; and 34 more.
android/omniinfer-server/src/main/java · medium confidence · unverified
8 commits (5 fixes) fixing android
A fix in android — 8 commits (5 fixs), 1 file: “feat(android): add consumer proguard rules for JNI bridge preservation”; “build(android): guard aar dependencies”; “fix(android): preserve stream callbacks in release builds”; and 3 more.
android · medium confidence · unverified
Test coverage
12 commits adding/updating tests in crates/omniinfer-cli/src/gateway/tests; 15 commits adding/updating tests in crates/omniinfer-cli/tests/fixtures; 4 commits adding/updating tests in android/omniinfer-server/src/test; 50 commits adding/updating tests in crates/omniinfer-cli/tests; 56 commits adding/updating tests in crates/omniinfer-cli/tests/cli\_smoke; 58 commits adding/updating tests in tests.
Dependencies
96 commits updating dependencies (11 manifests)
A dependency / build maintenance change in (dependencies) — 96 commits (19 fixs), 11 files: “build(android): add lite packaging and downloadable engine package bundle”; “chore(release): prepare v0.3.21”; “fix(serve): propagate explicit roots to gateway”; and 87 more (refs \#62, \#60).
(dependencies) · medium confidence · unverified
Written by cca.canine.dev from the codebase's own history, inside the signed delivery this page is composed from.
How this codebase got here
Baseline
- First survey — no prior run to compare against. CAI 60.8.
Lenses
- Code Health 85.5
- Architecture 93.5
- Maturity 80.0
- Readiness 43.1
- Security 68.8
- Performance 82.1
Changes since last survey
- 300 commits — 194 feature/other, 106 fixes
By area
- (repo) — 73 commits
- crates/omniinfer-cli — 68 commits
- (root) — 27 commits
- .github/workflows — 15 commits
- crates/omniinfer-core — 15 commits
- android/omniinfer-server — 10 commits
- scripts/install-from-source.ps1 — 9 commits
- docs/assets — 7 commits
- examples/vla-libero — 7 commits
- docs/android — 6 commits
- docs/benchmark-environment.md — 6 commits
- docs/build.md — 6 commits
- framework/llama.cpp — 6 commits
- framework/executorch — 4 commits
- framework/ik_llama.cpp — 4 commits
- framework/mlx — 4 commits
- scripts/platforms — 4 commits
- docs/API.md — 3 commits
- framework/llama-cpp-turboquant — 3 commits
- framework/mnn — 3 commits
Notable commits
- fix: Merge pull request #200 from omnimind-ai/fix/macos-ci-runtime-log-sync
- fix: Merge pull request #201 from omnimind-ai/fix/serve-tui-startup
- fix: Merge pull request #203 from omnimind-ai/fix/request-defaults
- fix: Merge pull request #204 from omnimind-ai/fix/serve-state-ownership
- fix: Merge pull request #214 from omnimind-ai/fix/benchmark-tg
- fix: Merge pull request #217 from omnimind-ai/fix/benchmark-cache-isolation
- fix: Merge pull request #219 from omnimind-ai/fix/memory-budget-calculation
- fix: Merge pull request #221 from omnimind-ai/fix/pr-219-portable-resource-test
- fix: Merge pull request #223 from omnimind-ai/fix/tui-thinking-runtime-forwarding
- fix: Merge pull request #230 from omnimind-ai/fix/issue-229-partial-offload
- fix: Merge pull request #240 from omnimind-ai/fix/external-runtime-stop-lifecycle
- fix: Merge pull request #241 from omnimind-ai/fix/issue-209-multi-gpu-placement
- fix: Merge pull request #243 from omnimind-ai/fix/issue-218-windows-contract
- fix: Merge pull request #245 from omnimind-ai/fix/issue-244-catalog-sizes
- fix: Merge pull request #247 from omnimind-ai/fix/vla-install-finalization
- fix: Merge pull request #248 from omnimind-ai/fix/ik-llama-cpu-moe-placement
- fix: Merge pull request #249 from omnimind-ai/fix/benchmark-scored-decode-tokens
- fix: Merge pull request #261 from omnimind-ai/fix/benchmark-resource-placement
- fix: Merge pull request #262 from omnimind-ai/fix/benchmark-environment-evidence
- fix: Merge pull request #263 from omnimind-ai/fix/vulkan-placement-accounting
- …and 280 more
Architecture
- 0 containers · 2 bounded contexts · 0 dependency edges (baseline)
Written by cca.canine.dev from the codebase's own history, inside the signed delivery this page is composed from.
Survey your own repository
omnimind-ai/OmniInfer was measured the same way every project in this corpus was: the same rubric, at a pinned commit, with the result published in full. Point a surveyor at a repository you know and see whether you agree with it.
About this page
- The score is its most recent published measurement, taken on 16 November 2026 at a pinned commit. It is not a live figure and does not change until the project is measured again.
- Measured at commit 27930b453576a7130a1454f802ea754f8dcd8aed — the exact code this score is about.
- Scored under rubric-2026.11.4 — the same rubric and the same method as every other entry in this index.
- Measured by Canine Code Analyzer (cca.canine.dev) using cca measure-2026.11.83+preprod-a489942cf94b.