Skip to content
CAI
Software that uses CAICheck a score

LMCache/LMCache

59.1

Adequate · 16 November 2026

171.5k

lines of production code

Python

primary language

1

measurement over time

CAI band scale
CAI lens gauges

What this system is

Behavioural changes

1 commit (0 fixes) modifying .agents

A change to existing behaviour in .agents — 1 commit, 1 file: “\[Doc\] Share repository skills across coding tools (\#6391)” (refs \#6391).

.agents · low confidence · unverified

1 commit (0 fixes) modifying csrc/musa

A change to existing behaviour in csrc/musa — 1 commit, 5 files: “\[Platform\]\[MUSA\]fea: Add native MUSA CacheGen codec (\#5865)” (refs \#5865).

csrc/musa · medium confidence · unverified

1 commit (0 fixes) modifying examples/mp\_runtime\_plugins

A change to existing behaviour in examples/mp\_runtime\_plugins — 1 commit, 3 files: “\[MP\] Introduce MP runtime plugin framework (\#2956)” (refs \#2956).

_examples/mp\_runtime\plugins · medium confidence · unverified

10 commits (1 fix) modifying .buildkite/k3\_tests/multiprocess/scripts/workloads/common

A change to existing behaviour in .buildkite/k3\_tests/multiprocess/scripts/workloads/common — 10 commits (1 fix), 9 files: “\[good-first-issue\] tests: keep L2 long\_doc\_qa metrics diagnostics when thresholds fail (\#5404) (\#5413)”; “\[CI\]\[XPU\]: enable long-doc l2 SHM tests and engine-driven metrics (\#6102)”; “\[Refactor\] Prepare InProcess extraction boundaries (\#6258)”; and 7 more (refs \#5404, \#5413, \#6102, \#6258, \#5214, …).

_.buildkite/k3\tests/multiprocess/scripts/workloads/common · medium confidence · unverified

10 commits (1 fix) modifying .buildkite/k3\_tests/unit

A change to existing behaviour in .buildkite/k3\_tests/unit — 10 commits (1 fix), 3 files: “\[Refactor\] Move mode-specific utilities out of lmcache.utils (\#6286)”; “\[CI\] Add file-backed DevDAX L1 and DAX L2 integration coverage (\#5635)”; “nixl\_storage: Fix tests and remove from ignore list (\#3200)”; and 7 more (refs \#6286, \#5635, \#3200, \#5066, \#6254, …).

_.buildkite/k3\tests/unit · medium confidence · unverified

1066 commits (241 fixes) modifying lmcache

A change to existing behaviour in lmcache — 1066 commits (241 fixs), 740 files: “\[Fix\]\[NIXL\] Report L2 load success only after transfer completion (\#5336)”; “\[Bugfix\]\[CLI\] Fingerprint measured RAG prompts and gold answers (\#5757)”; “\[MP\] Health Check (\#2645)”; and 1063 more (refs \#5336, \#5757, \#2645, \#3160, \#2366, …).

lmcache · medium confidence · unverified

11 commits (0 fixes) modifying csrc/lmcache\_native

A change to existing behaviour in csrc/lmcache\_native — 11 commits, 11 files: “refactor: rename native\_storage\_ops to lmcache\_native and relocate KV-format/transfer types (\#4453)”; “\[RBLN\] Support vLLM-RBLN's blocks-first KV cache layout (\#5748)”; “\[MP\]\[Ascend\] Ascend NPU multiprocess format support + generic engine-driven path (\#3968)”; and 8 more (refs \#4453, \#5748, \#3968, \#5346, \#4729, …).

_csrc/lmcache\native · medium confidence · unverified

12 commits (0 fixes) modifying .claude

A change to existing behaviour in .claude — 12 commits, 42 files: “\[Misc\] Agent skills for p2p (\#6209)”; “\[Bench\] Add \ignore\_eos\, \output\_length\ and a hybrid model benchmarking skill (\#3715)”; “Enable --separate-object-groups as default (\#6041)”; and 9 more (refs \#6209, \#3715, \#6041, \#6066, \#6013, …).

.claude · medium confidence · unverified

13 commits (3 fixes) modifying examples/token\_dropping

A change to existing behaviour in examples/token\_dropping — 13 commits (3 fixs), 8 files: “KVCache SDK: batch and stream interface (\#3950)”; “lint: convert token dropping experiment logging to %-format (\#5276)”; “\[Bugfix\]\[Doc\] examples/token\_dropping: support interleaved RoPE in rerotate\_k\_cache (\#6054)”; and 10 more (refs \#3950, \#5276, \#6054, \#6365, \#5275, …).

_examples/token\dropping · medium confidence · unverified

14 commits (1 fix) modifying .buildkite/k3\_tests/amd

A change to existing behaviour in .buildkite/k3\_tests/amd — 14 commits (1 fix), 9 files: “\[MP\]\[ROCm\] VMM KV-cache IPC on ROCm through rocm.bindings (\#6626)”; “build(multiprocess): add gRPC protobuf and test foundation (\#5066)”; “ci: pre-merge PR base before pipeline expansion (\#4769)”; and 11 more (refs \#6626, \#5066, \#4769, \#5439, \#6254, …).

_.buildkite/k3\tests/amd · medium confidence · unverified

14 commits (1 fix) modifying .buildkite/k3\_tests/xpu/unittests

A change to existing behaviour in .buildkite/k3\_tests/xpu/unittests — 14 commits (1 fix), 4 files: “\[Refactor\] Move mode-specific utilities out of lmcache.utils (\#6286)”; “fix(ci): correct REPO\_ROOT depth in xpu unittests run.sh (\#4964)”; “\[CI\] complete end-to-end XPU nightly workflow (\#5423)”; and 11 more (refs \#6286, \#4964, \#5423, \#6254, \#4999, …).

_.buildkite/k3\tests/xpu/unittests · medium confidence · unverified

16 commits (1 fix) modifying .buildkite/k3\_tests/multiprocess/scripts/workloads/vllm

A change to existing behaviour in .buildkite/k3\_tests/multiprocess/scripts/workloads/vllm — 16 commits (1 fix), 14 files: “\[Feat\]\[MP\] Engine-driven multi-group transfers via KVLayerGroupsManager (\#4410)”; “\[CI\]\[XPU\] Add P2P, long\_doc\_qa mp tests (\#6101)”; “\[CI\]\[XPU\] Add deterministic DeepSeek V4 HMA correctness coverage (\#6167)”; and 13 more (refs \#4410, \#6101, \#6167, \#5862, \#6258, …).

_.buildkite/k3\tests/multiprocess/scripts/workloads/vllm · medium confidence · unverified

16 commits (1 fix) modifying csrc/storage\_backends

A change to existing behaviour in csrc/storage\_backends — 16 commits (1 fix), 15 files: “\[Fix\]\[Native Connector\] Balance batch tiles (\#4333)”; “\[Feat\] Add RDMA L1 memory preregistration support for MooncakeStore L2 adapter (\#3018)”; “\[Build\] Remove hardcoded C++17 flags from PyTorch extensions (\#5564)”; and 13 more (refs \#4333, \#3018, \#5564, \#3302, \#3458, …).

_csrc/storage\backends · medium confidence · unverified

16 commits (3 fixes) modifying examples/kv\_cache\_calculator

A change to existing behaviour in examples/kv\_cache\_calculator — 16 commits (3 fixs), 5 files: “Update modelconfig.json to have more models in KV cache size calculator (\#366)”; “\[CI/Build\]: Replace linting and formatting management with pre-commit (\#691)”; “\[Bugfix\] revert change made by \#694 of kvcache calculation for deepseekV3 (\#715)”; and 13 more (refs \#366, \#691, \#694, \#715, \#1024, …).

_examples/kv\_cache\calculator · medium confidence · unverified

17 commits (1 fix) modifying .buildkite/k3\_tests/xpu/multiprocess

A change to existing behaviour in .buildkite/k3\_tests/xpu/multiprocess — 17 commits (1 fix), 3 files: “\[Feat\]\[MP\] Engine-driven multi-group transfers via KVLayerGroupsManager (\#4410)”; “\[CI\]\[XPU\] Add P2P, long\_doc\_qa mp tests (\#6101)”; “\[Bugfix\] Add missing retries to XPU multiprocess CI tests (\#6510)”; and 14 more (refs \#4410, \#6101, \#6510, \#6167, \#6102, …).

_.buildkite/k3\tests/xpu/multiprocess · medium confidence · unverified

18 commits (3 fixes) modifying csrc

A change to existing behaviour in csrc — 18 commits (3 fixs), 3 files: “\[core\]\[feat\] add NL\_X\_NB\_BSV\_BSS format for CB (\#4351)”; “\[SGLang\]\[MP\] Support SGLang MLA format in MP mode (\#4793)”; “\[MP\]\[Refactor\] Move kv\_format and gpu\_connector/utils.py to common (\#6530)”; and 15 more (refs \#4351, \#4793, \#6530, \#5748, \#4594, …).

csrc · medium confidence · unverified

18 commits (5 fixes) modifying .buildkite/scripts/multiprocessing-test

A change to existing behaviour in .buildkite/scripts/multiprocessing-test — 18 commits (5 fixs), 12 files: “ci: add vLLM end-to-end benchmark to AMD pipeline (\#4641)”; “\[Refactor\] Prepare InProcess extraction boundaries (\#6258)”; “build(multiprocess): add gRPC protobuf and test foundation (\#5066)”; and 15 more (refs \#4641, \#6258, \#5066, \#2451, \#2360, …).

.buildkite/scripts/multiprocessing-test · medium confidence · unverified

18 commits (7 fixes) modifying rust/raw\_block

A change to existing behaviour in rust/raw\_block — 18 commits (7 fixs), 2 files: “\[2/N\]\[Feat\] Add zero-copy aligned buffer odirect (\#2573)”; “\[RawBlock\] Support padded payloads in batched io\_uring put\_many (\#3949)”; “\[6/N\]\[Feat\] This PR adds io\_uring support to the Rust raw block backend. (\#2635)”; and 15 more (refs \#2573, \#3949, \#2635, \#3119, \#4697, …).

_rust/raw\block · medium confidence · unverified

2 commits (0 fixes) modifying benchmarks/ttft-estimator

A change to existing behaviour in benchmarks/ttft-estimator — 2 commits, 2 files: “\[CI\]\[Linter\] Add back strict mypy checking (\#1451)”; “\[Benchmark\]: Add a TTFT estimator/drawer (\#1389)” (refs \#1451, \#1389).

benchmarks/ttft-estimator · medium confidence · unverified

2 commits (0 fixes) modifying examples/agents

A change to existing behaviour in examples/agents — 2 commits, 1 file: “\[Agents\] Add prefix hit rate vs pool size analysis (\#1838)”; “\[Agents\] Non-prefix caching hit rate vs pool size (\#1851)” (refs \#1838, \#1851).

examples/agents · medium confidence · unverified

2 commits (0 fixes) modifying examples/dynamo\_integration

A change to existing behaviour in examples/dynamo\_integration — 2 commits, 8 files: “\[Examples\] Add Dynamo + LMCache MP integration recipe (aggregated + disaggregated) (\#3935)”; “\[Docs\] Add local and Kubernetes Dynamo integration guide (\#5257)” (refs \#3935, \#5257).

_examples/dynamo\integration · medium confidence · unverified

2 commits (0 fixes) modifying examples/kvcache\_sdk

A change to existing behaviour in examples/kvcache\_sdk — 2 commits, 2 files: “Token dropping sdk v3 (\#3820)”; “Get query tensor v2 (\#4042)” (refs \#3820, \#4042).

_examples/kvcache\sdk · medium confidence · unverified

20 commits (4 fixes) modifying csrc/sycl

A change to existing behaviour in csrc/sycl — 20 commits (4 fixs), 11 files: “\[Feat\]\[MP\] Engine-driven multi-group transfers via KVLayerGroupsManager (\#4410)”; “refactor: rename native\_storage\_ops to lmcache\_native and relocate KV-format/transfer types (\#4453)”; “xpu: pin LMCache host buffer via sycl::malloc\_host (\#4129)”; and 17 more (refs \#4410, \#4453, \#4129, \#2902, \#3673, …).

csrc/sycl · medium confidence · unverified

21 commits (3 fixes) modifying csrc/cuda

A change to existing behaviour in csrc/cuda — 21 commits (3 fixs), 27 files: “\[Perf\]\[MP\] Use 2-D copies for block-outermost layouts in the direct copy path (\#5506)”; “\[MACA\] Add self-compile build profile for MetaX GPUs (\#4606)”; “\[Refactor\] Promote blend\_v3 to blend and remove the legacy blend (\#4758)”; and 18 more (refs \#5506, \#4606, \#4758, \#6299, \#6062, …).

csrc/cuda · medium confidence · unverified

21 commits (3 fixes) modifying setup\_extensions/build\_profiles

A change to existing behaviour in setup\_extensions/build\_profiles — 21 commits (3 fixs), 10 files: “\[MACA\] Add self-compile build profile for MetaX GPUs (\#4606)”; “\[MACA\] Fix detect() exception handling and add missing triton dependency (\#4907)”; “\[Build\] Remove hardcoded C++17 flags from PyTorch extensions (\#5564)”; and 18 more (refs \#4606, \#4907, \#5564, \#4733, \#4949, …).

_setup\_extensions/build\profiles · medium confidence · unverified

22 commits (1 fix) modifying .buildkite/k3\_tests/common\_scripts

A change to existing behaviour in .buildkite/k3\_tests/common\_scripts — 22 commits (1 fix), 6 files: “\[Hotfix\]\[CI\] Unblock CI: pandas auto-heal + CUDA 12 build toolchain (\#3055)”; “Refine XPU CI filtering and discovery (\#4166)”; “\[CI\]\[RBLN\] Add a nightly rbln-serve lane and promote its verified image to PR builds (\#6157)”; and 19 more (refs \#3055, \#4166, \#6157, \#5606, \#6258, …).

_.buildkite/k3\_tests/common\scripts · medium confidence · unverified

226 commits (28 fixes) modifying (repo-wide)

A change to existing behaviour in (repo-wide) — 226 commits (28 fixs), 19 files: “\[Doc\] Reconcile the documented PR title prefixes with actual practice (\#4990)”; “\[Doc\] add badge and fix typos (\#591)”; “\[Enhancement\] Latest vllm (0.7.0) docker support (\#339)”; and 214 more (refs \#4990, \#591, \#339, \#4070, \#691, …).

(repo-wide) · low confidence · unverified

23 commits (5 fixes) modifying .buildkite/scripts

A change to existing behaviour in .buildkite/scripts — 23 commits (5 fixs), 11 files: “\[CI\] Configure device environment for AMD MP benchmark (\#4976)”; “\[CI/Build\] Add comprehensive test pipeline (\#1249)”; “ci: add vLLM end-to-end benchmark to AMD pipeline (\#4641)”; and 20 more (refs \#4976, \#1249, \#4641, \#1451, \#6258, …).

.buildkite/scripts · medium confidence · unverified

3 commits (0 fixes) modifying .buildkite/k3\_tests/multiprocess/scripts/workloads/sglang

A change to existing behaviour in .buildkite/k3\_tests/multiprocess/scripts/workloads/sglang — 3 commits, 2 files: “\[CI\]\[SGLang\] Add integration test for kimi linear test (\#5862)”; “\[CI\]\[SGLang\] Preserve Kimi chunk checkpoints (\#6645)”; “\[CI\]\[DSv4\] optimize the CI execution time by reducing the layer (\#6143)” (refs \#5862, \#6645, \#6143).

_.buildkite/k3\tests/multiprocess/scripts/workloads/sglang · medium confidence · unverified

3 commits (0 fixes) modifying examples/kv\_cache\_reuse

A change to existing behaviour in examples/kv\_cache\_reuse — 3 commits, 4 files: “\[Refactor\] Remove in-tree InProcess implementation (\#6254)”; “\[Misc\] Rename experimental to v1 and refactor examples (\#704)”; “\[Docs\] Add SGLang-to-vLLM KV cache sharing example (\#4130)” (refs \#6254, \#704, \#4130).

_examples/kv\_cache\reuse · medium confidence · unverified

3 commits (1 fix) modifying .buildkite/coordinator\_controllers

A change to existing behaviour in .buildkite/coordinator\_controllers — 3 commits (1 fix), 2 files: “\[CI\] Add the coordinator-controllers compatibility pipeline (\#5243)”; “\[MP\] Test real MP servers against the coordinator end to end (\#5519)”; “\[Bugfix\]\[Coordinator\] Serve /cache/delete from the eviction controller (\#5918)” (refs \#5243, \#5519, \#5918).

_.buildkite/coordinator\controllers · medium confidence · unverified

3 commits (1 fix) modifying csrc/storage\_backends/redis

A change to existing behaviour in csrc/storage\_backends/redis — 3 commits (1 fix), 3 files: “\[Southbound\]: Create a Native Protocol for MP and non-MP (\#2642)”; “fix: bound RESP authentication reply length (\#6108)”; “\[Feat\]: Add eviction to L2 Native Backend (\#2939)” (refs \#2642, \#6108, \#2939).

_csrc/storage\backends/redis · medium confidence · unverified

30 commits (3 fixes) modifying lmcache/v1/multiprocess/modules/blend

A change to existing behaviour in lmcache/v1/multiprocess/modules/blend — 30 commits (3 fixs), 9 files: “\[cb\] skip rope-less engine-group (\#5080)”; “\[Cacheblend\] Scope coordinator blend matches to the requester's namespace (\#4806)”; “\[2/N\] Updating StorageManager.submit\_prefetch\_request interface (\#5245)”; and 27 more (refs \#5080, \#4806, \#5245, \#6572, \#4953, …).

lmcache/v1/multiprocess/modules/blend · medium confidence · unverified

34 commits (7 fixes) modifying operator

A change to existing behaviour in operator — 34 commits (7 fixs), 162 files: “\[Operator\] CacheBlend webhook: support namespace-qualified engine refs for cross-namespace binds (\#4024)”; “\[Operator\] Add configurable hostNetwork field to LMCacheEngine CRD (\#3849)”; “\[Operator\] Add PD disaggregation to CacheBlendEngine (\#4932)”; and 31 more (refs \#4024, \#3849, \#4932, \#4758, \#3496, …).

operator · medium confidence · unverified

35 commits (3 fixes) modifying .buildkite/k3\_tests/multiprocess/scripts

A change to existing behaviour in .buildkite/k3\_tests/multiprocess/scripts — 35 commits (3 fixs), 7 files: “\[CI\]\[MP\] Add DeepSeek-V4-Flash L1 correctness test (4-GPU) (\#4442)”; “\[CI/CD\] Add CUDA engine-driven MP mode for gsm8k to prevent functional and accuracy regressions (\#3860)”; “ci: add vLLM end-to-end benchmark to AMD pipeline (\#4641)”; and 32 more (refs \#4442, \#3860, \#4641, \#2914, \#5862, …).

_.buildkite/k3\tests/multiprocess/scripts · medium confidence · unverified

39 commits (8 fixes) modifying .buildkite/k3\_harness

A change to existing behaviour in .buildkite/k3\_harness — 39 commits (8 fixs), 16 files: “Cleanup/remove blend v2 ci (\#3541)”; “\[CI\] Fail fast on missing CPU runtime dependencies (\#5072)”; “\[Hotfix\]\[CI\] Unblock CI: pandas auto-heal + CUDA 12 build toolchain (\#3055)”; and 36 more (refs \#3541, \#5072, \#3055, \#4353, \#6157, …).

_.buildkite/k3\harness · medium confidence · unverified

4 commits (0 fixes) modifying .buildkite/k3\_tests/rbln

A change to existing behaviour in .buildkite/k3\_tests/rbln — 4 commits, 12 files: “\[CI\]\[RBLN\] Add a nightly rbln-serve lane and promote its verified image to PR builds (\#6157)”; “\[RBLN\] Support vLLM-RBLN's blocks-first KV cache layout (\#5748)”; “\[CI\] Remove duplicate post-merge validation (\#6550)”; and 1 more (refs \#6157, \#5748, \#6550, \#5543).

_.buildkite/k3\tests/rbln · medium confidence · unverified

4 commits (0 fixes) modifying benchmarks/microbenchmark

A change to existing behaviour in benchmarks/microbenchmark — 4 commits, 2 files: “refactor: rename native\_storage\_ops to lmcache\_native and relocate KV-format/transfer types (\#4453)”; “\[Prefetch only sliding window 1/N\] Add bitmap operations (\#3745)”; “\[Perf\]\[MP\] Avoid full-bucket snapshots in isolated LRU victim selection (\#6393)”; and 1 more (refs \#4453, \#3745, \#6393, \#5356).

benchmarks/microbenchmark · medium confidence · unverified

4 commits (0 fixes) modifying csrc/storage\_backends/mooncake

A change to existing behaviour in csrc/storage\_backends/mooncake — 4 commits, 3 files: “\[Feat\] Add RDMA L1 memory preregistration support for MooncakeStore L2 adapter (\#3018)”; “\[MP\]: Add batch operations to Mooncake L2 adapter (\#3172)”; “\[MP\]: Add per-operation dedicated worker pools to Mooncake L2 connector (\#3227)”; and 1 more (refs \#3018, \#3172, \#3227, \#2911).

_csrc/storage\backends/mooncake · medium confidence · unverified

4 commits (0 fixes) modifying examples/lmc\_external\_native\_connector

A change to existing behaviour in examples/lmc\_external\_native\_connector — 4 commits, 6 files: “\[Build\] Remove hardcoded C++17 flags from PyTorch extensions (\#5564)”; “\[MP\]\[Feat\] Add cache\_salt to ObjectKey for cache isolation (\#3042)”; “\[MP\] Refactor l2 plugin framework to support dynamic load third-party native l2 connector (\#2851)”; and 1 more (refs \#5564, \#3042, \#2851, \#2939).

_examples/lmc\_external\_native\connector · medium confidence · unverified

4 commits (1 fix) modifying tools

A change to existing behaviour in tools — 4 commits (1 fix), 3 files: “\[doc\] Fix chinese wheel translations (\#4714)”; “add Chinese translation pipeline (\#3265)”; “\[chore\]: Change code headers to SPDX License headers (\#1145)”; and 1 more (refs \#4714, \#3265, \#1145, \#6342).

tools · medium confidence · unverified

4 commits (2 fixes) modifying csrc/storage\_backends/hf3fs

A change to existing behaviour in csrc/storage\_backends/hf3fs — 4 commits (2 fixs), 5 files: “fix: Use temporary files for atomic HF3FS writes (\#5808)”; “\[Core\]\[HF3FS\] Add shard\_dirs option to spread stores across chunk-hash subdirectories (\#6261)”; “\[Bugfix\]\[MP\] Confirm HF3FS key-buffer misses on 3FS (\#6002)”; and 1 more (refs \#5808, \#6261, \#6002, \#5131).

_csrc/storage\backends/hf3fs · medium confidence · unverified

5 commits (0 fixes) modifying examples/serde

A change to existing behaviour in examples/serde — 5 commits, 5 files: “\[Refactor\] Group MP server & coordinator HTTP APIs into endpoint groups (\#3948)”; “\[Serde\] AES-GCM (\#4235)”; “Add TurboQuant serde support for LMCache L2 adapters (\#3193)”; and 2 more (refs \#3948, \#4235, \#3193, \#3185, \#3140).

examples/serde · medium confidence · unverified

5 commits (0 fixes) modifying examples/token\_dropping/rkv\_variants

A change to existing behaviour in examples/token\_dropping/rkv\_variants — 5 commits, 3 files: “\[Example\] Tune R-KV token-dropping default config and add Qwen3-1.7B Colab demo (\#4500)”; “\[Examples\] token\_dropping: pass --supported-transfer-mode auto to LMCache server (\#4601)”; “\[Examples\] Add an R-KV token dropping and benchmarking notebook (\#4252)”; and 2 more (refs \#4500, \#4601, \#4252, \#5277, \#5793).

_examples/token\_dropping/rkv\variants · medium confidence · unverified

5 commits (0 fixes) modifying setup\_extensions/storage\_backend\_profiles

A change to existing behaviour in setup\_extensions/storage\_backend\_profiles — 5 commits, 5 files: “\[Build\] Remove hardcoded C++17 flags from PyTorch extensions (\#5564)”; “Add optional native Aerospike L2 backend (BUILD\_AEROSPIKE) (\#3458)”; “refactor(build): extract extension build into profile-based architecture (\#3642)”; and 2 more (refs \#5564, \#3458, \#3642, \#4865, \#5131).

_setup\_extensions/storage\_backend\profiles · medium confidence · unverified

5 commits (1 fix) modifying benchmarks/multi\_round\_qa

A change to existing behaviour in benchmarks/multi\_round\_qa — 5 commits (1 fix), 4 files: “\[CI\]\[Linter\] Add back strict mypy checking (\#1451)”; “Convert multi-round QA logging to lazy formatting (\#5229)”; “\[Doc\] Drop --disable-log-requests from vllm serve examples (\#5814)”; and 2 more (refs \#1451, \#5229, \#5814, \#1448, \#2199).

_benchmarks/multi\_round\qa · medium confidence · unverified

5 commits (2 fixes) modifying examples/p2p

A change to existing behaviour in examples/p2p — 5 commits (2 fixs), 2 files: “update p2p example (\#3781)”; “docs: use scoped coordinator bind addresses (\#6609)”; “\[Enhancement\] Support P2P KV Cache sharing (\#371)”; and 2 more (refs \#3781, \#6609, \#371, \#372, \#375).

examples/p2p · medium confidence · unverified

57 commits (7 fixes) modifying .buildkite/k3\_tests/multiprocess

A change to existing behaviour in .buildkite/k3\_tests/multiprocess — 57 commits (7 fixs), 8 files: “\[CI\]\[MP\] Add DeepSeek-V4-Flash L1 correctness test (4-GPU) (\#4442)”; “\[CI/CD\] Add CUDA engine-driven MP mode for gsm8k to prevent functional and accuracy regressions (\#3860)”; “\[good-first-issue\] tests: keep L2 long\_doc\_qa metrics diagnostics when thresholds fail (\#5404) (\#5413)”; and 54 more (refs \#4442, \#3860, \#5404, \#5413, \#3489, …).

_.buildkite/k3\tests/multiprocess · medium confidence · unverified

66 commits (13 fixes) modifying docker

A change to existing behaviour in docker — 66 commits (13 fixs), 11 files: “\[CI\] cu129 images: pin vllm to the cu129 index (drop unsafe-best-match) (\#3621)”; “\[Enhancement\] Latest vllm (0.7.0) docker support (\#339)”; “\[Build\] add SM120 for wheel build (\#2873)”; and 63 more (refs \#3621, \#339, \#2873, \#3101, \#5590, …).

docker · medium confidence · unverified

7 commits (0 fixes) modifying examples/lmc\_external\_l2\_adapter

A change to existing behaviour in examples/lmc\_external\_l2\_adapter — 7 commits, 4 files: “refactor: rename native\_storage\_ops to lmcache\_native and relocate KV-format/transfer types (\#4453)”; “\[HMA\] change L2 adapter signatures (\#4407)”; “\[Core\] Add tags for L1 managers and L2 adapters for affinity and prefetch filtering (\#5919)”; and 4 more (refs \#4453, \#4407, \#5919, \#3363, \#2715, …).

_examples/lmc\_external\_l2\adapter · medium confidence · unverified

7 commits (1 fix) modifying .buildkite/k3\_tests/xpu

A change to existing behaviour in .buildkite/k3\_tests/xpu — 7 commits (1 fix), 5 files: “\[CI\] complete end-to-end XPU nightly workflow (\#5423)”; “Fix XPU nightly compiler patch version selection (\#6603)”; “Refine k3 tests path filtering (\#4177)”; and 4 more (refs \#5423, \#6603, \#4177, \#6096, \#6550, …).

_.buildkite/k3\tests/xpu · medium confidence · unverified

7 commits (1 fix) modifying csrc/storage\_backends/fs

A change to existing behaviour in csrc/storage\_backends/fs — 7 commits (1 fix), 3 files: “\[MP\]\[Feat\] Add cache\_salt to ObjectKey for cache isolation (\#3042)”; “\[MP\] Refactor l2 plugin framework to support dynamic load third-party native l2 connector (\#2851)”; “Introduce native fs connector (\#2779)”; and 4 more (refs \#3042, \#2851, \#2779, \#5078, \#3916, …).

_csrc/storage\backends/fs · medium confidence · unverified

8 commits (0 fixes) modifying .buildkite/metax

A change to existing behaviour in .buildkite/metax — 8 commits, 6 files: “\[Refactor\] Move cache\_controller under inprocess/v1 (\#5970)”; “\[MACA\] Add Buildkite CI pipeline for MetaX MACA hardware (\#4949)”; “\[Refactor\] Remove in-tree InProcess implementation (\#6254)”; and 5 more (refs \#5970, \#4949, \#6254, \#6550, \#6007, …).

.buildkite/metax · medium confidence · unverified

8 commits (1 fix) modifying examples/observability

A change to existing behaviour in examples/observability — 8 commits (1 fix), 6 files: “\[observability\] blend server trace sub-spans + V3 hit-rate breakdown (\#3607)”; “\[observability\] Keep the APC-covered prefix out of lookup hit counters (\#5836)”; “\[Refactor\] Promote blend\_v3 to blend and remove the legacy blend (\#4758)”; and 5 more (refs \#3607, \#5836, \#4758, \#3033, \#3175, …).

examples/observability · medium confidence · unverified

9 commits (0 fixes) modifying .buildkite/k3\_tests/blend

A change to existing behaviour in .buildkite/k3\_tests/blend — 9 commits, 5 files: “Cleanup/remove blend v2 ci (\#3541)”; “ci: add MUSA self-hosted smoke pipeline (\#4774)”; “\[ci\] resolve GH\_TOKEN for blend plugin clone from Buildkite secret (\#4175)”; and 6 more (refs \#3541, \#4774, \#4175, \#2993, \#3113, …).

_.buildkite/k3\tests/blend · medium confidence · unverified

9 commits (0 fixes) modifying .buildkite/k3\_tests/multiprocess/scripts/engines

A change to existing behaviour in .buildkite/k3\_tests/multiprocess/scripts/engines — 9 commits, 3 files: “\[CI\]\[XPU\] Add deterministic DeepSeek V4 HMA correctness coverage (\#6167)”; “\[Refactor\] Refactor multi process integration test (\#5214)”; “\[SGLang\] Support engine driven (\#5549)”; and 6 more (refs \#6167, \#5214, \#5549, \#5298, \#6612, …).

_.buildkite/k3\tests/multiprocess/scripts/engines · medium confidence · unverified

9 commits (0 fixes) modifying .buildkite/k3\_tests/musa

A change to existing behaviour in .buildkite/k3\_tests/musa — 9 commits, 8 files: “ci: add MUSA self-hosted smoke pipeline (\#4774)”; “\[Refactor\] Prepare InProcess extraction boundaries (\#6258)”; “\[Refactor\] Remove in-tree InProcess implementation (\#6254)”; and 6 more (refs \#4774, \#6258, \#6254, \#5610, \#6550, …).

_.buildkite/k3\tests/musa · medium confidence · unverified

9 commits (1 fix) modifying examples/online\_session

A change to existing behaviour in examples/online\_session — 9 commits (1 fix), 5 files: “Add and organize examples (\#128)”; “\[CI/Build\]: Replace linting and formatting management with pre-commit (\#691)”; “\[Refactor\]: Remove redundant files (\#719)”; and 6 more (refs \#128, \#691, \#719, \#138, \#704, …).

_examples/online\session · medium confidence · unverified

Test coverage

1 commit adding/updating tests in .buildkite/k3\_tests/multiprocess/scripts/tests; 1 commit adding/updating tests in tests/cli/commands/bench/quality\_bench; 1 commit adding/updating tests in tests/skills; 1 commit adding/updating tests in tests/v1/platform/devices/supa; 1 commit adding/updating tests in tests/v1/platform/devices/xpu; 1 commit adding/updating tests in tests/v1/storage\_backend; 10 commits adding/updating tests in tests/v1/lazy\_offload; 11 commits adding/updating tests in tests/cli/commands/bench/engine\_bench; 13 commits adding/updating tests in tests/cli/commands/trace; 13 commits adding/updating tests in tests/v1/platform/devices/cuda; 14 commits adding/updating tests in tests/cli/commands/bench/engine\_bench/workloads; 14 commits adding/updating tests in tests/v1/platform/devices/musa; 16 commits adding/updating tests in tests/v1/mp\_observability/subscribers/tracing; 16 commits adding/updating tests in tests/v1/mp\_observability/trace; 18 commits adding/updating tests in tests/v1/distributed/l2\_adapters; 18 commits adding/updating tests in tests/v1/mp\_observability; 180 commits adding/updating tests in tests/v1/distributed; 2 commits adding/updating tests in tests/security; 2 commits adding/updating tests in tests/v1/distributed/memory\_manager; 23 commits adding/updating tests in tests/cli; 23 commits adding/updating tests in tests/v1/distributed/serde; 23 commits adding/updating tests in tests/v1/multiprocess/http\_apis; 242 commits adding/updating tests in tests/v1; 28 commits adding/updating tests in tests/cli/commands; 29 commits adding/updating tests in tests/v1/mp\_observability/subscribers/metrics; 292 commits adding/updating tests in tests/v1/multiprocess; 3 commits adding/updating tests in tests/cli/commands/bench/engine\_bench/interactive; 3 commits adding/updating tests in tests/cli/commands/query; 3 commits adding/updating tests in tests/v1/platform/devices/cpu; 38 commits adding/updating tests in tests/v1/platform; 39 commits adding/updating tests in tests/v1/gpu\_connector; 4 commits adding/updating tests in tests/v1/multiprocess/transport; 4 commits adding/updating tests in tests/v1/platform/devices/neuron; 47 commits adding/updating tests in tests/cli/commands/bench; 5 commits adding/updating tests in tests/ci; 5 commits adding/updating tests in tests/v1/cli; 5 commits adding/updating tests in tests/v1/client; 5 commits adding/updating tests in tests/v1/distributed/raw\_block; 5 commits adding/updating tests in tests/v1/platform/devices/npu; 5 commits adding/updating tests in tests/v1/plugin; 6 commits adding/updating tests in tests/benchmarks; 6 commits adding/updating tests in tests/cli/commands/bench/engine\_bench/quality; 6 commits adding/updating tests in tests/lmcache\_frontend; 6 commits adding/updating tests in tests/sdk; 6 commits adding/updating tests in tests/v1/memory\_orchestrator; 6 commits adding/updating tests in tests/v1/platform/devices/mlu; 69 commits adding/updating tests in tests/v1/mp\_coordinator; 7 commits adding/updating tests in tests/cli/commands/bench/l2\_adapter\_bench; 7 commits adding/updating tests in tests/tools; 8 commits adding/updating tests in tests/v1/distributed/transfer\_channel; 8 commits adding/updating tests in tests/v1/mp\_coordinator/persistence; 8 commits adding/updating tests in tests/v1/platform/devices/rbln; 9 commits adding/updating tests in tests/v1/mp\_observability/subscribers/logging; 91 commits adding/updating tests in tests.

Dependencies

139 commits updating dependencies (11 manifests)

A dependency / build maintenance change in (dependencies) — 139 commits (19 fixs), 11 files: “\[good-first-issue\] Convert storage backend logs to lazy %-format (\#5262)”; “Buildkite integration (\#40)”; “\[Enhancement\] Latest vllm (0.7.0) docker support (\#339)”; and 136 more (refs \#5262, \#40, \#339, \#5081, \#691, …).

(dependencies) · high confidence · unverified

Written by cca.canine.dev from the codebase's own history, inside the signed delivery this page is composed from.

How this codebase got here

Baseline

  • First survey — no prior run to compare against. CAI 59.1.

Lenses

  • Code Health 67.6
  • Architecture 92.7
  • Maturity 71.8
  • Readiness 77.4
  • Security 79.8
  • Accessibility 43.4
  • Performance 85.0

Changes since last survey

  • 300 commits — 208 feature/other, 92 fixes

By area

  • lmcache/v1 — 72 commits
  • tests/v1 — 42 commits
  • .buildkite/k3_tests — 23 commits
  • docs/design — 22 commits
  • docs/source — 21 commits
  • lmcache/cli — 20 commits
  • .github/workflows — 16 commits
  • lmcache/integration — 13 commits
  • (root) — 11 commits
  • lmcache/inprocess — 11 commits
  • .github/scripts — 5 commits
  • csrc/cuda — 5 commits
  • .claude/skills — 4 commits
  • tests/inprocess — 4 commits
  • csrc/storage_backends — 3 commits
  • docker/Dockerfile — 3 commits
  • tests/cli — 3 commits
  • docker/Dockerfile.payload — 2 commits
  • lmcache/sdk — 2 commits
  • .buildkite/k3_harness — 1 commit

Notable commits

  • fix: Fix HF3FS test mixed line endings (#6137)
  • fix: Fix XPU nightly compiler patch version selection (#6603)
  • fix: Fix server CLI help test with installed LMCache wheel (#5975)
  • fix: [Bugfix] Add missing retries to XPU multiprocess CI tests (#6510)
  • fix: [Bugfix] Avoid scheduling receiver cleanup on a stopped event loop (#6116)
  • fix: [Bugfix] Delete NIXL static file-pool scratch files on close (#6369)
  • fix: [Bugfix] Fall back to buffered I/O when an fs L2 O_DIRECT buffer is unaligned or refused (#6158)
  • fix: [Bugfix] Handle cached steps without legacy resume IDs in the vLLM MP connector (#6457)
  • fix: [Bugfix] Load the Mooncake SDK only when its backend is selected (#6134)
  • fix: [Bugfix] Preserve chunk prefixes when touching prefetched keys (#6551)
  • fix: [Bugfix] Release StorageManager refs when a backend raises in batched_put (#5940)
  • fix: [Bugfix] S3 L2 adapter: bounds-check GET bodies and treat a wrong-sized object as a miss (#6015)
  • fix: [Bugfix] print actual stored tokens (#6188)
  • fix: [Bugfix][Build] Keep cu129 wheels on Torch 2.13 (#6529)
  • fix: [Bugfix][CB] Fingerprint a prompt's first chunk too (#6228)
  • fix: [Bugfix][CLI] Fail L2 benchmarks when all measured rounds time out (#6524)
  • fix: [Bugfix][CLI] Fall back from chat only on a missing-template 400 (#6563)
  • fix: [Bugfix][CLI] Handle failures while reading HTTP 503 bodies (#6306)
  • fix: [Bugfix][CLI] Handle incomplete HTTP response bodies (#5902)
  • fix: [Bugfix][CLI] Isolate profiling failure tests from host deps (#6350)
  • …and 280 more

Architecture

  • 0 containers · 1 bounded contexts · 0 dependency edges (baseline)

Written by cca.canine.dev from the codebase's own history, inside the signed delivery this page is composed from.

Survey your own repository

LMCache/LMCache was measured the same way every project in this corpus was: the same rubric, at a pinned commit, with the result published in full. Point a surveyor at a repository you know and see whether you agree with it.

About this page

  • The score is its most recent published measurement, taken on 16 November 2026 at a pinned commit. It is not a live figure and does not change until the project is measured again.
  • Measured at commit c0572702cd2d70216776ab2041eaa88f6126a60a — the exact code this score is about.
  • Scored under rubric-2026.11.4 — the same rubric and the same method as every other entry in this index.
  • Measured by Canine Code Analyzer (cca.canine.dev) using cca measure-2026.11.83+preprod-a489942cf94b.