LMCache/LMCache
59.1
Adequate · 16 November 2026
171.5k
lines of production code
Python
primary language
1
measurement over time
What this system is
Behavioural changes
1 commit (0 fixes) modifying .agents
A change to existing behaviour in .agents — 1 commit, 1 file: “\[Doc\] Share repository skills across coding tools (\#6391)” (refs \#6391).
.agents · low confidence · unverified
1 commit (0 fixes) modifying csrc/musa
A change to existing behaviour in csrc/musa — 1 commit, 5 files: “\[Platform\]\[MUSA\]fea: Add native MUSA CacheGen codec (\#5865)” (refs \#5865).
csrc/musa · medium confidence · unverified
1 commit (0 fixes) modifying examples/mp\_runtime\_plugins
A change to existing behaviour in examples/mp\_runtime\_plugins — 1 commit, 3 files: “\[MP\] Introduce MP runtime plugin framework (\#2956)” (refs \#2956).
_examples/mp\_runtime\plugins · medium confidence · unverified
10 commits (1 fix) modifying .buildkite/k3\_tests/multiprocess/scripts/workloads/common
A change to existing behaviour in .buildkite/k3\_tests/multiprocess/scripts/workloads/common — 10 commits (1 fix), 9 files: “\[good-first-issue\] tests: keep L2 long\_doc\_qa metrics diagnostics when thresholds fail (\#5404) (\#5413)”; “\[CI\]\[XPU\]: enable long-doc l2 SHM tests and engine-driven metrics (\#6102)”; “\[Refactor\] Prepare InProcess extraction boundaries (\#6258)”; and 7 more (refs \#5404, \#5413, \#6102, \#6258, \#5214, …).
_.buildkite/k3\tests/multiprocess/scripts/workloads/common · medium confidence · unverified
10 commits (1 fix) modifying .buildkite/k3\_tests/unit
A change to existing behaviour in .buildkite/k3\_tests/unit — 10 commits (1 fix), 3 files: “\[Refactor\] Move mode-specific utilities out of lmcache.utils (\#6286)”; “\[CI\] Add file-backed DevDAX L1 and DAX L2 integration coverage (\#5635)”; “nixl\_storage: Fix tests and remove from ignore list (\#3200)”; and 7 more (refs \#6286, \#5635, \#3200, \#5066, \#6254, …).
_.buildkite/k3\tests/unit · medium confidence · unverified
1066 commits (241 fixes) modifying lmcache
A change to existing behaviour in lmcache — 1066 commits (241 fixs), 740 files: “\[Fix\]\[NIXL\] Report L2 load success only after transfer completion (\#5336)”; “\[Bugfix\]\[CLI\] Fingerprint measured RAG prompts and gold answers (\#5757)”; “\[MP\] Health Check (\#2645)”; and 1063 more (refs \#5336, \#5757, \#2645, \#3160, \#2366, …).
lmcache · medium confidence · unverified
11 commits (0 fixes) modifying csrc/lmcache\_native
A change to existing behaviour in csrc/lmcache\_native — 11 commits, 11 files: “refactor: rename native\_storage\_ops to lmcache\_native and relocate KV-format/transfer types (\#4453)”; “\[RBLN\] Support vLLM-RBLN's blocks-first KV cache layout (\#5748)”; “\[MP\]\[Ascend\] Ascend NPU multiprocess format support + generic engine-driven path (\#3968)”; and 8 more (refs \#4453, \#5748, \#3968, \#5346, \#4729, …).
_csrc/lmcache\native · medium confidence · unverified
12 commits (0 fixes) modifying .claude
A change to existing behaviour in .claude — 12 commits, 42 files: “\[Misc\] Agent skills for p2p (\#6209)”; “\[Bench\] Add \ignore\_eos\, \output\_length\ and a hybrid model benchmarking skill (\#3715)”; “Enable --separate-object-groups as default (\#6041)”; and 9 more (refs \#6209, \#3715, \#6041, \#6066, \#6013, …).
.claude · medium confidence · unverified
13 commits (3 fixes) modifying examples/token\_dropping
A change to existing behaviour in examples/token\_dropping — 13 commits (3 fixs), 8 files: “KVCache SDK: batch and stream interface (\#3950)”; “lint: convert token dropping experiment logging to %-format (\#5276)”; “\[Bugfix\]\[Doc\] examples/token\_dropping: support interleaved RoPE in rerotate\_k\_cache (\#6054)”; and 10 more (refs \#3950, \#5276, \#6054, \#6365, \#5275, …).
_examples/token\dropping · medium confidence · unverified
14 commits (1 fix) modifying .buildkite/k3\_tests/amd
A change to existing behaviour in .buildkite/k3\_tests/amd — 14 commits (1 fix), 9 files: “\[MP\]\[ROCm\] VMM KV-cache IPC on ROCm through rocm.bindings (\#6626)”; “build(multiprocess): add gRPC protobuf and test foundation (\#5066)”; “ci: pre-merge PR base before pipeline expansion (\#4769)”; and 11 more (refs \#6626, \#5066, \#4769, \#5439, \#6254, …).
_.buildkite/k3\tests/amd · medium confidence · unverified
14 commits (1 fix) modifying .buildkite/k3\_tests/xpu/unittests
A change to existing behaviour in .buildkite/k3\_tests/xpu/unittests — 14 commits (1 fix), 4 files: “\[Refactor\] Move mode-specific utilities out of lmcache.utils (\#6286)”; “fix(ci): correct REPO\_ROOT depth in xpu unittests run.sh (\#4964)”; “\[CI\] complete end-to-end XPU nightly workflow (\#5423)”; and 11 more (refs \#6286, \#4964, \#5423, \#6254, \#4999, …).
_.buildkite/k3\tests/xpu/unittests · medium confidence · unverified
16 commits (1 fix) modifying .buildkite/k3\_tests/multiprocess/scripts/workloads/vllm
A change to existing behaviour in .buildkite/k3\_tests/multiprocess/scripts/workloads/vllm — 16 commits (1 fix), 14 files: “\[Feat\]\[MP\] Engine-driven multi-group transfers via KVLayerGroupsManager (\#4410)”; “\[CI\]\[XPU\] Add P2P, long\_doc\_qa mp tests (\#6101)”; “\[CI\]\[XPU\] Add deterministic DeepSeek V4 HMA correctness coverage (\#6167)”; and 13 more (refs \#4410, \#6101, \#6167, \#5862, \#6258, …).
_.buildkite/k3\tests/multiprocess/scripts/workloads/vllm · medium confidence · unverified
16 commits (1 fix) modifying csrc/storage\_backends
A change to existing behaviour in csrc/storage\_backends — 16 commits (1 fix), 15 files: “\[Fix\]\[Native Connector\] Balance batch tiles (\#4333)”; “\[Feat\] Add RDMA L1 memory preregistration support for MooncakeStore L2 adapter (\#3018)”; “\[Build\] Remove hardcoded C++17 flags from PyTorch extensions (\#5564)”; and 13 more (refs \#4333, \#3018, \#5564, \#3302, \#3458, …).
_csrc/storage\backends · medium confidence · unverified
16 commits (3 fixes) modifying examples/kv\_cache\_calculator
A change to existing behaviour in examples/kv\_cache\_calculator — 16 commits (3 fixs), 5 files: “Update modelconfig.json to have more models in KV cache size calculator (\#366)”; “\[CI/Build\]: Replace linting and formatting management with pre-commit (\#691)”; “\[Bugfix\] revert change made by \#694 of kvcache calculation for deepseekV3 (\#715)”; and 13 more (refs \#366, \#691, \#694, \#715, \#1024, …).
_examples/kv\_cache\calculator · medium confidence · unverified
17 commits (1 fix) modifying .buildkite/k3\_tests/xpu/multiprocess
A change to existing behaviour in .buildkite/k3\_tests/xpu/multiprocess — 17 commits (1 fix), 3 files: “\[Feat\]\[MP\] Engine-driven multi-group transfers via KVLayerGroupsManager (\#4410)”; “\[CI\]\[XPU\] Add P2P, long\_doc\_qa mp tests (\#6101)”; “\[Bugfix\] Add missing retries to XPU multiprocess CI tests (\#6510)”; and 14 more (refs \#4410, \#6101, \#6510, \#6167, \#6102, …).
_.buildkite/k3\tests/xpu/multiprocess · medium confidence · unverified
18 commits (3 fixes) modifying csrc
A change to existing behaviour in csrc — 18 commits (3 fixs), 3 files: “\[core\]\[feat\] add NL\_X\_NB\_BSV\_BSS format for CB (\#4351)”; “\[SGLang\]\[MP\] Support SGLang MLA format in MP mode (\#4793)”; “\[MP\]\[Refactor\] Move kv\_format and gpu\_connector/utils.py to common (\#6530)”; and 15 more (refs \#4351, \#4793, \#6530, \#5748, \#4594, …).
csrc · medium confidence · unverified
18 commits (5 fixes) modifying .buildkite/scripts/multiprocessing-test
A change to existing behaviour in .buildkite/scripts/multiprocessing-test — 18 commits (5 fixs), 12 files: “ci: add vLLM end-to-end benchmark to AMD pipeline (\#4641)”; “\[Refactor\] Prepare InProcess extraction boundaries (\#6258)”; “build(multiprocess): add gRPC protobuf and test foundation (\#5066)”; and 15 more (refs \#4641, \#6258, \#5066, \#2451, \#2360, …).
.buildkite/scripts/multiprocessing-test · medium confidence · unverified
18 commits (7 fixes) modifying rust/raw\_block
A change to existing behaviour in rust/raw\_block — 18 commits (7 fixs), 2 files: “\[2/N\]\[Feat\] Add zero-copy aligned buffer odirect (\#2573)”; “\[RawBlock\] Support padded payloads in batched io\_uring put\_many (\#3949)”; “\[6/N\]\[Feat\] This PR adds io\_uring support to the Rust raw block backend. (\#2635)”; and 15 more (refs \#2573, \#3949, \#2635, \#3119, \#4697, …).
_rust/raw\block · medium confidence · unverified
2 commits (0 fixes) modifying benchmarks/ttft-estimator
A change to existing behaviour in benchmarks/ttft-estimator — 2 commits, 2 files: “\[CI\]\[Linter\] Add back strict mypy checking (\#1451)”; “\[Benchmark\]: Add a TTFT estimator/drawer (\#1389)” (refs \#1451, \#1389).
benchmarks/ttft-estimator · medium confidence · unverified
2 commits (0 fixes) modifying examples/agents
A change to existing behaviour in examples/agents — 2 commits, 1 file: “\[Agents\] Add prefix hit rate vs pool size analysis (\#1838)”; “\[Agents\] Non-prefix caching hit rate vs pool size (\#1851)” (refs \#1838, \#1851).
examples/agents · medium confidence · unverified
2 commits (0 fixes) modifying examples/dynamo\_integration
A change to existing behaviour in examples/dynamo\_integration — 2 commits, 8 files: “\[Examples\] Add Dynamo + LMCache MP integration recipe (aggregated + disaggregated) (\#3935)”; “\[Docs\] Add local and Kubernetes Dynamo integration guide (\#5257)” (refs \#3935, \#5257).
_examples/dynamo\integration · medium confidence · unverified
2 commits (0 fixes) modifying examples/kvcache\_sdk
A change to existing behaviour in examples/kvcache\_sdk — 2 commits, 2 files: “Token dropping sdk v3 (\#3820)”; “Get query tensor v2 (\#4042)” (refs \#3820, \#4042).
_examples/kvcache\sdk · medium confidence · unverified
20 commits (4 fixes) modifying csrc/sycl
A change to existing behaviour in csrc/sycl — 20 commits (4 fixs), 11 files: “\[Feat\]\[MP\] Engine-driven multi-group transfers via KVLayerGroupsManager (\#4410)”; “refactor: rename native\_storage\_ops to lmcache\_native and relocate KV-format/transfer types (\#4453)”; “xpu: pin LMCache host buffer via sycl::malloc\_host (\#4129)”; and 17 more (refs \#4410, \#4453, \#4129, \#2902, \#3673, …).
csrc/sycl · medium confidence · unverified
21 commits (3 fixes) modifying csrc/cuda
A change to existing behaviour in csrc/cuda — 21 commits (3 fixs), 27 files: “\[Perf\]\[MP\] Use 2-D copies for block-outermost layouts in the direct copy path (\#5506)”; “\[MACA\] Add self-compile build profile for MetaX GPUs (\#4606)”; “\[Refactor\] Promote blend\_v3 to blend and remove the legacy blend (\#4758)”; and 18 more (refs \#5506, \#4606, \#4758, \#6299, \#6062, …).
csrc/cuda · medium confidence · unverified
21 commits (3 fixes) modifying setup\_extensions/build\_profiles
A change to existing behaviour in setup\_extensions/build\_profiles — 21 commits (3 fixs), 10 files: “\[MACA\] Add self-compile build profile for MetaX GPUs (\#4606)”; “\[MACA\] Fix detect() exception handling and add missing triton dependency (\#4907)”; “\[Build\] Remove hardcoded C++17 flags from PyTorch extensions (\#5564)”; and 18 more (refs \#4606, \#4907, \#5564, \#4733, \#4949, …).
_setup\_extensions/build\profiles · medium confidence · unverified
22 commits (1 fix) modifying .buildkite/k3\_tests/common\_scripts
A change to existing behaviour in .buildkite/k3\_tests/common\_scripts — 22 commits (1 fix), 6 files: “\[Hotfix\]\[CI\] Unblock CI: pandas auto-heal + CUDA 12 build toolchain (\#3055)”; “Refine XPU CI filtering and discovery (\#4166)”; “\[CI\]\[RBLN\] Add a nightly rbln-serve lane and promote its verified image to PR builds (\#6157)”; and 19 more (refs \#3055, \#4166, \#6157, \#5606, \#6258, …).
_.buildkite/k3\_tests/common\scripts · medium confidence · unverified
226 commits (28 fixes) modifying (repo-wide)
A change to existing behaviour in (repo-wide) — 226 commits (28 fixs), 19 files: “\[Doc\] Reconcile the documented PR title prefixes with actual practice (\#4990)”; “\[Doc\] add badge and fix typos (\#591)”; “\[Enhancement\] Latest vllm (0.7.0) docker support (\#339)”; and 214 more (refs \#4990, \#591, \#339, \#4070, \#691, …).
(repo-wide) · low confidence · unverified
23 commits (5 fixes) modifying .buildkite/scripts
A change to existing behaviour in .buildkite/scripts — 23 commits (5 fixs), 11 files: “\[CI\] Configure device environment for AMD MP benchmark (\#4976)”; “\[CI/Build\] Add comprehensive test pipeline (\#1249)”; “ci: add vLLM end-to-end benchmark to AMD pipeline (\#4641)”; and 20 more (refs \#4976, \#1249, \#4641, \#1451, \#6258, …).
.buildkite/scripts · medium confidence · unverified
3 commits (0 fixes) modifying .buildkite/k3\_tests/multiprocess/scripts/workloads/sglang
A change to existing behaviour in .buildkite/k3\_tests/multiprocess/scripts/workloads/sglang — 3 commits, 2 files: “\[CI\]\[SGLang\] Add integration test for kimi linear test (\#5862)”; “\[CI\]\[SGLang\] Preserve Kimi chunk checkpoints (\#6645)”; “\[CI\]\[DSv4\] optimize the CI execution time by reducing the layer (\#6143)” (refs \#5862, \#6645, \#6143).
_.buildkite/k3\tests/multiprocess/scripts/workloads/sglang · medium confidence · unverified
3 commits (0 fixes) modifying examples/kv\_cache\_reuse
A change to existing behaviour in examples/kv\_cache\_reuse — 3 commits, 4 files: “\[Refactor\] Remove in-tree InProcess implementation (\#6254)”; “\[Misc\] Rename experimental to v1 and refactor examples (\#704)”; “\[Docs\] Add SGLang-to-vLLM KV cache sharing example (\#4130)” (refs \#6254, \#704, \#4130).
_examples/kv\_cache\reuse · medium confidence · unverified
3 commits (1 fix) modifying .buildkite/coordinator\_controllers
A change to existing behaviour in .buildkite/coordinator\_controllers — 3 commits (1 fix), 2 files: “\[CI\] Add the coordinator-controllers compatibility pipeline (\#5243)”; “\[MP\] Test real MP servers against the coordinator end to end (\#5519)”; “\[Bugfix\]\[Coordinator\] Serve /cache/delete from the eviction controller (\#5918)” (refs \#5243, \#5519, \#5918).
_.buildkite/coordinator\controllers · medium confidence · unverified
3 commits (1 fix) modifying csrc/storage\_backends/redis
A change to existing behaviour in csrc/storage\_backends/redis — 3 commits (1 fix), 3 files: “\[Southbound\]: Create a Native Protocol for MP and non-MP (\#2642)”; “fix: bound RESP authentication reply length (\#6108)”; “\[Feat\]: Add eviction to L2 Native Backend (\#2939)” (refs \#2642, \#6108, \#2939).
_csrc/storage\backends/redis · medium confidence · unverified
30 commits (3 fixes) modifying lmcache/v1/multiprocess/modules/blend
A change to existing behaviour in lmcache/v1/multiprocess/modules/blend — 30 commits (3 fixs), 9 files: “\[cb\] skip rope-less engine-group (\#5080)”; “\[Cacheblend\] Scope coordinator blend matches to the requester's namespace (\#4806)”; “\[2/N\] Updating StorageManager.submit\_prefetch\_request interface (\#5245)”; and 27 more (refs \#5080, \#4806, \#5245, \#6572, \#4953, …).
lmcache/v1/multiprocess/modules/blend · medium confidence · unverified
34 commits (7 fixes) modifying operator
A change to existing behaviour in operator — 34 commits (7 fixs), 162 files: “\[Operator\] CacheBlend webhook: support namespace-qualified engine refs for cross-namespace binds (\#4024)”; “\[Operator\] Add configurable hostNetwork field to LMCacheEngine CRD (\#3849)”; “\[Operator\] Add PD disaggregation to CacheBlendEngine (\#4932)”; and 31 more (refs \#4024, \#3849, \#4932, \#4758, \#3496, …).
operator · medium confidence · unverified
35 commits (3 fixes) modifying .buildkite/k3\_tests/multiprocess/scripts
A change to existing behaviour in .buildkite/k3\_tests/multiprocess/scripts — 35 commits (3 fixs), 7 files: “\[CI\]\[MP\] Add DeepSeek-V4-Flash L1 correctness test (4-GPU) (\#4442)”; “\[CI/CD\] Add CUDA engine-driven MP mode for gsm8k to prevent functional and accuracy regressions (\#3860)”; “ci: add vLLM end-to-end benchmark to AMD pipeline (\#4641)”; and 32 more (refs \#4442, \#3860, \#4641, \#2914, \#5862, …).
_.buildkite/k3\tests/multiprocess/scripts · medium confidence · unverified
39 commits (8 fixes) modifying .buildkite/k3\_harness
A change to existing behaviour in .buildkite/k3\_harness — 39 commits (8 fixs), 16 files: “Cleanup/remove blend v2 ci (\#3541)”; “\[CI\] Fail fast on missing CPU runtime dependencies (\#5072)”; “\[Hotfix\]\[CI\] Unblock CI: pandas auto-heal + CUDA 12 build toolchain (\#3055)”; and 36 more (refs \#3541, \#5072, \#3055, \#4353, \#6157, …).
_.buildkite/k3\harness · medium confidence · unverified
4 commits (0 fixes) modifying .buildkite/k3\_tests/rbln
A change to existing behaviour in .buildkite/k3\_tests/rbln — 4 commits, 12 files: “\[CI\]\[RBLN\] Add a nightly rbln-serve lane and promote its verified image to PR builds (\#6157)”; “\[RBLN\] Support vLLM-RBLN's blocks-first KV cache layout (\#5748)”; “\[CI\] Remove duplicate post-merge validation (\#6550)”; and 1 more (refs \#6157, \#5748, \#6550, \#5543).
_.buildkite/k3\tests/rbln · medium confidence · unverified
4 commits (0 fixes) modifying benchmarks/microbenchmark
A change to existing behaviour in benchmarks/microbenchmark — 4 commits, 2 files: “refactor: rename native\_storage\_ops to lmcache\_native and relocate KV-format/transfer types (\#4453)”; “\[Prefetch only sliding window 1/N\] Add bitmap operations (\#3745)”; “\[Perf\]\[MP\] Avoid full-bucket snapshots in isolated LRU victim selection (\#6393)”; and 1 more (refs \#4453, \#3745, \#6393, \#5356).
benchmarks/microbenchmark · medium confidence · unverified
4 commits (0 fixes) modifying csrc/storage\_backends/mooncake
A change to existing behaviour in csrc/storage\_backends/mooncake — 4 commits, 3 files: “\[Feat\] Add RDMA L1 memory preregistration support for MooncakeStore L2 adapter (\#3018)”; “\[MP\]: Add batch operations to Mooncake L2 adapter (\#3172)”; “\[MP\]: Add per-operation dedicated worker pools to Mooncake L2 connector (\#3227)”; and 1 more (refs \#3018, \#3172, \#3227, \#2911).
_csrc/storage\backends/mooncake · medium confidence · unverified
4 commits (0 fixes) modifying examples/lmc\_external\_native\_connector
A change to existing behaviour in examples/lmc\_external\_native\_connector — 4 commits, 6 files: “\[Build\] Remove hardcoded C++17 flags from PyTorch extensions (\#5564)”; “\[MP\]\[Feat\] Add cache\_salt to ObjectKey for cache isolation (\#3042)”; “\[MP\] Refactor l2 plugin framework to support dynamic load third-party native l2 connector (\#2851)”; and 1 more (refs \#5564, \#3042, \#2851, \#2939).
_examples/lmc\_external\_native\connector · medium confidence · unverified
4 commits (1 fix) modifying tools
A change to existing behaviour in tools — 4 commits (1 fix), 3 files: “\[doc\] Fix chinese wheel translations (\#4714)”; “add Chinese translation pipeline (\#3265)”; “\[chore\]: Change code headers to SPDX License headers (\#1145)”; and 1 more (refs \#4714, \#3265, \#1145, \#6342).
tools · medium confidence · unverified
4 commits (2 fixes) modifying csrc/storage\_backends/hf3fs
A change to existing behaviour in csrc/storage\_backends/hf3fs — 4 commits (2 fixs), 5 files: “fix: Use temporary files for atomic HF3FS writes (\#5808)”; “\[Core\]\[HF3FS\] Add shard\_dirs option to spread stores across chunk-hash subdirectories (\#6261)”; “\[Bugfix\]\[MP\] Confirm HF3FS key-buffer misses on 3FS (\#6002)”; and 1 more (refs \#5808, \#6261, \#6002, \#5131).
_csrc/storage\backends/hf3fs · medium confidence · unverified
5 commits (0 fixes) modifying examples/serde
A change to existing behaviour in examples/serde — 5 commits, 5 files: “\[Refactor\] Group MP server & coordinator HTTP APIs into endpoint groups (\#3948)”; “\[Serde\] AES-GCM (\#4235)”; “Add TurboQuant serde support for LMCache L2 adapters (\#3193)”; and 2 more (refs \#3948, \#4235, \#3193, \#3185, \#3140).
examples/serde · medium confidence · unverified
5 commits (0 fixes) modifying examples/token\_dropping/rkv\_variants
A change to existing behaviour in examples/token\_dropping/rkv\_variants — 5 commits, 3 files: “\[Example\] Tune R-KV token-dropping default config and add Qwen3-1.7B Colab demo (\#4500)”; “\[Examples\] token\_dropping: pass --supported-transfer-mode auto to LMCache server (\#4601)”; “\[Examples\] Add an R-KV token dropping and benchmarking notebook (\#4252)”; and 2 more (refs \#4500, \#4601, \#4252, \#5277, \#5793).
_examples/token\_dropping/rkv\variants · medium confidence · unverified
5 commits (0 fixes) modifying setup\_extensions/storage\_backend\_profiles
A change to existing behaviour in setup\_extensions/storage\_backend\_profiles — 5 commits, 5 files: “\[Build\] Remove hardcoded C++17 flags from PyTorch extensions (\#5564)”; “Add optional native Aerospike L2 backend (BUILD\_AEROSPIKE) (\#3458)”; “refactor(build): extract extension build into profile-based architecture (\#3642)”; and 2 more (refs \#5564, \#3458, \#3642, \#4865, \#5131).
_setup\_extensions/storage\_backend\profiles · medium confidence · unverified
5 commits (1 fix) modifying benchmarks/multi\_round\_qa
A change to existing behaviour in benchmarks/multi\_round\_qa — 5 commits (1 fix), 4 files: “\[CI\]\[Linter\] Add back strict mypy checking (\#1451)”; “Convert multi-round QA logging to lazy formatting (\#5229)”; “\[Doc\] Drop --disable-log-requests from vllm serve examples (\#5814)”; and 2 more (refs \#1451, \#5229, \#5814, \#1448, \#2199).
_benchmarks/multi\_round\qa · medium confidence · unverified
5 commits (2 fixes) modifying examples/p2p
A change to existing behaviour in examples/p2p — 5 commits (2 fixs), 2 files: “update p2p example (\#3781)”; “docs: use scoped coordinator bind addresses (\#6609)”; “\[Enhancement\] Support P2P KV Cache sharing (\#371)”; and 2 more (refs \#3781, \#6609, \#371, \#372, \#375).
examples/p2p · medium confidence · unverified
57 commits (7 fixes) modifying .buildkite/k3\_tests/multiprocess
A change to existing behaviour in .buildkite/k3\_tests/multiprocess — 57 commits (7 fixs), 8 files: “\[CI\]\[MP\] Add DeepSeek-V4-Flash L1 correctness test (4-GPU) (\#4442)”; “\[CI/CD\] Add CUDA engine-driven MP mode for gsm8k to prevent functional and accuracy regressions (\#3860)”; “\[good-first-issue\] tests: keep L2 long\_doc\_qa metrics diagnostics when thresholds fail (\#5404) (\#5413)”; and 54 more (refs \#4442, \#3860, \#5404, \#5413, \#3489, …).
_.buildkite/k3\tests/multiprocess · medium confidence · unverified
66 commits (13 fixes) modifying docker
A change to existing behaviour in docker — 66 commits (13 fixs), 11 files: “\[CI\] cu129 images: pin vllm to the cu129 index (drop unsafe-best-match) (\#3621)”; “\[Enhancement\] Latest vllm (0.7.0) docker support (\#339)”; “\[Build\] add SM120 for wheel build (\#2873)”; and 63 more (refs \#3621, \#339, \#2873, \#3101, \#5590, …).
docker · medium confidence · unverified
7 commits (0 fixes) modifying examples/lmc\_external\_l2\_adapter
A change to existing behaviour in examples/lmc\_external\_l2\_adapter — 7 commits, 4 files: “refactor: rename native\_storage\_ops to lmcache\_native and relocate KV-format/transfer types (\#4453)”; “\[HMA\] change L2 adapter signatures (\#4407)”; “\[Core\] Add tags for L1 managers and L2 adapters for affinity and prefetch filtering (\#5919)”; and 4 more (refs \#4453, \#4407, \#5919, \#3363, \#2715, …).
_examples/lmc\_external\_l2\adapter · medium confidence · unverified
7 commits (1 fix) modifying .buildkite/k3\_tests/xpu
A change to existing behaviour in .buildkite/k3\_tests/xpu — 7 commits (1 fix), 5 files: “\[CI\] complete end-to-end XPU nightly workflow (\#5423)”; “Fix XPU nightly compiler patch version selection (\#6603)”; “Refine k3 tests path filtering (\#4177)”; and 4 more (refs \#5423, \#6603, \#4177, \#6096, \#6550, …).
_.buildkite/k3\tests/xpu · medium confidence · unverified
7 commits (1 fix) modifying csrc/storage\_backends/fs
A change to existing behaviour in csrc/storage\_backends/fs — 7 commits (1 fix), 3 files: “\[MP\]\[Feat\] Add cache\_salt to ObjectKey for cache isolation (\#3042)”; “\[MP\] Refactor l2 plugin framework to support dynamic load third-party native l2 connector (\#2851)”; “Introduce native fs connector (\#2779)”; and 4 more (refs \#3042, \#2851, \#2779, \#5078, \#3916, …).
_csrc/storage\backends/fs · medium confidence · unverified
8 commits (0 fixes) modifying .buildkite/metax
A change to existing behaviour in .buildkite/metax — 8 commits, 6 files: “\[Refactor\] Move cache\_controller under inprocess/v1 (\#5970)”; “\[MACA\] Add Buildkite CI pipeline for MetaX MACA hardware (\#4949)”; “\[Refactor\] Remove in-tree InProcess implementation (\#6254)”; and 5 more (refs \#5970, \#4949, \#6254, \#6550, \#6007, …).
.buildkite/metax · medium confidence · unverified
8 commits (1 fix) modifying examples/observability
A change to existing behaviour in examples/observability — 8 commits (1 fix), 6 files: “\[observability\] blend server trace sub-spans + V3 hit-rate breakdown (\#3607)”; “\[observability\] Keep the APC-covered prefix out of lookup hit counters (\#5836)”; “\[Refactor\] Promote blend\_v3 to blend and remove the legacy blend (\#4758)”; and 5 more (refs \#3607, \#5836, \#4758, \#3033, \#3175, …).
examples/observability · medium confidence · unverified
9 commits (0 fixes) modifying .buildkite/k3\_tests/blend
A change to existing behaviour in .buildkite/k3\_tests/blend — 9 commits, 5 files: “Cleanup/remove blend v2 ci (\#3541)”; “ci: add MUSA self-hosted smoke pipeline (\#4774)”; “\[ci\] resolve GH\_TOKEN for blend plugin clone from Buildkite secret (\#4175)”; and 6 more (refs \#3541, \#4774, \#4175, \#2993, \#3113, …).
_.buildkite/k3\tests/blend · medium confidence · unverified
9 commits (0 fixes) modifying .buildkite/k3\_tests/multiprocess/scripts/engines
A change to existing behaviour in .buildkite/k3\_tests/multiprocess/scripts/engines — 9 commits, 3 files: “\[CI\]\[XPU\] Add deterministic DeepSeek V4 HMA correctness coverage (\#6167)”; “\[Refactor\] Refactor multi process integration test (\#5214)”; “\[SGLang\] Support engine driven (\#5549)”; and 6 more (refs \#6167, \#5214, \#5549, \#5298, \#6612, …).
_.buildkite/k3\tests/multiprocess/scripts/engines · medium confidence · unverified
9 commits (0 fixes) modifying .buildkite/k3\_tests/musa
A change to existing behaviour in .buildkite/k3\_tests/musa — 9 commits, 8 files: “ci: add MUSA self-hosted smoke pipeline (\#4774)”; “\[Refactor\] Prepare InProcess extraction boundaries (\#6258)”; “\[Refactor\] Remove in-tree InProcess implementation (\#6254)”; and 6 more (refs \#4774, \#6258, \#6254, \#5610, \#6550, …).
_.buildkite/k3\tests/musa · medium confidence · unverified
9 commits (1 fix) modifying examples/online\_session
A change to existing behaviour in examples/online\_session — 9 commits (1 fix), 5 files: “Add and organize examples (\#128)”; “\[CI/Build\]: Replace linting and formatting management with pre-commit (\#691)”; “\[Refactor\]: Remove redundant files (\#719)”; and 6 more (refs \#128, \#691, \#719, \#138, \#704, …).
_examples/online\session · medium confidence · unverified
Test coverage
1 commit adding/updating tests in .buildkite/k3\_tests/multiprocess/scripts/tests; 1 commit adding/updating tests in tests/cli/commands/bench/quality\_bench; 1 commit adding/updating tests in tests/skills; 1 commit adding/updating tests in tests/v1/platform/devices/supa; 1 commit adding/updating tests in tests/v1/platform/devices/xpu; 1 commit adding/updating tests in tests/v1/storage\_backend; 10 commits adding/updating tests in tests/v1/lazy\_offload; 11 commits adding/updating tests in tests/cli/commands/bench/engine\_bench; 13 commits adding/updating tests in tests/cli/commands/trace; 13 commits adding/updating tests in tests/v1/platform/devices/cuda; 14 commits adding/updating tests in tests/cli/commands/bench/engine\_bench/workloads; 14 commits adding/updating tests in tests/v1/platform/devices/musa; 16 commits adding/updating tests in tests/v1/mp\_observability/subscribers/tracing; 16 commits adding/updating tests in tests/v1/mp\_observability/trace; 18 commits adding/updating tests in tests/v1/distributed/l2\_adapters; 18 commits adding/updating tests in tests/v1/mp\_observability; 180 commits adding/updating tests in tests/v1/distributed; 2 commits adding/updating tests in tests/security; 2 commits adding/updating tests in tests/v1/distributed/memory\_manager; 23 commits adding/updating tests in tests/cli; 23 commits adding/updating tests in tests/v1/distributed/serde; 23 commits adding/updating tests in tests/v1/multiprocess/http\_apis; 242 commits adding/updating tests in tests/v1; 28 commits adding/updating tests in tests/cli/commands; 29 commits adding/updating tests in tests/v1/mp\_observability/subscribers/metrics; 292 commits adding/updating tests in tests/v1/multiprocess; 3 commits adding/updating tests in tests/cli/commands/bench/engine\_bench/interactive; 3 commits adding/updating tests in tests/cli/commands/query; 3 commits adding/updating tests in tests/v1/platform/devices/cpu; 38 commits adding/updating tests in tests/v1/platform; 39 commits adding/updating tests in tests/v1/gpu\_connector; 4 commits adding/updating tests in tests/v1/multiprocess/transport; 4 commits adding/updating tests in tests/v1/platform/devices/neuron; 47 commits adding/updating tests in tests/cli/commands/bench; 5 commits adding/updating tests in tests/ci; 5 commits adding/updating tests in tests/v1/cli; 5 commits adding/updating tests in tests/v1/client; 5 commits adding/updating tests in tests/v1/distributed/raw\_block; 5 commits adding/updating tests in tests/v1/platform/devices/npu; 5 commits adding/updating tests in tests/v1/plugin; 6 commits adding/updating tests in tests/benchmarks; 6 commits adding/updating tests in tests/cli/commands/bench/engine\_bench/quality; 6 commits adding/updating tests in tests/lmcache\_frontend; 6 commits adding/updating tests in tests/sdk; 6 commits adding/updating tests in tests/v1/memory\_orchestrator; 6 commits adding/updating tests in tests/v1/platform/devices/mlu; 69 commits adding/updating tests in tests/v1/mp\_coordinator; 7 commits adding/updating tests in tests/cli/commands/bench/l2\_adapter\_bench; 7 commits adding/updating tests in tests/tools; 8 commits adding/updating tests in tests/v1/distributed/transfer\_channel; 8 commits adding/updating tests in tests/v1/mp\_coordinator/persistence; 8 commits adding/updating tests in tests/v1/platform/devices/rbln; 9 commits adding/updating tests in tests/v1/mp\_observability/subscribers/logging; 91 commits adding/updating tests in tests.
Dependencies
139 commits updating dependencies (11 manifests)
A dependency / build maintenance change in (dependencies) — 139 commits (19 fixs), 11 files: “\[good-first-issue\] Convert storage backend logs to lazy %-format (\#5262)”; “Buildkite integration (\#40)”; “\[Enhancement\] Latest vllm (0.7.0) docker support (\#339)”; and 136 more (refs \#5262, \#40, \#339, \#5081, \#691, …).
(dependencies) · high confidence · unverified
Written by cca.canine.dev from the codebase's own history, inside the signed delivery this page is composed from.
How this codebase got here
Baseline
- First survey — no prior run to compare against. CAI 59.1.
Lenses
- Code Health 67.6
- Architecture 92.7
- Maturity 71.8
- Readiness 77.4
- Security 79.8
- Accessibility 43.4
- Performance 85.0
Changes since last survey
- 300 commits — 208 feature/other, 92 fixes
By area
- lmcache/v1 — 72 commits
- tests/v1 — 42 commits
- .buildkite/k3_tests — 23 commits
- docs/design — 22 commits
- docs/source — 21 commits
- lmcache/cli — 20 commits
- .github/workflows — 16 commits
- lmcache/integration — 13 commits
- (root) — 11 commits
- lmcache/inprocess — 11 commits
- .github/scripts — 5 commits
- csrc/cuda — 5 commits
- .claude/skills — 4 commits
- tests/inprocess — 4 commits
- csrc/storage_backends — 3 commits
- docker/Dockerfile — 3 commits
- tests/cli — 3 commits
- docker/Dockerfile.payload — 2 commits
- lmcache/sdk — 2 commits
- .buildkite/k3_harness — 1 commit
Notable commits
- fix: Fix HF3FS test mixed line endings (#6137)
- fix: Fix XPU nightly compiler patch version selection (#6603)
- fix: Fix server CLI help test with installed LMCache wheel (#5975)
- fix: [Bugfix] Add missing retries to XPU multiprocess CI tests (#6510)
- fix: [Bugfix] Avoid scheduling receiver cleanup on a stopped event loop (#6116)
- fix: [Bugfix] Delete NIXL static file-pool scratch files on close (#6369)
- fix: [Bugfix] Fall back to buffered I/O when an fs L2 O_DIRECT buffer is unaligned or refused (#6158)
- fix: [Bugfix] Handle cached steps without legacy resume IDs in the vLLM MP connector (#6457)
- fix: [Bugfix] Load the Mooncake SDK only when its backend is selected (#6134)
- fix: [Bugfix] Preserve chunk prefixes when touching prefetched keys (#6551)
- fix: [Bugfix] Release StorageManager refs when a backend raises in batched_put (#5940)
- fix: [Bugfix] S3 L2 adapter: bounds-check GET bodies and treat a wrong-sized object as a miss (#6015)
- fix: [Bugfix] print actual stored tokens (#6188)
- fix: [Bugfix][Build] Keep cu129 wheels on Torch 2.13 (#6529)
- fix: [Bugfix][CB] Fingerprint a prompt's first chunk too (#6228)
- fix: [Bugfix][CLI] Fail L2 benchmarks when all measured rounds time out (#6524)
- fix: [Bugfix][CLI] Fall back from chat only on a missing-template 400 (#6563)
- fix: [Bugfix][CLI] Handle failures while reading HTTP 503 bodies (#6306)
- fix: [Bugfix][CLI] Handle incomplete HTTP response bodies (#5902)
- fix: [Bugfix][CLI] Isolate profiling failure tests from host deps (#6350)
- …and 280 more
Architecture
- 0 containers · 1 bounded contexts · 0 dependency edges (baseline)
Written by cca.canine.dev from the codebase's own history, inside the signed delivery this page is composed from.
Survey your own repository
LMCache/LMCache was measured the same way every project in this corpus was: the same rubric, at a pinned commit, with the result published in full. Point a surveyor at a repository you know and see whether you agree with it.
About this page
- The score is its most recent published measurement, taken on 16 November 2026 at a pinned commit. It is not a live figure and does not change until the project is measured again.
- Measured at commit c0572702cd2d70216776ab2041eaa88f6126a60a — the exact code this score is about.
- Scored under rubric-2026.11.4 — the same rubric and the same method as every other entry in this index.
- Measured by Canine Code Analyzer (cca.canine.dev) using cca measure-2026.11.83+preprod-a489942cf94b.