AlexsJones/llmfit
48.0
Weak · 14 November 2026
71.2k
lines of production code
Rust
with Python, JavaScript
8
measurements over time
What this system is
Features
Add embedded React web dashboard with Vite configuration
The llmfit-web directory now contains the source code for a React-based web dashboard, including the entry point (index.html), Vite configuration (vite.config.js), and documentation (README.md). The configuration sets up a development server on port 5173 and a preview server on port 8787, both proxying API requests to the backend at 127.0.0.1:8787. It also includes security measures like DNS rebinding protection via allowed hosts and test environment setup using jsdom.
llmfit-web · high confidence
Embedded community benchmarks and hardware profiles
The application now bundles community-submitted benchmark results and hardware profiles directly into the binary at build time. This allows users to access aggregated community data and hardware-specific configurations without requiring network fetches or separate CI steps, ensuring that merged contributions are immediately available to all users in the next release.
llmfit-core · high confidence
Initial Tauri desktop application shell with system and model fit detection
The desktop application entry point is established using Tauri, introducing a new main module that exposes core analysis capabilities to the UI layer. This includes commands to detect local hardware specifications (CPU, RAM, GPU details) and to retrieve a ranked list of compatible models based on system constraints, providing detailed fit metrics such as memory requirements, estimated performance, and supported inference runtimes. Additionally, the app integrates with Ollama to allow users to pull models directly from the desktop interface, with commands to start downloads and poll their real-time progress status.
llmfit-desktop/src · high confidence
Initial project scaffolding and documentation
This change establishes the foundational structure of the llmfit project. It introduces the MIT License, a Code of Conduct, and a Contributing guide to standardize community interaction. The repository is configured with a Makefile for build/test workflows, a Dockerfile for containerized deployment, and a .dockerignore to optimize build contexts. Documentation is expanded with a comprehensive API guide (API.md), a model catalog (MODELS.md), and localized READMEs for Chinese and Japanese speakers. Additionally, release automation is initialized via .release-please-manifest.json, and repository hygiene is improved with .gitattributes and a CNAME for web hosting.
(repo-wide) · high confidence
Introduce Tauri-based desktop application with WebView2 bootstrapper
The llmfit-desktop location now implements a native desktop application using the Tauri framework, replacing previous packaging methods. This change introduces a build configuration (build.rs) and a Tauri configuration file (tauri.conf.json) that defines the app as 'llmfit' (version 0.4.8) with a 1200x800 resizable window. A key user-facing improvement is the configuration for Windows to download the WebView2 bootstrapper, ensuring the app can run on systems without WebView2 pre-installed. The app also enforces a strict Content Security Policy (CSP) for security.
llmfit-desktop · high confidence
Introduce desktop UI with system specs, model compatibility analysis, and Chinese localization
The desktop application now includes a dedicated user interface that displays real-time system specifications (CPU, RAM, GPU, and unified memory) and provides a detailed compatibility analysis for local LLMs. Users can view fit levels, estimated performance, and runtime modes in a sortable table, and access a detailed modal for each model that includes memory usage visualization and installation status. A new language selector allows switching between English and Simplified Chinese, and the interface supports downloading models directly via Ollama when available.
llmfit-desktop/ui · high confidence
New TUI application with embedded web dashboard and theme support
The llmfit-tui package introduces a new terminal user interface and an embedded web dashboard. The TUI now supports 10 color themes (including Catppuccin variants) which are persisted to the user's config directory. The embedded web dashboard is built from the llmfit-web frontend assets during compilation, with a fallback placeholder page if assets are missing. The application also includes a new download history feature that tracks recent model downloads, and a filter configuration system that persists user filter preferences across sessions.
llmfit-tui/src · high confidence
New application icon and demo recording added to assets
The assets directory now includes a new SVG icon (\assets/icon.svg\) featuring a chip and neural network design, as well as a new demo recording script (\assets/demo.tape\) that defines a reproducible sequence for generating a README GIF. These additions provide visual branding and a standardized demonstration of the tool's interface for documentation purposes.
assets · high confidence
New maintenance and validation scripts for model data and CI
This change introduces a suite of new scripts in the \scripts/\ directory to support model database maintenance, data validation, and CI integration. \scrape\_hf\_models.py\ is updated to support parallel fetching (\--threads\), pagination, and rate-limit handling for Hugging Face. New scripts include \scrape\_benchmarks.py\ to cache hardware benchmark data, \scrape\_docker\_models.py\ to map Hugging Face models to Docker Model Runner tags, and \update\_models.sh\ to orchestrate scraping, JSON validation, and binary rebuilding. Validation scripts \validate\_community\_benchmarks.py\ and \validate\_generation\_scoring.py\ enforce schema and scoring logic for community submissions and model quality. \verify\_models.py\ checks the availability of Hugging Face models and Ollama tags. Finally, \test\_api.py\ provides local API validation for the \llmfit serve\ endpoint, and \install-openclaw-skill.sh\ automates the installation of the \llmfit-advisor\ skill for OpenClaw.
scripts · high confidence
Removals
Removal of legacy CLI and TUI display logic
The \src\ directory has removed the previous implementation of the command-line interface and terminal user interface, including the hardware detection, model fit analysis, and display modules. This change eliminates the old table-based output and interactive TUI components, indicating a shift in how the application presents system specifications and model compatibility information to the user.
src · high confidence
Behavioural changes
3 commits (1 fix) modifying llmfit-tui
A change to existing behaviour in llmfit-tui — 3 commits (1 fix), 1 file: “feat(dashboard): ship embedded web UI and auto-start it from CLI”; “chore: updated fmt”; “fix(build): give the Windows binary an 8 MB main-thread stack (\#1198)” (refs \#1198).
llmfit-tui · medium confidence · unverified
Enforce Rust code formatting on push
A new pre-push git hook has been added to automatically check Rust code formatting before changes are pushed to the remote repository. The hook runs \cargo fmt --check\ to verify that the codebase adheres to the standard Rust formatting style; if formatting issues are detected, the push is blocked with an error message instructing the user to run \cargo fmt\ to fix them.
.githooks · high confidence
Python package structure and build system reorganized
The llmfit-python package has been restructured to use a custom Hatchling build hook that injects the pre-compiled Rust binary into the wheel, ensuring the CLI is correctly installed and version-matched. This change introduces a new Makefile for development tasks (formatting, linting, testing) and adds a uv.lock file to manage Python dependencies, while also adding a symlink for the LICENSE file and a test suite to verify binary availability and versioning.
llmfit-python · high confidence
Web UI restructured with new components, state management, and comparison view
The web interface has been refactored from a single-page component into a modular architecture using React Contexts (Filter, Model, I18n) and custom hooks. This change introduces a side-by-side model comparison view (up to 5 models), a hardware simulation panel for estimating fit on different system specs, and a detailed model diagnostics panel with plan estimation. The UI now supports 10 color themes and Chinese (zh-CN) localization, while the API layer has been updated to accept runtime and model parameters for plan estimates and simulation data.
llmfit-web/src · high confidence
Fixes
283 commits (143 fixes) fixing llmfit-core/src
A fix in llmfit-core/src — 283 commits (143 fixs), 18 files.
llmfit-core/src · medium confidence · unverified
Test coverage
Added CLI integration smoke tests for hardware profiles, storage planning, and macOS GPU detection; Added Docker Compose integration tests for the application stack; Added nvidia-smi parser test fixtures; Added sysfs test fixtures for GPU VRAM and vendor scenarios; Added validation tests for estimator accuracy, hardware profiles, ONNX catalog, and model schema.
Dependencies
Project restructured into a multi-crate workspace with new desktop and web interfaces
The repository has been reorganized from a single binary into a Rust workspace containing \llmfit-core\ (shared library), \llmfit-tui\ (terminal interface), and \llmfit-desktop\ (Tauri-based macOS app), alongside a new \llmfit-web\ frontend. This structural change introduces several dependency updates: the Rust codebase now uses \ureq\ 3 (upgraded from \ureq\ 2), \clap\ 4.6, \ratatui\ 0.30, and \sysinfo\ 0.39, while the web interface adds React 18 and Vite 5. The core library also adds \objc2-metal\ for macOS GPU memory detection and \schemars\ for JSON schema generation.
(dependencies) · high confidence
Written by cca.canine.dev from the codebase's own history, inside the signed delivery this page is composed from.
How this codebase got here
Score
- CAI 46 → 48 (+2.0)
- Rubric changed (rubric-2026.10.5 → rubric-2026.11.4) — scores are not directly comparable.
Lenses
- Code Health 49 → 49 (+0.5)
- Architecture 99 → 96 (-3.0)
- Maturity 66 → 68 (+1.8)
- Readiness 55 → 56 (+0.2)
- Security 62 → 64 (+2.1)
- Accessibility 34 → 37 (+3.7)
- Performance 89 → 89 (+0.0)
Resolved (80)
- Duplicated block (10 lines × 2) (llmfit-tui/src/tui_ui.rs)
- Duplicated block (11–12 lines × 2) (llmfit-tui/src/display.rs)
- Duplicated block (12–41 lines × 2) (scripts/scrape_hf_models.py)
- Duplicated block (13 lines × 2) (llmfit-core/src/hardware.rs)
- Duplicated block (13 lines × 2) (llmfit-tui/src/display.rs)
- Duplicated block (13 lines × 2) (scripts/verify_models.py)
- Duplicated block (14 lines × 6) (llmfit-tui/src/tui_ui.rs)
- Duplicated block (20–26 lines × 3) (llmfit-core/src/models.rs)
- Duplicated block (37 lines × 2) (llmfit-tui/src/main.rs)
- Duplicated block (3–7 lines × 6) (llmfit-tui/src/tui_ui.rs)
- Duplicated block (5 lines × 2) (llmfit-core/src/quality.rs)
- Duplicated block (5 lines × 2) (llmfit-tui/src/tui_ui.rs)
- Duplicated block (5 lines × 2) (llmfit-tui/src/tui_ui.rs)
- Duplicated block (5 lines × 7) (llmfit-tui/src/tui_ui.rs)
- Duplicated block (55–56 lines × 2) (llmfit-tui/src/main.rs)
- Duplicated block (6 lines × 2) (llmfit-tui/src/tui_app.rs)
- Duplicated block (6 lines × 8) (llmfit-tui/src/tui_ui.rs)
- Duplicated block (7 lines × 3) (llmfit-core/src/hardware.rs)
- Duplicated block (7 lines × 7) (llmfit-tui/src/tui_ui.rs)
- Duplicated block (8 lines × 2) (llmfit-core/src/hardware.rs)
- …and 60 more
New (84)
- Capability::infer (cognitive 17) (llmfit-core/src/models.rs)
- ClassTooLong: ModelFit (llmfit-core/src/fit.rs)
- Duplicated block (10 lines × 8) (llmfit-tui/src/tui_ui.rs)
- Duplicated block (11 lines × 2) (llmfit-core/src/providers.rs)
- Duplicated block (11 lines × 2) (llmfit-tui/src/tui_ui.rs)
- Duplicated block (11–12 lines × 2) (llmfit-tui/src/display.rs)
- Duplicated block (13 lines × 2) (llmfit-core/src/hardware.rs)
- Duplicated block (14 lines × 6) (llmfit-tui/src/tui_ui.rs)
- Duplicated block (15 lines × 2) (llmfit-core/src/quality.rs)
- Duplicated block (3–7 lines × 6) (llmfit-tui/src/tui_ui.rs)
- Duplicated block (5 lines × 2) (llmfit-tui/src/tui_ui.rs)
- Duplicated block (5 lines × 4) (llmfit-tui/src/tui_ui.rs)
- Duplicated block (5 lines × 7) (llmfit-tui/src/tui_ui.rs)
- Duplicated block (6 lines × 2) (llmfit-tui/src/tui_app.rs)
- Duplicated block (7 lines × 2) (llmfit-tui/src/mcp_server.rs)
- Duplicated block (7 lines × 2) (llmfit-tui/src/tui_ui.rs)
- Duplicated block (7 lines × 4) (llmfit-tui/src/tui_ui.rs)
- Duplicated block (7 lines × 7) (llmfit-tui/src/tui_ui.rs)
- Duplicated block (7–8 lines × 8) (llmfit-tui/src/tui_ui.rs)
- Duplicated block (8 lines × 2) (llmfit-core/src/share.rs)
- …and 64 more
Changes since last survey
- 94 commits — 43 feature/other, 51 fixes
By area
- llmfit-core/src — 39 commits
- llmfit-tui/src — 19 commits
- (root) — 13 commits
- llmfit-core/data — 13 commits
- llmfit-web/src — 2 commits
- scripts/scrape_hf_models.py — 2 commits
- (repo) — 1 commit
- .github/workflows — 1 commit
- docs/cluster.md — 1 commit
- docs/tui.md — 1 commit
- llmfit-core/tests — 1 commit
- llmfit-tui/build.rs — 1 commit
Notable commits
- fix: fix(build): give the Windows binary an 8 MB main-thread stack (#1198)
- fix: fix(cli): honor --ray-url on cluster init, apply hardware overrides to cluster specs, hard-fail forced --cluster on load failure
- fix: fix(cli): let --memory resolve zero-VRAM clusters; reject --profile with --cluster
- fix: fix(cli): match every word of a multi-word search (#1188)
- fix: fix(cli): refuse cluster specs with GPUs but unset per-GPU VRAM
- fix: fix(cli): return structured JSON errors from plan, concurrency and claim (#1191)
- fix: fix(cluster): adapt to GpuInfo and HardwareOverrides fields added on main
- fix: fix(cluster): consistent quant, no phantom KV on refused splits, no speed for refused layouts (#1228)
- fix: fix(cluster): count CPU-only Ray nodes as zero GPUs
- fix: fix(cluster): don't describe a refused TP split as the layout
- fix: fix(cluster): don't print this machine's RAM bandwidth for a cluster
- fix: fix(cluster): fall back to the largest valid TP size that fits
- fix: fix(cluster): keep https Ray URLs, size mixed-GPU pools by the smallest card, report config errors
- fix: fix(cluster): keep the Ray GPU name when a card reports no memory total
- fix: fix(cluster): keep vLLM when --force-runtime names another runtime
- fix: fix(cluster): name a mixed Ray node by its oldest GPU
- fix: fix(cluster): never offer a TurboQuant fit for an invalid full split
- fix: fix(cluster): print config paths plainly and name the Ray URL that failed
- fix: fix(cluster): read Ray's real node summary shape and its per-GPU stats
- fix: fix(cluster): refuse mixed-backend clusters; split unified RAM overrides per GPU
- …and 74 more
Written by cca.canine.dev from the codebase's own history, inside the signed delivery this page is composed from.
Survey your own repository
AlexsJones/llmfit was measured the same way every project in this corpus was: the same rubric, at a pinned commit, with the result published in full. Point a surveyor at a repository you know and see whether you agree with it.
About this page
- The score is its most recent published measurement, taken on 14 November 2026 at a pinned commit. It is not a live figure and does not change until the project is measured again.
- Measured at commit 700cfc818c63e98f61200b8b00401f4c76d265bc — the exact code this score is about.
- Scored under rubric-2026.11.4 — the same rubric and the same method as every other entry in this index.
- Measured by Canine Code Analyzer (cca.canine.dev) using cca measure-2026.11.65+preprod-36d4cd83012f.