deeplethe/utopia
57.1
Adequate · 14 November 2026
145.9k
lines of production code
Rust
with TypeScript
5
measurements over time
What this system is
Features
Add utopia CLI with backup and restore subcommands
The \utopia\ command-line tool is now available for operators to manage data persistence. It introduces a \backup\ subcommand that snapshots the Postgres database and optionally the data directory into a tarball, with a specific security design where the sealing key (\secret.key\) is excluded from the archive by default to prevent unsealed credential exposure. A \restore\ subcommand is also added, though it is currently a stub. The backup format includes a manifest with schema versioning (currently v99) and checksums to ensure integrity and compatibility during restoration.
crates/utopia-cli · high confidence
Expanded reasoning engine with business rules, ontology governance, and auditability
The database schema now supports a comprehensive reasoning and governance layer. Business logic is introduced via \attribute\_rules\ and \attribute\_rule\_conditions\, allowing users to define typed facts and attribute derivations based on entity properties, with results stored in \derived\_facts\. Ontology integrity is enforced through \ontology\_defects\ (for self-contradictory definitions) and \axiom\_violations\ (for data-definition conflicts, including signature and derived contradictions). Data provenance and security are strengthened with a new \audit\_events\ table (append-only), \personal\_tokens\ for MCP agent authentication, and \data\_source\_grants\ to restrict data source access by workspace. The system also tracks pending user confirmations (\pending\_facts\), handles document deletion as a reversible event (\document\_deletions\), and supports multiple query engines (Trino, Databricks, Snowflake, MySQL) via \data\_sources\. Finally, conversation context is preserved via \tool\_exchange\ to improve agent continuity.
migrations · high confidence
Introduces R1 reasoning engine with ontology validation and business rules
The \utopia-reason\ crate now implements the R1 reasoning layer, which materializes derived facts based on ontology axioms (transitive, symmetric, inverse, and sub-property relationships) and evaluates business rules against entity attributes. This change adds a new derivation engine (\derive.rs\) that computes transitive closures with depth limits and cycle detection, introduces an ontology consistency checker (\ontology.rs\) to detect definition-level defects like symmetric/asymmetric conflicts or subclass cycles, and adds a business rule evaluator (\rules.rs\) that derives new facts from attribute values and entity relationships. The system enforces strict precedence of asserted facts over derived ones, handles temporal validity through interval intersection, and caps derivations per predicate to prevent unbounded expansion.
crates/utopia-reason · high confidence
Introduction of open extraction and ontology alignment pipeline
The extraction module has been restructured to implement an 'open extraction' phase where the model writes statements using the document's own words without referencing the ontology or normalizing dates. This raw output is subsequently processed by new alignment components that bind relation phrases and kind words to ontology properties and classes, respectively, using signature-based caching. The pipeline also includes modules for interpreting time mentions, deriving implicit facts, reviewing extracted facts via an errata agent, and adjudicating entity identity pairs with a multi-step lookup tool.
crates/utopia-extract · high confidence
New benchmarking suite for entity typing, recall, governance, and agent evaluation
The \scripts/bench\ directory now provides a comprehensive set of tools to measure system performance across multiple dimensions. The \run.mjs\ script handles entity typing benchmarks using fixed corpora and truth sets (including Wikidata-derived answers), ensuring each test arm uses a fresh database to prevent state leakage. A new \recall.mjs\ tool measures extraction completeness against SEC filings, while \govern.mjs\ evaluates the agent's ability to correctly merge or separate duplicate entities. Additionally, \agent.mjs\ provides an A/B comparison of ontology proposal arms, and \competency.mjs\ tests the system's ability to answer specific questions via chat, tracking whether answers rely on the knowledge graph or raw text.
scripts/bench · high confidence
New database migration helper and comprehensive alerting, alignment, and governance modules
This change introduces several new backend capabilities and operational tools. First, it adds a new \migrate\ example (\crates/utopia-store/examples/migrate.rs\) that allows developers to manually run database migrations against a target database using the \UTOPIA\_DATABASE\_URL\ environment variable, facilitating local testing and CI setup. Second, it implements a new alerting system (\alerts.rs\) that records system and knowledge-base faults (such as sync failures, LLM rate limits, and governance trips) as immutable rows, with visibility controls based on user roles and support for grouping and purging. Third, it adds an alignment queue (\alignment\_queue.rs\) to hold phrase signatures, kind words, and implication rules for human review when automated alignment is uncertain. Fourth, it introduces business rules storage (\business\_rules.rs\) allowing users to define and manage rules that derive entity types or relations based on conditions. Fifth, it implements an errata review system (\errata.rs\) for an agent to audit typed facts for structural issues (domain/range violations, missing names) and apply corrections. Finally, it adds an execution gate (\execution\_gate.rs\) that evaluates the impact of merges or fact changes on derived facts and chat answers before allowing automatic actions, and tracks mapping exploration runs (\exploration\_runs.rs\) to provide coverage and drop statistics.
crates/utopia-store/src · high confidence
New ingestion examples and core parsing infrastructure for documents, ontologies, and audio
The \utopia-ingest\ crate now includes two new CLI examples (\owl\_probe\ for inspecting OWL/RDF ontology projections and \render\_doc\ for previewing parsed document text) and introduces foundational modules for handling diverse input sources. This adds structured parsing for RDF/OWL ontologies (including schema.org and SHACL domain/range handling), a block-based document parser that preserves table structures across page breaks, HTML-to-Markdown conversion with interstitial detection, and ingestion pipelines for MinerU OCR scans and diarized audio transcripts, all unified under a new provenance and reading model. Also in this area: Added tests for East Asian Excel date and time parsing; Ontology temporal annotations and bounded XLSX import memory usage.
crates/utopia-ingest/src, crates/utopia-ingest/tests · high confidence
New lease contract chain benchmarking corpus and tooling
Added a new benchmarking suite in \scripts/bench/corpora/contracts\ to evaluate how well the system handles temporal changes in contract chains. This includes a manifest of SEC EDGAR filings (primarily Blackbaud lease agreements and amendments), a script to fetch these documents, and a benchmark runner (\lease\_bench.py\) that ingests the data into a knowledge base with a specific ontology and scores the system's ability to answer 'as-of' questions against 18 predefined ground-truth values.
scripts/bench/corpora/contracts · high confidence
New star-history script and default port change to 1516
A new Node.js script (scripts/star-history.mjs) generates a cumulative star-history SVG chart by fetching data via the GitHub GraphQL API, ensuring monotonic interpolation and handling permission restrictions. Additionally, the default port for local development and smoke tests has been moved from 8080 to 1516, and several scripts have been made executable.
scripts · high confidence
Security
Security and configuration hardening in core
This change introduces static encryption for sensitive credentials (LLM keys, connection strings, tokens) using AES-256-GCM, ensuring that a database leak does not expose secrets; it also adds a dedicated migration database URL to allow the application to run with restricted permissions while migrations use a privileged connection. Additionally, the default server port is moved from 8080 to 1516, and the configuration now treats blank environment variables as unset to prevent deployment failures in containerized environments.
crates/utopia-core · high confidence
Behavioural changes
Chat loop now uses the rig agent framework with stricter tool-call enforcement
The chat conversation loop has been rewritten to use the rig agent framework instead of the previous hand-written loop. This change enforces that a model must call at least one tool before ending a turn, preventing the "I will check" dead-end where the model describes a plan without executing it. It also introduces a single retry for empty model replies to avoid wasting evidence, and adds a new \no\_evidence\_needed\ tool for questions that do not require knowledge base retrieval.
crates/utopia-server · high confidence
Database role initialization, build/runtime alignment, and port change
The Docker setup now initializes a restricted 'utopia\_app' database role during first-time container startup to enforce least-privilege access, while the application server's default listening port has changed from 8080 to 1516. Additionally, the build process now aligns the Rust build stage with the Debian bookworm runtime to prevent GLIBC version mismatches, includes necessary documentation sources for binary embedding, and installs poppler-utils to support PDF text extraction.
docker · high confidence
Migrate UI components to shadcn/ui
The web interface now uses the shadcn/ui component library for its UI elements. This introduces a new design system with standardized tokens for typography, spacing, and colors, enforced by a new style-guard script. Existing dialogs and controls have been replaced with shadcn equivalents (e.g., Dialog, Button, Badge), and the configuration is set up in components.json to use the 'radix-nova' style with Tailwind CSS variables.
web · high confidence
Removal of placeholder crate documentation
The placeholder documentation comments have been removed from the root library files of the utopia-connectors, utopia-graph, and utopia-mcp crates. These crates currently serve as structural placeholders for future features (external source connectors, graph traversal, and MCP server tools), and this change cleans up the initial roadmap notes while the actual implementations remain in other parts of the codebase.
crates/utopia-connectors, crates/utopia-graph, crates/utopia-mcp · high confidence
Stable result ordering for search queries with equal scores
The search results are now deterministic when multiple items share the same relevance score. Previously, the order of tied results could vary between queries due to hash map randomness; the implementation now breaks ties using the item ID, ensuring that repeated queries return the same candidate set in the same order. This stability applies to the RRF fusion logic used to combine search results.
crates/utopia-search · high confidence
Structured LLM error handling with retry logic
The LLM client now distinguishes between transient failures (rate limits, server unavailability, interrupted streams) and permanent errors (account out of credit, rejected requests). Transient errors are now typed and include retry-after information, enabling the system to wait and retry automatically instead of failing silently or treating them as fatal. Permanent errors are clearly separated so that retries are not wasted on issues that will not resolve themselves, such as insufficient funds or invalid API keys. This change improves reliability by ensuring that recoverable network issues do not cause document processing failures, while non-recoverable issues are surfaced correctly for user action. Also in this area: Graph read endpoints now accept personal access tokens; Attribute values are now normalized to declared units and datatypes; Correct handling of unindexed parallel tool calls in LLM streams; Embedding index fallback and tool call extra\_content passthrough; LLM error diagnostics now reported in English.
crates/utopia-llm · high confidence
Test coverage
Added tests for store governance, temporal migrations, and vector index concurrency; Integration tests for store resolution, materialization, and reasoning.
Dependencies
Major dependency upgrades and Rust workspace restructuring
The web frontend has upgraded to React 19 and added shadcn/ui, Radix UI, and several new UI components, while the Rust backend has restructured its workspace by removing the \utopia-connectors\, \utopia-graph\, and \utopia-mcp\ crates and introducing a new \utopia-cli\ crate. Key library updates include \jsonwebtoken\ 9 to 10 to address an authentication bypass vulnerability, \aws-lc-rs\ to 1.18.1, and \syn\ to 3.0.5, alongside the addition of \aes-gcm\ for credential encryption, \object\_store\ for cloud storage integration, and \tiktoken-rs\ for token-based chunking.
(dependencies) · high confidence
Written by cca.canine.dev from the codebase's own history, inside the signed delivery this page is composed from.
How this codebase got here
Score
- CAI 53 → 57 (+4.0)
- Rubric changed (rubric-2026.10.5 → rubric-2026.11.4) — scores are not directly comparable.
Lenses
- Code Health 57 → 64 (+7.6)
- Architecture 78 → 77 (-1.7)
- Maturity 86 → 90 (+4.1)
- Readiness 50 → 55 (+5.0)
- Security 67 → 68 (+0.5)
- Domain Modelling 100 → 100 (+0.0)
- Accessibility 45 → 49 (+3.6)
- Performance 100 → 100 (+0.0)
Resolved (103)
- ADR not followed: 0015 · A recorded sentence waits for a nod (docs/decisions/0015-recording-a-sentence-is-not-asserting-a-fact.md)
- Classify ADR enforcement: 0001 · Ontology import and governance (docs/decisions/0001-ontology-import-and-governance.md)
- Classify ADR enforcement: 0002 · Reasoning engine (docs/decisions/0002-reasoning-engine.md)
- Classify ADR enforcement: 0003 · The ontology grows out of the corpus (docs/decisions/0003-ontology-growth-loop.md)
- Classify ADR enforcement: 0004 · Language follows the reader of each text (docs/decisions/0004-language-and-localization.md)
- Classify ADR enforcement: 0005 · The alert center (docs/decisions/0005-alert-center.md)
- Classify ADR enforcement: 0006 · Ontology scale and the extraction prompt (docs/decisions/0006-ontology-scale-and-the-prompt.md)
- Classify ADR enforcement: 0007 · Counting decides what becomes a relation (docs/decisions/0007-who-decides-what-becomes-a-relation.md)
- Classify ADR enforcement: 0008 · Ontology packs as the cold start (docs/decisions/0008-ontology-packs-as-cold-start.md)
- Classify ADR enforcement: 0009 · An undecided type stays empty (docs/decisions/0009-no-type-is-a-type.md)
- Classify ADR enforcement: 0010 · An unnamed relation stays empty (docs/decisions/0010-no-relation-is-no-relation.md)
- Classify ADR enforcement: 0011 · A mapping is configuration (docs/decisions/0011-a-mapping-is-not-a-fact.md)
- Classify ADR enforcement: 0012 · The ontology is a contract (docs/decisions/0012-the-ontology-is-a-contract-not-a-suggestion.md)
- Classify ADR enforcement: 0013 · A source hands over its history (docs/decisions/0013-a-source-should-hand-over-its-history.md)
- Classify ADR enforcement: 0014 · Identity from the person, scope from the token (docs/decisions/0014-identity-from-the-person-scope-from-the-token.md)
- Classify ADR enforcement: 0015 · A recorded sentence waits for a nod (docs/decisions/0015-recording-a-sentence-is-not-asserting-a-fact.md)
- Classify ADR enforcement: 0016 · Close the open seams before cutting new ones (docs/decisions/0016-close-the-open-seams-before-cutting-new-ones.md)
- Classify ADR enforcement: 0017 · A contradiction points at an error upstream (docs/decisions/0017-a-contradiction-points-upstream.md)
- Classify ADR enforcement: 0018 · The lakehouse is one protocol away (docs/decisions/0018-the-lakehouse-is-one-protocol-away.md)
- Classify ADR enforcement: 0019 · The second clock can be rewound (docs/decisions/0019-the-second-clock-can-be-rewound.md)
- …and 83 more
New (131)
- Critical CVE: [GHSA redacted] (Cargo.lock)
- Duplicated block (10 lines × 2) (crates/utopia-server/src/ontology_agent.rs)
- Duplicated block (10 lines × 2) (crates/utopia-server/src/phrase_alignment.rs)
- Duplicated block (10–13 lines × 2) (crates/utopia-server/src/query_engine/databricks.rs)
- Duplicated block (12–13 lines × 2) (crates/utopia-extract/src/governor.rs)
- Duplicated block (12–13 lines × 2) (crates/utopia-llm/src/lib.rs)
- Duplicated block (13 lines × 2) (crates/utopia-server/src/api/mapping_routes.rs)
- Duplicated block (14 lines × 2) (crates/utopia-server/src/query_engine/mysql.rs)
- Duplicated block (14 lines × 4) (crates/utopia-store/src/documents.rs)
- Duplicated block (15 lines × 2) (crates/utopia-server/src/phrase_alignment.rs)
- Duplicated block (17 lines × 2) (crates/utopia-store/src/documents.rs)
- Duplicated block (28–31 lines × 2) (crates/utopia-store/src/documents.rs)
- Duplicated block (5 lines × 2) (crates/utopia-ingest/src/parsers.rs)
- Duplicated block (5 lines × 6) (crates/utopia-server/src/errata.rs)
- Duplicated block (6 lines × 2) (crates/utopia-server/src/ontology_agent.rs)
- Duplicated block (6 lines × 2) (crates/utopia-server/src/ontology_agent.rs)
- Duplicated block (6 lines × 2) (crates/utopia-server/src/query_engine/mysql.rs)
- Duplicated block (7 lines × 2) (crates/utopia-extract/src/align.rs)
- Duplicated block (7 lines × 2) (crates/utopia-server/src/api/ontology_routes.rs)
- Duplicated block (7 lines × 2) (crates/utopia-server/src/ingest_sources.rs)
- …and 111 more
Changes since last survey
- 2 commits — 2 feature/other, 0 fixes
By area
- (root) — 1 commit
- web/package.json — 1 commit
Notable commits
- change: Bump rustls from 0.23.45 to 0.23.46 (#1473)
- change: Bump vite from 6.4.3 to 6.4.5 in /web (#1475)
Written by cca.canine.dev from the codebase's own history, inside the signed delivery this page is composed from.
Survey your own repository
deeplethe/utopia was measured the same way every project in this corpus was: the same rubric, at a pinned commit, with the result published in full. Point a surveyor at a repository you know and see whether you agree with it.
About this page
- The score is its most recent published measurement, taken on 14 November 2026 at a pinned commit. It is not a live figure and does not change until the project is measured again.
- Measured at commit 4fec6cb5108895288405e1ffdabae63b76579f3a — the exact code this score is about.
- Scored under rubric-2026.11.4 — the same rubric and the same method as every other entry in this index.
- Measured by Canine Code Analyzer (cca.canine.dev) using cca measure-2026.11.65+preprod-e1a3b69fc8ee.