Skip to content
CAI
Software that uses CAICheck a score

iFurySt/open-codex-computer-use

57.2

Adequate · 15 November 2026

35.5k

lines of production code

Swift

with Go, Python, JavaScript

5

measurements over time

CAI band scale
CAI trend line
CAI lens gauges

What this system is

Features

Add standalone cursor motion reconstruction scripts

Added a new standalone directory \scripts/cursor-motion-re\ containing Python scripts for reverse-engineering and reconstructing cursor motion behavior from the official \Codex Computer Use.app\ binary. The \reconstruct\_cursor\_motion.py\ CLI tool allows users to inspect recovered Swift types, fields, and constants (such as \VelocityVerletSimulation\ parameters), generate candidate motion paths between start and end points, and perform sensitivity analysis on slider interactions. These scripts operate independently of the main runtime and provide binary-lifted geometric and timing evidence for cursor movement.

scripts/cursor-motion-re · high confidence

Added cursor motion reconstruction script

A new Python script, \official\_cursor\_motion.py\, has been added to the \scripts/cursor-motion-re/\ directory. This tool parses Mach-O binaries to extract Swift motion type information, specifically targeting cursor-related animation classes such as Bezier, Spring, and VelocityVerlet. It enables the reconstruction of cursor motion assets by analyzing binary sections for motion configuration and field metadata.

python · high confidence

Added launch scripts for the Open Computer Use plugin

New shell scripts have been added to the plugin's scripts directory to locate and execute the Open Computer Use native runtime and its JavaScript REPL adapter. These scripts search for the application binaries across various build outputs (including development and release variants for macOS, Linux, and Windows) and the system PATH, ensuring the plugin can start correctly regardless of where the runtime was installed or built.

plugins/open-computer-use/scripts · high confidence

Automated cross-platform npm packaging and publishing pipeline

The scripts/npm directory now includes build-packages.mjs and publish-packages.mjs, which automate the creation of npm packages for open-computer-use, open-computer-use-mcp, and open-codex-computer-use-mcp across macOS (arm64/x64), Linux (arm64/amd64), and Windows (arm64/amd64). The publishing script supports trusted publishing via GitHub Actions OIDC with provenance, falls back to NODE\_AUTH\_TOKEN, and includes retry logic with exponential backoff to handle transient network issues during release.

scripts/npm · high confidence

Introduce Linux Computer Use runtime with configurable text limits and click methods

This change adds a new Linux-specific Computer Use runtime (Go service and Python AT-SPI backend) that enables UI automation on Linux desktops. Users can now control text extraction volume via a new \text\_limit\ parameter (replacing the previous \show\_full\_text\ switch) and select from multiple click strategies (\auto\, \accessibility\, \app\_post\, \sky\_click\, \global\) to interact with applications. Also in this area: 5 commits (5 fixes) fixing apps/OpenComputerUseLinux; Opt-out of accessibility and screenshot data in Linux app state; Configurable action read-back behavior for Linux automation; Version bump to 1.1.0; Linux keyboard input reliability and tool schema updates.

apps/OpenComputerUseLinux · medium confidence · unverified

Introduce OpenComputerUseKit for cross-platform desktop automation

This release adds the OpenComputerUseKit package, providing the core engine for the Open Computer Use agent. It introduces configurable accessibility snapshotting with text and tree limits, a multi-strategy click system (including a new SkyLight background click method and global pointer fallbacks), and native input simulation for clicks, drags, scrolling, and text entry. The kit also includes app discovery via Spotlight, a visual cursor motion model, and a fixture bridge for headless testing. Also in this area: 1 commit (1 fix) fixing packages/OpenComputerUseKit; 1 commit adding/updating tests in packages/OpenComputerUseKit; 4 commits (4 fixes) fixing packages/OpenComputerUseKit; New select\_text tool and selective observation options for snapshots; Cursor overlay now follows moving windows during actions; and 3 more.

packages/OpenComputerUseKit/Sources, packages/OpenComputerUseKit/Tests · medium confidence

Introduce Windows Computer Use runtime with configurable UI interaction limits

Adds a new experimental Windows runtime (OpenComputerUseWindows) that enables AI agents to interact with Windows applications via UI Automation. The service supports configurable click methods (auto, accessibility, app\_post, sky\_click, global) and replaces the previous full-text snapshot toggle with a \text\_limit\ parameter (defaulting to 500 characters) alongside new \max\_tree\_nodes\ and \max\_tree\_depth\ budget controls to manage accessibility tree size. The implementation includes a PowerShell backend for executing UI actions and a Go service layer with corresponding unit tests for tool definitions, argument parsing, and error handling. Also in this area: 5 commits (5 fixes) fixing apps/OpenComputerUseWindows; 1 commit (1 fix) fixing apps/OpenComputerUseWindows; Enable guarded global input and fix DPI coordinate handling on Windows; Selective accessibility and screenshot collection in app snapshots; Configurable action read-back behavior for Linux automation; and 3 more.

apps/OpenComputerUseWindows · medium confidence · unverified

Introduce computer-use CLI for probing desktop-control tooling

A new Go-based CLI tool is added to scripts/computer-use-cli to help users probe and interact with the Codex desktop-control (computer-use) plugin. It supports two transport modes—direct (stdio MCP) and app-server (proxying through the signed Codex host)—and provides subcommands to resolve the server target, list available tools, invoke individual tool calls, and execute sequential tool calls via a JSON file. The CLI auto-discovers the bundled computer-use plugin (preferring version 1.0.750 when available) and allows overrides via flags or environment variables for plugin root, version, and server binary.

scripts/computer-use-cli · high confidence

New Cursor Motion lab for visualizing and tuning cursor trajectory dynamics

A standalone SwiftUI demo application has been added to the \experiments/CursorMotion\ directory to isolate and visualize cursor motion parameters (start/end handles, arc size, arc flow, and spring damping) without affecting the main product's \SoftwareCursorOverlay\. This lab allows users to preview heading-driven candidate paths, adjust motion parameters via sliders, and observe the resulting cursor glyph behavior—including rotation, fog, and click pulses—using an official baseline cursor image or a procedural fallback.

experiments/CursorMotion · high confidence

New OpenComputerUseFixture app for smoke testing

A new macOS application, OpenComputerUseFixture, has been added to serve as a controlled environment for smoke testing computer-use capabilities. The app provides a UI with specific interactive elements—including an increment button, editable text field, key capture view, scrollable area, and drag pad—allowing automated tests to verify keyboard input, mouse clicks, scrolling, and drag-and-drop interactions.

apps/OpenComputerUseFixture · high confidence

New build, packaging, and installation tooling for Open Computer Use

The scripts directory now includes a comprehensive set of automation tools for building, packaging, and installing the Open Computer Use runtime. Build scripts (build-apple-iconset.sh, build-cursor-motion-dmg.sh, build-open-computer-use-app.sh, build-open-computer-use-linux.sh, build-open-computer-use-windows.sh) handle macOS icon generation, DMG packaging, and native binary compilation for macOS, Linux, and Windows. Installation scripts (install-claude-mcp.sh, install-codex-mcp.sh, install-codex-plugin.sh, install-dsh-mcp.sh, install-gemini-mcp.sh, install-opencode-mcp.sh) automate the configuration of MCP server entries for various host applications (Claude, Codex, DeepSeek Harness, Gemini, OpenCode). Additional scripts (codex\_dump.py, package-github-release-assets.sh, package-skill.sh, render-open-computer-use-icon.swift) support traffic capture, release asset packaging, skill distribution, and icon rendering.

scripts · high confidence

New standalone macOS demo for cursor motion reconstruction

A new standalone Swift app has been added to the experiments/StandaloneCursor directory, porting the geometry and timing logic from the existing Python cursor-motion reconstruction script into a native macOS interface. Users can now run the app via Swift to interactively drag START and END handles, which triggers the real-time recalculation of 20 candidate paths (2 base and 18 arched). The interface displays candidate scores, path lengths, and in-bounds status, allowing users to manually lock a specific candidate or replay the motion using the raw spring timeline (response=1.4, dampingFraction=0.9). This tool serves as a visual verification environment to compare the Swift implementation against the original Python binary-guided reconstruction results.

experiments/StandaloneCursor · high confidence

Persistent JavaScript REPL and CLI configuration for macOS automation

The scripts/node-repl area now provides a persistent JavaScript REPL and a CLI launcher that allow users to automate macOS desktop interactions via a top-level await JavaScript session. Users can start an interactive REPL (ocu repl) or run one-off scripts (ocu js) that bind to apps and perform actions like clicking, typing, and querying accessibility state, with bindings persisting across calls until a reset. The CLI also introduces a config command (ocu config) to persist and manage macOS screenshot settings—such as image format, quality, and dimension limits—via a JSON file and environment variables, with validation and precedence rules. The entry point scripts (open-computer-use-cli.mjs, open-computer-use-repl.mjs, open-computer-use-kernel.mjs) wire the Node.js runtime, adapter, kernel, and native MCP capabilities, and include tests verifying REPL persistence, error handling, and config validation. Also in this area: 12 commits (12 fixes) fixing scripts; Added Windows input and observation test infrastructure; New text selection API and selective observation controls.

scripts/node-repl · medium confidence · unverified

Behavioural changes

1 commit (0 fixes) modifying packages/LockedUseNative

A change to existing behaviour in packages/LockedUseNative — 1 commit, 2 files: “feat(macos): add Locked Use”.

packages/LockedUseNative · medium confidence · unverified

1 commit (0 fixes) modifying packages/OpenComputerUseVirtualDisplayShim

A change to existing behaviour in packages/OpenComputerUseVirtualDisplayShim — 1 commit, 2 files: “feat(macos): complete background operation: sky\_key, covered/other-Space windows, agent display (\#65)” (refs \#65).

packages/OpenComputerUseVirtualDisplayShim · medium confidence · unverified

3 commits (1 fix) modifying experiments/LockedUse/AuthorizationPlugin

A change to existing behaviour in experiments/LockedUse/AuthorizationPlugin — 3 commits (1 fix), 7 files: “test(release): diagnose hosted task signature validation”; “feat(macos): add Locked Use”; “fix(macos): validate Locked Use host and reduce broker overhead”.

experiments/LockedUse/AuthorizationPlugin · medium confidence · unverified

Introduce macOS app agent proxy and native computer-use command

The Open Computer Use app now routes macOS automation through a dedicated background agent process to handle app-scoped permissions, ensuring that CLI commands and MCP interactions are executed with the correct entitlements. This change introduces a new \call\ command for native computer-use operations and adds a visual cursor overlay for click actions, improving the feedback loop during automated interactions. Additionally, the permission onboarding flow has been refined to launch from the doctor command and refreshes automatically after grants are made.

apps/OpenComputerUse · high confidence

Fixes

7 commits (5 fixes) fixing experiments/LockedUse/Sources

A fix in experiments/LockedUse/Sources — 7 commits (5 fixs), 22 files: “fix(locked-use): keep Guardian input monitor alive when keyboards are seized exclusively (\#143)”; “fix(locked-use): complete Guardian cleanup after idle and reconnect (\#158)”; “fix: preserve notarization tickets for Locked Use payloads (\#139)”; and 4 more (refs \#143, \#158, \#139, \#148).

experiments/LockedUse/Sources · medium confidence · unverified

Test coverage

1 commit adding/updating tests in experiments/LockedUse/Tests; Added integration and behavioral tests for DSH MCP installer and Locked Use subsystems; Introduce OpenComputerUseSmokeSuite for automated MCP tool testing.

Dependencies

Initial dependency manifests for Open Computer Use tooling

This change introduces the foundational dependency manifests for the Open Computer Use project across Swift, Go, and Node.js environments. It adds a Swift Package Manager configuration defining the core library and executable targets, Go module files for Linux and Windows runtime applications, and an npm package.json for repository-level build and release scripts. Additionally, it establishes the Go module definition for the computer-use CLI script, explicitly pinning the modelcontextprotocol/go-sdk to version 1.4.1 along with its indirect dependencies.

(dependencies) · high confidence

Written by cca.canine.dev from the codebase's own history, inside the signed delivery this page is composed from.

How this codebase got here

Score

  • CAI 58 → 57 (-0.4)
  • Rubric changed (rubric-2026.10.5 → rubric-2026.11.4) — scores are not directly comparable.

Lenses

  • Code Health 51 → 49 (-2.5)
  • Architecture 94 → 94 (+0.9)
  • Maturity 82 → 89 (+6.5)
  • Readiness 50 → 50 (-0.2)
  • Security 84 → 79 (-5.5)
  • Performance 67 → 70 (+3.4)

Resolved (92)

  • Classify ADR enforcement: 核心理念 (docs/design-docs/core-beliefs.md)
  • CodexDump._session_matches_capture (cognitive 21) (scripts/codex_dump.py)
  • CodexDump._summarize_local_session (cognitive 49) (scripts/codex_dump.py)
  • CodexDump._summarize_local_session (cyclomatic 25) (scripts/codex_dump.py)
  • CodexDump._sync_local_sessions (cognitive 22) (scripts/codex_dump.py)
  • CodexDump._sync_local_sessions (cyclomatic 16) (scripts/codex_dump.py)
  • CursorMotionPath.measure (cognitive 18) (scripts/cursor-motion-re/official_cursor_motion.py)
  • Disclosure policy has no reporting contact
  • DisplayGuardian.reportToBroker (cyclomatic 19) (experiments/LockedUse/Sources/Guardian/DisplayGuardian.swift)
  • Duplicated block (10 lines × 2) (apps/OpenComputerUseLinux/main.go)
  • Duplicated block (10 lines × 3) (experiments/CursorMotion/Sources/CursorMotion/CursorMotionModel.swift)
  • Duplicated block (11 lines × 2) (experiments/CursorMotion/Sources/CursorMotion/CursorMotionModel.swift)
  • Duplicated block (12 lines × 2) (apps/OpenComputerUse/Sources/OpenComputerUse/PermissionOnboardingApp.swift)
  • Duplicated block (14 lines × 2) (apps/OpenComputerUseSmokeSuite/Sources/OpenComputerUseSmokeSuite/main.swift)
  • Duplicated block (14 lines × 2) (packages/OpenComputerUseKit/Sources/OpenComputerUseKit/FixtureBridge.swift)
  • Duplicated block (15 lines × 2) (experiments/StandaloneCursor/Sources/StandaloneCursorSupport/StandaloneCursorModel.swift)
  • Duplicated block (15–16 lines × 3) (packages/OpenComputerUseKit/Sources/OpenComputerUseKit/OpenComputerUseCLI.swift)
  • Duplicated block (21 lines × 2) (experiments/CursorMotion/Sources/CursorMotion/CursorMotionModel.swift)
  • Duplicated block (25 lines × 2) (experiments/CursorMotion/Sources/CursorMotion/CursorMotionModel.swift)
  • Duplicated block (29 lines × 2) (packages/OpenComputerUseKit/Sources/OpenComputerUseKit/AccessibilitySnapshot.swift)
  • …and 72 more

New (115)

  • ComputerUseService.typeTextUsingAccessibility (cognitive 30) (packages/OpenComputerUseKit/Sources/OpenComputerUseKit/ComputerUseService.swift)
  • ComputerUseService.typeTextUsingAccessibility (cyclomatic 23) (packages/OpenComputerUseKit/Sources/OpenComputerUseKit/ComputerUseService.swift)
  • Disclosure policy has no reporting contact (SECURITY.md)
  • Duplicated block (13 lines × 2) (experiments/CursorMotion/Sources/CursorMotion/CursorMotionModel.swift)
  • Duplicated block (14 lines × 2) (apps/OpenComputerUseLinux/main.go)
  • Duplicated block (14 lines × 2) (experiments/CursorMotion/Sources/CursorMotion/CursorMotionModel.swift)
  • Duplicated block (21 lines × 2) (experiments/CursorMotion/Sources/CursorMotion/CursorMotionModel.swift)
  • Duplicated block (7 lines × 2) (packages/OpenComputerUseKit/Sources/OpenComputerUseKit/AccessibilitySnapshot.swift)
  • Duplicated block (7 lines × 3) (experiments/CursorMotion/Sources/CursorMotion/CursorMotionModel.swift)
  • Duplicated block (8 lines × 2) (experiments/CursorMotion/Sources/CursorMotion/CursorMotionApp.swift)
  • Duplicated block (8 lines × 2) (experiments/LockedUse/Sources/Guardian/ShieldPreview.swift)
  • Duplicated block (8 lines × 2) (experiments/StandaloneCursor/Sources/StandaloneCursor/StandaloneCursorRootView.swift)
  • Edited copies of one member (3 members, 14+ corresponding lines) (packages/OpenComputerUseKit/Sources/OpenComputerUseKit/AgentDisplay.swift)
  • Edited copies of one member (3 members, 3+ corresponding lines) (apps/OpenComputerUseSmokeSuite/Sources/OpenComputerUseSmokeSuite/main.swift)
  • Edited copies of one member (3 members, 37+ corresponding lines) (experiments/CursorMotion/Sources/CursorMotion/SynthesizedCursorGlyphView.swift)
  • Edited copies of one member (3 members, 4+ corresponding lines) (packages/OpenComputerUseKit/Sources/OpenComputerUseKit/LockedUseBrokerConfiguration.swift)
  • Edited copies of one member (3 members, 49+ corresponding lines) (experiments/CursorMotion/Sources/CursorMotion/SynthesizedCursorGlyphView.swift)
  • Edited copies of one member (3 members, 7+ corresponding lines) (packages/OpenComputerUseKit/Sources/OpenComputerUseKit/ComputerUseToolDispatcher.swift)
  • Edited copies of one member (4 members, 15+ corresponding lines) (apps/OpenComputerUseLinux/main.go)
  • Edited copy of a member (10 corresponding lines) (experiments/StandaloneCursor/Sources/StandaloneCursor/StandaloneCursorRootView.swift)
  • …and 95 more

Changes since last survey

  • 43 commits — 9 feature/other, 34 fixes

By area

  • packages/OpenComputerUseKit — 14 commits
  • scripts/tests — 11 commits
  • apps/OpenComputerUseWindows — 5 commits
  • docs/exec-plans — 4 commits
  • apps/OpenComputerUseLinux — 3 commits
  • docs/releases — 3 commits
  • .github/workflows — 1 commit
  • apps/OpenComputerUse — 1 commit
  • docs/histories — 1 commit

Notable commits

  • fix: fix(ci): make scripts/ci.sh pass on a clean checkout and run it on every PR (#165)
  • fix: fix(kit): capture partially off-screen windows whole and survive non-finite AX frames (#154)
  • fix: fix(linux): don't treat a GTK 3 text field's activate as a click (#180)
  • fix: fix(linux): isolate desktop session discovery from sandbox environments (#184)
  • fix: fix(linux): refuse set_value on read-only fields before writing (#179)
  • fix: fix(locked-use): complete Guardian cleanup after idle and reconnect (#158)
  • fix: fix(locked-use): create secondary-screen shields in screen-local coordinates (#148)
  • fix: fix(locked-use): keep Guardian input monitor alive when keyboards are seized exclusively (#143)
  • fix: fix(locked-use): wake and hold the display across locked-use episodes (#187)
  • fix: fix(macos): check an element index against what the snapshot showed before acting (#183)
  • fix: fix(macos): hit-test click candidates in window points (#126)
  • fix: fix(macos): keep coordinate-click descendant presses at the click point (#127)
  • fix: fix(macos): never read password field values (#164)
  • fix: fix(macos): refuse to press a disabled control (#182)
  • fix: fix(macos): release the mouse button when a drag or click fails partway (#173)
  • fix: fix(macos): resolve relative --calls-file and --args-file against the caller's directory (#119)
  • fix: fix(macos): root the snapshot at the app's focused sheet (#118)
  • fix: fix(macos): stop the click chain after an AX answer that may have acted (#181)
  • fix: fix(macos): type_text types into the live focus and replaces the selection (#130)
  • fix: fix(release): require notarization before publishing (#146)
  • …and 23 more

Architecture

  • Unchanged — 0 containers · 1 contexts · 0 edges

Written by cca.canine.dev from the codebase's own history, inside the signed delivery this page is composed from.

Survey your own repository

iFurySt/open-codex-computer-use was measured the same way every project in this corpus was: the same rubric, at a pinned commit, with the result published in full. Point a surveyor at a repository you know and see whether you agree with it.

About this page

  • The score is its most recent published measurement, taken on 15 November 2026 at a pinned commit. It is not a live figure and does not change until the project is measured again.
  • Measured at commit e25be21caa0ea489316f6be6635d2a4766c4cd0b — the exact code this score is about.
  • Scored under rubric-2026.11.4 — the same rubric and the same method as every other entry in this index.
  • Measured by Canine Code Analyzer (cca.canine.dev) using cca measure-2026.11.65+preprod-3c33c1882dc1.