Skip to content
CAI
Software that uses CAICheck a score

microsoft/playwright-cli

55.3

Adequate · 15 November 2026

245

lines of production code

JavaScript

primary language

5

measurements over time

CAI band scale
CAI trend line
CAI lens gauges

What this system is

Features

Introduce Playwright CLI with skill version warnings and update notifications

The repository now includes the Playwright CLI entry point (\playwright-cli.js\) and a skill-checking module (\skillCheck.js\) that warns users when their installed AI agent skill (e.g., in \.claude/skills\ or \.agents/skills\) is out of sync with the tool version. Additionally, the CLI automatically checks for newer npm versions and prints a notice if an update is available, while caching the check result to avoid repeated network calls.

(repo-wide) · high confidence

New script to automate Playwright skill updates

A new \scripts/update.js\ script has been added to automate the process of updating Playwright skills. When executed, it runs \playwright-cli.js install --skills\ to generate the latest skill files and then automatically moves them from the temporary \.claude/skills/playwright-cli\ directory into the project's main \skills/playwright-cli\ folder, cleaning up the temporary files in the process.

scripts · high confidence

Test coverage

Added integration tests for CLI skill updates and cache behavior

Added a new integration test suite (\tests/integration.spec.ts\) that verifies the CLI's behavior regarding installed skills and update caching. The tests confirm that the CLI warns users when an installed skill file is out of date, correctly ignores differences caused solely by line endings, and properly caches the update check result in the default registry directory. Also in this area: 3 commits adding/updating tests in tests; Added integration tests for CLI update check behavior.

tests · high confidence · unverified

Dependencies

Initial release of @playwright/cli v0.1.22

The project has been initialized as a standalone CLI package named @playwright/cli, version 0.1.22. This entry point bundles the latest alpha versions of the Playwright testing framework (1.64.0-alpha-1790635538000) and its core runtime as direct dependencies, allowing users to install and run Playwright tests via a dedicated \playwright-cli\ binary. The package requires Node.js 18 or higher and includes TypeScript definitions for Node.js as a development dependency.

(dependencies) · high confidence

Written by cca.canine.dev from the codebase's own history, inside the signed delivery this page is composed from.

How this codebase got here

Score

  • CAI 56 → 55 (-0.3)
  • Rubric changed (rubric-2026.10.5 → rubric-2026.11.4) — scores are not directly comparable.

Lenses

  • Code Health 78 → 76 (-1.5)
  • Architecture 69 → 69 (+0.0)
  • Maturity 57 → 57 (+0.0)
  • Readiness 42 → 42 (+0.1)
  • Security 85 → 81 (-4.0)
  • Performance 100 → 100 (+0.0)

Resolved (5)

  • High secret: WD-SECRET-0005 (package-lock.json)
  • No ADRs found
  • Outdated (npm): playwright
  • Outdated (npm): playwright-core
  • Rotate the exposed credentials — git history can't be un-committed

New (1)

  • No ADRs found (package.json)

Changes since last survey

  • 23 commits — 20 feature/other, 3 fixes

By area

  • (root) — 10 commits
  • .github/workflows — 9 commits
  • .azure-pipelines/publish.yml — 2 commits
  • .github/actions — 1 commit
  • skills/playwright-cli — 1 commit

Notable commits

  • fix: Revert "chore: hand agent-fix issues to the Playwright bots" (#526)
  • fix: chore: hand agent-fix issues to the Playwright bots (#524)
  • fix: fix(cli): report command failures in text and JSON modes (#522)
  • change: chore(bots): add the "Agent: task" workflow (#531)
  • change: chore(bots): hand agent-* labels to the bot in devops.playwright.dev (#527)
  • change: chore(bots): hand triage, review, roll and release to the Playwright bot (#530)
  • change: chore(bots): name the agent workflows agent-*, and start tasks by hand only (#534)
  • change: chore(bots): remove the unused setup-triage-runner action (#535)
  • change: chore: mark v0.1.23 (#494)
  • change: chore: mark v0.1.24 (#529)
  • change: chore: roll Playwright to 1.65.0-alpha-2026-10-30 (#492)
  • change: chore: roll Playwright to 1.66.0-alpha-1793916328000 (#523)
  • change: chore: roll Playwright to 1.66.0-alpha-1794252756000 (#528)
  • change: devops(bots): add the triage, revision, roll and release bots (#491)
  • change: devops(bots): pin the shared actions to a commit SHA (#520)
  • change: devops(bots): publish the agent's GitHub writes as typed calls (#495)
  • change: devops(bots): use the client ID of the app (#493)
  • change: devops: remove the Azure publish pipeline (#498)
  • change: devops: update checkout step in pipelines (#497)
  • change: docs(readme): require playwright 1.59+ for the local cli fallback (#536)
  • …and 3 more

Written by cca.canine.dev from the codebase's own history, inside the signed delivery this page is composed from.

Survey your own repository

microsoft/playwright-cli was measured the same way every project in this corpus was: the same rubric, at a pinned commit, with the result published in full. Point a surveyor at a repository you know and see whether you agree with it.

About this page

  • The score is its most recent published measurement, taken on 15 November 2026 at a pinned commit. It is not a live figure and does not change until the project is measured again.
  • Measured at commit b21724888b8100b05ef8dee3a92f2bb03bf4dcde — the exact code this score is about.
  • Scored under rubric-2026.11.4 — the same rubric and the same method as every other entry in this index.
  • Measured by Canine Code Analyzer (cca.canine.dev) using cca measure-2026.11.65+preprod-3c33c1882dc1.