Skip to content
CAI
Software that uses CAICheck a score

ccheney/robust-skills

50.0

Adequate · 8 November 2026

2.5k

lines of production code

Python

with JavaScript

7

measurements over time

CAI band scale
CAI trend line
CAI lens gauges

What this system is

This system is a framework for defining, validating, and evaluating AI assistant capabilities, referred to as 'skills.' It provides a structured environment for creating specific skills, such as one for Microsoft Teams Adaptive Cards, and includes a comprehensive local evaluation suite to test model behavior against deterministic tasks and routing requests. The system enforces data integrity and test coverage through validation scripts and manages its own runtime dependencies for these evaluations.

Features

Expanded local skill evaluation suite with 112 tasks and 226 routing requests

The \evals\ directory now contains a comprehensive, locally runnable evaluation suite covering all 11 skills, including 112 automated artifact tasks and 226 routing requests. This expansion introduces deterministic artifact graders and bounded Gemini skill evaluations (defaulting to Gemini 3.8 Flash) to detect missing skill guidance, routing mistakes, and regressions. The suite includes detailed coverage documentation, validation evidence, and specific assertion files for skills like modern-javascript, clean-ddd-hexagonal, and slack-mrkdwn, allowing developers to verify model behavior against positive controls and semantic counterexamples without relying on CI or external model providers.

evals · high confidence

New Microsoft Teams Adaptive Cards skill for building and validating card payloads

A new skill has been added to help build, validate, and repair Adaptive Card layouts, actions, forms, and delivery wrappers specifically for Microsoft Teams. This skill provides structured guidance for selecting the correct transport (Bot Framework, Workflows webhook, Microsoft Graph, or Message Extensions) and matching card elements to Teams client capabilities, including a version policy that defaults to 1.2 for broad compatibility and warns against unsupported versions like 1.6. It includes detailed references on action compatibility across surfaces, responsive design principles for narrow clients, and specific rules for Graph attachment formatting. To ensure payload correctness, the skill ships with a local Node.js validation script (\check-teams-card.mjs\) that checks JSON structure and transport-specific constraints for bots, webhooks, and Graph messages.

skills/teams-adaptive-cards · high confidence

New skill validation script for metadata and evaluation coverage

A new \scripts/validate\_skills.py\ script has been added to enforce consistency across skills. It validates that each skill's metadata (name, description) is well-formed, ensures all linked resources are reachable and contained within the skill's directory, and checks that evaluation coverage files (\evals/routing.json\ and \evals/workflows.json\) include required test cases for every skill. This helps maintain data integrity and ensures skills are properly tested before deployment.

scripts · high confidence

Dependencies

Add evaluation runtime dependencies

The \evals/runtime\ directory now includes a Node.js environment with dependencies for database access (drizzle-orm 0.45.2), diagram rendering (mermaid 11.16.1), browser automation (playwright 1.56.1), and TypeScript (5.9.3), alongside a Python requirement for PyYAML 6.0.2 in the \evals\ directory.

(dependencies) · high confidence

Written by cca.canine.dev from the codebase's own history, inside the signed delivery this page is composed from.

How this codebase got here

Score

  • CAI 49 → 50 (+1.4)
  • Rubric changed (rubric-2026.10.5 → rubric-2026.11.2) — scores are not directly comparable.

Lenses

  • Code Health 40 → 40 (+0.0)
  • Architecture 97 → 97 (+0.0)
  • Maturity 70 → 80 (+9.7)
  • Readiness 31 → 31 (+0.0)
  • Security 100 → 100 (+0.2)
  • Performance 100 → 100 (+0.0)

Resolved (1)

  • Low CVE: [GHSA redacted] (evals/runtime/package-lock.json)

New (1)

  • Critical CVE: [GHSA redacted] (evals/runtime/package-lock.json)

Written by cca.canine.dev from the codebase's own history, inside the signed delivery this page is composed from.

Survey your own repository

ccheney/robust-skills was measured the same way every project in this corpus was: the same rubric, at a pinned commit, with the result published in full. Point a surveyor at a repository you know and see whether you agree with it.

About this page

  • The score is its most recent published measurement, taken on 8 November 2026 at a pinned commit. It is not a live figure and does not change until the project is measured again.
  • Measured at commit 0eea7b060d12e3520556a73b15fbfa79480987d1 — the exact code this score is about.
  • Scored under rubric-2026.11.2 — the same rubric and the same method as every other entry in this index.
  • Measured by Canine Code Analyzer (cca.canine.dev) using cca measure-2026.11.3+preprod-45ab2cab63de.