Skip to content
CAI
Software that uses CAICheck a score

google/langextract

68.9

Adequate · 14 November 2026

15.2k

lines of production code

Python

primary language

7

measurements over time

CAI band scale
CAI trend line
CAI lens gauges

What this system is

Features

Add Ollama integration example with Docker support and timeout configuration

Users can now run LangExtract with local LLMs via Ollama using the new \examples/ollama\ directory. This includes a comprehensive demo script (\demo\_ollama.py\) that showcases extraction capabilities, a \Dockerfile\ and \docker-compose.yml\ for containerized execution with health checks, and updated documentation explaining how to configure timeout settings for slower models or larger prompts.

examples/ollama · high confidence

Developer tooling and documentation updates for v1.7.0

This release introduces a pre-commit configuration (\.pre-commit-config.yaml\) integrating isort and pyink for consistent code formatting, alongside a comprehensive \.pylintrc\ to standardize linting rules. The project now includes a \CITATION.cff\ file with a Zenodo DOI for proper academic citation, a \COMMUNITY\_PROVIDERS.md\ registry listing third-party plugin integrations (such as AWS Bedrock, LiteLLM, and vLLM), and a production Dockerfile. Additionally, the \README.md\ has been updated to reflect the new default model (\gemini-3.5-flash\), add sections for custom providers and OpenAI usage, and include a live demo link.

(repo-wide) · high confidence

New LangExtract benchmark suite for performance and quality testing

A new benchmark suite has been added to the \benchmarks\ directory to measure tokenization speed and extraction quality across multiple languages and text types. The suite includes a main runner (\benchmark.py\) that supports cloud models (Gemini) and local models (Ollama), automatically downloading test texts from Project Gutenberg for English, Japanese, French, and Spanish. It also features a dedicated fuzzy alignment benchmark (\fuzzy\_benchmark.py\) to evaluate the correctness and performance of the resolver's alignment logic, and visualization tools (\plotting.py\) to generate comparative charts of tokenization throughput and extraction metrics.

benchmarks · high confidence

New Romeo and Juliet extraction notebook with interactive visualization

A new example notebook demonstrates extracting characters, emotions, and relationships from Shakespeare's Romeo and Juliet using LangExtract. The notebook includes setup instructions for the Gemini API, defines an extraction task with few-shot examples, and shows how to run extraction using the gemini-3.5-flash model. It also features an interactive visualization component that saves results to JSONL and generates an HTML file for exploring extracted entities and their attributes.

examples/notebooks · high confidence

New custom provider plugin example for LangExtract

Added an example demonstrating how to create and register a custom provider plugin for LangExtract. This includes a sample \CustomGeminiProvider\ implementation that wraps the Gemini API, a \CustomProviderSchema\ for generating structured output constraints from examples, and a test script to verify the setup. The example shows how to use entry points for automatic provider discovery and how to configure model inference with custom schema constraints.

_examples/custom\_provider\plugin · high confidence

New scripts for creating and validating community provider plugins

Added \scripts/create\_provider\_plugin.py\ to automate the generation of new LangExtract provider plugins, including package structure, entry points, and boilerplate code. Added \scripts/validate\_community\_providers.py\ to enforce formatting and content rules for the community provider registry table in \COMMUNITY\_PROVIDERS.md\, ensuring valid PyPI names, GitHub links, and alphabetical sorting.

scripts · high confidence

Removals

Removal of Kokoro test script

The Kokoro test script (kokoro/test.sh) has been removed from the repository. This script previously handled the setup of the Python virtual environment, installation of dependencies, type checking with pytype, and execution of pytest tests for the langextract project within the Kokoro CI system. Its deletion indicates that this specific CI configuration is no longer maintained or used.

kokoro · high confidence

Behavioural changes

5 commits (1 fix) modifying skills

A change to existing behaviour in skills — 5 commits (1 fix), 8 files: “Send max\_output\_tokens as max\_completion\_tokens to OpenAI (\#600)”; “Route gpt-6 model IDs to the OpenAI provider (\#599)”; “Route OpenAI reasoning and GPT-3.5 models (\#494)”; and 2 more (refs \#600, \#599, \#494, \#448, \#572).

skills · medium confidence · unverified

LangExtract v2.0.0 backward compatibility layer for deprecated imports

LangExtract introduces a backward compatibility layer (\langextract.\_compat\) to support the upcoming v2.0.0 release. This layer provides shims for deprecated imports from \langextract.inference\, \langextract.schema\, \langextract.exceptions\, and \langextract.registry\, redirecting them to their new canonical locations in \langextract.core\ and \langextract.providers\ while emitting \FutureWarning\ deprecation notices. Users relying on the old import paths will continue to function but are advised to update their code to the new module structure before v2.0.0. Also in this area: Preserve literal NA/NULL strings in CSV and escape visualization data for script safety; Explicit temperature parameter now overrides config and model settings; Skip empty or invisible extraction values; Fix Vertex AI batch import failures for default google\_search tool; Fix Gemini batch tool configuration and Pydantic serialization; and 2 more.

langextract · high confidence

Test coverage

Added comprehensive test suite for LangExtract core features

Added a new test suite in the \tests/\ directory covering the provider plugin generator, \extract()\ parameter precedence, schema integration with Gemini and Ollama, factory model creation, format handling, fuzzy alignment correctness, Gemini retry logic, and I/O progress bar cleanup.

tests · high confidence

Dependencies

LangExtract 1.7.0 release with dependency updates and plugin infrastructure

This release updates the library to version 1.7.0 and raises the minimum Python requirement to 3.10. It significantly upgrades the Google GenAI SDK dependency from \>=0.1.0 to \>=1.39.0 and adds Google Cloud Storage as a new dependency, while removing the previously required langfun and python-magic dependencies. The package now includes a provider plugin system via entry points for Gemini, Ollama, and OpenAI, and adds optional dependencies for OpenAI (\>=1.50.0), development tooling (pyink, isort, pre-commit), and Jupyter notebooks. An example custom provider plugin is also included to demonstrate how users can register third-party providers.

(dependencies) · high confidence

Written by cca.canine.dev from the codebase's own history, inside the signed delivery this page is composed from.

How this codebase got here

This is the PUBLIC form of this artifact. Findings are listed in full, but the details of SECURITY findings — which rule fired, in which file, on which line, and how to fix it — are deliberately withheld, and any secret-scanner results are excluded entirely. Where detail is absent here it was REMOVED FOR PUBLICATION; it is not missing from the analysis. The complete artifact is available from the repository owner.

Score

  • CAI 70 → 69 (-0.9)
  • Rubric changed (rubric-2026.10.5 → rubric-2026.11.4) — scores are not directly comparable.

Lenses

  • Code Health 80 → 79 (-1.2)
  • Architecture 84 → 95 (+11.5)
  • Maturity 67 → 73 (+6.2)
  • Readiness 69 → 60 (-8.7)
  • Security 70 → 76 (+5.6)

Resolved (33)

  • Duplicated block (18–31 lines × 2) (langextract/_compat/inference.py)
  • Duplicated block (21 lines × 2) (langextract/providers/schemas/gemini.py)
  • FileTooLong: scripts/create_provider_plugin.py (scripts/create_provider_plugin.py)
  • High: security finding (details withheld)
  • High: security finding (details withheld)
  • High: security finding (details withheld)
  • High: security finding (details withheld)
  • High: security finding (details withheld)
  • High: security finding (details withheld)
  • High: security finding (details withheld)
  • High: security finding (details withheld)
  • High: security finding (details withheld)
  • High: security finding (details withheld)
  • High: security finding (details withheld)
  • High: security finding (details withheld)
  • High: security finding (details withheld)
  • High: security finding (details withheld)
  • High: security finding (details withheld)
  • High: security finding (details withheld)
  • High: security finding (details withheld)
  • …and 13 more

New (6)

  • Edited copies of one member (3 members, 18+ corresponding lines) (langextract/_compat/inference.py)
  • Edited copy of a member (27 corresponding lines) (langextract/providers/schemas/gemini.py)
  • No ADRs found (pyproject.toml)
  • OpenAILanguageModel._build_chat_completions_params (cognitive 16) (langextract/providers/openai.py)
  • OpenAILanguageModel._build_chat_completions_params (cyclomatic 16) (langextract/providers/openai.py)
  • Scattered collaborators

Changes since last survey

  • 13 commits — 12 feature/other, 1 fixes

By area

  • langextract/providers — 3 commits
  • .github/workflows — 2 commits
  • langextract/data_lib.py — 2 commits
  • tests/test_live_api.py — 2 commits
  • (root) — 1 commit
  • examples/ollama — 1 commit
  • langextract/core — 1 commit
  • skills/langextract-usage — 1 commit

Notable commits

  • fix: fix: write Ollama visualization HTML as UTF-8 (#550)
  • change: Harden pull_request_target workflows (#595)
  • change: Load annotated documents saved with null extractions (#584)
  • change: Move OpenAI live tests off retiring GPT-4o models (#601)
  • change: Pin GitHub Actions to commit SHAs and harden workflow scripts (#606)
  • change: Prepare v1.7.2 release (#607)
  • change: Replace retired o4-mini in the live reasoning-effort test (#594)
  • change: Retokenize a Document after its text changes (#583)
  • change: Route gpt-6 model IDs to the OpenAI provider (#599)
  • change: Send max_output_tokens as max_completion_tokens to OpenAI (#600)
  • change: Stop dict_to_annotated_document from mutating its input (#577)
  • change: Support httpx2 transport errors in Gemini retries (#605)
  • change: Warn when model output stops at the token limit (#592)

Architecture

  • Unchanged — 0 containers · 1 contexts · 0 edges

Written by cca.canine.dev from the codebase's own history, inside the signed delivery this page is composed from.

Survey your own repository

google/langextract was measured the same way every project in this corpus was: the same rubric, at a pinned commit, with the result published in full. Point a surveyor at a repository you know and see whether you agree with it.

About this page

  • The score is its most recent published measurement, taken on 14 November 2026 at a pinned commit. It is not a live figure and does not change until the project is measured again.
  • Measured at commit 0e441bf77ddc3119dd0aa413322959234dd84ee5 — the exact code this score is about.
  • Scored under rubric-2026.11.4 — the same rubric and the same method as every other entry in this index.
  • Measured by Canine Code Analyzer (cca.canine.dev) using cca measure-2026.11.65+preprod-36d4cd83012f.