Skip to content
@probityai

Probity

Open source tools for checking AI agent actions: evidence formats, tests, observation and deployment policy.

Probity

Check any verifier of signed AI-agent and supply-chain records against a public corpus. Choose a tool by task.

Explore retained runs or contribute one in the Open Evidence Lab. Browse the task catalog in HTML or Markdown. Read the agent guide for commands and pinned sources. Use the replay procedure to run a published example and keep its evidence.

Choose a tool

Task Project
Evaluate admission policies or reserve cost before dispatch Probity Admission
Choose a tool or inspect recorded claims and retained runs Probity Atlas
Sign and verify DSSE envelopes in Rust dsse
Reject duplicate JSON keys and canonicalize in Rust jcs-admit
Record file actions or check native delegation evidence Probity Observer
Test a verifier against conformance cases Probity Vectors
Install a pinned verifier and check an evidence claim Probity Verify
Use shared definitions for agent evidence claims Probity Vocabulary

Prove an agent harness change

Ratchet turns each observed agent failure into an executable guard. It proves the guard by replay against recorded history and fresh held-out runs before admitting it, and signs every admission decision with the agent change admission predicate. Install it with pip install probity-ratchet==0.1.0; its README gives the commands and the recorded results.

Current releases

Project Release Pinned install
Vectors v0.17.6 pip install agent-evidence-vectors==0.17.6
Admission py-v0.1.0 pip install agent-evidence-admission==0.1.0
Vocabulary v0.3.0 git clone --branch v0.3.0 https://github.com/probityai/agent-evidence-vocabulary
dsse v0.1.2 cargo add dsse@=0.1.2
jcs-admit v0.1.1 cargo add jcs-admit@=0.1.1

Observer, Verify and Atlas have no tagged release yet; their READMEs give source-pinned install steps.

Try a worked task:

Each project explains its supported commands and examples in its README. Verify links to source-pinned installation and checked task recipes. Admission includes policy-engine rules and a pre-call budget API and CLI for bounded local workloads. Retained runs keep source revisions, readers, operators and rerun instructions with the result.

Pinned Loading

  1. agent-evidence-vectors agent-evidence-vectors Public

    Conformance corpora and reference verifiers for AI-agent and supply-chain evidence formats

    Python 4 3

  2. agent-evidence-vocabulary agent-evidence-vocabulary Public

    Versioned terms and crosswalks for the claims carried in signed AI-agent and supply-chain records.

    Python 2 1

  3. agent-evidence-admission agent-evidence-admission Public

    OPA, Kyverno and Sigstore policy-controller rules that admit signed AI-agent execution evidence against a consumer-pinned policy.

    Python 2

  4. probity-verify probity-verify Public

    Checks supplied evidence bytes for signed AI-agent records offline, through claim-specific adapters.

    Python 2

  5. agent-evidence-atlas agent-evidence-atlas Public

    Maps assurance claims about AI agents to the evidence that can check them, with an open run register for verifier results.

    Python 2

  6. agent-evidence-observer agent-evidence-observer Public

    Records brokered file requests from AI agents and includes an offline reader for selected native delegation runs.

    Python 1 1

Repositories

Showing 10 of 12 repositories

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

Loading…

Most used topics

Loading…