Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 3 additions & 3 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,9 +6,9 @@
- Record fixture-owned account and meeting Gateway prerequisites before invoking credential-free synthetic probes. Keep ready status methods and unrelated Gateway failures visible; blocked methods remain explicit gaps until their host state and transports are supplied.

- Prepare selected npm fixture payloads before manual OpenClaw ref compatibility planning and execution; derive capability selections from prepared source while preserving intentional empty lanes.
- Discover SDK modules loaded inside retained plugin handlers and verify real source and unpublished-package CLI values while keeping Gateway prerequisite failures visible. Keep the published Plugin Inspector pin at 0.3.25 until release.
- Use the public lazy-runtime SDK contract in source-mode Plugin Inspector probes so plugin runtimes load lazily and report their actual outcomes. Keep the published package pin at 0.3.25 until release.
- Preserve original Gateway rejection messages in source-mode Plugin Inspector probes and verify both source and unpublished packed CLI smoke in Linux CI. Keep the published package pin at 0.3.25 until release.
- Discover SDK modules loaded inside retained plugin handlers and verify real source and package CLI values while keeping Gateway prerequisite failures visible. Adopt Plugin Inspector 0.3.26 in both source and published-package modes.
- Use the public lazy-runtime SDK contract in Plugin Inspector probes so plugin runtimes load lazily and report their actual outcomes in source and published-package modes.
- Preserve original Gateway rejection messages in Plugin Inspector probes and verify both source and published-package smoke in Linux CI.
- Fixed AWS Crabbox provisioning by sizing the root disk to the promoted image’s 400 GB minimum.
- Promote the green OpenClaw 2026.9.3 canary pin and adopt Kitchen Sink 0.3.0, covering 42 hooks, 56 active registrars, and 22 manifest contracts without replacing the host's detached-task owner.
- Bound OpenClaw track metadata fetches through JSON consumption and Git lookups through the shared command owner, with strict timeout settings and preserved operational failures; warn about missing tags only after successful empty lookups. Thanks @SebTardif.
Expand Down
12 changes: 6 additions & 6 deletions docs/inspector-plan.md
Original file line number Diff line number Diff line change
Expand Up @@ -93,19 +93,19 @@ npm run plugin-inspector:smoke
```

The smoke writes ignored artifacts under `.crabpot/plugin-inspector-smoke/`.
By default the smoke runs the published `@openclaw/plugin-inspector@0.3.25`
By default the smoke runs the published `@openclaw/plugin-inspector@0.3.26`
package through `npm exec`. For local plugin-inspector development, set
`CRABPOT_PLUGIN_INSPECTOR_CLI=source` to run the sibling or pinned source
checkout instead. Set `CRABPOT_PLUGIN_INSPECTOR_DIR=/path/to/candidate` to select
an exact candidate checkout before its npm release. Set
`CRABPOT_PLUGIN_INSPECTOR_BIN=/path/to/plugin-inspector`
to test an arbitrary CLI binary.

The pinned 0.3.25 source and published package recognize compiled CommonJS channel
factory calls and classify widget presenters as metadata-only synthetic probes.
Both include credential-free model-auth binding,
bounded capture and synthetic probes, serial service lifecycle probes,
CommonJS SDK mock capture, and Gateway response validation.
The pinned 0.3.26 source and published package recognize bundled SDK imports,
consume target-owned conversation contract proof, load retained-handler SDK
imports and lazy runtimes, and preserve method-scoped Gateway prerequisites.
They retain bounded capture and synthetic probes, CommonJS SDK mock capture,
serial service lifecycle probes, and Gateway response validation.
Run source-mode and package-mode smoke separately when validating a new release.

Current migration state: `scripts/inspect-fixtures.mjs` delegates static source,
Expand Down
9 changes: 5 additions & 4 deletions docs/operations.md
Original file line number Diff line number Diff line change
Expand Up @@ -147,10 +147,11 @@ npm run profile -- --check
node scripts/check-contract-coverage.mjs --openclaw ../openclaw
```

Source-backed reports and registration capture use inspector 0.3.25,
including bounded capture/probes, CommonJS SDK mocks, serial service lifecycle
probes, and Gateway response validation. `npm run plugin-inspector:smoke`
uses the published `@openclaw/plugin-inspector@0.3.25` package by default.
Source-backed reports and registration capture use inspector 0.3.26,
including bundled SDK import classification, target-owned conversation contract
proof, lazy runtime SDK loading, and method-scoped Gateway prerequisites.
`npm run plugin-inspector:smoke` uses the published
`@openclaw/plugin-inspector@0.3.26` package by default.
Use
`CRABPOT_PLUGIN_INSPECTOR_CLI=source npm run plugin-inspector:smoke` only when
validating local inspector source changes. Set `CRABPOT_PLUGIN_INSPECTOR_DIR`
Expand Down
4 changes: 2 additions & 2 deletions scripts/plugin-inspector-source.mjs
Original file line number Diff line number Diff line change
Expand Up @@ -4,8 +4,8 @@ import { pathToFileURL } from "node:url";
import { repoRoot } from "./manifest-lib.mjs";
import { configuredTimeoutMs, runOwnedCommand } from "./owned-command.mjs";

export const pluginInspectorRef = "0e8f55371170bce8dfc5bfe07023c56761b60de0";
export const pluginInspectorPackage = "@openclaw/plugin-inspector@0.3.25";
export const pluginInspectorRef = "6169338410f76e1e7e9f6ec29c65b6007e62d829";
export const pluginInspectorPackage = "@openclaw/plugin-inspector@0.3.26";
const defaultGitTimeoutMs = 2 * 60 * 1000;
const defaultNpmTimeoutMs = 2 * 60 * 1000;
export const defaultPluginInspectorTimeoutMs = 10 * 60 * 1000;
Expand Down
4 changes: 2 additions & 2 deletions test/plugin-inspector-source.test.mjs
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@ import {
} from "../scripts/plugin-inspector-source.mjs";

test("plugin inspector source pin requires an exact prepared checkout", (t) => {
assert.equal(pluginInspectorRef, "0e8f55371170bce8dfc5bfe07023c56761b60de0");
assert.equal(pluginInspectorRef, "6169338410f76e1e7e9f6ec29c65b6007e62d829");

const checkoutDir = mkdtempSync(path.join(os.tmpdir(), "crabpot plugin inspector checkout "));
t.after(() => rmSync(checkoutDir, { force: true, recursive: true }));
Expand Down Expand Up @@ -48,7 +48,7 @@ test("plugin inspector smoke defaults to the published npm package", () => {
const invocation = resolvePluginInspectorCliInvocation();

assert.equal(invocation.command, "npm");
assert.equal(pluginInspectorPackage, "@openclaw/plugin-inspector@0.3.25");
assert.equal(pluginInspectorPackage, "@openclaw/plugin-inspector@0.3.26");
assert.deepEqual(invocation.args, ["exec", "--yes", "--package", pluginInspectorPackage, "--", "plugin-inspector"]);
assert.equal(invocation.shell, process.platform === "win32");
});
Expand Down
34 changes: 31 additions & 3 deletions test/report.test.mjs
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,7 @@ test("compatibility report classifies current fixture seams", async () => {
const report = await buildReport(testReportOptions());
const hasTargetOpenClaw = report.targetOpenClaw.status === "ok";
const hasSdkExportGap = report.issues.some((issue) => issue.code === "sdk-export-missing");
const hasConversationContractCoverage = targetHasConversationContractCoverage(report.targetOpenClaw);
const agentchatChannelEnvVarsAreSupported =
report.targetOpenClaw.manifestFields?.includes("channelEnvVars") === true;
const p0Issues = report.issues.filter((issue) => issue.severity === "P0");
Expand Down Expand Up @@ -49,7 +50,11 @@ test("compatibility report classifies current fixture seams", async () => {

assertHasFinding(report.warnings, "hasdata", "provider-auth-env-vars");
assertHasFinding(report.warnings, "agentchat", "channel-env-vars");
assertHasFinding(report.warnings, "llm-trace-phoenix", "conversation-access-hook");
if (hasConversationContractCoverage) {
assertMissingFinding(report.warnings, "conversation-access-hook");
} else {
assertHasFinding(report.warnings, "llm-trace-phoenix", "conversation-access-hook");
}
assertHasFinding(report.suggestions, "a2a-gateway", "registration-capture-gap");
assertHasFinding(report.suggestions, "wecom", "before-tool-call-probe");
assertHasFinding(report.warnings, "a2a-gateway", "package-manifest-version-drift");
Expand All @@ -58,7 +63,9 @@ test("compatibility report classifies current fixture seams", async () => {
assertHasFinding(report.suggestions, "agentchat", "package-build-artifact-entrypoint");
assertHasFinding(report.suggestions, "a2a-gateway", "package-typescript-source-entrypoint");
assertHasFinding(report.suggestions, "wecom", "package-dependency-install-required");
assertHasFinding(report.warnings, "honcho", "conversation-access-hook");
if (!hasConversationContractCoverage) {
assertHasFinding(report.warnings, "honcho", "conversation-access-hook");
}
assertHasFinding(report.warnings, "composio", "package-plugin-api-compat-missing");
assertHasFinding(report.suggestions, "secureclaw", "registration-capture-gap");
if (hasTargetOpenClaw) {
Expand All @@ -74,7 +81,11 @@ test("compatibility report classifies current fixture seams", async () => {
assertHasDecision(report.decisions, "inspector-follow-up", "registration-capture");

assertHasIssue(report.issues, "P2", "registration-capture-gap");
assertHasIssue(report.issues, "P1", "conversation-access-hook");
if (hasConversationContractCoverage) {
assertMissingFinding(report.issues, "conversation-access-hook");
} else {
assertHasIssue(report.issues, "P1", "conversation-access-hook");
}
assertHasIssue(report.issues, "P2", "package-plugin-api-compat-missing");
assertHasIssue(report.issues, "P2", "package-build-artifact-entrypoint");
assertHasIssue(report.issues, "P2", "package-typescript-source-entrypoint");
Expand Down Expand Up @@ -311,6 +322,9 @@ test("disabled OpenClaw target suppresses target-derived compat findings", async
assertMissingFinding(report.warnings, "sdk-export-missing");
assertMissingFinding(report.warnings, "manifest-unknown-fields");
assertMissingFinding(report.suggestions, "missing-compat-record");
assertHasFinding(report.warnings, "llm-trace-phoenix", "conversation-access-hook");
assertHasFinding(report.warnings, "honcho", "conversation-access-hook");
assertHasIssue(report.issues, "P1", "conversation-access-hook");
assert.ok(report.contractProbes.every((probe) => !probe.id.startsWith("sdk.import.package-export-cold-import:")));
assert.match(markdown, /\| Status\s+\| disabled\s+\|/);
});
Expand Down Expand Up @@ -433,6 +447,20 @@ function testReportOptions() {
};
}

function targetHasConversationContractCoverage(targetOpenClaw) {
const contractId = "hook.llm-observer.privacy-payload";
const status = targetOpenClaw.compatRecordStatuses?.[contractId];
const tests = targetOpenClaw.compatRecordTests?.[contractId];
const missingTests = targetOpenClaw.compatRecordMissingTests?.[contractId];
return (
["active", "supported"].includes(status) &&
Array.isArray(tests) &&
tests.length > 0 &&
Array.isArray(missingTests) &&
missingTests.length === 0
);
}

function assertHasFinding(findings, fixture, code) {
assert.ok(
findings.some((finding) => finding.fixture === fixture && finding.code === code),
Expand Down
Loading