From d4c373047532f9c32f90285b5e4f0280087f5a98 Mon Sep 17 00:00:00 2001 From: Dominic Farolino Date: Fri, 4 Sep 2026 08:40:00 -0400 Subject: [PATCH 1/3] Refactor sequence diagrams --- README.md | 79 +++++++++++++++++++++++++++++++------------------------ 1 file changed, 45 insertions(+), 34 deletions(-) diff --git a/README.md b/README.md index 7557f23..7b6f553 100644 --- a/README.md +++ b/README.md @@ -28,45 +28,56 @@ Backend integrations work well for server-side actions, but they pose significan #### WebMCP In-browser tool flow ```mermaid -graph TD - subgraph WB["Web browser"] - BA["Browser-integrated AI agent"] - subgraph RP["Running Page 'index.html'"] - WMCP["WebMCP tools"] - end - end - - AI["AI agent platform"] - TP["Third-party service
(example.com)"] - - %% Connections - TP -->|"1. Browser loads page over HTTP"| RP - AI <-->|"2. LLM in the cloud communicates with a browser AI agent to act on web content"| BA - BA <-->|"3. Browser agent uses WebMCP tools to actuate the current page"| WMCP - WMCP -->|"4. WebMCP tools update UI and make API calls"| TP +sequenceDiagram + participant Page as Running Page
index.html + participant Agent as Browser-integrated
AI agent + participant AI as AI agent platform + participant Service as Third-party origin
example.com + + Agent->>AI: 1. Send user prompt + + AI-->>Agent: 2. Inspect or act on
the current page + + Agent->>Page: 3. Invoke page-provided
WebMCP tool + + Page->>Service: 4. Make API call as needed + Service-->>Page: API response + + Page->>Page: 5. Update application state
and visible UI + + Page-->>Agent: 6. WebMCP tool result + Agent-->>AI: Tool result + + Note over Page,Agent: Site-owned code performs the action and keeps its UI in sync ``` #### Direct backend MCP flow ```mermaid -graph TD - AI["AI agent platform"] - - subgraph WB["Web Browser"] - BIA["Browser-integrated AI agent"] - RP["Running Page <index.html>"] - end - - subgraph TP["Third-party service (example.com)"] - MCP[("MCP Server")] - end - - RP <-->|1. Browser loads page over HTTP| TP - BIA -->|2. User prompt sent to agent platform in the cloud.| AI - AI -->|"3. Agent platform uses pre-configured MCP server to interact directly with service and fulfill user request."| MCP - MCP -->|4a. MCP response routed back to agent platform.| AI - AI -->|5. Response rendered to user by browser agent. Web page has no direct visibility or control.| BIA - RP <-.->|4b. Service manually pushes updates to page.| TP +sequenceDiagram + participant Page as Running Page
index.html + participant Agent as Browser-integrated
AI agent + participant AI as AI agent platform + participant Service as Third-party origin
example.com + + Agent->>AI: 1. Send user prompt + + AI-->>Agent: 2. Inspect or act on
the current page + + Agent->>Page: 3. Scrape / actuate via
DOM and browser APIs + Page-->>Agent: Visible page state + Agent-->>AI: Page state + + AI->>Service: 4. MCP call + Service-->>AI: MCP response + + Note over Page,Service: Backend state may now differ from the visible page + + AI-->>Agent: 5. Continue browser task
with MCP result + + Agent->>Page: 6. Scrape / actuate DOM
to reconcile visible UI + + Note over Page,Agent: Front-end state must be inferred and manipulated indirectly ``` Many challenges faced by assistive technology also apply to AI agents that struggle to navigate existing human-first interfaces when agent-first "tools" are not available. Even when agents succeed, simple operations often require multiple steps and can be slow or unreliable. From bce5c2ca740d2ccf2b1e07ac08392c008a47304f Mon Sep 17 00:00:00 2001 From: Dominic Farolino Date: Fri, 4 Sep 2026 08:46:22 -0400 Subject: [PATCH 2/3] Try and break line --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 7b6f553..151c228 100644 --- a/README.md +++ b/README.md @@ -77,7 +77,7 @@ sequenceDiagram Agent->>Page: 6. Scrape / actuate DOM
to reconcile visible UI - Note over Page,Agent: Front-end state must be inferred and manipulated indirectly + Note over Page,Agent: Front-end state must be inferred
and manipulated indirectly ``` Many challenges faced by assistive technology also apply to AI agents that struggle to navigate existing human-first interfaces when agent-first "tools" are not available. Even when agents succeed, simple operations often require multiple steps and can be slow or unreliable. From b8bee41123622ac3191441df191f601c460d740f Mon Sep 17 00:00:00 2001 From: Dominic Farolino Date: Fri, 4 Sep 2026 08:47:31 -0400 Subject: [PATCH 3/3] Another --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 151c228..2b355b1 100644 --- a/README.md +++ b/README.md @@ -48,7 +48,7 @@ sequenceDiagram Page-->>Agent: 6. WebMCP tool result Agent-->>AI: Tool result - Note over Page,Agent: Site-owned code performs the action and keeps its UI in sync + Note over Page,Agent: Site-owned code performs the
action and keeps its UI in sync ``` #### Direct backend MCP flow