Issues

MCP spec conformance (math-mcp example): 1 requirement violated (via @hasmcp/mcp-spec-test) — spec 2025-11-25
Accenture/mcp-bench#42 · opened on Aug 24, 2026
MCP spec conformance (math-mcp example): 7 requirements violated (via @hasmcp/mcp-spec-test) — spec 2026-07-28
Accenture/mcp-bench#41 · opened on Aug 24, 2026
Protocol review request: AANA pre-tool-call safety/reliability track
Accenture/mcp-bench#33 · opened on May 7, 2026
5
Question About Multi-Server Task Counts in the Dataset
Accenture/mcp-bench#28 · opened on Dec 8, 2025
1
Clarification on "Overall Score" calculation logic
Accenture/mcp-bench#25 · opened on Nov 29, 2025
1
GOOGLE API
Accenture/mcp-bench#24 · opened on Nov 4, 2025
1
Total: 0 models
Accenture/mcp-bench#23 · opened on Nov 3, 2025
10
GOOGLE_MAPS_API_KEY
Accenture/mcp-bench#21 · opened on Nov 3, 2025
1
MCP connection error
Accenture/mcp-bench#20 · opened on Oct 17, 2025
10
Where can I save the agent's trajectory? I
Accenture/mcp-bench#18 · opened on Sep 29, 2025
3
Only 52 out of 56 tasks were successful.
Accenture/mcp-bench#17 · opened on Sep 29, 2025
4
Results have no scores except task_success_rate
Accenture/mcp-bench#16 · opened on Sep 24, 2025
1
Computation/rescale for the overall and each-item score
Accenture/mcp-bench#15 · opened on Sep 12, 2025
3
Available models: Total: 0 models
Accenture/mcp-bench#13 · opened on Sep 9, 2025
1
Trajectories for baselines
Accenture/mcp-bench#9 · opened on Sep 2, 2025
2
Release MCP-Bench Tasks on Hugging Face
Accenture/mcp-bench#7 · opened on Aug 31, 2025