Skip to content

dev issues 6 - #183

Open
lzsweb wants to merge 4 commits into
mainfrom
dev/issues-6
Open

dev issues 6#183
lzsweb wants to merge 4 commits into
mainfrom
dev/issues-6

Conversation

@lzsweb

@lzsweb lzsweb commented Aug 28, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • Add built-in view_image tool so the agent can analyze local images itself (after scrape_web_screenshot / camera_capture or any user-saved image), routing them to a vision-capable model on the active provider
  • Auto-slice oversized images (long side > 8000px or aspect ratio > 4:1): vision backends downscale or truncate ultra-tall images until text is illegible, so view_image crops overlapping slices with Pillow, runs one vision call per slice, and stitches the results; new slice=auto|never parameter; Pillow optional with whole-image fallback
  • Add Chinese README (README_zh.md) mirroring README.md, with language switchers in both

Test plan

  • tests/unit/test_acli_vision_tool.py: 15 unit tests pass (tool registration, model picking, slicing plan coverage/cap, auto-slice path, slice=never, per-slice error reporting)
  • Offline dry-run on a real 1382x12028 table image: 7 slices, full row coverage, ~1MB per slice
  • Manual: restart the assistant, ask it to read an ultra-tall table image; expect results prefixed with (Image auto-split into N slices ...) covering the whole table

zhansheng.lzs added 4 commits August 27, 2026 17:34
The only multimodal entry point was user-input @path expansion, so
after scrape_web_screenshot/camera_capture the model could not see the
saved image and sometimes echoed the user-facing @path hint verbatim,
ending the turn prematurely. view_image routes a local image to a
vision-capable model on the active provider (active model if vision-
capable, else the provider's declared vision model, else a per-
provider fallback), and screenshot/camera hints now point at it.
Synced from agenticCLI ae76b1a: vision backends downscale ultra-tall
images until text is illegible, so view_image now detects oversized
images, crops overlapping slices with Pillow, runs one vision call per
slice, and stitches the results. Pillow optional; slice=auto|never.
README.md stays the English primary doc; README_zh.md mirrors it
section by section, and both cross-link at the top.
Fixes CI pylint W0622 (redefined-builtin); local pre-commit hooks all
pass now, matching the CI --all-files gate.
@lzsweb lzsweb changed the title feat(acli): built-in view_image tool with auto-slicing for oversized images feat(acli): dev issues 6 Aug 28, 2026
@lzsweb lzsweb changed the title feat(acli): dev issues 6 dev issues 6 Aug 28, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant