--with fastapi --with orjson to fix missing package error with github_copilot models

[ekr1]

Issue

Right now I need to run cecli with the uv tool run ... --with fastapi --with orjson ... cecli options; otherwise it will raise a litellm.APIConnectionError: APIConnectionError: Github_copilotException with the message No module named '...' for either module. Looks like those are missing in the requirements.txt?

This happens with all github_copilot/... models.

N.B. the code just displays "Retrying in ..." and suppresses any meaningful user output for this error unless I add this line:

modified   cecli/models.py
@@ -1416,6 +1416,7 @@ class Model(ModelSettings):
                         return hash_object, self.model_error_response()
 
                 print(f"Retrying in {retry_delay:.1f} seconds...")
+                print(f"LiteLLM API Error: {str(err)}")
                 if interrupt_event:
                     _res, interrupted = await coroutines.interruptible(
                         asyncio.sleep(retry_delay), interrupt_event

So there is a path through this method that displays no info whatsoever; maybe you could make it so at least the bare error message is displayed to the user in any case. I'd rather have a little spam than an error that is unactionable to the user.

As usual, thanks for your great work! :)

Version and model info

cecli v0.100.13.dev9

[dwash96]

Hey, so I will make the logging change today with v0.100.13 but I am curious as to how the original error even happens because I can't reproduce it. Which version of python, litellm, and what platform does this happen with? I see that litellm declares them as optional dependencies in their pyproject.toml for the proxy. Are you using litellm-proxy as well in the same venv potentially?

[ekr1]

This is on current MacOS. Didn't do anything special with litellm etc., just plain cecli out of the box.

I can give more specific info later as well and try a fresh install if it helps.

[ekr1]

OK here is how I can reproduce it most directly.

1. Clone a fresh version of your official repo.
2. Run in agent mode (it does not happen without agent). Also with the variation of uv that does not install any tool, just runs from the current directory, to make sure nothing is wrong globally. uv tool list returns none.

uv --no-progress tool run --python python3.12 --with-editable `pwd` --from cecli-dev cecli --agent

3. Type "Hello"
4. Observe the litellm error as above ("no module...").
5. Try again with the options:

uv --no-progress tool run --python python3.12 --with-editable `pwd` --with fastapi --with orjson --from cecli-dev cecli --agent

6. Observe how everything works now.

I did update uv and cleaned its cache uv cache clean.

[dwash96]

Does this still happen in v0.100.14? The process you recommended following didn't error for me in WSL but I did update the import list and ideally litellm has fixed referencing deps they don't actually download