Skip to content
dipjyotimetiaPublic

About

A CLI based testing assistant powered by GenAI

Topics

Resources

Stars

14 stars

Watchers

1 watching

Forks

Repository files navigation

JARVIS

AI-powered CLI for API testing: generate test data and scenarios from OpenAPI, analyse failures, and inspect traffic.

JARVIS

goreleaser

Installation

Download the binary for your platform from the releases page.

chmod +x jarvis
sudo mv jarvis /usr/local/bin/

On Windows, put jarvis.exe on your PATH. To build from source, see the setup guide.

Quick start

jarvis setup
jarvis gen generate-testdata --spec api.yaml --count 10
jarvis gen generate-scenarios --path specs/openapi/api.yaml
jarvis analyze analyze-failures --limit 5
jarvis proxy --record
jarvis certificate --cert-dir ./certs

Supported providers

Generation and failure analysis call one LLM through pkg/engine/llm. Set LLM_PROVIDER to openai, anthropic, google, or ollama. If it is unset, Jarvis checks OPENAI_API_KEY, then ANTHROPIC_API_KEY, then GOOGLE_API_KEY, and otherwise uses Ollama.

Provider How to authenticate Default model
OpenAI OPENAI_API_KEY gpt-4o-mini
Anthropic ANTHROPIC_API_KEY claude-3-5-sonnet-20241022
Google Gemini GOOGLE_API_KEY gemini-1.5-flash
Ollama local server (OLLAMA_HOST, default http://localhost:11434) llama3.2

LLM_MODEL overrides the default model. LLM_API_KEY is accepted in place of the provider-specific key, and LLM_BASE_URL sets a custom endpoint for OpenAI-compatible APIs or for Ollama.

export OPENAI_API_KEY="sk-..."
export LLM_PROVIDER=openai
export LLM_MODEL=gpt-4o-mini

Provider setup, model choice, and troubleshooting: LLM integration and the provider quick start.

Documentation

Contributing

git clone https://github.com/dipjyotimetia/JARVIS.git
cd JARVIS
go mod download
go build -o jarvis
go test ./...

License

MIT. See LICENSE.

Support

About

A CLI based testing assistant powered by GenAI

Topics

Resources

Stars

14 stars

Watchers

1 watching

Forks

Releases

Used by

Contributors

Languages