A powerful Home Assistant custom integration that connects your Home Assistant instance with multiple AI providers (OpenAI, Google Gemini, Anthropic (Claude), OpenRouter, and Llama) to translate user requests into valid Home Assistant operations, including creating automations automatically!
- 🤖 Multiple AI Provider Support: OpenAI, Google Gemini, Anthropic (Claude), OpenRouter, and Llama
- 🎯 Model Selection: Choose from predefined models or use custom model names
- 🏠 Smart Home Control: Turn lights on/off, control climate, and manage devices
- ⚡ Automation Creation: Automatically create automations based on natural language
- 📊 Data Access: Get entity states, history, weather, and more
- 🔒 Secure: API keys stored securely in Home Assistant
- 🎨 Beautiful UI: Clean, modern chat interface
- 🔄 Real-time: Instant responses and updates
- Models: GPT-3.5 Turbo, GPT-4, GPT-4 Turbo, GPT-4o, O1-Preview, O1-Mini
- Setup: Get API key from OpenAI Platform
- Models: Gemini 1.5 Flash, Gemini 1.5 Pro, Gemini 1.0 Pro, Gemini 2.0 Flash Exp
- Setup: Get API key from Google AI Studio
- Models: Claude 3.5 Sonnet, Claude 3.5 Haiku, Claude 3 Opus, Claude 3 Sonnet, Claude 3 Haiku
- Setup: Get API key from Anthropic Console
- Popular Models:
claude-3-5-sonnet-20241022(Latest and most capable)claude-3-5-haiku-20241022(Fast and efficient)claude-3-opus-20240229(Most powerful for complex tasks)
- Models: Access to 100+ models including Claude, Llama, Mistral, and more
- Setup: Get API key from OpenRouter
- Popular Models:
anthropic/claude-3.5-sonnetmeta-llama/llama-3.1-70b-instructmistralai/mixtral-8x7b-instruct
- Models: Llama 4 Maverick, Llama 3.1, Llama 3.2
- Setup: Get API key from your Llama provider
- Open HACS in your Home Assistant instance
- Click on "Integrations"
- Click the three dots in the top right corner
- Select "Custom repositories"
- Add this repository:
https://github.com/sbenodiz/ai_agent_ha - Select "Integration" as the category
- Click "Add"
- Find "AI Agent HA" in the integration list
- Click "Download"
- Restart Home Assistant
- Go to Settings → Devices & Services → Add Integration
- Search for "AI Agent HA"
- Follow the setup wizard to configure your preferred AI provider
- Download the latest release from the releases page
- Extract the files
- Copy the
custom_components/ai_agent_hafolder to your Home Assistantcustom_componentsdirectory - Restart Home Assistant
- Go to Settings → Devices & Services → Add Integration
- Search for "AI Agent HA"
- Follow the setup wizard to configure your preferred AI provider
The integration uses a two-step configuration process:
Select your preferred AI provider from the dropdown:
- OpenAI
- Google Gemini
- Anthropic (Claude)
- OpenRouter
- Llama
Enter your API credentials and optionally select a model:
- API Key/Token: Your provider-specific API key
- Model: Choose from predefined models or enter a custom model name
# Example configuration.yaml (optional - integration supports config flow only)
ai_agent_ha:
ai_provider: anthropic
anthropic_token: "sk-ant-..."
models:
anthropic: "claude-3-5-sonnet-20241022"Access the beautiful chat interface at:
- Sidebar: AI Agent HA panel
- URL:
http://your-ha-instance:8123/ai_agent_ha
Ask natural language questions like:
- "Turn on all the lights in the living room"
- "What's the temperature in the bedroom?"
- "Create an automation to turn off lights at 11 PM"
- "Show me the weather forecast"
- "Which doors are open?"
Use the ai_agent_ha.query service in automations:
service: ai_agent_ha.query
data:
prompt: "Turn on the porch light when motion is detected"Enter any model name in the "Custom Model" field:
- OpenAI:
gpt-4-0125-preview - Anthropic:
claude-3-opus-20240229 - OpenRouter:
anthropic/claude-3-opus - Gemini:
gemini-pro-vision
The AI can create automations automatically:
- Ask: "Create an automation to turn on lights at sunset"
- Review the generated automation
- Approve or reject the suggestion
- Automation is added to your Home Assistant
The AI can access comprehensive Home Assistant data:
- Entity states and history
- Weather information
- Person locations
- Device registry
- Area/room information
- Statistics and analytics
- Fork the repository
- Create a feature branch
- Make your changes
- Test thoroughly
- Submit a pull request
The integration provides these main components:
- AI Clients: Modular providers (OpenAI, Gemini, OpenRouter, Llama)
- Agent: Core logic for processing requests
- Config Flow: Setup and options management
- Frontend: Chat interface
- Home Assistant 2023.3+
- Python 3.11+
- One of the supported AI provider API keys
- API keys are stored securely in Home Assistant's encrypted storage
- All communication uses HTTPS
- No data is stored outside your Home Assistant instance
- Provider-specific security practices are followed
If you find this integration helpful and would like to support its development, you can buy me a coffee! Your support helps keep this project active and maintained.
Every contribution, no matter how small, is greatly appreciated and helps fund the continued development and improvement of AI Agent HA.
This project is licensed under the MIT License - see the LICENSE file for details.
- Issues: GitHub Issues
- Discussions: GitHub Discussions
- Documentation: Wiki
- Home Assistant community for the excellent platform
- All AI providers for their powerful APIs
- Special thanks to @RmG152 for their valuable help with development
- Contributors and testers who help improve this integration
Made with ❤️ for the Home Assistant community