Inference engine that lets you run LLMs locally and efficiently
Website · Docs · Hugging Face . X · Bluesky . Discord
- On-device AI: inference library for Python, Kotlin, Swift, Flutter, React Native/Expo and Godot.
Inference engine that lets you run LLMs locally and efficiently
Website · Docs · Hugging Face . X · Bluesky . Discord
LocalChat for macOS: a local AI chat app (workshop edition)
LocalChat for Windows: a local AI chat app (workshop edition)
Enhanced ChatGPT Clone: Features Agents, MCP, Skills, DeepSeek, Anthropic, AWS, OpenAI, Responses API, Azure, Groq, o1, GPT-5, Mistral, OpenRouter, Vertex AI, Gemini, Artifacts, AI model switching, message search, Code Interpreter, langchain, DALL-E-3, OpenAPI Actions, Functions, Secure Multi-User Auth, Presets, open-source for self-hosting. Active
On-device AI inference for Swift apps. Run LLMs locally on iOS, macOS, visionOS and watchOS.
Expo starter example app to get started with NobodyWho, a library designed to run LLMs locally and efficiently on any device.