On-device & local inference
Infrastructure built to run AI models directly on user-owned or edge hardware rather than relying primarily on remote cloud inference. These platforms make local models easier to deploy and operate while accounting for the constraints of the underlying device.
- Companies
- 4
Explore
Companies
- Conifer
Conifer is an AI inference gateway that routes requests across local and cloud models, providing one interface, one account, and one bill for production inference.
- DiscreteStack
DiscreteStack builds private AI infrastructure for enterprises so they can run open models on their own servers with flat rate pricing and full control over data and governance. It says the…
- LM Studio
LM Studio builds a desktop and developer platform for running open-source LLMs locally on user-owned hardware, with offline chat, model management, APIs, and tooling for app integration.
- Ollama
Ollama builds a local and cloud platform that makes it easy for developers and teams to run open AI models on their own hardware or nearby infrastructure.