AI Assistants / Local LLMs & Inference Engines • 1 Resources

Local LLMs & Inference Engines

Tools for running large language models locally on your hardware.

AI Assistants & Cognitive Tools / Local LLMs & Inference Engines

free

Safe

Get up and running with large language models locally. Run Llama 3, Mistral, Gemma, and custom models with simple CLI commands and a local REST API.

OS: macos linux windows FOSS

Need quick client-side tasks? Try these companion utilities right in your browser:

ToolMatrix360 Cloud

Pro SaaS

Autonomous B2B pipeline qualification and intent scoring engine.