Models
How Tholos AI uses open-weight models — and the wider landscape. · 2 articles
AI models in Tholos AI & the open-weight landscape
What kinds of models Tholos AI runs, the major open-weight families (Llama, Qwen, Mistral, and more), and why models come in different sizes.
Bring your own GGUF model
Run an open-weight model that isn't in the catalog — what GGUF you need, where to put it, and how it shows up in the app (also the air-gapped install path).