Self-Hosted LLM vs Cloud API - A Cost Framework
A transparent framework for comparing the cost of self-hosted LLM inference against cloud APIs - the variables that matter, the break-even maths, and where each wins.
Blog
Notes from the Foundry
Guides, comparisons and practical write-ups on running LLMs on your own hardware. Written by the team building Olla and the TensorFoundry stack.
Olla vs LiteLLM - Choosing an LLM Proxy
An honest comparison of Olla and LiteLLM - where each fits, where each wins, and how to choose between a Go-based local-first proxy and a Python provider hub.
LLM Inference Servers Compared - vLLM, SGLang, llama.cpp and Ollama
A practical comparison of the main LLM inference backends - vLLM, SGLang, llama.cpp and Ollama - what each is built for, the hardware they suit, and how to choose.
Deploying LLMs on Your Own Infrastructure - A Practical Guide
A complete guide to running large language models on your own infrastructure - why teams do it, the stack from backends to orchestration, hardware, cost and compliance.
What is an LLM Proxy?
A practical look at what an LLM proxy does, why you end up needing one, and how it sits in front of inference backends like Ollama, vLLM and llama.cpp.