
Thushan Fernando
Founder & Principal Engineer
Melbourne, Australia
Thushan is the founder of TensorFoundry and the lead engineer behind Olla, the open-source LLM proxy and load balancer. With 25+ years building software, he specialises in low-level, performance-critical systems work across search, machine learning, and GPU-heavy compute, mostly in Go, Rust and Zig. Previously at SEEK and Readify, where he worked on low-latency search infrastructure and built NeoSearch, an efficient edge-model search platform serving ML at scale. TensorFoundry pivoted to AI infrastructure when the first Llama models landed; the bet was that on-premise inference would matter as much as the models themselves. He also leads TensorFoundry's consulting practice, helping organisations choose, plan, benchmark and tune the AI infrastructure they own. Based in Melbourne, Australia.
- Low-latency systems
- Search & information retrieval
- Machine learning infrastructure
- GPU compute
- Inference performance optimisation
- GPU workload benchmarking
- NVIDIA, AMD and Apple Silicon
- Go
- Rust
- Zig
