After a successful run with self-hosting several apps and services over the past few months, I recently decided to delve deeper into the rabbit hole by hosting an LLM on my home server. Thankfully, ...
Most discussions about self-hosted LLMs focus heavily on GPUs, benchmarks, quantization, and running bigger models locally. I used to think the same way. But after spending the past year experimenting ...