🔧 LLMs on Consumer Hardware — Part 1: The Stack and First Benchmarks

This is the first in a series of build-log posts documenting a local LLM project, in which models are run on owned consumer hardware rather than through a cloud API. The present entry covers the hardware, the software stack, and the benchmarks by which a primary model was selected.




The hardware


Two machines are used, both...