Scaling “E-Waste”: LLMs on Multiple Decommissioned GPUs
The critical finding last time was that: in this world of decommissioned enterprise hardware, three and four GPU setups are counter-intuitively durable against diminishing returns.