AI/LLM Homelab Server Setup 04/2025

03.04.2025
·
< 1 min.
·

Smaller form-factor and some hardware changes. I'm not planning to expand the setup; it's enough for experimentation and runs up to 32b q4 fine. Much lower energy consumption without sacrificing inference performance compared to the overpowered previous apartment heater build.

Case: Silverstone GD09 server case (19 inch rack compatible)

Mainboard: MSI

CPU: AMD

Cooler: Stock AMD

RAM: 1x 8 GB DDR4

GPU: 2x RTX 3060 12 GB

PSU: be quiet PURE POWER 11

Leave a Reply

Your email address will not be published. Required fields are marked *

QUESTIONS?

Contact me

Copyright © Noah Krasser