Premio LLM-2U-AM5 AMD Ryzen 9000 or EPYC 4005 2U Edge AI Server with 10GbE SFP+ and Dual PCIe x16 Slots

Running inference or vision models on site often calls for many-core processing, fast networking and room for GPU cards in a rack that is already in place. The Premio LLM-2U-AM5 is a 2U edge AI server built around the AMD AM5 socket, with Ryzen 9000/7000 and EPYC 4005/4004 processors, two PCIe x16 Gen5 slots for GPU cards and two 10GbE SFP+ ports.

Premio lists the Ryzen 9 9950X, Ryzen 9 7950X, EPYC 4565P and EPYC 4564P, up to 170 W TDP, on an AMD B650 chipset. Four DDR5 UDIMM sockets take up to 192 GB, non-ECC, at up to 5600 MT/s depending on the processor. The two x16 slots run one card at x16 or two at x8, and two x4 slots (one at x1, one sharing lanes with an M.2 socket) take further cards. Windows 11 and Ubuntu 22.04 are supported, with TPM 2.0.

Networking is two Broadcom 10GbE SFP+ ports and two Intel I210AT GbE ports, with an optional out-of-band management port. One DisplayPort 1.4a and one HDMI 2.0 output each drive a 4K display, and there are six rear USB 3.2 Gen 2 ports and two front USB 2.0 ports. Storage is two M.2 M key PCIe x4 NVMe sockets and two internal 2.5″ SATA SSD bays with RAID 0 and 1. An M.2 E key socket takes optional Wi-Fi.

An 850 W supply runs from 115 to 230 V AC through an IEC 60320 C14 inlet. A CPU fan cooler and four internal fans cool the server, rated 0 °C to 35 °C with 0.6 m/s airflow, or to 25 °C with GPUs above 210 W, and it is designed to comply with MIL-STD-810H for shock and vibration. We supply the LLM-2U-AM5 configured and tested, with memory, storage, GPU cards and the OS image fitted. The LLM-3U-AM5 takes the same board in 3U with a 3.5″ drive bay, and the LLM-1U-RPL-1E16-600W-AC is a 1U server on Intel Core with redundant power.