Local LLM Inference on AMD RX 9070 XT — Vulkan vs ROCm Benchmarks on RDNA4
I got an RX 9070 XT with 16GB VRAM and the obvious first thing to do was run local LLM inference on it.
Badges come from GitHub once the author claims this feed.
I got an RX 9070 XT with 16GB VRAM and the obvious first thing to do was run local LLM inference on it.