Enlarging AMD iGPU GTT on Linux to Run Big LLMs
AMD integrated GPUs (APUs) share the system RAM with the CPU — there’s no separate VRAM chip. In the BIOS you can carve out a fixed chunk of RAM as “VRAM” for the iGPU, but that setting is usually capped: on my Ryzen AI 9 HX 370 (Radeon 890M) the BIOS tops out at 48 GB. On a machine with 96 or 128 GB of RAM that’s frustrating — you’d love to hand more of it to the GPU and run a 70B model.