The only consumer GPU with 32GB of RAM in the current generation is the RTX 5090. NVidia claims it hasn't been discontinued but it's also impossible to buy and the resale prices have spiked to $5k+. So for a PC with 256GB of RAM and a 32GB GPU you're over $10k just for those two parts. Many believe, myself included, NVidia's new "flagship" will be announced in early 2026 and will be the RTX 5080 Super with 24GB of RAM, also probably costing $2k+ anyway.
What you probably want instead is a Mac Studio with an M5 Ultra. The 256GB model is ~$11k. The problem? Demand is so high that the lead time last I checked was March. But this will give you 256GB of shared memory, well above the 32GB you'll get on a 5090.
If you can live with 96GB (or less) on a Mac Studio it's quite a lot cheaper and the lead times are far quicker.
> The only consumer GPU with 32GB of RAM in the current generation is the RTX 5090.
Well not really, there is the AMD Radeon AI PRO 9700, which is a RX 9070 (or possibly the XT, dunno) with 32GB VRAM. It does use slower GDDR6, but it has "held its price better" (for some definition of better) and is still available for like 2.3k€ (this includes taxes). Though I remember when I was thinking of buying one when it was 1.4k not too long ago and didn't :( now I just don't bother looking anymore.
Slower in what specifically? It wouldn't surprise me if the card is up to 3x slower (it has roughly 3x less bandwidth), but do note that we are comparing a 2.3k€ card vs a +9k€ card here (plus on top of that the power usage on the RTX 5090 can be up to 2x under load).
The RX 7900 XTX has slightly higher bandwidth at almost 1kGBps compared to AI PROs almost 650GBps but has only 24GB instead of 32GB, though I can't find the card on sale anywhere rn.
In the end I see it mostly as a "is the massive jump in price worth it, or do you risk it and maybe get multiple AI 9700s instead and deal with ROCm instead". I can't tell how good ROCm has gotten in regards to training and such, but for inference Vulkan on my 9070 XT is pretty solid.
[−]SubiculumCode · 2026-11-15 Sun 17:56 UTC ·
link
What you probably want instead is a Mac Studio with an M5 Ultra. The 256GB model is ~$11k. The problem? Demand is so high that the lead time last I checked was March. But this will give you 256GB of shared memory, well above the 32GB you'll get on a 5090.
If you can live with 96GB (or less) on a Mac Studio it's quite a lot cheaper and the lead times are far quicker.
Well not really, there is the AMD Radeon AI PRO 9700, which is a RX 9070 (or possibly the XT, dunno) with 32GB VRAM. It does use slower GDDR6, but it has "held its price better" (for some definition of better) and is still available for like 2.3k€ (this includes taxes). Though I remember when I was thinking of buying one when it was 1.4k not too long ago and didn't :( now I just don't bother looking anymore.
The RX 7900 XTX has slightly higher bandwidth at almost 1kGBps compared to AI PROs almost 650GBps but has only 24GB instead of 32GB, though I can't find the card on sale anywhere rn.
In the end I see it mostly as a "is the massive jump in price worth it, or do you risk it and maybe get multiple AI 9700s instead and deal with ROCm instead". I can't tell how good ROCm has gotten in regards to training and such, but for inference Vulkan on my 9070 XT is pretty solid.