cross-posted from: https://lemmy.ml/post/1423579
Raytracing is finally in a good state for AMD GPUs. Always good to hear GPU improvements for Linux!
Meanwhile using stable diffusion with an nvidia card for too long makes cuda crash with failed assertions.
I hope AMD improves ROCm for consumer cards instead of focusing too much on graphics. The 24GB of VRAM on the 7900 XTX would be great for running LLMs, but with the state of ROCm it’s not really worth it when a used 3090 can do the job just as not-so-well.
I use Stable Diffusion with ROCm on Linux. Works great and no need to install the big bloat ROCm from the package manager. I’ve written an installation guide for Arch, but with little changes it should work on other distributions as well: https://gist.github.com/NoXPhasma/ba42b615c0ed1cb0c2b3a4a1b359ccf7
I’ve got three updates on ROCm in the last few months, I think the progress is going steadily.
