Linux, amd without zluda on rocm

[Tokariew]

Hi, i came back to sdnext after some time, i was using happily rocm version, but in meantime it seems that amd gpu now require zluda to work, and with my setup i can't make it to work.

tokariew in sdnext   master ?×2via  v20.12.2  v3.11.9 via  sd6next
➜ python launch.py  --medvram --listen --models-dir /media/nvme/ai/models/sdnext/
17:27:45-139167 INFO     Starting SD.Next
17:27:45-141816 INFO     Logger: file="/home/tokariew/gits/others/sdnext/sdnext.log" level=INFO size=1634083 mode=append
17:27:45-142675 INFO     Python version=3.11.9 platform=Linux bin="/home/tokariew/.local/share/conda/envs/sd6next/bin/python" venv="/home/tokariew/.local/share/conda/envs/sd6next"
17:27:45-161982 INFO     Version: app=sd.next updated=2024-07-10 hash=2ec6e9ee branch=master [email protected]:vladmandic/automatic/tree/master ui=main
17:27:45-493771 INFO     Platform: arch=x86_64 cpu= system=Linux release=6.9.7-200.fc40.x86_64 python=3.11.9
17:27:45-495579 INFO     HF cache folder: /home/tokariew/.cache/huggingface/hub
17:27:45-500650 INFO     Python version=3.11.9 platform=Linux bin="/home/tokariew/.local/share/conda/envs/sd6next/bin/python" venv="/home/tokariew/.local/share/conda/envs/sd6next"
17:27:45-501982 INFO     AMD ROCm toolkit detected
17:27:45-808075 ERROR    Uncaught exception occurred: type=<class 'FileNotFoundError'> value=[Errno 2] No such file or directory: '/opt/rocm/lib/hipblaslt/library'
17:27:45-809641 ERROR    '  File "/home/tokariew/gits/others/sdnext/launch.py", line 265, in <module>\n    main()\n'
17:27:45-810273 ERROR    '  File "/home/tokariew/gits/others/sdnext/launch.py", line 209, in main\n    installer.check_torch()\n'
17:27:45-810826 ERROR    '  File "/home/tokariew/gits/others/sdnext/installer.py", line 714, in check_torch\n    torch_command = install_rocm_zluda(torch_command)\n
                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n'
17:27:45-811497 ERROR    '  File "/home/tokariew/gits/others/sdnext/installer.py", line 559, in install_rocm_zluda\n    for file in os.listdir(libpath):\n
                         ^^^^^^^^^^^^^^^^^^^\n'

I using fedora and installed rocm/hip from the my distro repo.

[vladmandic]

amd gpus don't require zluda, if you're on linux you're actually better of with torch-rocm.
zluda is likely best option if you're on windows.

[Tokariew]

so why it want it is trying to install zluda on current master, i think about 1.5month ago it work fine with command which i tried to run it currently

[vladmandic]

please create an issue and document everything.

[Tokariew]

This workaroud worked for me pytorch/torchtune#1108