Skip to content
This repository was archived by the owner on May 11, 2025. It is now read-only.

Conversation

casper-hansen
Copy link
Owner

No description provided.

@casper-hansen casper-hansen merged commit 3da9d7f into main Jul 22, 2024
@wasertech
Copy link
Contributor

wasertech commented Aug 3, 2024

Hey @casper-hansen,

I have tried to build AWQ kernels on py312 from main since its not prebuilt on pypi yet but I get the following error while doing so.

pip install "git+https://github.com/casper-hansen/AutoAWQ_kernels.git" > awq_kernel_build.logs 2>&1
...
RuntimeError: Error compiling objects for extension

awq_kernel_build.logs can be found here as a gist

Do you want me to open an issue or provide more information?

PS: I've also tried cloning the repo manually and using pip install -e . but the result is the same.

EDIT: Nevermind, my default version of GCC is 14.1.1 which isn't supported by CUDA 12.5. Using GCC 13.3 and Torch 2.4.0 built with CUDA 12.4 (because my installed version of CUDA is 12.5) fixed this issue.
To do so I had to edit lines 8 and 9 of the setup.py file to use g++-13 (in my case - on arch/manjaro) and set requirements on lines 58-60 to torch==2.4.0

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants