python -m bitsandbytes 报错显示CUDA Setup failed despite GPU being available.

cuda use 11.8 not 12.1
bitsandbytes use :pip install https://github.com/jllllll/bitsandbytes-windows-webui/releases/download/wheels/bitsandbytes-0.39.1-py3-none-win_amd64.whl

bitsandbytes下载地址:Release Wheels · jllllll/bitsandbytes-windows-webui · GitHubWindows compile of bitsandbytes for use in text-generation-webui. - Release Wheels · jllllll/bitsandbytes-windows-webuihttps://github.com/jllllll/bitsandbytes-windows-webui/releases/tag/wheels

你可能感兴趣的:(大模型,语言模型,nlp,人工智能)