CUDA Setup failed despite GPU being available.

在跑chatglm-6B大模型时,由bitssandbytes包引起的报错!!!

CUDA Setup failed despite GPU being available. Please run the following command to get more information:
python -m bitsandbytes
Inspect the output of the command and see if you can locate CUDA libraries. You might need to add them
to your LD_LIBRARY_PATH. If you suspect a bug, please take the information from python -m bitsandbytes
and open an issue at: https://github.com/TimDettmers/bitsandbytes/issues"
debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:10001 {created_time:"2023-08-04T10:17:03.252422961+08:00", grpc_status:9, grpc_message:"Failed to import transformers.training_args_seq2seq because of the following error (look up to see its traceback):\n\n CUDA Setup failed despite GPU being available. Please run the following command to get more information:\n\n python -m bitsandbytes\n\n Inspect the ou

你可能感兴趣的:(#,chatglm,LLM)