启动百川大模型错误解决:ModuleNotFoundError: No module named ‘bitsandbytes‘

1.错误信息

Traceback (most recent call last):
  File "/root/.cache/huggingface/modules/transformers_modules/Baichuan2-13B-Chat-lora23/modeling_baichuan.py", line 735, in quantize
    from .quantizer import quantize_online
  File "/root/.cache/huggingface/modules/transformers_modules/Baichuan2-13B-Chat-lora23/quantizer.py", line 1, in 
    import bitsandbytes as bnb
ModuleNotFoundError: No module named 'bitsandbytes

2.错误原因排查

	pip install torch 默认安装的版本太高导致,如图:

启动百川大模型错误解决:ModuleNotFoundError: No module named ‘bitsandbytes‘_第1张图片
3.错误解决

	降低版本:pip install torch==2.0.1

你可能感兴趣的:(pytorch,人工智能,python,百川大模型)