Qwen-14B-Chat-Int4推理报错:ImportError: libcudart.so.12: cannot open shared object file

在 Qwen-14B-Chat-Int4推理时，发现报错，缺少 optimum 和 auto-gptq 两个pip包

Traceback (most recent call last):
  File "test_qwen_14b_int4.py", line 6, in
    model = AutoModelForCausalLM.from_pretrained(
  File "/home/linewell/anaconda3/envs/codeS/lib/python3.8/site-packages/transformers/models/auto/auto_factory.py", line 558, in from_pretrained
    return model_class.from_pretrained(
  File "/home/linewell/anaconda3/envs/codeS/lib/python3.8/site-packages/transformers/modeling_utils.py", line 2584, in from_pretrained
    raise ImportError(
ImportError: Loading GPTQ quantized model requires optimum library : `pip install optimum` and auto-gptq library 'pip install auto-gptq' 

按照提示，pip安装这两个包，结果报错： ImportError: libcudart.so.12: cannot open shared object file: No such file or directory

Traceback (most