Qwen-14B-Chat-Int4推理报错:ImportError: libcudart.so.12: cannot open shared object file
在Qwen-14B-Chat-Int4推理时,发现报错,缺少optimum和auto-gptq两个pip包Traceback(mostrecentcalllast):File"test_qwen_14b_int4.py",line6,inmodel=AutoModelForCausalLM.from_pretrained(File"/home/linewell/anaconda3/envs/cod