Build CUDA from Source
This is a note for Blog-1 and Blog-2:
git clone [email protected]:TimDettmers/bitsandbytes.git
cd bitsandbytes
export CUDA_HOME=/usr/local/cuda-12.1 && make cuda12x CUDA_VERSION=121
export CUDA_HOME=/usr/local/cuda-12.1 && make cuda12x_nomatmul CUDA_VERSION=121
CUDA_VERSION=121 && python setup.py install
This will generate 2 files one with approximately 7mb and other with 14mb
libbitsandbytes_cuda121.so
libbitsandbytes_cuda121_nocublaslt.so
Copy those files topython3.9/site-packages/bitsandbytes/.