【踩坑日记15】safetensors_rust.SafetensorError: Error while deserializing header: HeaderTooLarge

问题描述

加载stabilityai/stable-diffusion-xl-base-1.0模型时，出现问题。

Error while deserializing header: HeaderTooLarge
  File "/home/XXX/code/dreambooth_lora/train_dreambooth_lora_sdxl_advanced.py", line 1278, in main
    text_encoder_two = text_encoder_cls_two.from_pretrained(
  File "/home/XXX/code/dreambooth_lora/train_dreambooth_lora_sdxl_advanced.py", line 2366, in <module>
    main(args)
safetensors_rust.SafetensorError: Error while deserializing header: HeaderTooLarge

问题分析

下载的权重中textencoder的.safetensor文件可能出问题了。

问题解决

进入stabilityai/stable-diffusion-xl-base-1.0主页，重新下载textencode.safetensor文件，即下载文件text_encoder_2/model.fp16.safetensors和文件text_encoder_2/model.safetensors。

参考

SafetensorError: Error while deserializing header: HeaderTooLarge #27923
[Bug]: Stable diffusion model loading error: SafetensorError #10199