scrapy-redis 内存不够用 处理方法

scrapy-redis 报错

redis.exceptions.ResponseError: Command # 2 (ZREMRANGEBYRANK xxxxxx:requests 0 0) of pipeline caused error: 
MISCONF Redis is configured to save RDB snapshots, but it is currently not able to persist on disk. Commands 
that may modify the data set are disabled, because this instance is configured to report errors during writes 
if RDB snapshotting fails (stop-writes-on-bgsave-error option). Please check the Redis logs for details about the RDB error.

window 处理

找到redis的安装目录, 打开redis.windows.conf

# 添加
maxmemory 4G
# 将 yes 改为 no
stop-writes-on-bgsave-error no

保存文件, 一定要记得保存
然后重启redis

# 关闭redis
net stop redis
# 开启redis 
net start redis

linux 处理

修改redis.conf文件
查看redis 状态:

systemctl status redis

启动redis

systemctl start redis

重启redis

systemctl restart redis.service
# 或者
service redis restart

你可能感兴趣的:(scrapy-redis 内存不够用 处理方法)