scrapy遇到403 500 502等状态码时的应对

遇到错误忽略掉不重新请求,则设成[]

RETRY_HTTP_CODES = []

RETRY_HTTP_CODES = [500, 502, 503, 504, 400, 403, 404, 408]

你可能感兴趣的:(scrapy遇到403 500 502等状态码时的应对)