scrapy框架查看请求状态码

在中间件middlewares中写一个类，查看请求的状态码

class GetFailedUrl(object):
    def process_response(self, response, request, spider):
        if response.status != 200:
            print(111111111111)
            print(response.status)
            print(222222222222)
        else:
            return response

然后再setting中激活中间件中的类

DOWNLOADER_MIDDLEWARES = {
   'taskspider.middlewares.GetFailedUrl': 542,
}