Authenticate Scrapy HTTP Proxy
Authenticate Scrapy HTTP Proxy Question: I can set an http proxy using request.meta[‘proxy’], but how do I authenticate the proxy? This does not work to specify user and pass: request.meta[‘proxy’] = ‘http://user:[email protected]:2222′ From looking around, I may have to send request.headers[‘Proxy-Authorization’], but what format do I send it in? Asked By: Lionel || Source Answers: …