Python requests – getting 503 response

Question:

When I’m trying to scrape 1337x.to I get response 503 (service unavailable).

This is my code:

headers = {
                        'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:104.0) Gecko/20100101 Firefox/104.0',
                        'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,*/*;q=0.8',
                        'Accept-Language': 'en-US,en;q=0.5',
                        # 'Accept-Encoding': 'gzip, deflate, br',
                        'Connection': 'keep-alive',
                        # 'Cookie': '__cf_bm=8AWn5cgl3wrLk8I2mbjcWF2hZo6yTMkQVbABnjiu06A-1662900329-0-AbK6GqFf8nWKuLYRCwJ5Ihk6+gS1Q9KumHHO7SoJPYtnpuFG1l4gJHnYw/L+r+lApFRAVgw7JOQNIfhdfo64/GN1+O7RrjVep7rS0515TiUA1kNuExIIavYFcsgHBwQcqQ==',
                        'Upgrade-Insecure-Requests': '1',
                        'Sec-Fetch-Dest': 'document',
                        'Sec-Fetch-Mode': 'navigate',
                        'Sec-Fetch-Site': 'none',
                        'Sec-Fetch-User': '?1',
                    }

response = requests.get('https://1337x.to/popular-movies', headers=headers)

I tried without headers as well, but got the same result.

Any help will be appreciated!

Asked By: Binyamin Even

||

Answers:

>>> import requests
>>> response = requests.get('https://1337x.to/popular-movies')
>>> response
<Response [200]>

I get the above result. The only reason I see is you probably made too many requests(or their website was actually down). As a rule of thumb always have some cooling period between subsequent requests when scraping a website.

  1. That is the responsible thing to do so you don’t disturb the performance of the given website.
  2. Your IP won’t be blocked if any such WAF rule is present on the website’s server.
Answered By: ashutosh singh
Categories: questions Tags: , ,
Answers are sorted by their score. The answer accepted by the question owner as the best is marked with
at the top-right corner.