google-search

Pytrends ResponseErrore code 429 for a search list of many words

Pytrends ResponseErrore code 429 for a search list of many words Question: I am trying to get google search volume index using Pytrends. However, when I use a large set of words, I get the following error: TooManyRequestsError: The request failed: Google returned a response with code 429 There are similar posts on this issue …

Total answers: 1

Python search website in google that end with specific word

Python search website in google that end with specific word Question: I tried to search all websites in Google that end with "gencat.cat". My code: import requests, lxml from bs4 import BeautifulSoup headers = { "User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/72.0.3538.102 Safari/537.36 Edge/18.19582" } params = {‘q’: ‘gencat.cat’} html …

Total answers: 2

Using python requests with google search

Using python requests with google search Question: I’m a newbie with python. In PyCharm I wrote this code: import requests from bs4 import BeautifulSoup response = requests.get(f"https://www.google.com/search?q=fitness+wear") soup = BeautifulSoup(response.text, ‘html.parser’) print(soup) Instead getting the HTML of the search results, what I get is the HTML of the following page I use the same code …

Total answers: 4

ImportError: cannot import name 'search' from 'google' (unknown location)

ImportError: cannot import name 'search' from 'google' (unknown location) Question: I’m trying to repurpose some old code I found from 3 years ago, where it grabs text using an OCR, then Googles what it found. In the original code, it imports the google package using from google import google, and then using google.search(). However, when …

Total answers: 1

Searching in Google with Python

Searching in Google with Python Question: I want to search a text in Google using a python script and return the name, description and URL for each result. I’m currently using this code: from google import search ip=raw_input(“What would you like to search for? “) for url in search(ip, stop=20): print(url) This returns only the …

Total answers: 7

Google Search Web Scraping with Python

Google Search Web Scraping with Python Question: I’ve been learning a lot of python lately to work on some projects at work. Currently I need to do some web scraping with google search results. I found several sites that demonstrated how to use ajax google api to search, however after attempting to use it, it …

Total answers: 5

google search with python requests library

google search with python requests library Question: (I’ve tried looking but all of the other answers seem to be using urllib2) I’ve just started trying to use requests, but I’m still not very clear on how to send or request something additional from the page. For example, I’ll have import requests r = requests.get(‘http://google.com’) but …

Total answers: 6