Panda not printing all of the table Question: This is my first post so I hope I don’t forget anything. So I was trying to scrape all of the UFC events to see certain stats of fighters and I tried using Pandas. This is where my problem started, so when I imported the website using …
Selenium Python: How to capture li element with specific text Question: I am trying to extract urlToBeCaptured and Text to be captured from the HTML. The structure looks as follows: <li> " text with trailing spaces " <a href="urlToBeCaptured"> <span class ="class1> Text to be captured </span> <span class ="class2> Another text </span> </a> … …
Scraping using BeautifulSoup print an empty output Question: I’m trying to scrape a website. I want to print all the elements with the following class name, class=product-size-info__main-label The code is the following: from bs4 import BeautifulSoup with open("MadeInItaly.html", "r") as f: doc= BeautifulSoup (f, "html.parser") tags = doc.find_all(class_="product-size-info__main-label") print(tags) Result: [XS, XS, S, M, L, …
python Error : AttributeError: 'NoneType' object has no attribute 'find_all' Question: I have a requirement to read a table from confluence page and store it into a Json or csv file. In order to achieve that requirement, I am using python scripting. When I ran my code and try to print the confluence page content, …
Python selenium does not return the correct element Question: I am new in selenium. I want to run the automation test for calendar with python selenium, but the return does not same as my expect The website for testing: https://letcode.in/calendar I want to select the date in the right calendar. the right calendar So I …
Web scraping reviews from Amazon only returns data for the first page Question: I am trying to scrape reviews from Amazon. The reviews can appear on multiple pages to scrape more than one page I construct a list of links which I later scrape separately: # Construct list of links to scrape multiple pages links …
Beautiful Soup doesn't find element Question: A website I am trying to scrape has this html tag (I believe its an A/B test which is why I have two BS4 searches going at the same time). <h2 data-testid="price">39 777 kr</h2> I am trying to scrape the text inside this h2 tag, but it doesn’t seem …
"Message: no such window: target window already closed from unknown error: web view not found" Question: I am new to web scraping and here I am trying to extract the product details from a site, there are 48 products on a page, and when I debug I get the length of the list as 48, …
opening two instances of chrome webdriver(with and without proxies) with selenium python Question: I am trying to create two instances of chrome webdriver with selenium python. the first one uses proxies and the second one is proxyless. The problem I am facing is that the URL opened in the second instance doesn’t load(because it uses …
web scraping with selenium with python Question: I’m writing a python script to web scrape a betting site for up coming games with selenium. I keep getting this long error. Here’s the code. import os from selenium import webdriver from selenium.webdriver.common.by import By os.environ[‘PATH’] += r"C:/Users/dub6m/OneDrive/Documents/chromedriver_win32" driver = webdriver.Chrome() driver.get(‘https://www.888sport.com/tennis/’) athlete1 = driver.find_element(By.CLASS_NAME, ‘featured-matches-widget__event-text featured-matches-widget__event-competitor’) …
