What is the best way to check URL change with Selenium in Python?

Question

So, what’s I want to do is to run a function on a specific webpage (which is a match with my regex).

Right now I’m checking it every second and it works, but I’m sure that there is a better way (as it’s flooding that website with getting requests).

while flag:
    time.sleep(1)
    print(driver.current_url)
    if driver.current_url == "mydesiredURL_by_Regex":
        time.sleep(1)
        myfunction()

I was thinking to do that somehow with WebDriverWait but not really sure how.

Asked By: gyula

||

Source

Answer 1

I was thinking to do that somehow with WebDriverWait

Exactly. First of all, see if the built-in Expected Conditions may solve that:

title_is
title_contains

Sample usage:

from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC

wait = WebDriverWait(driver, 10)
wait.until(EC.title_is("title"))
wait.until(EC.title_contains("part of title"))

If not, you can always create a custom Expected Condition to wait for url to match a desired regular expression.

Answered By: alecxe

Answer 2

This is how I implemented it eventually. Works well for me:

driver = webdriver.Chrome()
wait = WebDriverWait(driver, 5)
desired_url = "https://yourpageaddress"

def wait_for_correct_current_url(desired_url):
    wait.until(
        lambda driver: driver.current_url == desired_url)

Answered By: Svetlana Levinsohn

Answer 3

To really know that the URL has changed, you need to know the old one. Using WebDriverWait the implementation in Java would be something like:

wait = new WebDriverWait(driver, 10);
wait.until(ExpectedConditions.not(ExpectedConditions.urlToBe(oldUrl)));

I know the question is for Python, but it’s probably easy to translate.

Answered By: Hatya

Answer 4

Here is an example using WebdriverWait with expected_conditions:

from selenium import webdriver
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC 

url = 'https://example.com/before'
changed_url = 'https://example.com/after'

driver = webdriver.Chrome()
driver.get(url)

# wait up to 10 secs for the url to change or else `TimeOutException` is raised.
WebDriverWait(driver, 10).until(EC.url_changes(changed_url))

Answered By: Corey Goldberg

Answer 5

Use url_matches Link to match a regex pattern with a url. It does re.search(pattern, url)

from selenium import webdriver
import re
from selenium.webdriver.support import expected_conditions as EC
from selenium.webdriver.support.ui import WebDriverWait

pattern='https://www.example.com/'
driver = webdriver.Chrome()
wait = WebDriverWait(driver,10)

wait.until(EC.url_matches(pattern))

Answered By: Aseem

Answer 6

I just used while loop

prev_url = str(driver.current_url)
driver.find_element(By.CSS_SELECTOR, '[data-cy="sidebar-game-over-new-game-button"]').click()
    while prev_url == str(driver.current_url):
        pass

Answered By: Tawfiq Khalilieh

What is the best way to check URL change with Selenium in Python?

Question:

Answers: