How can I percent-encode URL parameters in Python?


If I do

url = "" + urllib.quote(query)
  1. It doesn’t encode / to %2F (breaks OAuth normalization)
  2. It doesn’t handle Unicode (it throws an exception)

Is there a better library?

Asked By: Paul Tarjan



From the Python 3 documentation:

 urllib.parse.quote(string, safe='/', encoding=None, errors=None)

Replace special characters in string using the %xx escape. Letters, digits, and the characters '_.-~' are never quoted. By default, this function is intended for quoting the path section of a URL. The optional safe parameter specifies additional ASCII characters that should not be quoted — its default value is '/'.

That means passing '' for safe will solve your first issue:

>>> import urllib.parse
>>> urllib.parse.quote('/test')
>>> urllib.parse.quote('/test', safe='')

(The function quote was moved from urllib to urllib.parse in Python 3.)

By the way, have a look at urlencode.

About the second issue, there was a bug report about it and it was fixed in Python 3.

For Python 2, you can work around it by encoding as UTF-8 like this:

>>> query = urllib.quote(u"Müller".encode('utf8'))
>>> print urllib.unquote(query).decode('utf8')
Answered By: Nadia Alramli

In Python 3, urllib.quote has been moved to urllib.parse.quote, and it does handle Unicode by default.

>>> from urllib.parse import quote
>>> quote('/test')
>>> quote('/test', safe='')
>>> quote('/El Niño/')
Answered By: Paolo Moretti

I think module requests is much better. It’s based on urllib3.

You can try this:

>>> from requests.utils import quote
>>> quote('/test')
>>> quote('/test', safe='')

My answer is similar to Paolo’s answer.

Answered By: Aminah Nuraini

If you’re using Django, you can use urlquote:

>>> from django.utils.http import urlquote
>>> urlquote(u"Müller")

Note that changes to Python mean that this is now a legacy wrapper. From the Django 2.1 source code for django.utils.http:

A legacy compatibility wrapper to Python's urllib.parse.quote() function.
(was used for unicode handling on Python 2)
Answered By: Rick Westera

It is better to use urlencode here. There isn’t much difference for a single parameter, but, IMHO, it makes the code clearer. (It looks confusing to see a function quote_plus! – especially those coming from other languages.)

In [21]: query='lskdfj/sdfkjdf/ksdfj skfj'

In [22]: val=34

In [23]: from urllib.parse import urlencode

In [24]: encoded = urlencode(dict(p=query,val=val))

In [25]: print(f"{encoded}")


Answered By: balki

An alternative method using furl:

import furl

url = ",world"
url = furl.furl(url).url

Answered By: BaiJiFeiLong