TypeError: the JSON object must be str, not 'bytes'

Question

I have the following, very basic code that throws; TypeError: the JSON object must be str, not 'bytes'

import requests
import json

url = 'my url'
user = 'my user'
pwd = 'my password'

response = requests.get(url, auth=(user, pwd))

if(myResponse.ok):
    Data = json.loads(myResponse.content)

I try to set decode to the Data variable, as follows but it throws the same error; jData = json.loads(myResponse.content).decode('utf-8')

Any suggestions?

Asked By: FunnyChef

||

Source

Answer 1

Let requests decode it for you:

data = response.json()

This will check headers (Content-Type) and response encoding, auto-detecting how to decode the content correctly.

Answered By: wim

Answer 2

json.loads(myResponse.content.decode('utf-8'))

You just put it in the wrong order, innocent mistake.

(In-depth answer). As courteously pointed out by wim, in some rare cases, they could opt for UTF-16 or UTF-32. These cases will be less common as the developers, in that scenario would be consciously deciding to throw away valuable bandwidth. So, if you run into encoding issues, you can change utf-8 to 16, 32, etc.

There are a couple of solutions for this. You could use request’s built-in .json() function:

myResponse.json()

Or, you could opt for character detection via chardet. Chardet is a library developed based on a study. The library has one function: detect. Detect can detect most common encodings and then use them to encode your string with.

import chardet
json.loads(myResponse.content.decode(chardet.detect(myResponse.content)["encoding"]))

Answered By: Neil

Answer 3

python3.6+ does this automatically.so your code shouldn’t return error in python3.6+

what’s new in python3.6

Answered By: Suraj Shrestha

TypeError: the JSON object must be str, not 'bytes'

Question:

Answers: