Filtering a dictionary of dictionaries by a value

Question

I have a small example of a nested dictionary (in my case a collections defaultdict):

all_dict = {'d1': {'a': 2, 'b': 4, 'c': 10}, 
            'd2': {'a': 1, 'b': 23,'c': 0},
            'd3': {'a': 4, 'b': 12,'c': 4},
            'd4': {'a': 0, 'b': 4, 'c': 3},
            'd5': {'a': 4, 'b': 0, 'c': 1}}

And I would like to filter all the zero values in all_dict. In my real data, the nested dictionaries are very big. I would like any general "pythonic" solution.
I tried some comprehension but I failed.
I would like some like:

all_dict_filtered = 
           {'d1': {'a': 2, 'b': 4, 'c': 10}, 
            'd2': {'a': 1, 'b': 23},
            'd3': {'a': 4, 'b': 12,'c': 4},
            'd4': {'b': 4, 'c': 3},
            'd5': {'a': 4, 'c': 1}}

Any tip would be great.
Thank you for your time and attention.
Paulo

I have this but is ugly:

    filtered = defaultdict(dict)
    for k1, v1 in all_dict.items():
        for k2, v2 in v1.items():
            if v2 > 0:
                filtered[k1] = filtered.get(k1, {})
                filtered[k1][k2] = v2
defaultdict(dict,
            {'d1': {'a': 2, 'b': 4, 'c': 10},
             'd2': {'a': 1, 'b': 23},
             'd3': {'a': 4, 'b': 12, 'c': 4},
             'd4': {'b': 4, 'c': 3},
             'd5': {'a': 4, 'c': 1}})

Asked By: Paulo Sergio Schlogl

||

Source

Answer 1

took me some time, but here you go:

dicty = {'d1': {'a': 2, 'b': 4, 'c': 10}, 
            'd2': {'a': 1, 'b': 23,'c': 0},
            'd3': {'a': 4, 'b': 12,'c': 4},
            'd4': {'a': 0, 'b': 4, 'c': 3},
            'd5': {'a': 4, 'b': 0, 'c': 1}}

listy = []

for value in dicty:
    for value2 in dicty[value]:
        if dicty[value][value2] == 0:
            listy.append((value, value2))   

for inpurity in listy:
    dicty[inpurity[0]].pop(inpurity[1])

print(listy)
print(dicty)

Answered By: PiggyAwesome

Answer 2

Try:

all_dict = {
    "d1": {"a": 2, "b": 4, "c": 10},
    "d2": {"a": 1, "b": 23, "c": 0},
    "d3": {"a": 4, "b": 12, "c": 4},
    "d4": {"a": 0, "b": 4, "c": 3},
    "d5": {"a": 4, "b": 0, "c": 1},
}

for k, v in all_dict.items():
    all_dict[k] = {kk: vv for kk, vv in v.items() if vv != 0}

print(all_dict)

Prints:

{
    "d1": {"a": 2, "b": 4, "c": 10},
    "d2": {"a": 1, "b": 23},
    "d3": {"a": 4, "b": 12, "c": 4},
    "d4": {"b": 4, "c": 3},
    "d5": {"a": 4, "c": 1},
}

Answered By: Andrej Kesely

Answer 3

Simple one-liner using dict comprehensions:

import pprint

all_dict = {
    'd1': {'a': 2, 'b': 4, 'c': 10},
    'd2': {'a': 1, 'b': 23, 'c': 0},
    'd3': {'a': 4, 'b': 12, 'c': 4},
    'd4': {'a': 0, 'b': 4, 'c': 3},
    'd5': {'a': 4, 'b': 0, 'c': 1}
}

pprint.pprint({k: {key: value for key, value in v.items() if value != 0} for k, v in all_dict.items()})

Output:

{'d1': {'a': 2, 'b': 4, 'c': 10},
 'd2': {'a': 1, 'b': 23},
 'd3': {'a': 4, 'b': 12, 'c': 4},
 'd4': {'b': 4, 'c': 3},
 'd5': {'a': 4, 'c': 1}}

Answered By: funnydman

Answer 4

Try this:

import copy

all_dict = {'d1': {'a': 2, 'b': 4, 'c': 10}, 
            'd2': {'a': 1, 'b': 23,'c': 0},
            'd3': {'a': 4, 'b': 12,'c': 4},
            'd4': {'a': 0, 'b': 4, 'c': 3},
            'd5': {'a': 4, 'b': 0, 'c': 1}}

all_dict_filtered = copy.deepcopy(all_dict)

for i in all_dict:
    for j in all_dict[i] :
        if all_dict[i][j] == 0 :
            all_dict_filtered[str(i)].pop(str(j))

print(all_dict_filtered)

Output : {'d1': {'a': 2, 'b': 4, 'c': 10}, 'd2': {'a': 1, 'b': 23}, 'd3': {'a': 4, 'b': 12, 'c': 4}, 'd4': {'b': 4, 'c': 3}, 'd5': {'a': 4, 'c': 1}}

Answered By: ghost21blade

Filtering a dictionary of dictionaries by a value

Question:

Answers: