Dask: Continue with others task if one fails Question: I have a simple (but large) task Graph in Dask. This is a code example results = [] for params in SomeIterable: a = dask.delayed(my_function)(**params) b = dask.delayed(my_other_function)(a) results.append(b) dask.compute(**results) Here SomeIterable is a list of dict, where each are arguments to my_function. In each iteration …
Dask: How to return a tuple of futures in client.submit Question: I need to return a tuple from a task which has to be unpacked in the main process because each element of the tuple will go to different dask tasks. I would like to avoid unnecessary communication so I think that the tuple elements …
Dask crashing when saving to file? Question: I’m trying to take onehot encode a dataset then groupby a specific column so I can get one row for each item in that column with a aggregated view of what onehot columns are true for that specific row. It seems to be working on small data and …
