BrokenProcessPool while running code in jupyter notebook

Question

I am learning about multiprocessing in python. I have the following code snippet:

import time
import concurrent.futures

def wait(seconds):
    print(f'Waiting {seconds} seconds...')
    time.sleep(seconds)
    return f'Done'

if __name__ == "__main__":
    with concurrent.futures.ProcessPoolExecutor() as executor:
        p = executor.submit(wait,1)
        print(p.result())

Running it gives me this error:

BrokenProcessPool                         Traceback (most recent call last)
<ipython-input-19-8eff57e3a077> in <module>
      9     with concurrent.futures.ProcessPoolExecutor() as executor:
     10         p = executor.submit(do_something,1)
---> 11         print(p.result())

~.condaenvswlibconcurrentfutures_base.py in result(self, timeout)
    433                 raise CancelledError()
    434             elif self._state == FINISHED:
--> 435                 return self.__get_result()
    436             else:
    437                 raise TimeoutError()

~.condaenvswlibconcurrentfutures_base.py in __get_result(self)
    382     def __get_result(self):
    383         if self._exception:
--> 384             raise self._exception
    385         else:
    386             return self._result

BrokenProcessPool: A process in the process pool was terminated abruptly while the future was running or pending.

I am on a Windows computer and I have used if __name__ == "__main__": in my code. But I still get this error.

Asked By: Sabito 錆兎 stands with Ukraine

||

Source

Answer 1

I got it to work! I saved the wait function in a separate python file called wait.py and imported it in jupyter notebook.

wait.py:

import time

def wait(seconds):
    print(f'Waiting {seconds} seconds...')
    time.sleep(seconds)
    return f'Done'

ipynb file:

import concurrent.futures
import wait #import the wait file

if __name__ == "__main__":
    with concurrent.futures.ProcessPoolExecutor() as executor:
        p = executor.submit(wait.wait,1)
        print(p.result())

Answered By: Sabito 錆兎 stands with Ukraine

BrokenProcessPool while running code in jupyter notebook

Question:

Answers: