Is there a memmap functionality for pickle?
Question:
Is there a memmap functionality for pickle or torch.load()?
Ref: https://numpy.org/doc/stable/reference/generated/numpy.memmap.html
Answers:
My solution:
Using instead of pickle or torch.save/torch.load. It is better to use tf.records, e.g. from the PyTorch DALI plugin.
Is there a memmap functionality for pickle or torch.load()?
Ref: https://numpy.org/doc/stable/reference/generated/numpy.memmap.html
My solution:
Using instead of pickle or torch.save/torch.load. It is better to use tf.records, e.g. from the PyTorch DALI plugin.