batchsize

In deep learning, can the prediction speed increase as the batch size decreases?

In deep learning, can the prediction speed increase as the batch size decreases? Question: We are developing a prediction model using deepchem’s GCNModel. Model learning and performance verification proceeded without problems, but it was confirmed that a lot of time was spent on prediction. We are trying to predict a total of 1 million data, …

Total answers: 3