No device and batch size selection during eval
#322
Labels
Infrastructure: CLI
Related to the command line interface
Priority: Medium
Important issues to address after high priority.
Current implementation of the
mtt eval
forces the model to run on the CPU only. This is caused by a recent metatensor/metatensor#668 PR, where the model is forced to be saved with a CPU device, and the following lines in theeval
scriptwhere device is inherited from the model parameters. Batch size selection is also not available, since it is hardcoded to be equal to 1.
Therefore, the evaluation part of the MTT is now extremely slow and rigid.
The text was updated successfully, but these errors were encountered: