Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
[TESTING] Added precision option to benchmark CSV data saving (#2933)
This PR adds the `save_precision` argument to `benchmark.run()`, and makes its default value 6 (which is somewhat arbitrary, but seems reasonable). Right now it is not user configurable, and has an unusually low default of `.1f`. **Context:** I was using the benchmarking capability, and found that the CSV which was being generated had unacceptably low precision (`.1f`). This was after I had run a long-ish benchmarking session, and I was surprised that many of my benchmarks had an inference time of 0. For the benchmarks I am performing, I need a higher degree of precision. I do not think the downsides of higher precision, namely larger file sizes for the CSVs is relevant compared to the downsides of losing data. By making the value configurable, this gives us the best of both worlds.
- Loading branch information