I can’t select a specific hardware or batch size to benchmark in the Insights screen.

We encourage you to join our Slack channel, where you can consult with Deci’s support team in real-time, and exchange ideas with industry experts.

Cause 1: You are looking at an optimized model, which is bound to only one hardware and/or batch size.

  • Solution 1: Optimize your model for each hardware type that you want to benchmark. While baseline models work on all hardware types, optimized models only work with the specific hardware for which they were optimized. The same goes for batch sizes.

Cause 2: Benchmarking on some Hardware<>Batch size set ups failed due to memory limitations

  • Solution 1: Lower the batch size or the input dimensions. As part of Deci's offering, we test your model on many environments and update you if any environment isn't suitable to run your model. If it isn't suitable, we block the option to show results on it because the benchmark failed.