We encourage you to join our Slack channel, where you can consult with Deci’s support team in real-time, and exchange ideas with industry experts.
Cause 1: You are looking at an optimized model, which is bound to only one hardware and/or batch size.
- Solution 1: Optimize your model for each hardware type that you want to benchmark. While baseline models work on all hardware types, optimized models only work with the specific hardware for which they were optimized. The same goes for batch sizes.
- Solution 1: Lower the batch size or the input dimensions. As part of Deci's offering, we test your model on many environments and update you if any environment isn't suitable to run your model. If it isn't suitable, we block the option to show results on it because the benchmark failed.
Updated over 1 year ago