How does Deci run its benchmark without connecting any data?
Once a model is added to Deci’s platform, it is validated to make sure it is a proper file and goes through a benchmark process. Here, Deci runs a random (noise) input into the forward pass of the model, while measuring runtime performance metrics such as latency, throughput, model size, and memory footprint.
Updated 12 months ago
Did this page help you?