How does Deci run its benchmark without connecting any data?

Once a model is added to Deci’s platform, it is validated to make sure it is a proper file and goes through a benchmark process. Here, Deci runs a random (noise) input into the forward pass of the model, while measuring runtime performance metrics such as latency, throughput, model size, and memory footprint.