BodySendModelBenchmarkRequest
Properties
Name | Type | Description | Notes |
---|---|---|---|
batch_sizes | list[int] | List of batch sizes to benchmark on, if not given will use Deci's defaults. | [optional] |
hardwares | list[HardwareType] | List of hardware types to benchmark on, if not given will use all available. | [optional] |