Supported Deep Learning Frameworks
Framework | Checkpoint File requirements | Framework Type |
|---|---|---|
Your ONNX model should be saved as a .onnx file, and must support inference with dynamic batch size. | "onnx" | |
The platform supports a TF2 saved-model format. Make sure to zip the file's directory before uploading. | "tf2" | |
Make sure to save your traced TorchScript module as a .pth file. | "torchscript" | |
Save your Keras model in .h5 format. Make sure to save both the architecture and the weights. | "keras" | |
A CPU optimized checkpoint that was optimized by the Deci Platform. | "openvino" | |
A GPU optimized checkpoint that was optimized by the Deci Platform. Infery can also load TensorRT checkpoints, when saving them as described Here. Please note that TensorRT is version sensitive, so the current supported version is TensorRT==7.2.x. | "trt" |
Updated 3 months ago