DocumentationAPI Reference
Back to ConsoleLog In

Supported Deep Learning Frameworks

Framework

Checkpoint File requirements

Framework Type

ONNX

Your ONNX model should be saved as a .onnx file, and must support inference with dynamic batch size.

"onnx"

TensorFlow

The platform supports a TF2 saved-model format. Make sure to zip the file's directory before uploading.

"tf2"

TorchScript

Make sure to save your traced TorchScript module as a .pth file.

"torchscript"

Keras

Save your Keras model in .h5 format. Make sure to save both the architecture and the weights.

"keras"

OpenVino

A CPU optimized checkpoint that was optimized by the Deci Platform.

"openvino"

Nvidia TensorRT

A GPU optimized checkpoint that was optimized by the Deci Platform.

Infery can also load TensorRT checkpoints, when saving them as described Here.

Please note that TensorRT is version sensitive, so the current supported version is TensorRT==7.2.x.

"trt"


Did this page help you?