A model must be registered with the RTiC Server in order to enable it to handle inference requests sent by an RTiC Client. In order to register an optimized model that is located in the Deci Platform repository, the RTiC Server must be connected to the Deci platform.
Note – It is not mandatory to connect to the Deci platform now (meaning in the same command as when you run the RTiC server), because it can be done later using the RTiC Client after the RTiC server has started.
Note – It is not mandatory to connect the RTiC Server to the Deci platform repository, because you have the option to register models from a location other than Deci, such as a local machine.
Passing the DECI_PLATFORM_TOKEN argument in the docker run command enables the RTiC server to automatically connect (authenticate) with the Deci platform.
- -e DECI_PLATFORM_TOKEN="35c367c1fcf14xxxxxxxx8e6bab0a" – Specify a platform token to integrate RTiC with Deci's platform.
Note – If you do not already have the password (access token) issued by Deci, display the Deci Lab by clicking the Lab tab at the top of the page, select an Optimized Version model and click the Deploy button. The access token appears in the displayed window.
RTiC will write successful authentication logs entries upon success.
docker run -d --ipc=host -p 8000:8000 -p 8001:8001 -e DECI_PLATFORM_API_ENDPOINT=https://api.staging.deci.ai -e DECI_PLATFORM_TOKEN='bearer 2cc9478cxxxxxxxxd76cacf892d6' -e EXPORTED_MODEL_ID='12f7ca2d-fxxx-xxx-xxx-cdbe24eef742' deciai/rtic-cpu:latest
Alternatively, you can register a model with the RTiC server so that it is automatically registered when the RTiC server is launched (using the EXPORTED_MODEL_ID argument described below).
- -e EXPORTED_MODEL_ID="d9b7d3d722bd4ecb96e00a45c0734b34" – This argument runs the RTiC server and automatically launches the specified model upon startup from your model repository. To get the MODEL_ID of the model to register, click the Lab tab at the top of the page, select an Optimized Version model and click the Deploy button. The access token appears in the displayed window.
- -e DECI_PLATFORM_API_ENDPOINT="http://localhost:9000" – Use this argument (in addition to the above, if needed) in order to access the Deci platform through a proxy.
Updated 5 months ago