Wallaroo SDK Upload Tutorial: Pytorch Single IO
How to upload a Pytorch model with single input/output to Wallaroo
The following tutorials cover how to upload sample Pytorch models.
Parameter | Description |
---|---|
Web Site | https://pytorch.org/ |
Supported Libraries |
|
Framework | Framework.PYTORCH aka pytorch |
Supported File Types | pt ot pth in TorchScript format |
Runtime | onnx /flight |
torch.jit.script()
is always recommended over tracing (i.e. torch.jit.trace()
). From the PyTorch documentation: “Scripting preserves dynamic control flow and is valid for inputs of different sizes.” For more details, see TorchScript-based ONNX Exporter: Tracing vs Scripting.During the model upload process, the Wallaroo instance will attempt to convert the model to a Native Wallaroo Runtime. If unsuccessful based , it will create a Wallaroo Containerized Runtime for the model. See the model deployment section for details on how to configure pipeline resources based on the model’s runtime.
pyarrow.float32()
for the PyTorch model to be converted to the Native Wallaroo Runtime during the upload process.How to upload a Pytorch model with single input/output to Wallaroo
How to upload a Pytorch model with Multiple input/output to Wallaroo