Wallaroo API Guide
Reference Guide for the Wallaroo API
The following guides are made to help users work with Wallaroo workspaces, upload models, set up pipelines and start inferring from data from their own applications using the Wallaroo SDK, API, and other coding examples.
We recommend first time users refer to the Wallaroo Tutorials that walk new users through several different models and ways of creating pipelines.
The following ML Model versions and Python libraries are supported by Wallaroo. When using the Wallaroo autoconversion library or working with a local version of the Wallaroo SDK, use the following versions for maximum compatibility.
Library | Supported Version |
---|---|
Python | 3.8.6 and above |
onnx | onnx==1.12.0 |
tensorflow | tensorflow==2.9.3 |
keras | keras==2.9.0 |
pytorch | torch==2.0.0 |
sk-learn aka scikit-learn | scikit-learn==1.3.0 |
statsmodels | statsmodels==0.13.2 |
XGBoost | xgboost==1.7.4 |
MLFlow | mlflow==1.3.0 |
The following data types are supported for transporting data to and from Wallaroo in the following run times:
The following conditions apply to data types used in inference requests.
None
or Null
data types are not submitted. All fields must have submitted values that match their data type. For example, if the schema expects a float
value, then some value of type float
must be submitted and can not be None
or Null
. If a schema expects a string value, then some value of type string must be submitted, etc. The exception are BYOP models, which can accept optional inputs.datetime
data types must be converted to string
.Runtime | BFloat16* | Float16 | Float32 | Float64 |
---|---|---|---|---|
ONNX | X | X | ||
TensorFlow | X | X | X | |
MLFlow | X | X | X |
* (Brain Float 16, represented internally as a f32)
Runtime | Int8 | Int16 | Int32 | Int64 |
---|---|---|---|---|
ONNX | X | X | X | X |
TensorFlow | X | X | X | X |
MLFlow | X | X | X | X |
Runtime | Uint8 | Uint16 | Uint32 | Uint64 |
---|---|---|---|---|
ONNX | X | X | X | X |
TensorFlow | X | X | X | X |
MLFlow | X | X | X | X |
Runtime | Boolean | Utf8 (String) | Complex 64 | Complex 128 | FixedSizeList* |
---|---|---|---|---|---|
ONNX | X | ||||
Tensor | X | X | X | ||
MLFlow | X | X | X |
* Fixed sized lists of any of the previously supported data types.
Reference Guide for the Wallaroo API
Reference Guide for the most essential Wallaroo SDK Commands
Developer guides for various ML and Wallaroo concepts