Wallaroo SDK Essentials Guide: Client Connection
How to connect to a Wallaroo instance through the Wallaroo SDK
The following commands are the most essential when working with Wallaroo.
The following ML Model versions and Python libraries are supported by Wallaroo. When using the Wallaroo autoconversion library or working with a local version of the Wallaroo SDK, use the following versions for maximum compatibility.
Library | Supported Version |
---|---|
Python | 3.8.6 and above |
onnx | 1.12.0 |
tensorflow | 2.9.1 |
keras | 2.9.0 |
pytorch | 1.3.1 |
sk-learn aka scikit-learn | 1.1.2 |
statsmodels | 0.13.2 |
XGBoost | 1.6.2 |
MLFlow | 1.30.0 |
The following data types are supported for transporting data to and from Wallaroo in the following run times:
The following conditions apply to data types used in inference requests.
None
or Null
data types are not submitted. All fields must have submitted values that match their data type. For example, if the schema expects a float
value, then some value of type float
must be submitted and can not be None
or Null
. If a schema expects a string value, then some value of type string must be submitted, etc.datetime
data types must be converted to string
.Runtime | BFloat16* | Float16 | Float32 | Float64 |
---|---|---|---|---|
ONNX | X | X | ||
TensorFlow | X | X | X | |
MLFlow | X | X | X |
* (Brain Float 16, represented internally as a f32)
Runtime | Int8 | Int16 | Int32 | Int64 |
---|---|---|---|---|
ONNX | X | X | X | X |
TensorFlow | X | X | X | X |
MLFlow | X | X | X | X |
Runtime | Uint8 | Uint16 | Uint32 | Uint64 |
---|---|---|---|---|
ONNX | X | X | X | X |
TensorFlow | X | X | X | X |
MLFlow | X | X | X | X |
Runtime | Boolean | Utf8 (String) | Complex 64 | Complex 128 | FixedSizeList* |
---|---|---|---|---|---|
ONNX | X | ||||
Tensor | X | X | X | ||
MLFlow | X | X | X |
* Fixed sized lists of any of the previously supported data types.
How to connect to a Wallaroo instance through the Wallaroo SDK
How to create and manage Wallaroo Data Connections through the Wallaroo SDK
How to create and use Wallaroo Workspaces through the Wallaroo SDK
How to create and manage Wallaroo Models through the Wallaroo SDK
How to create and manage Wallaroo Users through the Wallaroo SDK
How to create and manage Wallaroo Pipelines through the Wallaroo SDK
How to create and manage Wallaroo Pipelines through the Wallaroo SDK
How to create and manage ML Workload Orchestration through the Wallaroo SDK
How to create and manage Wallaroo Tags through the Wallaroo SDK
How to create and manage Wallaroo Assays through the Wallaroo SDK
How to use Wallaroo SDK for inferences