Wallaroo Developer Guides

Reference Guides for Developers working with Wallaroo

The following guides are made to help users work with Wallaroo workspaces, upload models, set up pipelines and start inferring from data from their own applications using the Wallaroo SDK, API, and other coding examples.

We recommend first time users refer to the Wallaroo Tutorials that walk new users through several different models and ways of creating pipelines.

Supported Model Versions and Libraries

The following ML Model versions and Python libraries are supported by Wallaroo. When using the Wallaroo autoconversion library or working with a local version of the Wallaroo SDK, use the following versions for maximum compatibility.

Library Supported Version
Python 3.8.6 and above
onnx onnx==1.12.1
tensorflow tensorflow==2.9.3
keras keras==2.9.0
pytorch torch==1.13.1
sk-learn aka scikit-learn scikit-learn==1.3.0
statsmodels statsmodels==0.13.2
XGBoost xgboost==1.7.4
MLFlow xgboost==1.7.4

Supported Data Types

The following data types are supported for transporting data to and from Wallaroo in the following run times:

  • ONNX
  • TensorFlow
  • MLFlow

Data Type Conditions

The following conditions apply to data types used in inference requests.

  • None or Null data types are not submitted. All fields must have submitted values that match their data type. For example, if the schema expects a float value, then some value of type float must be submitted and can not be None or Null. If a schema expects a string value, then some value of type string must be submitted, etc.
  • datetime data types must be converted to string.
  • ONNX models support multiple inputs only of the same data type.
Runtime BFloat16* Float16 Float32 Float64
TensorFlow X X X
MLFlow X X X
  • * (Brain Float 16, represented internally as a f32)

Runtime Int8 Int16 Int32 Int64
TensorFlow X X X X
MLFlow X X X X
Runtime Uint8 Uint16 Uint32 Uint64
TensorFlow X X X X
MLFlow X X X X
Runtime Boolean Utf8 (String) Complex 64 Complex 128 FixedSizeList*
Tensor X X X
MLFlow X X X
  • * Fixed sized lists of any of the previously supported data types.

Wallaroo API Guide

Reference Guide for the Wallaroo API

Wallaroo SDK Guides

Reference Guide for the most essential Wallaroo SDK Commands

Wallaroo Developer Helper Guides

Developer guides for various ML and Wallaroo concepts