Deploy and Serve

Tutorials focused on model deployment and inference service


Aloha Quick Tutorial

The Aloha Quick Start Guide demonstrates how to use Wallaroo to determine malicious web sites from their URL.

Wallaroo SDK Upload Tutorials: Arbitrary Python

How to upload different Arbitrary Python models to Wallaroo.

Async Infer with Aloha Tutorial

How to perform asynchronous inferences via async_infer

CLIP ViT-B/32 Transformer Demonstration with Wallaroo

The CLIP ViT-B/32 Transformer Demonstration with Wallaroo deployment.

Computer Vision Tutorials

How to use Wallaroo with computer vision models to detect objects in images.

Computer Vision: Yolov8n Demonstration

How to use Wallaroo with the Yolov8n computer vision model to detect objects in images.

Containerized MLFlow Tutorial

The Containerized MLFlow Tutorial demonstrates how to use Wallaroo with containerized MLFlow models.

Custom Inference Computer Vision Upload, Autopackaging, and Deploy Tutorial

The uploading and autopackaging a Custom Inference aka Arbitrary Python computer vision model in Wallaroo.

Demand Curve Quick Start Guide

The Demand Curve Quick Start Guide demonstrates how to use Wallaroo to chart a demand curve based on submitted data. This example uses a model plus preprocess and postprocessing steps.

Wallaroo SDK Upload Tutorials: Hugging Face

How to upload different Hugging Face models to Wallaroo.

Computer Vision: Image Detection for Health Care

How to use Wallaroo with computer vision models to detect mitochondria from images of cells.

IMDB Tutorial

The IMDB Tutorial demonstrates how to use Wallaroo to determine if reviews are positive or negative.

Inference URL Tutorials

How to use the Wallaroo SDK and the Wallaroo MLOps API to perform inferences.

Using Jupyter Notebooks in Production

How to go from Jupyter Notebooks to Production Systems

Model Registry Service with Wallaroo Tutorials

How to use a Model Registry Service to upload models to a Wallaroo instance.

ONNX Multiple Input Output Example

How to manage ONNX ML models with muliple inputs and outputs.

Wallaroo SDK Parallel Infer: Aloha Demonstration

How to use Wallaroo parallel infer for faster inference requests for large data sets.

Wallaroo SDK Upload Tutorials: Python Step Shape

How to upload different Python Step Shape models to Wallaroo.

Wallaroo SDK Upload Tutorials: Pytorch

How to upload different Pytorch models to Wallaroo.

Wallaroo SDK Upload Tutorials: SKLearn

How to upload different SKLearn models to Wallaroo.

Statsmodel Forecast with Wallaroo Features

A life cycle with a Statsmodel forecast model from model creation to automation.

Tags Tutorial

How to use create and manage Tags for Wallaroo models and pipelines.

Wallaroo SDK Upload Tutorials: Tensorflow

How to upload different Tensorflow models to Wallaroo.

Wallaroo SDK Upload Tutorials: Tensorflow Keras

How to upload different Tensorflow Keras models to Wallaroo.

whisper-large-v2 Demonstration with Wallaroo

The whisper-large-v2 Demonstration with Wallaroo deployment.

Wallaroo Upload and Deploy Tutorials: XGBoost

How to upload different XGBoost models to Wallaroo.