Inference Tutorials


The following tutorials focus on performing inference requests on models deployed in Wallaroo. These include parallel infer, access inference logs, and related topics.


Infer Tutorial

How to use the Wallaroo SDK for inferences via the SDK and API with the Pipeline Inference URL.

Async Infer Tutorial

How to perform asynchronous inferences via async_infer

Inference Logs Tutorial

How to retrieve Inference logs as DataFrame or Apache Arrow tables, and save inference logs to files.

Wallaroo SDK Parallel Infer Tutorial

How to use Wallaroo parallel infer for faster inference requests for large data sets.