ML Workload Orchestration Configuration Guide
How to enable or disable Wallaroo ML Workload Orchestration
Wallaroo ML Workload Orchestration Management
How to use Wallaroo ML Workload Orchestrations
Wallaroo provides ML Workload Orchestrations and Tasks to automate processes in a Wallaroo instance. For example:
- Deploy a pipeline, retrieve data through a data connector, submit the data for inferences, undeploy the pipeline
- Replace a model with a new version
- Retrieve shadow deployed inference results and submit them to a database
Orchestration Flow
ML Workload Orchestration flow works within 3 tiers:
| Tier | Description |
|---|---|
| ML Workload Orchestration | User created custom instructions that provide automated processes that follow the same steps every time without error. Orchestrations contain the instructions to be performed, uploaded as a .ZIP file with the instructions, requirements, and artifacts. |
| Task | Instructions on when to run an Orchestration as a scheduled Task. Tasks can be Run Once, where is creates a single Task Run, or Run Scheduled, where a Task Run is created on a regular schedule based on the Kubernetes cronjob specifications. If a Task is Run Scheduled, it will create a new Task Run every time the schedule parameters are met until the Task is killed. |
| Task Run | The execution of an task. These validate business operations are successful identify any unsuccessful task runs. If the Task is Run Once, then only one Task Run is generated. If the Task is a Run Scheduled task, then a new Task Run will be created each time the schedule parameters are met, with each Task Run having its own results and logs. |
One example may be of making donuts.
- The ML Workload Orchestration is the recipe.
- The Task is the order to make the donuts. It might be Run Once, so only one set of donuts are made, or Run Scheduled, so donuts are made every 2nd Sunday at 6 AM. If Run Scheduled, the donuts are made every time the schedule hits until the order is cancelled (aka killed).
- The Task Run are the donuts with their own receipt of creation (logs, etc).
For details on uploading ML Workload Orchestrations, see the Wallaroo SDK Essentials Guide: ML Workload Orchestration and the Wallaroo MLOps API Essentials Guide: ML Workload Orchestration Management.
Wallaroo ML Workload Orchestrations User Interface
How to view uploaded ML Workload Orchestrations and their associates Tasks
Wallaroo ML Workload Orchestration Requirements
Requirements for uploading a Wallaroo ML Workload Orchestration