LLM Deploy

The following tutorials demonstrate deploying different LLMs with Wallaroo.

IBM Granite 8B Code Instruct Large Language Model (LLM) with GPU Tutorial

Managed Inference Endpoints