Wallaroo LLM Deploy

The following tutorials demonstrate deploying different LLMs with Wallaroo.

IBM Granite 8B Code Instruct Large Language Model (LLM) with GPU Tutorial

Llama 3 8B Instruct with vLLM

Quantized Llava 34B with Llama.cpp