Wallaroo.AI (Version 2024.1)
2024.1
2024.2 (Current Version)
LLM Operations
LLM Tutorials
Wallaroo LLM Deploy
Wallaroo LLM Deploy
The following tutorials demonstrate deploying different LLMs with Wallaroo.
IBM Granite 8B Code Instruct Large Language Model (LLM) with GPU Tutorial
Llama 3 8B Instruct with vLLM
Quantized Llava 34B with Llama.cpp