Wallaroo.AI (Version 2024.1)
2024.1
2024.3 (Current Version)
2024.2
LLM Operations
LLM Tutorials
Wallaroo LLM Deploy
Wallaroo LLM Deploy
The following tutorials demonstrate deploying different LLMs with Wallaroo.
IBM Granite 8B Code Instruct Large Language Model (LLM) with GPU Tutorial
Llama 3 8B Instruct with vLLM
LLM Deploy on ARM Tutorial
LLM Deploy on GPU Tutorial
Quantized Llava 34B with Llama.cpp
LLM Deploy on x86 Tutorial