Single Node Installation Prerequisites
Table of Contents
Prerequisites
Before starting the embedded Linux installation in either a cloud hosted virtual machine or on premise installation, the following conditions must be met:
- A Wallaroo Enterprise license file. For more information, you can request a demonstration.
- System requirements:
- Hardware: x64 architecture with a minimum of 32 CPU cores and 64 GB RAM.
- See the Install Wallaroo with Minimum Services for installing Wallaroo with reduced services.
- GPU Support: NVIDIA CUDA 12](https://docs.nvidia.com/cuda/cuda-toolkit-release-notes/index.html) for cloud and on-premise installations. See [GPU Support for installation procedures.
- For systems that include GPUs, note that Model Deployment Configurations that assign GPUs must include a deployment label. For more details on customizing deployment labels, see Custom Taints and Labels Guide.
- Storage: 650 GB allocated for the root partition, plus 50 GB allocated per node and another 50 GB for the JupyterHub service. Enterprise users who deploy additional pipelines will require an additional 50 GB of storage per lab node deployed.
- Operating System: Ubuntu 22.04. The cloud based installations scripts specify a VM image that complies with this requirement.
- Ensure memory swapping is disabled by removing it from
/etc/fstabif needed.
- Ensure memory swapping is disabled by removing it from
- Hardware: x64 architecture with a minimum of 32 CPU cores and 64 GB RAM.
- Internet access for the VM or on-premise device Wallaroo is installed on.
- DNS services for integrating your Wallaroo Enterprise instance. See the DNS Integration Guide for the instructions on configuring Wallaroo Enterprise with your DNS services.
IMPORTANT NOTE
- Wallaroo requires out-bound network connections to download the required container images and other tasks. For situations that require limiting out-bound access contact your Wallaroo support representative. Also note that if Wallaroo is being installed into a cloud environment such as Google Cloud Platform, Microsoft Azure, Amazon Web Services, etc, then additional considerations such as networking, DNS, certificates, and other considerations must be accounted for.
- The steps below are based on minimum requirements for installing Wallaroo in a single node environment.
- For situations that require limiting external IP access or other questions, refer to your Wallaroo support representative.
Network Configurations
Wallaroo installations provide the following methods for connecting to the Wallaroo services:
- When Ingress Mode for Wallaroo interactive services are set to None, the user will have to use port forwarding services to access the Wallaroo instance.
- When When Ingress Mode for Wallaroo interactive services is set to Embedded Cluster, the IP address is set via NodePort, and requires the following ports be open to access from remote locations:
- 22: Used for
sshconnections. Typically open by default; see cloud provider documentations for additional details. - 443: Access to the Wallaroo Dashboard and API services.
- 8081: Optional, used for Edge Observability
- 30000: Used to access the Wallaroo administration console and make configuration changes as well as carry out upgrades
- 22: Used for
For more details, see the Model Endpoints Guide.