2024.4 Product Release Notes
We are pleased to announce the following product improvements in our 2024.4 release:
- Python Version 3.10 Support: Wallaroo Enterprise and the Wallaroo SDK support Python 3.10. This provides support for newer Python 3.10 enhanced libraries for Custom Model, inference automation, and other options.
- LLM validation and monitoring with Harmful Language Listeners: LLM monitoring and validation can now support Harmful Language detection. These listeners can deployed in a multi-step inference pipeline with a LLM to provide instant harmful language scoring with reasoning on LLM inferences.
- Infrastructure and installation updates for Wallaroo Community Edition (CE): Wallaroo Community Edition (CE) is available for installation in GitHub Codespaces and Oracle Cloud Infrastructure (OCI) Marketplace starting at 8 Cpus, allowing more people to try the free version of Wallaroo on lower compute footprint.
- Replicas Reporting in Wallaroo Dashboard: The Wallaroo Dashboard is updated to display the number of replicas deployed as part of the deployment configuration and model use.
- IBM Power Integration: Wallaroo supports IBM Power 10 for model deployment and inference in the cloud, on-prem and at the edge.
- Infrastructure and installation updates for Wallaroo Enterprise on Single Node Cloud Installations: Wallaroo Enterprise edition is available for single node installations. Select a VM that matches the prerequisites, and have Wallaroo up and running within 30 minutes.
- Install Wallaroo Enterprise On Premise: Organizations who prefer on-premise installations can install Wallaroo right in their own buildings, on their own hardware.