Tensorflow

Parameter	Description
Web Site	https://www.tensorflow.org/
Supported Libraries	`tensorflow==2.13.1`
Framework	`Framework.TENSORFLOW` aka `tensorflow`
Supported File Types	SavedModel format as .zip file

IMPORTANT NOTE

These requirements are not for Tensorflow Keras models, only for non-Keras Tensorflow models in the SavedModel format. For Tensorflow Keras deployment in Wallaroo, see the Tensorflow Keras requirements.

TensorFlow File Format

TensorFlow models are .zip file of the SavedModel format. For example, the Aloha sample TensorFlow model is stored in the directory alohacnnlstm:

├── saved_model.pb
└── variables
    ├── variables.data-00000-of-00002
    ├── variables.data-00001-of-00002
    └── variables.index

This is compressed into the .zip file alohacnnlstm.zip with the following command:

zip -r alohacnnlstm.zip alohacnnlstm/

ML models that meet the Tensorflow and SavedModel format will run as Wallaroo Native runtimes by default.

See the SavedModel guide for full details.

Tensorflow Library in Wallaroo JupyterHub Service

For Jupyter Notebooks running the Wallaroo JupyterHub Service that import the tensorflow library, for example:

import tensorflow

Import the tensorflow-cpu library by executing the following command in the terminal shell:

pip install tensorflow-cpu==2.13.1 --user

Then proceed with the running the Notebook. This only applies to running notebooks in Wallaroo’s JupyterHub service, and does not affect model upload, packaging or other Wallaroo functionality. This does not affect using the Wallaroo SDK outside of Wallaroo’s JupyterHub service.

Wallaroo SDK Upload Tutorial: Tensorflow Aloha

How to upload the Tensorflow Aloha model to Wallaroo