Skip to content

Deploy Bentos

Bentos can be deployed using the following methods:

  • Containerize and deploy as custom docker containers
  • Use Yatai to deploy them at scale on Kubernetes
  • Use bentoctl for fast model deployment on any cloud platform

Learn More: Bento Deployment

Deploy Locally

 bentoml serve

Deploy Docker Containers

Create containers with the bento images

 bentoml containerize <bento_image_name>:latest
Run the generated docker image

 docker run -p 3000:3000 <bento_image_name>:<bento_image_tag> serve --production
Deployed docker container can be now viewed via Portainer

Figure 1: BentoML Container in Portainer
Figure 1: BentoML Container in Portainer

After bento is deployed, service can be accessed via swagger api UI - http://0.0.0.0:3000/

Figure 2: BentoML Swagger API UI
Figure 2: BentoML Swagger API UI

Next up

Developer Guide

BSD 3-Clause License: See License.