Deploy Bentos¶
Bentos can be deployed using the following methods:
- Containerize and deploy as custom docker containers
- Use Yatai to deploy them at scale on Kubernetes
- Use bentoctl for fast model deployment on any cloud platform
Learn More: Bento Deployment
Deploy Locally¶
bentoml serve
Deploy Docker Containers¶
Create containers with the bento images
bentoml containerize <bento_image_name>:latest
docker run -p 3000:3000 <bento_image_name>:<bento_image_tag> serve --production
After bento is deployed, service can be accessed via swagger api UI - http://0.0.0.0:3000/
Next up¶
BSD 3-Clause License: See License.