promptflow-image-bundle 0.3.0

Allow you to create your own prompt flow runtime base images

Prompt flow image bundle

This bundle package provides a way to use your own base images to build and run prompt flow runtime, and build high-quality LLM apps with prompt flow package.

Example usage:

# choose your base image, for example AzureML base images
FROM mcr.microsoft.com/azureml/openmpi4.1.0-cuda11.8-cudnn8-ubuntu22.04:latest
# install bundle package
RUN pip install -U promptflow-image-bundle[azure]
# install other requirements if needed
# RUN pip install -r requirements.txt
# expose prompt flow runtime service port
EXPOSE 8080
# start prompt flow runtime service
CMD ["start_promptflow"]

Currently, we only support Ubuntu and Debian based images, and have verified both AzureML base images and popular images like ubuntu:22.04, debian:11, python:3.10, continuumio/miniconda3:23.3.1-0, nginx:stable, etc.

If your base images doesn't have Python or Conda, you need to install it in you docker file as a prerequisite.