dockette/litellm repository overview

⁠Dockette / LiteLLM

🎁 LiteLLM Proxy with preinstalled pip and Pillow.

🕹 f3l1x.io⁠ | 💻 f3l1x⁠ | 🐦 @xf3l1x⁠

⁠Prologue

LiteLLM⁠ Proxy with pip and Pillow⁠ added to the application virtualenv.

The upstream image is built on Wolfi and ships a virtualenv at /app/.venv without pip. LiteLLM imports Pillow for image handling (Bedrock, Vertex AI and Ollama), but does not install it. There is also no HTTP client. This image fills all three gaps.

Features

• LiteLLM Proxy v1.98.0
• Python 3.13 (upstream virtualenv at /app/.venv)
• pip installed and upgraded, so you can add packages at runtime
• Pillow preinstalled (JPEG, PNG, WEBP, AVIF, GIF and TIFF)
• curl installed
• Healthcheck on /health/liveliness, done with curl
• Entrypoint, command, workdir and exposed port are inherited from upstream

⁠Usage

docker run \
    --rm \
    -it \
    -p 4000:4000 \
    -e LITELLM_MASTER_KEY=sk-1234 \
    dockette/litellm:latest

With a configuration file:

docker run \
    --rm \
    -it \
    -p 4000:4000 \
    -e LITELLM_MASTER_KEY=sk-1234 \
    -v $(pwd)/config.yaml:/app/config.yaml \
    dockette/litellm:latest \
    --config /app/config.yaml --port 4000

Add more Python packages at runtime:

docker exec -it <container> /app/.venv/bin/python -m pip install <package>

⁠Tags

Both tags hold the same LiteLLM version. Pillow is installed at build time and is not pinned, so a rebuild can ship a newer Pillow.

⁠ENV(s)

• LITELLM_MASTER_KEY - master key of the proxy
• PORT - port used by the healthcheck, 4000 by default

The default command is --port 4000. This argument wins over PORT. Set both if you change the port.

⁠Workdir

Default working directory is /app.

⁠User

Default user is root, same as upstream.

⁠Development

make build          # build the image
make test           # check curl, pip, Pillow, codecs and LiteLLM
make test-docker    # start the image and check the proxy
make run            # run the proxy on port 14000
make shell          # open a shell in the image
make push           # build and push linux/amd64 and linux/arm64

Build against another LiteLLM release:

make build LITELLM_VERSION=v1.97.0

⁠Maintenance

See how to contribute⁠ to this package. Consider to support⁠ f3l1x. Thank you for using this package.