Authenticates and proxies LLM requests through LiteLLM to enact budgets and per-user management.
Auth strategies supported:
- Firefox Account Auth
- iOS App Attest
- Google Play Integrity
make setupThis creates a virtual environment in .venv/, installs dependencies, and installs the tool locally in editable mode.
-
docker compose -f litellm_docker_compose.yaml up -d(
docker compose down --volumes --remove-orphansto remove all)
-
sh ./scripts/create-app-attest-database.sh -
Migrate app_attest (repo root):
bash scripts/migrate-app-attest-database-local.shoruv run alembic upgrade head -
Set
MLPA_DEBUG=truein theconfig.pyor.envfile
- Run
python scripts/create-and-set-virtual-key.py(also sets the value in.env)
- Install it as a library:
pip install --no-cache-dir -e .- Run the binary
mlpaNavigate to
Config (see LiteLLM Documentation for more config options)
Service account configured to hit VertexAI: service_account.json should be in directory root
After running, Swagger can be viewed at http://localhost:<PORT>/api/docs