Skip to content

feat: OTel#200

Open
kuraisle wants to merge 10 commits into
mainfrom
feature/OTel
Open

feat: OTel#200
kuraisle wants to merge 10 commits into
mainfrom
feature/OTel

Conversation

@kuraisle

@kuraisle kuraisle commented Jun 9, 2026

Copy link
Copy Markdown
Member
✨ Feature
🛠️ Repo maintenance

PR Description

We need to keep an eye on our vegetables, so here's some OTel monitoring.
The OTel instrumentation has defaults for FastAPI, so the app is now attached to an Instrumentor.

The azure app service default is to use an environment variable APPLICATIONINSIGHTS_CONNECTION_STRING to attach the collector, so if this is in the environment the azure monitor is configured.

I've put it as an extra dependency (as people should have the option not to load the dependency), and updated the container to load the extra.

UPDATE: I had to change some tests and dependencies. I didn't need the specific opentelemetry-instrumentation-fastapi dependency locally (mysterious) and the malformed auth test has started returning 401, which seems right to me anyway. The CI/CD tests still test the local weights features, but I've flagged them to skip if llama-cpp-python isn't installed.

Related Issues or other material

Related #184
Closes #184

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Open Telemetry

1 participant