fix(eve): preserve prompt cache for connection tools#717
Draft
ruiconti wants to merge 1 commit into
Draft
Conversation
Contributor
|
The latest updates on your projects. Learn more about Vercel for GitHub.
2 Skipped Deployments
|
Use Anthropic deferred loading and result-positioned tool references for framework-owned connection discovery. Keep unsupported transports eager, and preserve the first advertised definition so replay cannot rewrite an earlier cache prefix. Signed-off-by: Rui Conti <[email protected]>
ruiconti
force-pushed
the
rui/preserve-connection-tool-cache
branch
from
74f4de3 to
0042092
Compare
Contributor
Bundle + Package Summary:
|
| Area | Metric | Baseline | Current | Delta |
|---|---|---|---|---|
| Package | Packed tarball | 3.62 MB | 3.63 MB | +3.3 kB |
| Package | Unpacked publish size | 13.14 MB | 13.15 MB | +8.8 kB |
| Package | Installed footprint | 52.25 MB | 52.26 MB | +8.8 kB |
| Package | Published files | 2529 | 2533 | +4 |
| Package | Installed files | 5764 | 5768 | +4 |
| Runtime | Unique function payloads | 2 | 2 | 0 |
| Runtime | Total function bytes | 8.99 MB | 9.00 MB | +6.7 kB |
| Runtime | Public routes | 9 | 9 | 0 |
Changed function payloads vs main (7c4af24) (2)
| Function | Status | Baseline | Current | Delta | Route changes |
|---|---|---|---|---|---|
functions/.well-known/workflow/v1/flow.func |
changed | 5.67 MB | 5.67 MB | +5.0 kB |
none |
functions/__server.func |
changed | 3.32 MB | 3.33 MB | +1.6 kB |
none |
eve init install
| Metric | Baseline | Current | Delta |
|---|---|---|---|
| Installed footprint | 90.52 MB | 90.53 MB | +8.8 kB |
| Installed packages | 122 | 122 | 0 |
| dependencies | 4 | 4 | 0 |
| devDependencies | 2 | 2 | 0 |
| Dependency package bytes | 27.33 MB | 27.33 MB | +8.8 kB |
| devDependency package bytes | 5.04 MB | 5.04 MB | 0 B ➖ |
Build Metadata
- Preset:
vercel - Nitro:
[email protected] - Output directory:
apps/fixtures/weather-agent/.vercel/output - Build metadata timestamp: 2026-07-12T02:57:18.330Z
- Route aliases: 9 public, 1 internal (10 total aliases)
- Vercel routes in config: 10
- Severity legend: 🔴 dominant/large, 🟠 notable, 🟡 watch, ⚪ small
Package Drill-Down
Package Details
- Package:
[email protected] - Package directory:
packages/eve - Tarball: 3.63 MB (
eve-0.22.5.tgz) - Unpacked payload: 13.15 MB across 2533 published files
- Installed footprint: 52.26 MB across 5768 installed files
- Installed root package: 11.87 MB
- Installed dependencies: 40.39 MB
- Runtime dependencies: 1
- Peer dependencies: 5 (4 optional)
Installed footprint is measured from an isolated temporary npm install of the packed tarball.
Heavy installed dependencies
@rolldown/binding-linux-x64-gnu: 19.13 MB (36.6%)eve: 11.87 MB (22.7%)ai: 6.36 MB (12.2%)zod: 5.04 MB (9.6%)nitro: 2.41 MB (4.6%)
Publish payload breakdown
Published file size
🟠 dist/src/compiled/experimental-ai-sdk-code-mo... [####....................] 1.51 MB 11.5%
🟡 dist/src/compiled/@vercel/sandbox/index.js [##......................] 632.2 kB 4.8%
🟡 dist/src/compiled/_chunks/workflow/undici-fb5... [#.......................] 502.4 kB 3.8%
🟡 dist/src/compiled/@chat-adapter/slack/index.js [#.......................] 433.8 kB 3.3%
🟡 dist/src/compiled/_chunks/workflow/dist-DnBju... [#.......................] 277.5 kB 2.1%
🔴 Other published files [########################] 9.80 MB 74.5%
Installed footprint breakdown
Installed package size
🔴 @rolldown/binding-linux-x64-gnu [########################] 19.13 MB 36.6%
🔴 eve [###############.........] 11.87 MB 22.7%
🔴 ai [########................] 6.36 MB 12.2%
🔴 zod [######..................] 5.04 MB 9.6%
🟠 nitro [###.....................] 2.41 MB 4.6%
🟡 rolldown [#.......................] 785.9 kB 1.5%
🔴 Other installed packages [########................] 6.66 MB 12.7%
Runtime dependencies (1)
| Package | Range | Notes |
|---|---|---|
nitro |
3.0.260610-beta |
Peer dependencies (5)
| Package | Range | Notes |
|---|---|---|
@opentelemetry/api |
^1.0.0 |
optional peer |
ai |
catalog: |
|
braintrust |
^3.0.0 |
optional peer |
just-bash |
^3.0.0 |
optional peer |
microsandbox |
^0.5.0 |
optional peer |
eve init install drill-down
eve init install details
- Command:
eve init my-agent - Package manager:
npm - Installed footprint: 90.53 MB across 7586 installed files
- Installed packages: 122 total (116 transitive-only)
- dependencies: 4 direct packages totaling 27.33 MB
- devDependencies: 2 direct packages totaling 5.04 MB
- Other transitive package files: 58.15 MB
Installed footprint is measured from an isolated temporary eve init my-agent using the current packed eve tarball.
Heavy installed dependencies
@typescript/typescript-linux-x64: 27.95 MB (30.9%)@rolldown/binding-linux-x64-gnu: 19.13 MB (21.1%)eve: 11.87 MB (13.1%)zod: 9.00 MB (9.9%)ai: 6.36 MB (7.0%)
Installed footprint breakdown
Installed package size
🔴 @typescript/typescript-linux-x64 [########################] 27.95 MB 30.9%
🔴 @rolldown/binding-linux-x64-gnu [################........] 19.13 MB 21.1%
🔴 eve [##########..............] 11.87 MB 13.1%
🔴 zod [########................] 9.00 MB 9.9%
🔴 ai [#####...................] 6.36 MB 7.0%
🟠 @types/node [##......................] 2.54 MB 2.8%
🔴 Other installed packages [############............] 13.67 MB 15.1%
dependencies (4)
| Package | Range | Installed size | Share |
|---|---|---|---|
@vercel/connect |
0.2.2 |
98.6 kB | 0.1% |
ai |
^7.0.0 |
6.36 MB | 7.0% |
eve |
file:eve-0.22.5.tgz |
11.87 MB | 13.1% |
zod |
4.4.3 |
9.00 MB | 9.9% |
devDependencies (2)
| Package | Range | Installed size | Share |
|---|---|---|---|
@types/node |
24.x |
2.54 MB | 2.8% |
typescript |
7.0.2 |
2.50 MB | 2.8% |
Function Drill-Down
Payload Size Graph
Unique function payload size and share of total
🔴 functions/.well-known/workflow/v1/flow.func [########################] 5.67 MB 63.0%
🟠 functions/__server.func [##############..........] 3.33 MB 37.0%
Top Function Payloads
🔴 functions/.well-known/workflow/v1/flow.func • 1 public route • 5.67 MB
| Metric | Value |
|---|---|
| Public routes | /.well-known/workflow/v1/flow |
| Runtime | nodejs24.x |
| Handler | index.mjs |
| Payload | 5.67 MB |
| Function files | 5.67 MB across 31 files |
| Traced dependencies | 0 B |
| Signal | 🔴 Bundled file __eve_nitro_handler__.mjs is 2.85 MB (50.3%) |
🔴 🔎 Dependency Analysis
📦 Bundled files:
Bundled file size
🔴 __eve_nitro_handler__.mjs [########################] 2.85 MB 50.3%
🟡 _chunks/sandbox.mjs [######..................] 766.3 kB 13.5%
🟡 _libs/@ai-sdk/gateway+[...].mjs [###.....................] 413.6 kB 7.3%
🟡 _chunks/dist-DnBjuNAZ.mjs [###.....................] 337.1 kB 5.9%
🟡 _libs/ai.mjs [##......................] 270.1 kB 4.8%
🟠 Other bundled files [#########...............] 1.03 MB 18.2%
🧾 Vercel Config
{
"handler": "index.mjs",
"launcherType": "Nodejs",
"shouldAddHelpers": false,
"supportsResponseStreaming": true,
"runtime": "nodejs24.x",
"environment": {
"NODE_OPTIONS": "--experimental-require-module"
},
"maxDuration": "max",
"experimentalTriggers": [
{
"type": "queue/v2beta",
"topic": "__eve776561746865722d6167656e74_wkf_workflow_*",
"consumer": "default",
"retryAfterSeconds": 5,
"initialDelaySeconds": 0
}
]
}🟠 functions/__server.func • 8 public routes, 1 internal alias • 3.33 MB
| Metric | Value |
|---|---|
| Public routes | //eve/v1/callback/[token]/eve/v1/connections/[name]/callback/[token]/eve/v1/health/eve/v1/info/eve/v1/session/eve/v1/session/[sessionId]/eve/v1/session/[sessionId]/stream |
| Internal aliases | /__server |
| Runtime | nodejs24.x |
| Handler | index.mjs |
| Payload | 3.33 MB |
| Function files | 3.33 MB across 21 files |
| Traced dependencies | 0 B |
| Signal | 🟠 Bundled file _chunks/dev-runtime-artifacts.mjs is 943.3 kB (28.4%) |
🟠 🔎 Dependency Analysis
📦 Bundled files:
Bundled file size
🟠 _chunks/dev-runtime-artifacts.mjs [########################] 943.3 kB 28.4%
🟠 index.mjs [####################....] 785.1 kB 23.6%
🟠 _chunks/sandbox.mjs [###################.....] 766.3 kB 23.0%
🟡 _chunks/dist-DnBjuNAZ.mjs [#########...............] 337.1 kB 10.1%
⚪ _chunks/resume-hook-BkVkWg2r.mjs [###.....................] 120.1 kB 3.6%
🟡 Other bundled files [#########...............] 373.3 kB 11.2%
🧾 Vercel Config
{
"handler": "index.mjs",
"launcherType": "Nodejs",
"shouldAddHelpers": false,
"supportsResponseStreaming": true,
"runtime": "nodejs24.x"
}![vercel[bot]](https://avatars.githubusercontent.com/in/8329?s=60&v=4){kind=small}
| } | ||
|
|
||
| function supportsAnthropicToolSearch(modelId: string): boolean { | ||
| const match = /^claude-[a-z]+-(\d+)(?:[.-](\d+))?/.exec(modelId.toLowerCase()); |
Contributor
There was a problem hiding this comment.
supportsAnthropicToolSearch misreads the 8-digit date in dated snapshot IDs (e.g. claude-sonnet-4-20250514) as a minor version, wrongly classifying Sonnet 4 / Opus 4 as tool-reference-capable.
1 task
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
Addresses #716.
connection_searchcurrently adds each discovered definition to the next request's top-level tool catalog. Direct Anthropic requests serialize tools before the system prompt and messages, so that insertion prevents reuse of every later cached prefix.What:
defer_loadingand append matchingtool_referenceblocks to theconnection_searchresult that introduced them.Provider boundary
Other authored dynamic tools remain eager. This path is scoped to
connection_search, where eve owns both the loader result and the loaded definitions.OpenAI and Gateway model strings also remain eager. OpenAI's positional mechanism is
additional_tools, but the AI SDK request interface used here has no representation for that input item. Replacingconnection_searchwith OpenAI's native clienttool_searchwould change its result to{ tools }, dropping connection summaries, partial errors, and authorization signals. Anthropic's custom-tool path can preserve that contract withdefer_loadingandtool_reference.This does not add a live-provider cache-token eval. The adapter-level test captures the exact Anthropic request JSON, including
cache_control,defer_loading, and the result-positionedtool_reference.How did you test your changes?
pnpm typecheck— 27/27 workspace tasks passed.pnpm lint— passed with the existing control-regex warning insrc/public/next/server.ts.pnpm guard:invariantsandpnpm docs:check— passed.pnpm test:unit— 4,699 passed and 1 skipped; 3 tests failed in untouchedsrc/execution/sandbox/bindings/vercel.test.tsbecause the run supplied ambient Vercel credential fields to credential-free mock expectations.PR Checklist
CONTRIBUTING.mdevepackagegit commit --signoff)