Skip to content

[WIP] Add streaming support#366

Draft
julien-nc wants to merge 25 commits into
mainfrom
enh/noid/streaming
Draft

[WIP] Add streaming support#366
julien-nc wants to merge 25 commits into
mainfrom
enh/noid/streaming

Conversation

@julien-nc
Copy link
Copy Markdown
Member

@julien-nc julien-nc commented May 11, 2026

This depends on nextcloud/server#60167 and other adjustments in the Task Processing API that are coming soon.

  • Refactor the network logic to parse streamed responses (basic dummy usage in the TextToText provider)
  • Wait for Let devs choose the handler for http requests server#60167
  • Wait for the Task Processing adjustments
  • Adjust the providers that have some text output
  • Adjust the assistant to progressively display the streamed outputs in the UI

@julien-nc julien-nc force-pushed the enh/noid/streaming branch from 6ef833d to 1390e9c Compare May 18, 2026 11:23
@julien-nc julien-nc force-pushed the enh/noid/streaming branch 3 times, most recently from ec0ade4 to 2b7aa83 Compare May 21, 2026 12:34
@julien-nc julien-nc force-pushed the enh/noid/streaming branch 2 times, most recently from 3bf71aa to bf6829a Compare June 2, 2026 12:19
julien-nc added 22 commits June 5, 2026 16:38
Signed-off-by: Julien Veyssier <[email protected]>
Signed-off-by: Julien Veyssier <[email protected]>
Signed-off-by: Julien Veyssier <[email protected]>
Signed-off-by: Julien Veyssier <[email protected]>
Signed-off-by: Julien Veyssier <[email protected]>
…treaming param in process

Signed-off-by: Julien Veyssier <[email protected]>
…sponses, content and resoning_content chunks are yielded when streaming. ignore reasoning in the providers for now

Signed-off-by: Julien Veyssier <[email protected]>
…nd SynchronousProviderOptions

Signed-off-by: Julien Veyssier <[email protected]>
Signed-off-by: Julien Veyssier <[email protected]>
@julien-nc julien-nc force-pushed the enh/noid/streaming branch 2 times, most recently from 3627a13 to 38f9977 Compare June 5, 2026 18:22
julien-nc added 2 commits June 5, 2026 20:31
Signed-off-by: Julien Veyssier <[email protected]>
Signed-off-by: Julien Veyssier <[email protected]>
@julien-nc julien-nc force-pushed the enh/noid/streaming branch from 2c1b83b to eddfb58 Compare June 5, 2026 18:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant