Skip to content

feat: emb_list and hybrid (RRF) searchIterator#577

Draft
DashUmEr wants to merge 1 commit into
milvus-io:2.6from
41zero:upstream-pr/emblist-hybrid-iterator
Draft

feat: emb_list and hybrid (RRF) searchIterator#577
DashUmEr wants to merge 1 commit into
milvus-io:2.6from
41zero:upstream-pr/emblist-hybrid-iterator

Conversation

@DashUmEr

@DashUmEr DashUmEr commented Jun 8, 2026

Copy link
Copy Markdown

Adds Node SDK support for:

  • searchIterator() over an emb_list (ArrayOfVector) field.
  • hybridSearchIterator() fusing dense + emb_list modalities via RRF over streamed results.

Pairs with the Milvus server-side emb_list iterator (milvus-io/milvus#49906). Validated live
(both iterators stream correctly over a real collection); tests in HybridSearchIterator.spec.ts.

Note (found in live testing): the RRF fuser keys on each hit's primary key. The shared
formatSearchResult only populates hit.id when the PK is in output_fields, so the hybrid
iterator now force-includes the PK in each sub-iterator's output_fields (and throws if a hit
lacks an id) — otherwise, with the PK omitted, all hits collapse onto one fusion key. The
broader formatSearchResult id-population behavior is pre-existing/upstream and out of scope
here (worth a separate issue). Targets 2.6; can retarget main. Draft.

@sre-ci-robot

Copy link
Copy Markdown

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: DashUmEr

The full list of commands accepted by this bot can be found here.

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@sre-ci-robot

Copy link
Copy Markdown

Welcome @DashUmEr! It looks like this is your first PR to milvus-io/milvus-sdk-node 🎉

Adds Node SDK support for:
- searchIterator() over an emb_list (ArrayOfVector) field.
- hybridSearchIterator() fusing dense + emb_list modalities via RRF over the
  streamed per-modality results.

Fusion keys on the primary key, which is force-included in each sub-iterator's
output_fields so fusion is correct even when the caller omits the PK. Part of
milvus-io/milvus#49906. Tests: test/utils/HybridSearchIterator.spec.ts.

Signed-off-by: David <[email protected]>
@DashUmEr
DashUmEr force-pushed the upstream-pr/emblist-hybrid-iterator branch from ab8c260 to 18194c4 Compare June 8, 2026 21:22
@shanghaikid
shanghaikid marked this pull request as ready for review June 10, 2026 07:43
@shanghaikid
shanghaikid marked this pull request as draft June 10, 2026 07:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants