Skip to content

TurboQuant again!#7829

Draft
connortsui20 wants to merge 6 commits intodevelopfrom
ct/tq-pull-out
Draft

TurboQuant again!#7829
connortsui20 wants to merge 6 commits intodevelopfrom
ct/tq-pull-out

Conversation

@connortsui20
Copy link
Copy Markdown
Contributor

@connortsui20 connortsui20 commented May 7, 2026

Summary

Tracking issue: #7830

Moves TurboQuant out of vortex-tensor into a new vortex-turboquant crate.

The first commit was mostly copying and pasting a bunch of code, as well as adding the unpack method to replace canonicalization. The second commit was cleaning up everything holistically.

A lot of the code in vortex-tensor was reviewed pretty lightly because we knew that it was unstable, but now that we are more certain about the implementation (not necessarily about the exact design, but the actual implementation of the TQ algorithms), I think it is worth reviewing everything as a whole.

Testing

These tests were mostly there before, but now there are more!

@connortsui20 connortsui20 changed the title Ct/tq pull out TurboQuant again! May 7, 2026
@connortsui20 connortsui20 added the changelog/feature A new feature label May 7, 2026
@connortsui20 connortsui20 mentioned this pull request May 7, 2026
7 tasks
Signed-off-by: Connor Tsui <[email protected]>
Signed-off-by: Connor Tsui <[email protected]>
Signed-off-by: Connor Tsui <[email protected]>
Signed-off-by: Connor Tsui <[email protected]>
use vortex_array::dtype::session::DTypeSessionExt;
use vortex_tensor::vector::Vector;

session.dtypes().register(Vector);
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think you want to call vortex_tensor::initialize(...)?

We should probably document that initialize functions should be idempotent!

Comment thread vortex-turboquant/src/vector/normalize.rs Outdated
Signed-off-by: Connor Tsui <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/feature A new feature

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants