Skip to content

Add SAM3 (Segment Anything 3) interactive segmentation#13

Merged
infil00p merged 1 commit into
mainfrom
sam3_feature
Jan 23, 2026
Merged

Add SAM3 (Segment Anything 3) interactive segmentation#13
infil00p merged 1 commit into
mainfrom
sam3_feature

Conversation

@infil00p

@infil00p infil00p commented Jan 8, 2026

Copy link
Copy Markdown
Contributor

Integrates SAM3 as a toggle-able overlay tool for interactive image segmentation with ONNX Runtime backend (CUDA/CoreML/DirectML with CPU fallback).

Backend:

  • sam3_engine.rs: ONNX inference with embedding caching
  • sam3_image_processor.rs: Image preprocessing and mask postprocessing
  • Tauri commands for load/unload/encode/segment operations
  • Model download from onnx-community/sam3-tracker-ONNX

Frontend:

  • Sam3Overlay: Interactive mask overlay with point/box prompts
  • Sam3Controls: Mask quality selector, opacity, export, crop-to-mask
  • Toolbar toggle button with download indicator
  • Download dialog with progress for SAM3 model

Usage: Click sparkle button to enable, left-click for foreground points, right-click for background, drag to draw bounding box.

🤖 Generated with Claude Code

Integrates SAM3 as a toggle-able overlay tool for interactive image
segmentation with ONNX Runtime backend (CUDA/CoreML/DirectML with CPU
fallback).

Backend:
- sam3_engine.rs: ONNX inference with embedding caching
- sam3_image_processor.rs: Image preprocessing and mask postprocessing
- Tauri commands for load/unload/encode/segment operations
- Model download from onnx-community/sam3-tracker-ONNX

Frontend:
- Sam3Overlay: Interactive mask overlay with point/box prompts
- Sam3Controls: Mask quality selector, opacity, export, crop-to-mask
- Toolbar toggle button with download indicator
- Download dialog with progress for SAM3 model

Usage: Click sparkle button to enable, left-click for foreground points,
right-click for background, drag to draw bounding box.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.5 <[email protected]>
@infil00p
infil00p merged commit 538b9c9 into main Jan 23, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant