SwiftLM b554

SwiftLM b554-b33801a

Merge pull request #77 from SharpAI/fix/issue-72-draft-model-ssd-ram

fix: memory auto-cap strategy for SSD MoE streaming + speculative decoding (Issue #72)

Changelog

• fix: allow custom model selection in benchmark test 10 (8385350)
• fix: address Copilot review feedback on PR #77 (7b0bfd4)
• fix(ci): use bash variable for PID in ssd-draft-memory-guard (58249c2)
• ci: trigger run after YAML fix (c8b236d)
• fix(ci): repair YAML corruption in ci.yml (retention-days merged with comment) (be8353f)
• docs: document --stream-experts + --draft-model auto-cap strategy (Issue #72) (bb29e36)
• ci: add ssd-draft-memory-guard job + vm_stat readings for Issue #72 (3f6bad5)
• test(benchmark): add Test 10 — Issue #72 SSD + draft model RAM regression (7a14a67)
• fix(ssd-stream): auto-cap draft tokens to 1 when --stream-experts + --draft-model (#72) (dfd0935)
• fix(ssd-stream): prevent inference-time swap explosion with --draft-model (#72 follow-up) (5390216)

Download

• CLI Server: macOS Apple Silicon (arm64)
• GUI Desktop App: Download the attached SwiftBuddy-macOS.dmg below!

Quick Start

For GUI Users (SwiftBuddy):

1. Download the attached DMG and open it.
2. Drag SwiftBuddy.app into your Applications folder natively or run directly.
3. When launched, click "Model Options" to select or download an MLX local model to chat with.

For CLI Users (SwiftLM):
Please refer to the Getting Started section in the README.

Note: mlx.metallib is bundled in the tar archive. Keep it in the same directory as the SwiftLM binary — Metal GPU compute will fail if it is missing.