Refresh the arXiv note to the current results (dose-fragility 3-vs-3, MoE, methods lesson) - #42
Merged
Conversation
Rebuild docs/note.tex + docs/note.pdf from the updated docs/note.md so the paper matches main. Adds the cross-model face of the dose-fragility result (the pinned norm-relative dose collapses coherence out-of-family on DeepSeek-Coder-33B and CodeLlama-34B, a three-versus-three split against Coder-32B, the MoE probe, and the dense Qwen rungs; broken-model nulls that enter nothing into the headline) and the corrected methods lesson (a cheap rule-based coherence gate is too lenient versus the Bedrock judge; length is ruled out). Adds the cross-architecture MoE section (Qwen1.5-MoE-A2.7B: the injection hook is live, routing perturbed at 79% of positions, yet the behavioural result is a genuine null predetermined by scale and post-training, not an architecture verdict). Corrects total spend to ~$23 to match RESULTS.md. The core 7B/14B/32B trend table, the 32B three-way, the hero figure, and the logit-lens mechanism are unchanged.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
The committed
docs/note.tex/note.pdfhad gone stale againstdocs/note.md. This rebuilds them from the current source so the paper is submission-ready (submission itself still awaits an explicit go).What's new in the paper
Unchanged
Core 7B/14B/32B trend table, the 32B three-way, the hero figure, and the logit-lens mechanism — same numbers (Coder-32B 5/216, n=1).
Verification
Rebuild:
cd docs && make. Not submitted to arXiv; endorser email not sent — both await an explicit go.