leaderboard: show each model's rank number and rank shift on the reorder plot - #29
Merged
Merged
Conversation
…der plot The bump chart drew connecting lines and per-node rates but not the explicit rank position, so a reader had to infer ranks from vertical order. Render each model's integer rank at both the hijack and leakage endpoints (white numeral on the node), and mark movers with an up/down glyph plus the rank delta (reusing the same moved test as the crossing count). A null (Kendall tau = 1) shows no delta. Closes bamdadd#8
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Closes #8.
The hijack-vs-leakage bump chart drew lines and per-node rates but not the explicit rank position, so a reader had to infer ranks from vertical order.
Change (
_svg_reorder):r=6→9to fit).▲2/▼1), reusing the samemovedtest that drives the crossing count. A null (Kendall τ = 1) shows no delta.Tests (
tests/test_leaderboard.py): a 2-model reorder renders the rank numerals at both endpoints and both movement glyphs with the delta; a ranks-agree case renders numerals but no glyph.ruff check/format,mypy, andpytestall green.