Skip to content

Add competition holdout loader + wire submissions to real data#1

Merged
gereonelvers merged 1 commit into
mainfrom
refactor
Jul 2, 2026
Merged

Add competition holdout loader + wire submissions to real data#1
gereonelvers merged 1 commit into
mainfrom
refactor

Conversation

@gereonelvers

Copy link
Copy Markdown
Collaborator

pnpl.competition.LibriBrainCompetitionHoldout downloads the LibriBrain 2026 holdout (pnpl/LibriBrain-Competition-2026) and enumerates the canonical submission rows: one (306, 250) window per word, for the Deep (subj0) and Broad (subj1-39) tracks, across both the sentence and isolated-word sources, every valid word. The loader is the single source of truth for row order / submission index.

  • holdout.py: streaming loader (iter_windows with a one-file MEG cache), track presets, and an npy-header shape read so index building never decompresses the large meg arrays.
  • competition/init.py: export the loader + track/source constants.
  • tests/test_competition_holdout.py: offline tests over synthetic npz fixtures (enumeration order, window extraction, batching, guards).
  • examples/submit_pnpl2026.ipynb: build the submission from the real holdout loader instead of range(N).
  • docs/competition.md (+ _toc.yml): document the format, tracks, and the canonical row ordering.

pnpl.competition.LibriBrainCompetitionHoldout downloads the LibriBrain
2026 holdout (pnpl/LibriBrain-Competition-2026) and enumerates the
canonical submission rows: one (306, 250) window per word, for the Deep
(subj0) and Broad (subj1-39) tracks, across both the sentence and
isolated-word sources, every valid word. The loader is the single source
of truth for row order / submission index.

- holdout.py: streaming loader (iter_windows with a one-file MEG cache),
  track presets, and an npy-header shape read so index building never
  decompresses the large meg arrays.
- competition/__init__.py: export the loader + track/source constants.
- tests/test_competition_holdout.py: offline tests over synthetic npz
  fixtures (enumeration order, window extraction, batching, guards).
- examples/submit_pnpl2026.ipynb: build the submission from the real
  holdout loader instead of range(N).
- docs/competition.md (+ _toc.yml): document the format, tracks, and the
  canonical row ordering.
@gereonelvers gereonelvers merged commit 380b641 into main Jul 2, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant