Allow multiple SLURM partitions for structure inference

[DimaMolod]

Problem

slurm_partition in config/config.yaml accepted only a single partition, so GPU structure_inference jobs were pinned to one queue and stuck waiting whenever that partition was busy — even if another GPU partition (e.g. gpu-training/transform) had idle nodes.

Change

SLURM's sbatch -p natively accepts a comma-separated partition list and starts the job on whichever partition frees up first. This PR lets slurm_partition be several partitions and forwards them to the plugin (which passes them straight to sbatch -p).

• normalize_partitions() (new, in workflow/rules/common.smk, unit-testable): accepts any of
  • a single name — "gpu-el8" (unchanged behaviour),
  • a comma/space-separated string — "gpu-el8, gpu-training",
  • a YAML list —

    slurm_partition:
      - gpu-el8
      - gpu-training

  and emits a de-duplicated, order-preserving, comma-joined string (gpu-el8,gpu-training). No spaces, so it survives the SLURM plugin's shlex.quote unquoted and reaches sbatch verbatim.
• Snakefile: DEFAULT_SLURM_PARTITION now runs the config value through normalize_partitions. Only structure_inference uses it; the CPU rules keep using the cluster default partition.
• Docs: config.yaml + README document multi-partition usage; removed the now-obsolete "multi-partition routing is out of scope" note. Every listed partition must accept the job's GPUs/--mem/walltime (structure_inference_max_runtime ≤ each partition's MaxTime); a partition the job doesn't fit is simply skipped by SLURM.

Testing

• Unit: test/test_normalize_partitions.py (8 cases: single/list/comma/whitespace inputs, dedup, None/empty, shlex.quote no-op). Full suite: 38 passed.
• End-to-end on the EMBL cluster: with config slurm_partition: [gpu-el8, transform], Snakemake (slurm executor) built sbatch ... -p gpu-el8,transform ... and SLURM scheduled the job onto the free transform partition (H100 node hgx1), running on GPU to COMPLETED (exit 0). Verified the plugin path is version-agnostic (installed 1.9.2 and workspace 2.0.0 both pass the partition through shlex.quote unchanged).

🤖 Generated with Claude Code