Skip to content

added inference_only mode (skip target loading, loss computation, and metric logging) (2nd PR) - #2625

Open
sbAsma wants to merge 18 commits into
ecmwf:developfrom
sbAsma:sbAsma/dev/2256-optional-target
Open

added inference_only mode (skip target loading, loss computation, and metric logging) (2nd PR)#2625
sbAsma wants to merge 18 commits into
ecmwf:developfrom
sbAsma:sbAsma/dev/2256-optional-target

Conversation

@sbAsma

@sbAsma sbAsma commented Jul 13, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Description

Issue Number

Closes #2256

Checklist before asking for review

  • I have performed a self-review of my code
  • My changes comply with basic sanity checks:
    • I have fixed formatting issues with ./scripts/actions.sh lint
    • I have run unit tests with ./scripts/actions.sh unit-test
    • I have documented my code and I have updated the docstrings.
    • I have added unit tests, if relevant
  • I have tried my changes with data and code:
    • I have run the integration tests with ./scripts/actions.sh integration-test
    • (bigger changes) I have run a full training and I have written in the comment the run_id(s): launch-slurm.py --time 60
    • (bigger changes and experiments) I have shared a hegdedoc in the github issue with all the configurations and runs for this experiments
  • I have informed and aligned with people impacted by my change:
    • for config changes: the MatterMost channels and/or a design doc
    • for changes of dependencies: the MatterMost software development channel

sbAsma and others added 15 commits April 25, 2026 11:57
@sbAsma
add inference_only flag to default config
a5fbd44
@sbAsma
add inference_only mode: skip target loading, batch validation, and t…
13974f0 
…okens_lens for targets; improve empty-batch error handling with max_attempts and skip reason logging
@sbAsma
add optional target_coords_raw and times_raw fields to add_target_coords
524a132
@sbAsma
return coords_raw and datetimes from get_target_coords
52c2212
@sbAsma
skip loss/metric computation and logging in inference_only mode; fall…
5aad8d1 
… back to source samples for coordinate/time metadata and override is_spoof for output writing
@sbAsma
fix output writing in inference_only mode: guard empty idxs_inv tenso…
a6aaa56 
…r, reshape empty target array to (0, n_channels), and use coord count for targets_lens
@sbAsma
default inference only to false
d36afe6
@sbAsma
improved logging for non valid data
eb27fad
@sbAsma
added ruff requested change
08ac2e0
@sbAsma
added ruff requested change
9c674d5
@sbAsma
made inference_only applicable during inference
417b7be
@sbAsma
simplify validation target/aux computation
502050f
@sbAsma
removed unecessary comment
e4fccda
@sbAsma
Merge branch 'develop' into sbAsma/dev/2256-optional-target
5c79a51
@sbAsma
removed spoofing
4c6da35
@sbAsma

sbAsma commented Jul 13, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor Author

I re-opened the PR @clessig @MatKbauer
EDIT: I tested the PR after the changes and it wasn't serving the purpose anymore, so I had to make new changes. Can you please re-review it?

@github-actions github-actions Bot added the infra Issues related to infrastructure label Jul 14, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

infra Issues related to infrastructure

Projects

WeatherGen-dev
Status: No status

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

Task: Support Optional Target During Inference for Beyond-Training-Date Forecasting

1 participant

@sbAsma