From b0b3959a5ff33f348633dd14c108dcf9efc44d8e Mon Sep 17 00:00:00 2001 From: =?UTF-8?q?Michael=20J=C3=A4hn?= Date: Wed, 24 Jun 2026 09:56:07 +0200 Subject: [PATCH 1/8] Move EvaSuite to SPICE --- docs/tools/SUMMARY.md | 1 - docs/tools/index.md | 8 --- docs/tools/spice.md | 130 ++++++++++++++++++++++++++++++++++++++++++ 3 files changed, 130 insertions(+), 9 deletions(-) diff --git a/docs/tools/SUMMARY.md b/docs/tools/SUMMARY.md index c97195a29..a3bb36a71 100644 --- a/docs/tools/SUMMARY.md +++ b/docs/tools/SUMMARY.md @@ -1,6 +1,5 @@ * [Tools](index.md) * [DWD ICON Tools](icontools.md) -* [EvaSuite](evasuite.md) * [EXTPAR](extpar.md) * [Processing Chain](processing_chain.md) * [Scaling Analysis](scaling_analysis.md) diff --git a/docs/tools/index.md b/docs/tools/index.md index 306d47416..98ba9c50f 100644 --- a/docs/tools/index.md +++ b/docs/tools/index.md @@ -37,14 +37,6 @@ C2SM supports a set of pre- and postprocessing tools on different high-performan [:octicons-arrow-right-24: SPICE](spice.md) -- :material-check-circle-outline:{ .lg .middle } **EvaSuite** - - --- - - Addon for SPICE and standalone tool for comparing simulation experiments with E-OBS or ERA5. - - [:octicons-arrow-right-24: EvaSuite](evasuite.md) - - :material-pipe:{ .lg .middle } **Processing Chain** --- diff --git a/docs/tools/spice.md b/docs/tools/spice.md index d3f799bf3..1e8400248 100644 --- a/docs/tools/spice.md +++ b/docs/tools/spice.md @@ -18,3 +18,133 @@ For any questions, please contact [Michael Jähn :material-open-in-new:](https:/ ## Documentation * [SPICE Docs :material-open-in-new:](https://spice.clm-community.eu/){:target="_blank"} + + +## EvaSuite + +EvaSuite is an addon for SPICE but also a standalone software for either + +1. Compare your simulation experiment with E-OBS or ERA5. +2. Compare your simulation experiment and a reference simulation with E-OBS or ERA5. + +### Instructions to Set Up on Säntis + +!!! warning "Instructions partly outdated" + + Due to the latest updates of EvaSuite, there is no official support on Santis. + The instructions below may still be valid, but could also be partly outdated. + In any case, please refer to the official EvaSuite Documentation. + +#### Setup Miniforge + +EvaSuite needs a conda environment setup to run properly. On a HPC system as Alps/Säntis, +Conda's packages and environments should be installed on `$SCRATCH` in order to not run into the file quota limit. +Miniforge itself can be installed in `$HOME`. + +**Download Miniforge for aarch64** + +```bash +cd ~ +wget https://github.com/conda-forge/miniforge/releases/latest/download/Miniforge3-Linux-aarch64.sh +``` + +**Install Miniforge into your home directory** + +```bash +Miniforge3-Linux-aarch64.sh -b -p $HOME/miniforge3 +``` + +**Add Miniforge to your PATH** + +```bash +echo 'export PATH=$HOME/miniforge3/bin:$PATH' >> ~/.bashrc +``` + +**Configure Conda to store envs/pkgs on `$SCRATCH`** + +Create `~/.condarc`: + +```yaml +channels: + - conda-forge +channel_priority: strict + +envs_dirs: + - $SCRATCH/conda_envs +pkgs_dirs: + - $SCRATCH/conda_pkgs + +auto_activate_base: false +``` + +uenv and modules: + +```bash +uenv start --view=modules netcdf-tools/2024:v1 +module load gcc/13.2.0 hdf5/1.14.3 +``` + +Base environment: + +```bash +conda create -n py310_evasuite python=3.10 -y +conda activate py310_evasuite +``` + +Installing packages: + +```bash +conda install -c conda-forge fiona cartopy rasterio h5py psutil +``` + +#### Installation + +Follow `DOCS/installation.md`: + +1. **Clone the repository** +```bash +git clone --recurse-submodules https://gitlab.dkrz.de/clm-community/public/evasuite.git EvaSuite_v1.0 +``` + + + +2. **Create and activate a Python virtual environment within the EvaSuite repo** +```bash +cd EvaSuite_v1.0 +conda activate py310_evasuite +``` + +3. **Tell pip to Use `$SCRATCH` for Cache & Wheels** + +```bash +export PIP_CACHE_DIR=$SCRATCH/pip_cache +export TMPDIR=$SCRATCH/pip_temp +mkdir -p $PIP_CACHE_DIR $TMPDIR +``` + +4. **Upgrade pip and install dependencies** +```bash +pip install --upgrade pip setuptools wheel +pip install -r requirements.txt +``` + +5. **Install EvaSuite** +```bash +pip install . +``` + + +### Usage + +Load modules and activate environment: +```bash +uenv start --view=modules netcdf-tools/2024:v1 +module load cdo/2.4.0 netcdf-c/4.9.2 netcdf-fortran/4.6.1 +conda activate py310_evasuite +``` + +### Reference + +- [PDF Documentation :material-open-in-new:](https://gitlab.dkrz.de/clm-community/public/evasuite/-/raw/main/DOCS/Documentation_EvaSuite_v1_0.pdf?ref_type=heads&inline=true){:target="_blank"} +- [EvaSuite within SPICE User Guide :material-open-in-new:](https://clm-community.gitlab-pages.dkrz.de/public/spice/add-ons/eva-suite.html){:target="_blank"} +- [Public repository on GitLab :material-open-in-new:](https://gitlab.dkrz.de/clm-community/public/evasuite){:target="_blank"} \ No newline at end of file From dfca1fe4611bc6fc64044a01e718dee0424b0bda Mon Sep 17 00:00:00 2001 From: =?UTF-8?q?Michael=20J=C3=A4hn?= Date: Wed, 24 Jun 2026 09:59:28 +0200 Subject: [PATCH 2/8] Use Spack-C2SM everywhere --- docs/tools/SUMMARY.md | 2 +- docs/tools/icontools.md | 2 +- docs/tools/spack.md | 4 ++-- 3 files changed, 4 insertions(+), 4 deletions(-) diff --git a/docs/tools/SUMMARY.md b/docs/tools/SUMMARY.md index a3bb36a71..7ac9d5bfc 100644 --- a/docs/tools/SUMMARY.md +++ b/docs/tools/SUMMARY.md @@ -3,7 +3,7 @@ * [EXTPAR](extpar.md) * [Processing Chain](processing_chain.md) * [Scaling Analysis](scaling_analysis.md) -* [Spack](spack.md) +* [Spack-C2SM](spack.md) * [SPICE](spice.md) * [Zephyr](zephyr.md) * [Zonda](zonda.md) \ No newline at end of file diff --git a/docs/tools/icontools.md b/docs/tools/icontools.md index cc23dd13a..cfe3b013b 100644 --- a/docs/tools/icontools.md +++ b/docs/tools/icontools.md @@ -29,7 +29,7 @@ uenv start climtools/25.2:v1 --view=climtools please consider the official [spack-c2sm documentation :material-open-in-new:](https://c2sm.github.io/spack-c2sm/latest){:target="_blank"}. The following Spack installation should be sufficient for most cases. -Clone the C2SM Spack main branch and source it: +Clone the Spack-C2SM main branch and source it: ```bash git clone --depth 1 --recurse-submodules --shallow-submodules https://github.com/C2SM/spack-c2sm.git source ./spack-c2sm/setup-env.sh /user-environment diff --git a/docs/tools/spack.md b/docs/tools/spack.md index a356c856d..c38810901 100644 --- a/docs/tools/spack.md +++ b/docs/tools/spack.md @@ -1,3 +1,3 @@ -# C2SM Spack +# Spack-C2SM -Find all information about the C2SM version of Spack in the [official C2SM Spack documentation :material-open-in-new:](https://c2sm.github.io/spack-c2sm/latest){:target="_blank"}. \ No newline at end of file +Find all information about the C2SM version of Spack in the [official Spack-C2SM documentation :material-open-in-new:](https://c2sm.github.io/spack-c2sm/latest){:target="_blank"}. \ No newline at end of file From 91200fcfaf10e2fbbddbb3551d7ef2b200d61351 Mon Sep 17 00:00:00 2001 From: =?UTF-8?q?Michael=20J=C3=A4hn?= Date: Wed, 24 Jun 2026 10:00:27 +0200 Subject: [PATCH 3/8] Update spack-c2sm for index page --- docs/tools/index.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/tools/index.md b/docs/tools/index.md index 98ba9c50f..34b5eddb9 100644 --- a/docs/tools/index.md +++ b/docs/tools/index.md @@ -57,7 +57,7 @@ C2SM supports a set of pre- and postprocessing tools on different high-performan C2SM's configuration of the Spack package manager for installing ICON and related software on HPC systems. - [:octicons-arrow-right-24: Spack](spack.md) + [:octicons-arrow-right-24: Spack-C2SM](spack.md) - :material-chart-bar:{ .lg .middle } **Scaling Analysis** From 0ceaf98017f852ef4cd32b348382db3f2f8c3dc1 Mon Sep 17 00:00:00 2001 From: =?UTF-8?q?Michael=20J=C3=A4hn?= Date: Wed, 24 Jun 2026 10:29:39 +0200 Subject: [PATCH 4/8] Update general info about spack-c2sm --- docs/tools/spack.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/docs/tools/spack.md b/docs/tools/spack.md index c38810901..79a178e55 100644 --- a/docs/tools/spack.md +++ b/docs/tools/spack.md @@ -1,3 +1,5 @@ # Spack-C2SM +Spack-C2SM is the package management system maintained by C2SM and MeteoSwiss for installing and deploying scientific software on high-performance computing systems, primarily at the Swiss National Supercomputing Centre (CSCS). Built on top of [Spack](https://spack.io), it provides environment management, package discovery, and installation workflows tailored to the C2SM community. It supports different use cases — from simply installing pre-built packages to actively developing and building model code with commands like `spack dev-build`. + Find all information about the C2SM version of Spack in the [official Spack-C2SM documentation :material-open-in-new:](https://c2sm.github.io/spack-c2sm/latest){:target="_blank"}. \ No newline at end of file From c17b8f537d50b218d574826fabadff879b43a08e Mon Sep 17 00:00:00 2001 From: =?UTF-8?q?Michael=20J=C3=A4hn?= Date: Wed, 24 Jun 2026 10:29:52 +0200 Subject: [PATCH 5/8] Link EXTPAR --- docs/tools/extpar.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/tools/extpar.md b/docs/tools/extpar.md index d3200589d..cd6f93af6 100644 --- a/docs/tools/extpar.md +++ b/docs/tools/extpar.md @@ -1,6 +1,6 @@ # EXTPAR -EXTPAR (**Ext**ernal **Par**ameters for Numerical Weather Prediction and Climate Application) +[EXTPAR :material-open-in-new:](https://github.com/C2SM/extpar){:target="_blank"} (**Ext**ernal **Par**ameters for Numerical Weather Prediction and Climate Application) is used to prepare the external parameter data files that are used as input for the ICON model. All information around this software can be found in the From 46df39715d4ad56f4d33bae630c5e1c7dfc563a0 Mon Sep 17 00:00:00 2001 From: =?UTF-8?q?Michael=20J=C3=A4hn?= Date: Wed, 24 Jun 2026 10:30:10 +0200 Subject: [PATCH 6/8] Add disclaimer for ICON-CLM --- docs/models/icon/icon-clm.md | 4 ++++ 1 file changed, 4 insertions(+) diff --git a/docs/models/icon/icon-clm.md b/docs/models/icon/icon-clm.md index 53d788015..80f6b44b6 100644 --- a/docs/models/icon/icon-clm.md +++ b/docs/models/icon/icon-clm.md @@ -1,5 +1,9 @@ # ICON-CLM Workflow for EURO-CORDEX 12 km Domain +!!! warning + + Information provided here is outdated since Santis, uenvs and SPICE have received updates. + ## SPICE [SPICE](../../tools/spice.md) is a software created by the CLM community and serves as a processing chain / workflow tool From ef5acda2c15b4ba3d9d1dd27b40c43af9ef529d6 Mon Sep 17 00:00:00 2001 From: mjaehn Date: Wed, 24 Jun 2026 08:30:37 +0000 Subject: [PATCH 7/8] GitHub Action: Apply external link format --- docs/tools/spack.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/tools/spack.md b/docs/tools/spack.md index 79a178e55..7cc53dc0f 100644 --- a/docs/tools/spack.md +++ b/docs/tools/spack.md @@ -1,5 +1,5 @@ # Spack-C2SM -Spack-C2SM is the package management system maintained by C2SM and MeteoSwiss for installing and deploying scientific software on high-performance computing systems, primarily at the Swiss National Supercomputing Centre (CSCS). Built on top of [Spack](https://spack.io), it provides environment management, package discovery, and installation workflows tailored to the C2SM community. It supports different use cases — from simply installing pre-built packages to actively developing and building model code with commands like `spack dev-build`. +Spack-C2SM is the package management system maintained by C2SM and MeteoSwiss for installing and deploying scientific software on high-performance computing systems, primarily at the Swiss National Supercomputing Centre (CSCS). Built on top of [Spack :material-open-in-new:](https://spack.io){:target="_blank"}, it provides environment management, package discovery, and installation workflows tailored to the C2SM community. It supports different use cases — from simply installing pre-built packages to actively developing and building model code with commands like `spack dev-build`. Find all information about the C2SM version of Spack in the [official Spack-C2SM documentation :material-open-in-new:](https://c2sm.github.io/spack-c2sm/latest){:target="_blank"}. \ No newline at end of file From 087c82520d4681f3fb3886319e4121b4c9a9ec5d Mon Sep 17 00:00:00 2001 From: =?UTF-8?q?Michael=20J=C3=A4hn?= Date: Wed, 24 Jun 2026 10:40:26 +0200 Subject: [PATCH 8/8] Remove half sentence --- docs/tools/spack.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/tools/spack.md b/docs/tools/spack.md index 7cc53dc0f..1505f9ac4 100644 --- a/docs/tools/spack.md +++ b/docs/tools/spack.md @@ -1,5 +1,5 @@ # Spack-C2SM -Spack-C2SM is the package management system maintained by C2SM and MeteoSwiss for installing and deploying scientific software on high-performance computing systems, primarily at the Swiss National Supercomputing Centre (CSCS). Built on top of [Spack :material-open-in-new:](https://spack.io){:target="_blank"}, it provides environment management, package discovery, and installation workflows tailored to the C2SM community. It supports different use cases — from simply installing pre-built packages to actively developing and building model code with commands like `spack dev-build`. +Spack-C2SM is the package management system maintained by C2SM and MeteoSwiss for installing and deploying scientific software on high-performance computing systems, primarily at the Swiss National Supercomputing Centre (CSCS). Built on top of [Spack :material-open-in-new:](https://spack.io){:target="_blank"}, it provides environment management, package discovery, and installation workflows tailored to the C2SM community. It supports different use cases — from simply installing pre-built packages to actively developing and building model code. Find all information about the C2SM version of Spack in the [official Spack-C2SM documentation :material-open-in-new:](https://c2sm.github.io/spack-c2sm/latest){:target="_blank"}. \ No newline at end of file