Running on Betzy

[lasseke]

Hey,

I was testing the code on Betzy and ran into some problems. Here is what I did to fix them.

1 Conda environment

Creating a conda env from the requirements.txt file did not work, I assume due to the specified builds being unavailable on different machines. Here is a shortened conda_env.yaml file that should be more portable and worked for me:

name: xesmf-env
channels:
  - conda-forge
dependencies:
  - black=24.8.0
  - dask=2025.1.0
  - cartopy=0.23.0
  - cftime=1.6.4
  - esmf=8.6.1
  - h5netcdf=1.3.0
  - matplotlib=3.9.2
  - netcdf4=1.7.1
  - pandas=2.2.2
  - pip=24.2
  - python=3.12.5
  - xarray=2024.7.0
  - xesmf=0.8.7

To create the environment: conda env create -p /path/to/save/env/xesmf-env --file conda_env.yaml (note the env before create).

2 Providing the path to the CLM outputs

Note that the CLI argument path_1 currently MUST include a trailing "/", so:

WRONG:   python run_diagnostic_full_from_terminal.py /cluster/work/users/lassetk/archive/sval_bgc/lnd/hist
CORRECT: python run_diagnostic_full_from_terminal.py /cluster/work/users/lassetk/archive/sval_bgc/lnd/hist/

3 Weight file

I cannot access the default weight file under the default path. However, the file is not needed if you want to plot on regular lat-lon grids. BUT: you currently still need to provide an argument for the "weight" parameter, which must point to an existing file. Here is an example that successfully produced plots in my test:

touch /cluster/home/lassetk/git_repos/xesmf_clm_fates_diagnostic/scripts/weight_dummy.txt

python run_diagnostic_full_from_terminal.py /path/to/case/output/lnd/hist/ weight=/cluster/home/lassetk/git_repos/xesmf_clm_fates_diagnostic/scripts/weight_dummy.txt outpath=/cluster/home/lassetk/ctsm_regional_test/plots/sval_bgc pamfile=/cluster/home/lassetk/git_repos/xesmf_clm_fates_diagnostic/scripts/short_pams_no_compare.json