Skip to content

esmvaltool/enso-basic-climatology diagnostic not configured for CMIP7 datasets #803

Description

@k-a-webb

Despite enso-basic-climatology being marked as CMIP7 ready in #536, the diagnostic script is only configured for CMIP6 datasets.
While the recipe will run successfully for CMIP7 datasets, no output is produced (and since Climate-ref v0.16.0 an error is raised when attempting to copy the output from scratch/ to results/; see below)

See https://github.com/ESMValGroup/ESMValTool/blob/324d4ebaa8c1420fdc09a40818fbe1a36754d773/esmvaltool/diag_scripts/enso_metrics/climatology_diagnosticlevel2.py#L156:
if metadata["project"] == "CMIP6":

A similar issue is in the diagnostic enso-characteristics: https://github.com/ESMValGroup/ESMValTool/blob/324d4ebaa8c1420fdc09a40818fbe1a36754d773/esmvaltool/diag_scripts/enso_metrics/enso_diag1metrics.py#L541-L556

        for var_prep in var_preproc:
            obs += select_metadata(
                input_data,
                variable_group=var_prep,
                project="OBS",
            )
            obs += select_metadata(
                input_data,
                variable_group=var_prep,
                project="OBS6",
            )
            models += select_metadata(
                input_data,
                variable_group=var_prep,
                project="CMIP6",
            )

log when running enso-characteristics (similar for enso-basic-climatology):

| INFO     | climate_ref_core.executor - Executing 'esmvaltool/enso-characteristics/cmip7_g127_CanESM5-1_r1i1p2f1'
2026-07-09 20:02:58.209 +00:00 | INFO     | climate_ref_core.executor - Executing 'esmvaltool/enso-characteristics/cmip7_g999_CanESM6-0-rc1-MR_r1i1p1f1'
2026-07-09 20:05:56.816 +00:00 | ERROR    | climate_ref_core.executor - System error running 'esmvaltool/enso-characteristics/cmip7_g127_CanESM5-1_r1i1p2f1' (will be retried on next solve): [Errno 2] No such file or directory: '/fs/site7/eccc/crd/cccma/users/scrd115/REF/REF_v0.16.0/climate-ref/.ref/scratch/esmvaltool/enso-characteristics/g127_CanESM5-1_r1i1p2f1_g148_v1_99e11f4d/200/executions/recipe_20260709_200313/work/diagnostic_metrics/plot_script/matrix.csv'
2026-07-09 20:05:56.843 +00:00 | ERROR    | climate_ref_core.executor - System error running 'esmvaltool/enso-characteristics/cmip7_g999_CanESM6-0-rc1-MR_r1i1p1f1' (will be retried on next solve): [Errno 2] No such file or directory: '/fs/site7/eccc/crd/cccma/users/scrd115/REF/REF_v0.16.0/climate-ref/.ref/scratch/esmvaltool/enso-characteristics/g999_CanESM6-0-rc1-MR_r1i1p1f1_g149_v1_6bc6da9f/201/executions/recipe_20260709_200313/work/diagnostic_metrics/plot_script/matrix.csv'
2026-07-09 20:05:57.111 +00:00 | ERROR    | climate_ref.executor.result_handling - Error running esmvaltool/enso-characteristics/cmip7_g127_CanESM5-1_r1i1p2f1. 
Additional information about this execution can be viewed using: ref executions inspect 148
2026-07-09 20:05:57.120 +00:00 | ERROR    | climate_ref.executor.result_handling - <climate_ref.models.execution.Execution object at 0x7ff7757cde50> failed due to a system error (will be retried on next solve)
Waiting for executions to complete:  50%|██████████████████████████████████████████████████                                                  | 1/2 [03:05<03:05, 185.16s/execution]2026-07-09 20:05:57.183 +00:00 | ERROR    | climate_ref.executor.result_handling - Error running esmvaltool/enso-characteristics/cmip7_g999_CanESM6-0-rc1-MR_r1i1p1f1. 
Additional information about this execution can be viewed using: ref executions inspect 149
2026-07-09 20:05:57.185 +00:00 | ERROR    | climate_ref.executor.result_handling - <climate_ref.models.execution.Execution object at 0x7ff7757ccf20> failed due to a system error (will be retried on next solve)
Waiting for executions to complete: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████| 2/2 [03:05<00:00, 92.59s/execution]
2026-07-09 20:05:57.209 +00:00 | INFO     | climate_ref.executor.local - All executions completed successfully
2026-07-09 20:05:57.210 +00:00 | INFO     | climate_ref.solver - All executions complete

System

ref tag v0.16.0

  provider     version   conda environment                                                             data path                                                                   
 ───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────── 
  pmp          0.16.0    /fs/site7/eccc/crd/cccma/users/scrd115/REF/REF_v0.16.0/climate-ref/.ref/so…   /fs/site7/eccc/crd/cccma/users/scrd115/REF/REF_v0.16.0/climate-ref/.ref/c…  
  ilamb        0.16.0                                                                                  /fs/site7/eccc/crd/cccma/users/scrd115/REF/REF_v0.16.0/climate-ref/.ref/c…  
  example      0.16.0                                                                                                                                                              
  esmvaltool   0.16.0    /fs/site7/eccc/crd/cccma/users/scrd115/REF/REF_v0.16.0/climate-ref/.ref/so…   /fs/site7/eccc/crd/cccma/users/scrd115/REF/REF_v0.16.0/climate-ref/.ref/c…  

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions