2023-05-31 09:13:21,821 UTC [647842] INFO esmvaltool.cmorizers.data.cmorizer:71 Writing program log files to: /projects/NS9560K/www/diagnostics/esmvaltool/yanchun/tmp/data_formatting_20230531_091321/run/main_log.txt /projects/NS9560K/www/diagnostics/esmvaltool/yanchun/tmp/data_formatting_20230531_091321/run/main_log_debug.txt 2023-05-31 09:13:21,821 UTC [647842] INFO esmvaltool.cmorizers.data.cmorizer:77 Starting the CMORization Tool at time: 2023-05-31 09:13:21 UTC 2023-05-31 09:13:21,821 UTC [647842] INFO esmvaltool.cmorizers.data.cmorizer:80 ---------------------------------------------------------------------- 2023-05-31 09:13:21,821 UTC [647842] INFO esmvaltool.cmorizers.data.cmorizer:81 input_dir = /projects/NS9560K-datalake/ESGF/rawdata/obs 2023-05-31 09:13:21,822 UTC [647842] INFO esmvaltool.cmorizers.data.cmorizer:86 output_dir = /projects/NS9560K/www/diagnostics/esmvaltool/yanchun/tmp/data_formatting_20230531_091321 2023-05-31 09:13:21,822 UTC [647842] INFO esmvaltool.cmorizers.data.cmorizer:87 ---------------------------------------------------------------------- 2023-05-31 09:13:21,822 UTC [647842] INFO esmvaltool.cmorizers.data.cmorizer:187 Running the CMORization scripts. 2023-05-31 09:13:21,822 UTC [647842] INFO esmvaltool.cmorizers.data.cmorizer:193 Processing datasets ['HadCRUT5'] 2023-05-31 09:13:21,822 UTC [647842] ERROR esmvaltool.cmorizers.data.cmorizer:268 Data for HadCRUT5 not found. Perhaps you are not storing it in a RAWOBS/TierX/HadCRUT5 (X=2 or 3) directory structure? 2023-05-31 09:13:21,822 UTC [647842] ERROR esmvalcore._main:533 Program terminated abnormally, see stack trace below for more information: Traceback (most recent call last): File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_main.py", line 521, in run fire.Fire(ESMValTool()) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/fire/core.py", line 141, in Fire component_trace = _Fire(component, args, parsed_flag_args, context, name) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/fire/core.py", line 475, in _Fire component, remaining_args = _CallAndUpdateTrace( File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/fire/core.py", line 691, in _CallAndUpdateTrace component = fn(*varargs, **kwargs) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvaltool/cmorizers/data/cmorizer.py", line 496, in format self.formatter.format(start, end, install) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvaltool/cmorizers/data/cmorizer.py", line 202, in format raise Exception( Exception: Format failed for datasets HadCRUT5 2023-05-31 09:13:21,823 UTC [647842] INFO esmvalcore._main:537 If you have a question or need help, please start a new discussion on https://github.com/ESMValGroup/ESMValTool/discussions If you suspect this is a bug, please open an issue on https://github.com/ESMValGroup/ESMValTool/issues To make it easier to find out what the problem is, please consider attaching the files run/recipe_*.yml and run/main_log_debug.txt from the output directory.