INFO [631894] ______________________________________________________________________ _____ ____ __ ____ __ _ _____ _ | ____/ ___|| \/ \ \ / /_ _| |_ _|__ ___ | | | _| \___ \| |\/| |\ \ / / _` | | | |/ _ \ / _ \| | | |___ ___) | | | | \ V / (_| | | | | (_) | (_) | | |_____|____/|_| |_| \_/ \__,_|_| |_|\___/ \___/|_| ______________________________________________________________________ ESMValTool - Earth System Model Evaluation Tool. http://www.esmvaltool.org CORE DEVELOPMENT TEAM AND CONTACTS: Birgit Hassler (Co-PI; DLR, Germany - birgit.hassler@dlr.de) Alistair Sellar (Co-PI; Met Office, UK - alistair.sellar@metoffice.gov.uk) Bouwe Andela (Netherlands eScience Center, The Netherlands - b.andela@esciencecenter.nl) Lee de Mora (PML, UK - ledm@pml.ac.uk) Niels Drost (Netherlands eScience Center, The Netherlands - n.drost@esciencecenter.nl) Veronika Eyring (DLR, Germany - veronika.eyring@dlr.de) Bettina Gier (UBremen, Germany - gier@uni-bremen.de) Remi Kazeroni (DLR, Germany - remi.kazeroni@dlr.de) Nikolay Koldunov (AWI, Germany - nikolay.koldunov@awi.de) Axel Lauer (DLR, Germany - axel.lauer@dlr.de) Saskia Loosveldt-Tomas (BSC, Spain - saskia.loosveldt@bsc.es) Ruth Lorenz (ETH Zurich, Switzerland - ruth.lorenz@env.ethz.ch) Benjamin Mueller (LMU, Germany - b.mueller@iggf.geo.uni-muenchen.de) Valeriu Predoi (URead, UK - valeriu.predoi@ncas.ac.uk) Mattia Righi (DLR, Germany - mattia.righi@dlr.de) Manuel Schlund (DLR, Germany - manuel.schlund@dlr.de) Breixo Solino Fernandez (DLR, Germany - breixo.solinofernandez@dlr.de) Javier Vegas-Regidor (BSC, Spain - javier.vegas@bsc.es) Klaus Zimmermann (SMHI, Sweden - klaus.zimmermann@smhi.se) For further help, please read the documentation at http://docs.esmvaltool.org. Have fun! INFO [631894] Package versions INFO [631894] ---------------- INFO [631894] ESMValCore: 2.8.0 INFO [631894] ESMValTool: 2.8.0 INFO [631894] ---------------- INFO [631894] Using config file /nird/home/yanchun/.esmvaltool/config-user.yml INFO [631894] Writing program log files to: /projects/NS9560K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_mydiag_20230531_084453/run/main_log.txt /projects/NS9560K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_mydiag_20230531_084453/run/main_log_debug.txt INFO [631894] Starting the Earth System Model Evaluation Tool at time: 2023-05-31 08:44:54 UTC INFO [631894] ---------------------------------------------------------------------- INFO [631894] RECIPE = /nird/home/yanchun/esmvaltool_workshop/recipe_mydiag.yml INFO [631894] RUNDIR = /projects/NS9560K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_mydiag_20230531_084453/run INFO [631894] WORKDIR = /projects/NS9560K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_mydiag_20230531_084453/work INFO [631894] PREPROCDIR = /projects/NS9560K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_mydiag_20230531_084453/preproc INFO [631894] PLOTDIR = /projects/NS9560K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_mydiag_20230531_084453/plots INFO [631894] ---------------------------------------------------------------------- INFO [631894] Running tasks using at most 2 processes INFO [631894] If your system hangs during execution, it may not have enough memory for keeping this number of tasks in memory. INFO [631894] If you experience memory problems, try reducing 'max_parallel_tasks' in your user configuration file. INFO [631894] For Dataset: tas, Amon, CMIP6, EC-Earth3, historical, r1i1p1f1, gr, supplementaries: areacella, *, *, *, *: ignoring supplementary variable 'areacella', unable to expand wildcards 'mip', 'exp', 'ensemble', 'activity', 'institute'. INFO [631894] For Dataset: tas, Amon, OBS, NCEP, 1, supplementaries: areacella, *, *: ignoring supplementary variable 'areacella', unable to expand wildcards 'mip', 'version'. INFO [631894] Creating tasks from recipe INFO [631894] Creating tasks for diagnostic map INFO [631894] Creating diagnostic task map/myscript INFO [631894] Creating preprocessor task map/tas_map INFO [631894] Creating preprocessor 'mypp_map' task for variable 'tas_map' INFO [631894] Found input files for Dataset: tas, Amon, CMIP6, NorESM2-LM, CMIP, historical, r1i1p1f1, gn, v20190815 INFO [631894] Found input files for Dataset: tas, Amon, CMIP6, EC-Earth3, CMIP, historical, r1i1p1f1, gr, v20200310 INFO [631894] Found input files for Dataset: tas, Amon, OBS, NCEP, 1 INFO [631894] PreprocessingTask map/tas_map created. INFO [631894] Creating tasks for diagnostic timeseries INFO [631894] Creating diagnostic task timeseries/myscript INFO [631894] Creating preprocessor task timeseries/tas_ts INFO [631894] Creating preprocessor 'mypp_ts' task for variable 'tas_ts' INFO [631894] Found input files for Dataset: tas, Amon, CMIP6, NorESM2-LM, CMIP, historical, r1i1p1f1, gn, v20190815, supplementaries: areacella, fx WARNING [631894] Preprocessor function area_statistics works best when at least one supplementary variable of ['areacella', 'areacello'] is defined in the recipe for Dataset: {'diagnostic': 'timeseries', 'variable_group': 'tas_ts', 'dataset': 'EC-Earth3', 'project': 'CMIP6', 'mip': 'Amon', 'short_name': 'tas', 'activity': 'CMIP', 'alias': 'CMIP6_EC-Earth3', 'ensemble': 'r1i1p1f1', 'exp': 'historical', 'frequency': 'mon', 'grid': 'gr', 'institute': ['EC-Earth-Consortium'], 'long_name': 'Near-Surface Air Temperature', 'modeling_realm': ['atmos'], 'original_short_name': 'tas', 'preprocessor': 'mypp_ts', 'recipe_dataset_index': 1, 'standard_name': 'air_temperature', 'timerange': '1970/2014', 'units': 'K'} session: 'recipe_mydiag_20230531_084453'. INFO [631894] Found input files for Dataset: tas, Amon, CMIP6, EC-Earth3, CMIP, historical, r1i1p1f1, gr, v20200310 WARNING [631894] Preprocessor function area_statistics works best when at least one supplementary variable of ['areacella', 'areacello'] is defined in the recipe for Dataset: {'diagnostic': 'timeseries', 'variable_group': 'tas_ts', 'dataset': 'NCEP', 'project': 'OBS', 'mip': 'Amon', 'short_name': 'tas', 'alias': 'OBS', 'frequency': 'mon', 'long_name': 'Near-Surface Air Temperature', 'modeling_realm': ['atmos'], 'original_short_name': 'tas', 'preprocessor': 'mypp_ts', 'recipe_dataset_index': 2, 'standard_name': 'air_temperature', 'tier': 2, 'timerange': '2000/2014', 'type': 'reanaly', 'units': 'K', 'version': 1} session: 'recipe_mydiag_20230531_084453'. INFO [631894] Found input files for Dataset: tas, Amon, OBS, NCEP, 1 INFO [631894] PreprocessingTask timeseries/tas_ts created. INFO [631894] These tasks will be executed: timeseries/tas_ts, timeseries/myscript, map/myscript, map/tas_map INFO [631894] Wrote recipe with version numbers and wildcards to: file:///projects/NS9560K/www/diagnostics/esmvaltool/yanchun/tmp/recipe_mydiag_20230531_084453/run/recipe_mydiag_filled.yml INFO [631894] Running 4 tasks using 2 processes INFO [632042] Starting task map/tas_map in process [632042] INFO [632043] Starting task timeseries/tas_ts in process [632043] INFO [631894] Progress: 2 tasks running, 2 tasks waiting for ancestors, 0/4 done ERROR [632042] Failed to run preprocessor function 'load' on the data [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier2/NCEP/OBS_NCEP_reanaly_1_Amon_tas_200001-200012.nc')] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier2/NCEP/OBS_NCEP_reanaly_1_Amon_tas_200001-200012.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier2/NCEP/OBS_NCEP_reanaly_1_Amon_tas_200101-200112.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier2/NCEP/OBS_NCEP_reanaly_1_Amon_tas_200201-200212.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/obsdata/Tier2/NCEP/OBS_NCEP_reanaly_1_Amon_tas_200301-200312.nc')] (and 11 further file(s) not shown here; refer to the debug log for a full list) with function argument(s) callback = 'default' INFO [631894] Maximum memory used (estimate): 0.6 GB INFO [631894] Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. ERROR [631894] Program terminated abnormally, see stack trace below for more information: multiprocessing.pool.RemoteTraceback: """ Traceback (most recent call last): File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/multiprocessing/pool.py", line 125, in worker result = (True, func(*args, **kwds)) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_task.py", line 795, in _run_task output_files = task.run() File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_task.py", line 262, in run self.output_files = self._run(input_files) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/preprocessor/__init__.py", line 670, in _run product.apply(step, self.debug) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/preprocessor/__init__.py", line 470, in apply self.cubes = preprocess(self.cubes, step, File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/preprocessor/__init__.py", line 481, in cubes self._cubes = [ File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/preprocessor/__init__.py", line 482, in ds._load_with_callback(callback) for ds in self.datasets File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/dataset.py", line 688, in _load_with_callback cube = self._load(callback) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/dataset.py", line 765, in _load result = preprocess( File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/preprocessor/__init__.py", line 379, in preprocess result.append(_run_preproc_function(function, item, settings, File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/preprocessor/__init__.py", line 328, in _run_preproc_function return function(items, **kwargs) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/preprocessor/_io.py", line 181, in load raw_cubes = iris.load_raw(file, callback=callback) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/iris/__init__.py", line 435, in load_raw return _load_collection(uris, constraints, callback).cubes() File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/iris/__init__.py", line 285, in _load_collection result = _CubeFilterCollection.from_cubes(cubes, constraints) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/iris/cube.py", line 105, in from_cubes for cube in cubes: File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/iris/__init__.py", line 270, in _generate_cubes for cube in iris.io.load_files(part_names, callback, constraints): File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/iris/io/__init__.py", line 223, in load_files for cube in handling_format_spec.handler( File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/iris/fileformats/netcdf/loader.py", line 566, in load_cubes cube = _load_cube(engine, cf, cf_var, filename) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/iris/fileformats/netcdf/loader.py", line 276, in _load_cube engine.activate() File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/iris/fileformats/_nc_load_rules/engine.py", line 97, in activate run_actions(self) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/iris/fileformats/_nc_load_rules/actions.py", line 521, in run_actions action_default(engine) # This should run the default rules. File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/iris/fileformats/_nc_load_rules/actions.py", line 74, in inner rule_name = func(engine, *args, **kwargs) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/iris/fileformats/_nc_load_rules/actions.py", line 90, in action_default hh.build_cube_metadata(engine) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/iris/fileformats/_nc_load_rules/helpers.py", line 418, in build_cube_metadata cube.cell_methods = parse_cell_methods(nc_att_cell_methods) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/iris/fileformats/_nc_load_rules/helpers.py", line 312, in parse_cell_methods for m in _split_cell_methods(nc_cell_methods): File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/iris/fileformats/_nc_load_rules/helpers.py", line 267, in _split_cell_methods method_indices.append((name_start_inds[-1], len(nc_cell_methods))) IndexError: list index out of range """ The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_main.py", line 521, in run fire.Fire(ESMValTool()) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/fire/core.py", line 141, in Fire component_trace = _Fire(component, args, parsed_flag_args, context, name) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/fire/core.py", line 475, in _Fire component, remaining_args = _CallAndUpdateTrace( File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/fire/core.py", line 691, in _CallAndUpdateTrace component = fn(*varargs, **kwargs) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_main.py", line 408, in run self._run(recipe, session) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_main.py", line 450, in _run process_recipe(recipe_file=recipe, session=session) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_main.py", line 122, in process_recipe recipe.run() File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_recipe/recipe.py", line 1308, in run self.tasks.run(max_parallel_tasks=self.session['max_parallel_tasks']) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_task.py", line 724, in run self._run_parallel(max_parallel_tasks) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_task.py", line 767, in _run_parallel _copy_results(task, running[task]) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_task.py", line 790, in _copy_results task.output_files, task.products = future.get() File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/multiprocessing/pool.py", line 774, in get raise self._value File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/multiprocessing/pool.py", line 125, in worker result = (True, func(*args, **kwds)) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_task.py", line 795, in _run_task output_files = task.run() File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_task.py", line 262, in run self.output_files = self._run(input_files) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/preprocessor/__init__.py", line 670, in _run product.apply(step, self.debug) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/preprocessor/__init__.py", line 470, in apply self.cubes = preprocess(self.cubes, step, File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/preprocessor/__init__.py", line 481, in cubes self._cubes = [ File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/preprocessor/__init__.py", line 482, in ds._load_with_callback(callback) for ds in self.datasets File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/dataset.py", line 688, in _load_with_callback cube = self._load(callback) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/dataset.py", line 765, in _load result = preprocess( File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/preprocessor/__init__.py", line 379, in preprocess result.append(_run_preproc_function(function, item, settings, File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/preprocessor/__init__.py", line 328, in _run_preproc_function return function(items, **kwargs) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/preprocessor/_io.py", line 181, in load raw_cubes = iris.load_raw(file, callback=callback) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/iris/__init__.py", line 435, in load_raw return _load_collection(uris, constraints, callback).cubes() File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/iris/__init__.py", line 285, in _load_collection result = _CubeFilterCollection.from_cubes(cubes, constraints) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/iris/cube.py", line 105, in from_cubes for cube in cubes: File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/iris/__init__.py", line 270, in _generate_cubes for cube in iris.io.load_files(part_names, callback, constraints): File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/iris/io/__init__.py", line 223, in load_files for cube in handling_format_spec.handler( File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/iris/fileformats/netcdf/loader.py", line 566, in load_cubes cube = _load_cube(engine, cf, cf_var, filename) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/iris/fileformats/netcdf/loader.py", line 276, in _load_cube engine.activate() File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/iris/fileformats/_nc_load_rules/engine.py", line 97, in activate run_actions(self) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/iris/fileformats/_nc_load_rules/actions.py", line 521, in run_actions action_default(engine) # This should run the default rules. File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/iris/fileformats/_nc_load_rules/actions.py", line 74, in inner rule_name = func(engine, *args, **kwargs) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/iris/fileformats/_nc_load_rules/actions.py", line 90, in action_default hh.build_cube_metadata(engine) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/iris/fileformats/_nc_load_rules/helpers.py", line 418, in build_cube_metadata cube.cell_methods = parse_cell_methods(nc_att_cell_methods) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/iris/fileformats/_nc_load_rules/helpers.py", line 312, in parse_cell_methods for m in _split_cell_methods(nc_cell_methods): File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/iris/fileformats/_nc_load_rules/helpers.py", line 267, in _split_cell_methods method_indices.append((name_start_inds[-1], len(nc_cell_methods))) IndexError: list index out of range INFO [631894] If you have a question or need help, please start a new discussion on https://github.com/ESMValGroup/ESMValTool/discussions If you suspect this is a bug, please open an issue on https://github.com/ESMValGroup/ESMValTool/issues To make it easier to find out what the problem is, please consider attaching the files run/recipe_*.yml and run/main_log_debug.txt from the output directory.