2023-05-30 12:08:01,675 UTC [338601] INFO esmvalcore._main:495 ______________________________________________________________________ _____ ____ __ ____ __ _ _____ _ | ____/ ___|| \/ \ \ / /_ _| |_ _|__ ___ | | | _| \___ \| |\/| |\ \ / / _` | | | |/ _ \ / _ \| | | |___ ___) | | | | \ V / (_| | | | | (_) | (_) | | |_____|____/|_| |_| \_/ \__,_|_| |_|\___/ \___/|_| ______________________________________________________________________ ESMValTool - Earth System Model Evaluation Tool. http://www.esmvaltool.org CORE DEVELOPMENT TEAM AND CONTACTS: Birgit Hassler (Co-PI; DLR, Germany - birgit.hassler@dlr.de) Alistair Sellar (Co-PI; Met Office, UK - alistair.sellar@metoffice.gov.uk) Bouwe Andela (Netherlands eScience Center, The Netherlands - b.andela@esciencecenter.nl) Lee de Mora (PML, UK - ledm@pml.ac.uk) Niels Drost (Netherlands eScience Center, The Netherlands - n.drost@esciencecenter.nl) Veronika Eyring (DLR, Germany - veronika.eyring@dlr.de) Bettina Gier (UBremen, Germany - gier@uni-bremen.de) Remi Kazeroni (DLR, Germany - remi.kazeroni@dlr.de) Nikolay Koldunov (AWI, Germany - nikolay.koldunov@awi.de) Axel Lauer (DLR, Germany - axel.lauer@dlr.de) Saskia Loosveldt-Tomas (BSC, Spain - saskia.loosveldt@bsc.es) Ruth Lorenz (ETH Zurich, Switzerland - ruth.lorenz@env.ethz.ch) Benjamin Mueller (LMU, Germany - b.mueller@iggf.geo.uni-muenchen.de) Valeriu Predoi (URead, UK - valeriu.predoi@ncas.ac.uk) Mattia Righi (DLR, Germany - mattia.righi@dlr.de) Manuel Schlund (DLR, Germany - manuel.schlund@dlr.de) Breixo Solino Fernandez (DLR, Germany - breixo.solinofernandez@dlr.de) Javier Vegas-Regidor (BSC, Spain - javier.vegas@bsc.es) Klaus Zimmermann (SMHI, Sweden - klaus.zimmermann@smhi.se) For further help, please read the documentation at http://docs.esmvaltool.org. Have fun! 2023-05-30 12:08:01,675 UTC [338601] INFO esmvalcore._main:496 Package versions 2023-05-30 12:08:01,675 UTC [338601] INFO esmvalcore._main:497 ---------------- 2023-05-30 12:08:01,675 UTC [338601] INFO esmvalcore._main:498 ESMValCore: 2.8.0 2023-05-30 12:08:01,675 UTC [338601] INFO esmvalcore._main:500 ESMValTool: 2.8.0 2023-05-30 12:08:01,676 UTC [338601] INFO esmvalcore._main:501 ---------------- 2023-05-30 12:08:01,676 UTC [338601] INFO esmvalcore._main:502 Using config file /nird/home/andr/.esmvaltool/config-user.yml 2023-05-30 12:08:01,676 UTC [338601] INFO esmvalcore._main:503 Writing program log files to: /projects/NS9560K/www/diagnostics/esmvaltool/andr/tmp/recipe_cvdp_20230530_120801/run/main_log.txt /projects/NS9560K/www/diagnostics/esmvaltool/andr/tmp/recipe_cvdp_20230530_120801/run/main_log_debug.txt 2023-05-30 12:08:02,392 UTC [338601] INFO esmvalcore._main:85 Starting the Earth System Model Evaluation Tool at time: 2023-05-30 12:08:02 UTC 2023-05-30 12:08:02,392 UTC [338601] INFO esmvalcore._main:89 ---------------------------------------------------------------------- 2023-05-30 12:08:02,392 UTC [338601] INFO esmvalcore._main:90 RECIPE = /nird/home/andr/esmvaltool_workshop/recipe_cvdp.yml 2023-05-30 12:08:02,392 UTC [338601] INFO esmvalcore._main:91 RUNDIR = /projects/NS9560K/www/diagnostics/esmvaltool/andr/tmp/recipe_cvdp_20230530_120801/run 2023-05-30 12:08:02,392 UTC [338601] INFO esmvalcore._main:92 WORKDIR = /projects/NS9560K/www/diagnostics/esmvaltool/andr/tmp/recipe_cvdp_20230530_120801/work 2023-05-30 12:08:02,392 UTC [338601] INFO esmvalcore._main:93 PREPROCDIR = /projects/NS9560K/www/diagnostics/esmvaltool/andr/tmp/recipe_cvdp_20230530_120801/preproc 2023-05-30 12:08:02,393 UTC [338601] INFO esmvalcore._main:94 PLOTDIR = /projects/NS9560K/www/diagnostics/esmvaltool/andr/tmp/recipe_cvdp_20230530_120801/plots 2023-05-30 12:08:02,393 UTC [338601] INFO esmvalcore._main:95 ---------------------------------------------------------------------- 2023-05-30 12:08:02,394 UTC [338601] INFO esmvalcore._main:98 Running tasks using at most 2 processes 2023-05-30 12:08:02,394 UTC [338601] INFO esmvalcore._main:100 If your system hangs during execution, it may not have enough memory for keeping this number of tasks in memory. 2023-05-30 12:08:02,394 UTC [338601] INFO esmvalcore._main:103 If you experience memory problems, try reducing 'max_parallel_tasks' in your user configuration file. 2023-05-30 12:08:02,395 UTC [338601] DEBUG esmvalcore._recipe.check:52 Checking recipe against schema /diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_recipe/recipe_schema.yml 2023-05-30 12:08:02,413 UTC [338601] DEBUG esmvalcore._recipe.to_datasets:344 Populating list of datasets for variable ts in diagnostic diagnostic1 2023-05-30 12:08:02,413 UTC [338601] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: ts, Amon, CMIP5, ACCESS1-0, historical, r1i1p1 2023-05-30 12:08:02,413 UTC [338601] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: ts, Amon, CMIP5, ACCESS1-0, historical, r2i1p1 2023-05-30 12:08:02,414 UTC [338601] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: ts, Amon, CMIP5, MPI-ESM-LR, historical, r1i1p1 2023-05-30 12:08:02,414 UTC [338601] DEBUG esmvalcore._recipe.to_datasets:344 Populating list of datasets for variable tas in diagnostic diagnostic1 2023-05-30 12:08:02,414 UTC [338601] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: tas, Amon, CMIP5, ACCESS1-0, historical, r1i1p1 2023-05-30 12:08:02,414 UTC [338601] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: tas, Amon, CMIP5, ACCESS1-0, historical, r2i1p1 2023-05-30 12:08:02,414 UTC [338601] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: tas, Amon, CMIP5, MPI-ESM-LR, historical, r1i1p1 2023-05-30 12:08:02,414 UTC [338601] DEBUG esmvalcore._recipe.to_datasets:344 Populating list of datasets for variable pr in diagnostic diagnostic1 2023-05-30 12:08:02,414 UTC [338601] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: pr, Amon, CMIP5, ACCESS1-0, historical, r1i1p1 2023-05-30 12:08:02,415 UTC [338601] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: pr, Amon, CMIP5, ACCESS1-0, historical, r2i1p1 2023-05-30 12:08:02,415 UTC [338601] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: pr, Amon, CMIP5, MPI-ESM-LR, historical, r1i1p1 2023-05-30 12:08:02,415 UTC [338601] DEBUG esmvalcore._recipe.to_datasets:344 Populating list of datasets for variable psl in diagnostic diagnostic1 2023-05-30 12:08:02,415 UTC [338601] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: psl, Amon, CMIP5, ACCESS1-0, historical, r1i1p1 2023-05-30 12:08:02,415 UTC [338601] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: psl, Amon, CMIP5, ACCESS1-0, historical, r2i1p1 2023-05-30 12:08:02,415 UTC [338601] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: psl, Amon, CMIP5, MPI-ESM-LR, historical, r1i1p1 2023-05-30 12:08:02,416 UTC [338601] DEBUG esmvalcore._recipe.recipe:1014 Retrieving diagnostics from recipe 2023-05-30 12:08:02,416 UTC [338601] DEBUG esmvalcore._recipe.recipe:1042 Setting script for diagnostic diagnostic1 2023-05-30 12:08:02,416 UTC [338601] INFO esmvalcore._recipe.recipe:1232 Creating tasks from recipe 2023-05-30 12:08:02,416 UTC [338601] INFO esmvalcore._recipe.recipe:1241 Creating tasks for diagnostic diagnostic1 2023-05-30 12:08:02,416 UTC [338601] INFO esmvalcore._recipe.recipe:1163 Creating diagnostic task diagnostic1/cvdp 2023-05-30 12:08:02,417 UTC [338601] INFO esmvalcore._recipe.recipe:1216 Creating preprocessor task diagnostic1/ts 2023-05-30 12:08:02,417 UTC [338601] INFO esmvalcore._recipe.recipe:849 Creating preprocessor 'default' task for variable 'ts' 2023-05-30 12:08:02,418 UTC [338601] DEBUG esmvalcore.config._config:48 Loading extra facets from /diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/config/extra_facets/cmip5-fx.yml 2023-05-30 12:08:02,418 UTC [338601] DEBUG esmvalcore.config._config:48 Loading extra facets from /diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/config/extra_facets/cmip5-institutes.yml 2023-05-30 12:08:02,446 UTC [338601] DEBUG esmvalcore.config._config:48 Loading extra facets from /diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/config/extra_facets/cmip5-product.yml 2023-05-30 12:08:02,452 UTC [338601] WARNING esmvalcore.local:426 'CMIP5' rootpaths '/scratch/andr/ESGF/cmip5/output1' set in config-user.yml do not exist 2023-05-30 12:08:02,453 UTC [338601] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/CSIRO-BOM/ACCESS1-0/historical/mon/atmos/Amon/r1i1p1/*/ts/ts_Amon_ACCESS1-0_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/CSIRO-BOM/ACCESS1-0/historical/mon/atmos/Amon/r1i1p1/*/ts/ts_Amon_ACCESS1-0_historical_r1i1p1*.nc /scratch/andr/ESGF/cmip5/output1/CSIRO-BOM/ACCESS1-0/historical/mon/atmos/Amon/r1i1p1/*/ts/ts_Amon_ACCESS1-0_historical_r1i1p1*.nc 2023-05-30 12:08:02,455 UTC [338601] DEBUG esmvalcore._recipe.recipe:446 Using input files for variable ts of dataset ACCESS1-0 r1i1p1: /projects/NS9560K-datalake/ESGF/cmip5/output1/CSIRO-BOM/ACCESS1-0/historical/mon/atmos/Amon/r1i1p1/v1/ts/ts_Amon_ACCESS1-0_historical_r1i1p1_185001-200512.nc 2023-05-30 12:08:02,455 UTC [338601] INFO esmvalcore._recipe.recipe:717 Found input files for Dataset: ts, Amon, CMIP5, ACCESS1-0, historical, r1i1p1, v1 2023-05-30 12:08:02,457 UTC [338601] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/CSIRO-BOM/ACCESS1-0/historical/mon/atmos/Amon/r2i1p1/*/ts/ts_Amon_ACCESS1-0_historical_r2i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/CSIRO-BOM/ACCESS1-0/historical/mon/atmos/Amon/r2i1p1/*/ts/ts_Amon_ACCESS1-0_historical_r2i1p1*.nc /scratch/andr/ESGF/cmip5/output1/CSIRO-BOM/ACCESS1-0/historical/mon/atmos/Amon/r2i1p1/*/ts/ts_Amon_ACCESS1-0_historical_r2i1p1*.nc 2023-05-30 12:08:02,457 UTC [338601] ERROR esmvalcore._recipe.check:118 No input files found for Dataset: {'diagnostic': 'diagnostic1', 'variable_group': 'ts', 'dataset': 'ACCESS1-0', 'project': 'CMIP5', 'mip': 'Amon', 'short_name': 'ts', 'alias': 'ACCESS1-0_r2i1p1', 'ensemble': 'r2i1p1', 'exp': 'historical', 'frequency': 'mon', 'institute': ['CSIRO-BOM'], 'long_name': 'Surface Temperature', 'modeling_realm': ['atmos'], 'original_short_name': 'ts', 'product': ['output1', 'output2'], 'recipe_dataset_index': 1, 'standard_name': 'surface_temperature', 'timerange': '1850/1855', 'units': 'K'} session: 'recipe_cvdp_20230530_120801' 2023-05-30 12:08:02,458 UTC [338601] ERROR esmvalcore._recipe.check:124 Looked for files matching /projects/NS9034K/CMIP5/output1/CSIRO-BOM/ACCESS1-0/historical/mon/atmos/Amon/r2i1p1/*/ts/ts_Amon_ACCESS1-0_historical_r2i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/CSIRO-BOM/ACCESS1-0/historical/mon/atmos/Amon/r2i1p1/*/ts/ts_Amon_ACCESS1-0_historical_r2i1p1*.nc /scratch/andr/ESGF/cmip5/output1/CSIRO-BOM/ACCESS1-0/historical/mon/atmos/Amon/r2i1p1/*/ts/ts_Amon_ACCESS1-0_historical_r2i1p1*.nc 2023-05-30 12:08:02,458 UTC [338601] ERROR esmvalcore._recipe.check:125 Set 'log_level' to 'debug' to get more information 2023-05-30 12:08:02,458 UTC [338601] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/ts/ts_Amon_MPI-ESM-LR_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/ts/ts_Amon_MPI-ESM-LR_historical_r1i1p1*.nc /scratch/andr/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/ts/ts_Amon_MPI-ESM-LR_historical_r1i1p1*.nc 2023-05-30 12:08:02,460 UTC [338601] DEBUG esmvalcore._recipe.recipe:446 Using input files for variable ts of dataset MPI-ESM-LR: /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/ts/ts_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc 2023-05-30 12:08:02,460 UTC [338601] INFO esmvalcore._recipe.recipe:717 Found input files for Dataset: ts, Amon, CMIP5, MPI-ESM-LR, historical, r1i1p1, v20120315 2023-05-30 12:08:02,460 UTC [338601] INFO esmvalcore._recipe.recipe:1216 Creating preprocessor task diagnostic1/tas 2023-05-30 12:08:02,460 UTC [338601] INFO esmvalcore._recipe.recipe:849 Creating preprocessor 'default' task for variable 'tas' 2023-05-30 12:08:02,461 UTC [338601] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/CSIRO-BOM/ACCESS1-0/historical/mon/atmos/Amon/r1i1p1/*/tas/tas_Amon_ACCESS1-0_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/CSIRO-BOM/ACCESS1-0/historical/mon/atmos/Amon/r1i1p1/*/tas/tas_Amon_ACCESS1-0_historical_r1i1p1*.nc /scratch/andr/ESGF/cmip5/output1/CSIRO-BOM/ACCESS1-0/historical/mon/atmos/Amon/r1i1p1/*/tas/tas_Amon_ACCESS1-0_historical_r1i1p1*.nc 2023-05-30 12:08:02,462 UTC [338601] DEBUG esmvalcore._recipe.recipe:446 Using input files for variable tas of dataset ACCESS1-0 r1i1p1: /projects/NS9560K-datalake/ESGF/cmip5/output1/CSIRO-BOM/ACCESS1-0/historical/mon/atmos/Amon/r1i1p1/v1/tas/tas_Amon_ACCESS1-0_historical_r1i1p1_185001-200512.nc 2023-05-30 12:08:02,462 UTC [338601] INFO esmvalcore._recipe.recipe:717 Found input files for Dataset: tas, Amon, CMIP5, ACCESS1-0, historical, r1i1p1, v1 2023-05-30 12:08:02,463 UTC [338601] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/CSIRO-BOM/ACCESS1-0/historical/mon/atmos/Amon/r2i1p1/*/tas/tas_Amon_ACCESS1-0_historical_r2i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/CSIRO-BOM/ACCESS1-0/historical/mon/atmos/Amon/r2i1p1/*/tas/tas_Amon_ACCESS1-0_historical_r2i1p1*.nc /scratch/andr/ESGF/cmip5/output1/CSIRO-BOM/ACCESS1-0/historical/mon/atmos/Amon/r2i1p1/*/tas/tas_Amon_ACCESS1-0_historical_r2i1p1*.nc 2023-05-30 12:08:02,463 UTC [338601] ERROR esmvalcore._recipe.check:118 No input files found for Dataset: {'diagnostic': 'diagnostic1', 'variable_group': 'tas', 'dataset': 'ACCESS1-0', 'project': 'CMIP5', 'mip': 'Amon', 'short_name': 'tas', 'alias': 'ACCESS1-0_r2i1p1', 'ensemble': 'r2i1p1', 'exp': 'historical', 'frequency': 'mon', 'institute': ['CSIRO-BOM'], 'long_name': 'Near-Surface Air Temperature', 'modeling_realm': ['atmos'], 'original_short_name': 'tas', 'product': ['output1', 'output2'], 'recipe_dataset_index': 1, 'standard_name': 'air_temperature', 'timerange': '1850/1855', 'units': 'K'} session: 'recipe_cvdp_20230530_120801' 2023-05-30 12:08:02,463 UTC [338601] ERROR esmvalcore._recipe.check:124 Looked for files matching /projects/NS9034K/CMIP5/output1/CSIRO-BOM/ACCESS1-0/historical/mon/atmos/Amon/r2i1p1/*/tas/tas_Amon_ACCESS1-0_historical_r2i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/CSIRO-BOM/ACCESS1-0/historical/mon/atmos/Amon/r2i1p1/*/tas/tas_Amon_ACCESS1-0_historical_r2i1p1*.nc /scratch/andr/ESGF/cmip5/output1/CSIRO-BOM/ACCESS1-0/historical/mon/atmos/Amon/r2i1p1/*/tas/tas_Amon_ACCESS1-0_historical_r2i1p1*.nc 2023-05-30 12:08:02,463 UTC [338601] ERROR esmvalcore._recipe.check:125 Set 'log_level' to 'debug' to get more information 2023-05-30 12:08:02,464 UTC [338601] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/tas/tas_Amon_MPI-ESM-LR_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/tas/tas_Amon_MPI-ESM-LR_historical_r1i1p1*.nc /scratch/andr/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/tas/tas_Amon_MPI-ESM-LR_historical_r1i1p1*.nc 2023-05-30 12:08:02,466 UTC [338601] DEBUG esmvalcore._recipe.recipe:446 Using input files for variable tas of dataset MPI-ESM-LR: /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/tas/tas_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc 2023-05-30 12:08:02,466 UTC [338601] INFO esmvalcore._recipe.recipe:717 Found input files for Dataset: tas, Amon, CMIP5, MPI-ESM-LR, historical, r1i1p1, v20120315 2023-05-30 12:08:02,466 UTC [338601] INFO esmvalcore._recipe.recipe:1216 Creating preprocessor task diagnostic1/pr 2023-05-30 12:08:02,466 UTC [338601] INFO esmvalcore._recipe.recipe:849 Creating preprocessor 'default' task for variable 'pr' 2023-05-30 12:08:02,467 UTC [338601] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/CSIRO-BOM/ACCESS1-0/historical/mon/atmos/Amon/r1i1p1/*/pr/pr_Amon_ACCESS1-0_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/CSIRO-BOM/ACCESS1-0/historical/mon/atmos/Amon/r1i1p1/*/pr/pr_Amon_ACCESS1-0_historical_r1i1p1*.nc /scratch/andr/ESGF/cmip5/output1/CSIRO-BOM/ACCESS1-0/historical/mon/atmos/Amon/r1i1p1/*/pr/pr_Amon_ACCESS1-0_historical_r1i1p1*.nc 2023-05-30 12:08:02,467 UTC [338601] DEBUG esmvalcore._recipe.recipe:446 Using input files for variable pr of dataset ACCESS1-0 r1i1p1: /projects/NS9560K-datalake/ESGF/cmip5/output1/CSIRO-BOM/ACCESS1-0/historical/mon/atmos/Amon/r1i1p1/v1/pr/pr_Amon_ACCESS1-0_historical_r1i1p1_185001-200512.nc 2023-05-30 12:08:02,467 UTC [338601] INFO esmvalcore._recipe.recipe:717 Found input files for Dataset: pr, Amon, CMIP5, ACCESS1-0, historical, r1i1p1, v1 2023-05-30 12:08:02,468 UTC [338601] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/CSIRO-BOM/ACCESS1-0/historical/mon/atmos/Amon/r2i1p1/*/pr/pr_Amon_ACCESS1-0_historical_r2i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/CSIRO-BOM/ACCESS1-0/historical/mon/atmos/Amon/r2i1p1/*/pr/pr_Amon_ACCESS1-0_historical_r2i1p1*.nc /scratch/andr/ESGF/cmip5/output1/CSIRO-BOM/ACCESS1-0/historical/mon/atmos/Amon/r2i1p1/*/pr/pr_Amon_ACCESS1-0_historical_r2i1p1*.nc 2023-05-30 12:08:02,468 UTC [338601] ERROR esmvalcore._recipe.check:118 No input files found for Dataset: {'diagnostic': 'diagnostic1', 'variable_group': 'pr', 'dataset': 'ACCESS1-0', 'project': 'CMIP5', 'mip': 'Amon', 'short_name': 'pr', 'alias': 'ACCESS1-0_r2i1p1', 'ensemble': 'r2i1p1', 'exp': 'historical', 'frequency': 'mon', 'institute': ['CSIRO-BOM'], 'long_name': 'Precipitation', 'modeling_realm': ['atmos'], 'original_short_name': 'pr', 'product': ['output1', 'output2'], 'recipe_dataset_index': 1, 'standard_name': 'precipitation_flux', 'timerange': '1850/1855', 'units': 'kg m-2 s-1'} session: 'recipe_cvdp_20230530_120801' 2023-05-30 12:08:02,469 UTC [338601] ERROR esmvalcore._recipe.check:124 Looked for files matching /projects/NS9034K/CMIP5/output1/CSIRO-BOM/ACCESS1-0/historical/mon/atmos/Amon/r2i1p1/*/pr/pr_Amon_ACCESS1-0_historical_r2i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/CSIRO-BOM/ACCESS1-0/historical/mon/atmos/Amon/r2i1p1/*/pr/pr_Amon_ACCESS1-0_historical_r2i1p1*.nc /scratch/andr/ESGF/cmip5/output1/CSIRO-BOM/ACCESS1-0/historical/mon/atmos/Amon/r2i1p1/*/pr/pr_Amon_ACCESS1-0_historical_r2i1p1*.nc 2023-05-30 12:08:02,469 UTC [338601] ERROR esmvalcore._recipe.check:125 Set 'log_level' to 'debug' to get more information 2023-05-30 12:08:02,469 UTC [338601] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/pr/pr_Amon_MPI-ESM-LR_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/pr/pr_Amon_MPI-ESM-LR_historical_r1i1p1*.nc /scratch/andr/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/pr/pr_Amon_MPI-ESM-LR_historical_r1i1p1*.nc 2023-05-30 12:08:02,470 UTC [338601] DEBUG esmvalcore._recipe.recipe:446 Using input files for variable pr of dataset MPI-ESM-LR: /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/v20120315/pr/pr_Amon_MPI-ESM-LR_historical_r1i1p1_185001-200512.nc 2023-05-30 12:08:02,470 UTC [338601] INFO esmvalcore._recipe.recipe:717 Found input files for Dataset: pr, Amon, CMIP5, MPI-ESM-LR, historical, r1i1p1, v20120315 2023-05-30 12:08:02,471 UTC [338601] INFO esmvalcore._recipe.recipe:1216 Creating preprocessor task diagnostic1/psl 2023-05-30 12:08:02,471 UTC [338601] INFO esmvalcore._recipe.recipe:849 Creating preprocessor 'default' task for variable 'psl' 2023-05-30 12:08:02,471 UTC [338601] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/CSIRO-BOM/ACCESS1-0/historical/mon/atmos/Amon/r1i1p1/*/psl/psl_Amon_ACCESS1-0_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/CSIRO-BOM/ACCESS1-0/historical/mon/atmos/Amon/r1i1p1/*/psl/psl_Amon_ACCESS1-0_historical_r1i1p1*.nc /scratch/andr/ESGF/cmip5/output1/CSIRO-BOM/ACCESS1-0/historical/mon/atmos/Amon/r1i1p1/*/psl/psl_Amon_ACCESS1-0_historical_r1i1p1*.nc 2023-05-30 12:08:02,471 UTC [338601] ERROR esmvalcore._recipe.check:118 No input files found for Dataset: {'diagnostic': 'diagnostic1', 'variable_group': 'psl', 'dataset': 'ACCESS1-0', 'project': 'CMIP5', 'mip': 'Amon', 'short_name': 'psl', 'alias': 'ACCESS1-0_r1i1p1', 'ensemble': 'r1i1p1', 'exp': 'historical', 'frequency': 'mon', 'institute': ['CSIRO-BOM'], 'long_name': 'Sea Level Pressure', 'modeling_realm': ['atmos'], 'original_short_name': 'psl', 'product': ['output1', 'output2'], 'recipe_dataset_index': 0, 'standard_name': 'air_pressure_at_sea_level', 'timerange': '1850/1855', 'units': 'Pa'} session: 'recipe_cvdp_20230530_120801' 2023-05-30 12:08:02,472 UTC [338601] ERROR esmvalcore._recipe.check:124 Looked for files matching /projects/NS9034K/CMIP5/output1/CSIRO-BOM/ACCESS1-0/historical/mon/atmos/Amon/r1i1p1/*/psl/psl_Amon_ACCESS1-0_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/CSIRO-BOM/ACCESS1-0/historical/mon/atmos/Amon/r1i1p1/*/psl/psl_Amon_ACCESS1-0_historical_r1i1p1*.nc /scratch/andr/ESGF/cmip5/output1/CSIRO-BOM/ACCESS1-0/historical/mon/atmos/Amon/r1i1p1/*/psl/psl_Amon_ACCESS1-0_historical_r1i1p1*.nc 2023-05-30 12:08:02,472 UTC [338601] ERROR esmvalcore._recipe.check:125 Set 'log_level' to 'debug' to get more information 2023-05-30 12:08:02,472 UTC [338601] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/CSIRO-BOM/ACCESS1-0/historical/mon/atmos/Amon/r2i1p1/*/psl/psl_Amon_ACCESS1-0_historical_r2i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/CSIRO-BOM/ACCESS1-0/historical/mon/atmos/Amon/r2i1p1/*/psl/psl_Amon_ACCESS1-0_historical_r2i1p1*.nc /scratch/andr/ESGF/cmip5/output1/CSIRO-BOM/ACCESS1-0/historical/mon/atmos/Amon/r2i1p1/*/psl/psl_Amon_ACCESS1-0_historical_r2i1p1*.nc 2023-05-30 12:08:02,473 UTC [338601] ERROR esmvalcore._recipe.check:118 No input files found for Dataset: {'diagnostic': 'diagnostic1', 'variable_group': 'psl', 'dataset': 'ACCESS1-0', 'project': 'CMIP5', 'mip': 'Amon', 'short_name': 'psl', 'alias': 'ACCESS1-0_r2i1p1', 'ensemble': 'r2i1p1', 'exp': 'historical', 'frequency': 'mon', 'institute': ['CSIRO-BOM'], 'long_name': 'Sea Level Pressure', 'modeling_realm': ['atmos'], 'original_short_name': 'psl', 'product': ['output1', 'output2'], 'recipe_dataset_index': 1, 'standard_name': 'air_pressure_at_sea_level', 'timerange': '1850/1855', 'units': 'Pa'} session: 'recipe_cvdp_20230530_120801' 2023-05-30 12:08:02,473 UTC [338601] ERROR esmvalcore._recipe.check:124 Looked for files matching /projects/NS9034K/CMIP5/output1/CSIRO-BOM/ACCESS1-0/historical/mon/atmos/Amon/r2i1p1/*/psl/psl_Amon_ACCESS1-0_historical_r2i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/CSIRO-BOM/ACCESS1-0/historical/mon/atmos/Amon/r2i1p1/*/psl/psl_Amon_ACCESS1-0_historical_r2i1p1*.nc /scratch/andr/ESGF/cmip5/output1/CSIRO-BOM/ACCESS1-0/historical/mon/atmos/Amon/r2i1p1/*/psl/psl_Amon_ACCESS1-0_historical_r2i1p1*.nc 2023-05-30 12:08:02,473 UTC [338601] ERROR esmvalcore._recipe.check:125 Set 'log_level' to 'debug' to get more information 2023-05-30 12:08:02,473 UTC [338601] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/psl/psl_Amon_MPI-ESM-LR_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/psl/psl_Amon_MPI-ESM-LR_historical_r1i1p1*.nc /scratch/andr/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/psl/psl_Amon_MPI-ESM-LR_historical_r1i1p1*.nc 2023-05-30 12:08:02,474 UTC [338601] ERROR esmvalcore._recipe.check:118 No input files found for Dataset: {'diagnostic': 'diagnostic1', 'variable_group': 'psl', 'dataset': 'MPI-ESM-LR', 'project': 'CMIP5', 'mip': 'Amon', 'short_name': 'psl', 'alias': 'MPI-ESM-LR', 'ensemble': 'r1i1p1', 'exp': 'historical', 'frequency': 'mon', 'institute': ['MPI-M'], 'long_name': 'Sea Level Pressure', 'modeling_realm': ['atmos'], 'original_short_name': 'psl', 'product': ['output1', 'output2'], 'recipe_dataset_index': 2, 'standard_name': 'air_pressure_at_sea_level', 'timerange': '1850/1855', 'units': 'Pa'} session: 'recipe_cvdp_20230530_120801' 2023-05-30 12:08:02,474 UTC [338601] ERROR esmvalcore._recipe.check:124 Looked for files matching /projects/NS9034K/CMIP5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/psl/psl_Amon_MPI-ESM-LR_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/psl/psl_Amon_MPI-ESM-LR_historical_r1i1p1*.nc /scratch/andr/ESGF/cmip5/output1/MPI-M/MPI-ESM-LR/historical/mon/atmos/Amon/r1i1p1/*/psl/psl_Amon_MPI-ESM-LR_historical_r1i1p1*.nc 2023-05-30 12:08:02,474 UTC [338601] ERROR esmvalcore._recipe.check:125 Set 'log_level' to 'debug' to get more information 2023-05-30 12:08:02,474 UTC [338601] ERROR esmvalcore._recipe.recipe:960 Could not create all tasks 2023-05-30 12:08:02,474 UTC [338601] ERROR esmvalcore._recipe.recipe:962 Missing data for preprocessor diagnostic1/ts: - Missing data for Dataset: ts, Amon, CMIP5, ACCESS1-0, historical, r2i1p1 2023-05-30 12:08:02,475 UTC [338601] ERROR esmvalcore._recipe.recipe:962 Missing data for preprocessor diagnostic1/tas: - Missing data for Dataset: tas, Amon, CMIP5, ACCESS1-0, historical, r2i1p1 2023-05-30 12:08:02,475 UTC [338601] ERROR esmvalcore._recipe.recipe:962 Missing data for preprocessor diagnostic1/pr: - Missing data for Dataset: pr, Amon, CMIP5, ACCESS1-0, historical, r2i1p1 2023-05-30 12:08:02,475 UTC [338601] ERROR esmvalcore._recipe.recipe:962 Missing data for preprocessor diagnostic1/psl: - Missing data for Dataset: psl, Amon, CMIP5, ACCESS1-0, historical, r1i1p1 - Missing data for Dataset: psl, Amon, CMIP5, ACCESS1-0, historical, r2i1p1 - Missing data for Dataset: psl, Amon, CMIP5, MPI-ESM-LR, historical, r1i1p1 2023-05-30 12:08:02,475 UTC [338601] ERROR esmvalcore._recipe.recipe:967 Not all input files required to run the recipe could be found. 2023-05-30 12:08:02,475 UTC [338601] ERROR esmvalcore._recipe.recipe:970 If the files are available locally, please check your `rootpath` and `drs` settings in your user configuration file /nird/home/andr/.esmvaltool/config-user.yml 2023-05-30 12:08:02,475 UTC [338601] ERROR esmvalcore._recipe.recipe:974 To automatically download the required files to `download_dir: /scratch/andr/ESGF/rawdata/model`, set `search_esgf: when_missing` or `search_esgf: always` in /nird/home/andr/.esmvaltool/config-user.yml, or run the recipe with the extra command line argument --search_esgf=when_missing or --search_esgf=always 2023-05-30 12:08:02,475 UTC [338601] INFO esmvalcore._recipe.recipe:983 Note that automatic download is only available for files that are hosted on the ESGF, i.e. for projects: CMIP3, CMIP5, CMIP6, CORDEX, and obs4MIPs 2023-05-30 12:08:02,678 UTC [338601] INFO esmvalcore._task:126 Maximum memory used (estimate): 0.0 GB 2023-05-30 12:08:02,679 UTC [338601] INFO esmvalcore._task:128 Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. 2023-05-30 12:08:02,679 UTC [338601] ERROR esmvalcore._main:526 Could not create all tasks 2023-05-30 12:08:02,680 UTC [338601] DEBUG esmvalcore._main:527 Stack trace for debugging: Traceback (most recent call last): File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_main.py", line 521, in run fire.Fire(ESMValTool()) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/fire/core.py", line 141, in Fire component_trace = _Fire(component, args, parsed_flag_args, context, name) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/fire/core.py", line 475, in _Fire component, remaining_args = _CallAndUpdateTrace( File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/fire/core.py", line 691, in _CallAndUpdateTrace component = fn(*varargs, **kwargs) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_main.py", line 408, in run self._run(recipe, session) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_main.py", line 450, in _run process_recipe(recipe_file=recipe, session=session) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_main.py", line 119, in process_recipe recipe = read_recipe_file(recipe_file, session) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_recipe/recipe.py", line 82, in read_recipe_file return Recipe(raw_recipe, session, recipe_file=filename) File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_recipe/recipe.py", line 917, in __init__ self.tasks = self.initialize_tasks() File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_recipe/recipe.py", line 1279, in initialize_tasks tasks = self._create_tasks() File "/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_recipe/recipe.py", line 1267, in _create_tasks raise recipe_error esmvalcore.exceptions.RecipeError: Could not create all tasks