INFO [323419] ______________________________________________________________________ _____ ____ __ ____ __ _ _____ _ | ____/ ___|| \/ \ \ / /_ _| |_ _|__ ___ | | | _| \___ \| |\/| |\ \ / / _` | | | |/ _ \ / _ \| | | |___ ___) | | | | \ V / (_| | | | | (_) | (_) | | |_____|____/|_| |_| \_/ \__,_|_| |_|\___/ \___/|_| ______________________________________________________________________ ESMValTool - Earth System Model Evaluation Tool. http://www.esmvaltool.org CORE DEVELOPMENT TEAM AND CONTACTS: Birgit Hassler (Co-PI; DLR, Germany - birgit.hassler@dlr.de) Alistair Sellar (Co-PI; Met Office, UK - alistair.sellar@metoffice.gov.uk) Bouwe Andela (Netherlands eScience Center, The Netherlands - b.andela@esciencecenter.nl) Lee de Mora (PML, UK - ledm@pml.ac.uk) Niels Drost (Netherlands eScience Center, The Netherlands - n.drost@esciencecenter.nl) Veronika Eyring (DLR, Germany - veronika.eyring@dlr.de) Bettina Gier (UBremen, Germany - gier@uni-bremen.de) Remi Kazeroni (DLR, Germany - remi.kazeroni@dlr.de) Nikolay Koldunov (AWI, Germany - nikolay.koldunov@awi.de) Axel Lauer (DLR, Germany - axel.lauer@dlr.de) Saskia Loosveldt-Tomas (BSC, Spain - saskia.loosveldt@bsc.es) Ruth Lorenz (ETH Zurich, Switzerland - ruth.lorenz@env.ethz.ch) Benjamin Mueller (LMU, Germany - b.mueller@iggf.geo.uni-muenchen.de) Valeriu Predoi (URead, UK - valeriu.predoi@ncas.ac.uk) Mattia Righi (DLR, Germany - mattia.righi@dlr.de) Manuel Schlund (DLR, Germany - manuel.schlund@dlr.de) Breixo Solino Fernandez (DLR, Germany - breixo.solinofernandez@dlr.de) Javier Vegas-Regidor (BSC, Spain - javier.vegas@bsc.es) Klaus Zimmermann (SMHI, Sweden - klaus.zimmermann@smhi.se) For further help, please read the documentation at http://docs.esmvaltool.org. Have fun! INFO [323419] Package versions INFO [323419] ---------------- INFO [323419] ESMValCore: 2.8.0 INFO [323419] ESMValTool: 2.8.0 INFO [323419] ---------------- INFO [323419] Using config file /nird/home/oskaral/.esmvaltool/config-user.yml INFO [323419] Writing program log files to: /projects/NS9560K/www/diagnostics/esmvaltool/oskaral/tmp/recipe_quantilebias_20230530_112607/run/main_log.txt /projects/NS9560K/www/diagnostics/esmvaltool/oskaral/tmp/recipe_quantilebias_20230530_112607/run/main_log_debug.txt INFO [323419] Starting the Earth System Model Evaluation Tool at time: 2023-05-30 11:26:08 UTC INFO [323419] ---------------------------------------------------------------------- INFO [323419] RECIPE = /nird/home/oskaral/your-recipes/recipe_quantilebias.yml INFO [323419] RUNDIR = /projects/NS9560K/www/diagnostics/esmvaltool/oskaral/tmp/recipe_quantilebias_20230530_112607/run INFO [323419] WORKDIR = /projects/NS9560K/www/diagnostics/esmvaltool/oskaral/tmp/recipe_quantilebias_20230530_112607/work INFO [323419] PREPROCDIR = /projects/NS9560K/www/diagnostics/esmvaltool/oskaral/tmp/recipe_quantilebias_20230530_112607/preproc INFO [323419] PLOTDIR = /projects/NS9560K/www/diagnostics/esmvaltool/oskaral/tmp/recipe_quantilebias_20230530_112607/plots INFO [323419] ---------------------------------------------------------------------- INFO [323419] Running tasks using at most 2 processes INFO [323419] If your system hangs during execution, it may not have enough memory for keeping this number of tasks in memory. INFO [323419] If you experience memory problems, try reducing 'max_parallel_tasks' in your user configuration file. WARNING [323419] 'CMIP5' rootpaths '/scratch/oskaral/ESGF/cmip5/output1' set in config-user.yml do not exist WARNING [323419] 'obs4MIPs' rootpaths '/scratch/oskaral/ESGF/obs4MIPs' set in config-user.yml do not exist INFO [323419] For Dataset: pr, Amon, obs4MIPs, GPCP-SG, v2.3, supplementaries: sftlf, *: ignoring supplementary variable 'sftlf', unable to expand wildcards 'version', 'institute'. INFO [323419] Creating tasks from recipe INFO [323419] Creating tasks for diagnostic quantilebias INFO [323419] Creating diagnostic task quantilebias/main INFO [323419] Creating preprocessor task quantilebias/pr INFO [323419] Creating preprocessor 'mask_regrid_preproc' task for variable 'pr' INFO [323419] Found input files for Dataset: pr, Amon, CMIP5, CanESM2, historical, r1i1p1, v20120718, supplementaries: sftlf, fx, r0i0p0, v20120410 WARNING [323419] Preprocessor function mask_landsea works best when at least one supplementary variable of ['sftlf', 'sftof'] is defined in the recipe for Dataset: {'diagnostic': 'quantilebias', 'variable_group': 'pr', 'dataset': 'GPCP-SG', 'project': 'obs4MIPs', 'mip': 'Amon', 'short_name': 'pr', 'alias': 'obs4MIPs', 'frequency': 'mon', 'level': 'L3', 'long_name': 'Precipitation', 'modeling_realm': [], 'original_short_name': 'pr', 'preprocessor': 'mask_regrid_preproc', 'recipe_dataset_index': 1, 'reference_dataset': 'GPCP-SG', 'standard_name': 'precipitation_flux', 'tier': 1, 'timerange': '1979/2005', 'units': 'kg m-2 s-1', 'version': 'v2.3'} session: 'recipe_quantilebias_20230530_112607'. ERROR [323419] No input files found for Dataset: {'diagnostic': 'quantilebias', 'variable_group': 'pr', 'dataset': 'GPCP-SG', 'project': 'obs4MIPs', 'mip': 'Amon', 'short_name': 'pr', 'alias': 'obs4MIPs', 'frequency': 'mon', 'level': 'L3', 'long_name': 'Precipitation', 'modeling_realm': [], 'original_short_name': 'pr', 'preprocessor': 'mask_regrid_preproc', 'recipe_dataset_index': 1, 'reference_dataset': 'GPCP-SG', 'standard_name': 'precipitation_flux', 'tier': 1, 'timerange': '1979/2005', 'units': 'kg m-2 s-1', 'version': 'v2.3'} session: 'recipe_quantilebias_20230530_112607' ERROR [323419] Looked for files matching /projects/NS9560K-datalake/ESGF/obs4MIPs/Tier1/GPCP-SG/pr_*.nc /scratch/oskaral/ESGF/obs4MIPs/Tier1/GPCP-SG/pr_*.nc ERROR [323419] Set 'log_level' to 'debug' to get more information ERROR [323419] Could not create all tasks ERROR [323419] Missing data for preprocessor quantilebias/pr: - Missing data for Dataset: pr, Amon, obs4MIPs, GPCP-SG, v2.3 ERROR [323419] Not all input files required to run the recipe could be found. ERROR [323419] If the files are available locally, please check your `rootpath` and `drs` settings in your user configuration file /nird/home/oskaral/.esmvaltool/config-user.yml ERROR [323419] To automatically download the required files to `download_dir: /scratch/oskaral/ESGF/rawdata/model`, set `search_esgf: when_missing` or `search_esgf: always` in /nird/home/oskaral/.esmvaltool/config-user.yml, or run the recipe with the extra command line argument --search_esgf=when_missing or --search_esgf=always INFO [323419] Note that automatic download is only available for files that are hosted on the ESGF, i.e. for projects: CMIP3, CMIP5, CMIP6, CORDEX, and obs4MIPs INFO [323419] Maximum memory used (estimate): 0.0 GB INFO [323419] Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. ERROR [323419] Could not create all tasks