INFO [730581] ______________________________________________________________________ _____ ____ __ ____ __ _ _____ _ | ____/ ___|| \/ \ \ / /_ _| |_ _|__ ___ | | | _| \___ \| |\/| |\ \ / / _` | | | |/ _ \ / _ \| | | |___ ___) | | | | \ V / (_| | | | | (_) | (_) | | |_____|____/|_| |_| \_/ \__,_|_| |_|\___/ \___/|_| ______________________________________________________________________ ESMValTool - Earth System Model Evaluation Tool. http://www.esmvaltool.org CORE DEVELOPMENT TEAM AND CONTACTS: Birgit Hassler (Co-PI; DLR, Germany - birgit.hassler@dlr.de) Alistair Sellar (Co-PI; Met Office, UK - alistair.sellar@metoffice.gov.uk) Bouwe Andela (Netherlands eScience Center, The Netherlands - b.andela@esciencecenter.nl) Lee de Mora (PML, UK - ledm@pml.ac.uk) Niels Drost (Netherlands eScience Center, The Netherlands - n.drost@esciencecenter.nl) Veronika Eyring (DLR, Germany - veronika.eyring@dlr.de) Bettina Gier (UBremen, Germany - gier@uni-bremen.de) Remi Kazeroni (DLR, Germany - remi.kazeroni@dlr.de) Nikolay Koldunov (AWI, Germany - nikolay.koldunov@awi.de) Axel Lauer (DLR, Germany - axel.lauer@dlr.de) Saskia Loosveldt-Tomas (BSC, Spain - saskia.loosveldt@bsc.es) Ruth Lorenz (ETH Zurich, Switzerland - ruth.lorenz@env.ethz.ch) Benjamin Mueller (LMU, Germany - b.mueller@iggf.geo.uni-muenchen.de) Valeriu Predoi (URead, UK - valeriu.predoi@ncas.ac.uk) Mattia Righi (DLR, Germany - mattia.righi@dlr.de) Manuel Schlund (DLR, Germany - manuel.schlund@dlr.de) Breixo Solino Fernandez (DLR, Germany - breixo.solinofernandez@dlr.de) Javier Vegas-Regidor (BSC, Spain - javier.vegas@bsc.es) Klaus Zimmermann (SMHI, Sweden - klaus.zimmermann@smhi.se) For further help, please read the documentation at http://docs.esmvaltool.org. Have fun! INFO [730581] Package versions INFO [730581] ---------------- INFO [730581] ESMValCore: 2.8.0 INFO [730581] ESMValTool: 2.8.0 INFO [730581] ---------------- INFO [730581] Using config file /nird/home/andr/esmvaltool_workshop/config-user.yml INFO [730581] Writing program log files to: /projects/NS9560K/www/diagnostics/esmvaltool/andr/tmp/recipe_mydiag_20230531_123952/run/main_log.txt /projects/NS9560K/www/diagnostics/esmvaltool/andr/tmp/recipe_mydiag_20230531_123952/run/main_log_debug.txt INFO [730581] Starting the Earth System Model Evaluation Tool at time: 2023-05-31 12:39:53 UTC INFO [730581] ---------------------------------------------------------------------- INFO [730581] RECIPE = /nird/home/andr/esmvaltool_workshop/recipe_mydiag.yml INFO [730581] RUNDIR = /projects/NS9560K/www/diagnostics/esmvaltool/andr/tmp/recipe_mydiag_20230531_123952/run INFO [730581] WORKDIR = /projects/NS9560K/www/diagnostics/esmvaltool/andr/tmp/recipe_mydiag_20230531_123952/work INFO [730581] PREPROCDIR = /projects/NS9560K/www/diagnostics/esmvaltool/andr/tmp/recipe_mydiag_20230531_123952/preproc INFO [730581] PLOTDIR = /projects/NS9560K/www/diagnostics/esmvaltool/andr/tmp/recipe_mydiag_20230531_123952/plots INFO [730581] ---------------------------------------------------------------------- INFO [730581] Running tasks using at most 2 processes INFO [730581] If your system hangs during execution, it may not have enough memory for keeping this number of tasks in memory. INFO [730581] If you experience memory problems, try reducing 'max_parallel_tasks' in your user configuration file. WARNING [730581] 'CMIP6' rootpaths '/scratch/andr/ESGF/CMIP6' set in config-user.yml do not exist INFO [730581] For Dataset: tas, Amon, CMIP6, EC-Earth3, historical, r1i1p1f1, gr, supplementaries: areacella, *, *, *, *: ignoring supplementary variable 'areacella', unable to expand wildcards 'mip', 'exp', 'ensemble', 'activity', 'institute'. WARNING [730581] 'OBS6' rootpaths '/scratch/andr/ESGF/obsdata' set in config-user.yml do not exist INFO [730581] For Dataset: tas, Amon, OBS6, ERA-Interim, 1, supplementaries: areacella, *, *: ignoring supplementary variable 'areacella', unable to expand wildcards 'mip', 'version'. INFO [730581] Creating tasks from recipe INFO [730581] Creating tasks for diagnostic my_maps INFO [730581] Creating diagnostic task my_maps/myscript INFO [730581] Creating preprocessor task my_maps/tas_map INFO [730581] Creating preprocessor 'mypp_map' task for variable 'tas_map' INFO [730581] Found input files for Dataset: tas, Amon, CMIP6, NorESM2-LM, CMIP, historical, r1i1p1f1, gn, v20190815 INFO [730581] Found input files for Dataset: tas, Amon, CMIP6, EC-Earth3, CMIP, historical, r1i1p1f1, gr, v20200310 INFO [730581] Found input files for Dataset: tas, Amon, OBS6, ERA-Interim, 1 INFO [730581] PreprocessingTask my_maps/tas_map created. INFO [730581] Creating tasks for diagnostic timeseries INFO [730581] Creating diagnostic task timeseries/annisscript INFO [730581] Creating preprocessor task timeseries/tas_ts INFO [730581] Creating preprocessor 'mypp_ts' task for variable 'tas_ts' INFO [730581] Found input files for Dataset: tas, Amon, CMIP6, NorESM2-LM, CMIP, historical, r1i1p1f1, gn, v20190815, supplementaries: areacella, fx WARNING [730581] Preprocessor function area_statistics works best when at least one supplementary variable of ['areacella', 'areacello'] is defined in the recipe for Dataset: {'diagnostic': 'timeseries', 'variable_group': 'tas_ts', 'dataset': 'EC-Earth3', 'project': 'CMIP6', 'mip': 'Amon', 'short_name': 'tas', 'activity': 'CMIP', 'alias': 'CMIP6_EC-Earth3', 'ensemble': 'r1i1p1f1', 'exp': 'historical', 'frequency': 'mon', 'grid': 'gr', 'institute': ['EC-Earth-Consortium'], 'long_name': 'Near-Surface Air Temperature', 'modeling_realm': ['atmos'], 'original_short_name': 'tas', 'preprocessor': 'mypp_ts', 'recipe_dataset_index': 1, 'standard_name': 'air_temperature', 'timerange': '1980/2004', 'units': 'K'} session: 'recipe_mydiag_20230531_123952'. INFO [730581] Found input files for Dataset: tas, Amon, CMIP6, EC-Earth3, CMIP, historical, r1i1p1f1, gr, v20200310 WARNING [730581] Preprocessor function area_statistics works best when at least one supplementary variable of ['areacella', 'areacello'] is defined in the recipe for Dataset: {'diagnostic': 'timeseries', 'variable_group': 'tas_ts', 'dataset': 'ERA-Interim', 'project': 'OBS6', 'mip': 'Amon', 'short_name': 'tas', 'alias': 'OBS6', 'frequency': 'mon', 'long_name': 'Near-Surface Air Temperature', 'modeling_realm': ['atmos'], 'original_short_name': 'tas', 'preprocessor': 'mypp_ts', 'recipe_dataset_index': 2, 'standard_name': 'air_temperature', 'tier': 3, 'timerange': '1980/2004', 'type': 'reanaly', 'units': 'K', 'version': 1} session: 'recipe_mydiag_20230531_123952'. INFO [730581] Found input files for Dataset: tas, Amon, OBS6, ERA-Interim, 1 INFO [730581] PreprocessingTask timeseries/tas_ts created. INFO [730581] These tasks will be executed: my_maps/myscript, timeseries/tas_ts, my_maps/tas_map, timeseries/annisscript INFO [730581] Wrote recipe with version numbers and wildcards to: file:///projects/NS9560K/www/diagnostics/esmvaltool/andr/tmp/recipe_mydiag_20230531_123952/run/recipe_mydiag_filled.yml INFO [730581] Running 4 tasks using 2 processes INFO [730736] Starting task my_maps/tas_map in process [730736] INFO [730737] Starting task timeseries/tas_ts in process [730737] INFO [730581] Progress: 2 tasks running, 2 tasks waiting for ancestors, 0/4 done INFO [730736] Successfully completed task my_maps/tas_map (priority 1) in 0:00:10.027909 INFO [730581] Progress: 1 tasks running, 2 tasks waiting for ancestors, 1/4 done INFO [730736] Starting task my_maps/myscript in process [730736] INFO [730736] Running command ['/diagnostics/esmvaltool/2.8.0/bin/python', '/nird/home/andr/esmvaltool_workshop/mydiag.py', '/projects/NS9560K/www/diagnostics/esmvaltool/andr/tmp/recipe_mydiag_20230531_123952/run/my_maps/myscript/settings.yml'] INFO [730736] Writing output to /projects/NS9560K/www/diagnostics/esmvaltool/andr/tmp/recipe_mydiag_20230531_123952/work/my_maps/myscript INFO [730736] Writing plots to /projects/NS9560K/www/diagnostics/esmvaltool/andr/tmp/recipe_mydiag_20230531_123952/plots/my_maps/myscript INFO [730736] Writing log to /projects/NS9560K/www/diagnostics/esmvaltool/andr/tmp/recipe_mydiag_20230531_123952/run/my_maps/myscript/log.txt INFO [730736] To re-run this diagnostic script, run: cd /projects/NS9560K/www/diagnostics/esmvaltool/andr/tmp/recipe_mydiag_20230531_123952/run/my_maps/myscript; MPLBACKEND="Agg" /diagnostics/esmvaltool/2.8.0/bin/python /nird/home/andr/esmvaltool_workshop/mydiag.py /projects/NS9560K/www/diagnostics/esmvaltool/andr/tmp/recipe_mydiag_20230531_123952/run/my_maps/myscript/settings.yml INFO [730581] Progress: 2 tasks running, 1 tasks waiting for ancestors, 1/4 done INFO [730736] Maximum memory used (estimate): 0.6 GB INFO [730736] Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. WARNING [730736] No provenance information was written to /projects/NS9560K/www/diagnostics/esmvaltool/andr/tmp/recipe_mydiag_20230531_123952/run/my_maps/myscript/diagnostic_provenance.yml. Unable to record provenance for files created by diagnostic script ~/esmvaltool_workshop/mydiag.py in task my_maps/myscript INFO [730736] Successfully completed task my_maps/myscript (priority 0) in 0:00:05.020498 INFO [730581] Progress: 1 tasks running, 1 tasks waiting for ancestors, 2/4 done INFO [730737] Successfully completed task timeseries/tas_ts (priority 3) in 0:00:52.741847 INFO [730581] Progress: 0 tasks running, 1 tasks waiting for ancestors, 3/4 done INFO [730736] Starting task timeseries/annisscript in process [730736] INFO [730736] Running command ['/diagnostics/esmvaltool/2.8.0/bin/python', '/nird/home/andr/esmvaltool_workshop/mydiag.py', '/projects/NS9560K/www/diagnostics/esmvaltool/andr/tmp/recipe_mydiag_20230531_123952/run/timeseries/annisscript/settings.yml'] INFO [730736] Writing output to /projects/NS9560K/www/diagnostics/esmvaltool/andr/tmp/recipe_mydiag_20230531_123952/work/timeseries/annisscript INFO [730736] Writing plots to /projects/NS9560K/www/diagnostics/esmvaltool/andr/tmp/recipe_mydiag_20230531_123952/plots/timeseries/annisscript INFO [730736] Writing log to /projects/NS9560K/www/diagnostics/esmvaltool/andr/tmp/recipe_mydiag_20230531_123952/run/timeseries/annisscript/log.txt INFO [730736] To re-run this diagnostic script, run: cd /projects/NS9560K/www/diagnostics/esmvaltool/andr/tmp/recipe_mydiag_20230531_123952/run/timeseries/annisscript; MPLBACKEND="Agg" /diagnostics/esmvaltool/2.8.0/bin/python /nird/home/andr/esmvaltool_workshop/mydiag.py /projects/NS9560K/www/diagnostics/esmvaltool/andr/tmp/recipe_mydiag_20230531_123952/run/timeseries/annisscript/settings.yml INFO [730581] Progress: 1 tasks running, 0 tasks waiting for ancestors, 3/4 done INFO [730736] Maximum memory used (estimate): 0.6 GB INFO [730736] Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. WARNING [730736] No provenance information was written to /projects/NS9560K/www/diagnostics/esmvaltool/andr/tmp/recipe_mydiag_20230531_123952/run/timeseries/annisscript/diagnostic_provenance.yml. Unable to record provenance for files created by diagnostic script ~/esmvaltool_workshop/mydiag.py in task timeseries/annisscript INFO [730736] Successfully completed task timeseries/annisscript (priority 2) in 0:00:05.020218 INFO [730581] Progress: 0 tasks running, 0 tasks waiting for ancestors, 4/4 done INFO [730581] Successfully completed all tasks. INFO [730581] Wrote recipe with version numbers and wildcards to: file:///projects/NS9560K/www/diagnostics/esmvaltool/andr/tmp/recipe_mydiag_20230531_123952/run/recipe_mydiag_filled.yml INFO [730581] Wrote recipe output to: file:///projects/NS9560K/www/diagnostics/esmvaltool/andr/tmp/recipe_mydiag_20230531_123952/index.html INFO [730581] Ending the Earth System Model Evaluation Tool at time: 2023-05-31 12:40:52 UTC INFO [730581] Time for running the recipe was: 0:00:59.217738 INFO [730581] Maximum memory used (estimate): 5.7 GB INFO [730581] Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. INFO [730581] Run was successful