2023-05-31 09:38:29,516 UTC [661745] INFO esmvalcore._main:495 ______________________________________________________________________ _____ ____ __ ____ __ _ _____ _ | ____/ ___|| \/ \ \ / /_ _| |_ _|__ ___ | | | _| \___ \| |\/| |\ \ / / _` | | | |/ _ \ / _ \| | | |___ ___) | | | | \ V / (_| | | | | (_) | (_) | | |_____|____/|_| |_| \_/ \__,_|_| |_|\___/ \___/|_| ______________________________________________________________________ ESMValTool - Earth System Model Evaluation Tool. http://www.esmvaltool.org CORE DEVELOPMENT TEAM AND CONTACTS: Birgit Hassler (Co-PI; DLR, Germany - birgit.hassler@dlr.de) Alistair Sellar (Co-PI; Met Office, UK - alistair.sellar@metoffice.gov.uk) Bouwe Andela (Netherlands eScience Center, The Netherlands - b.andela@esciencecenter.nl) Lee de Mora (PML, UK - ledm@pml.ac.uk) Niels Drost (Netherlands eScience Center, The Netherlands - n.drost@esciencecenter.nl) Veronika Eyring (DLR, Germany - veronika.eyring@dlr.de) Bettina Gier (UBremen, Germany - gier@uni-bremen.de) Remi Kazeroni (DLR, Germany - remi.kazeroni@dlr.de) Nikolay Koldunov (AWI, Germany - nikolay.koldunov@awi.de) Axel Lauer (DLR, Germany - axel.lauer@dlr.de) Saskia Loosveldt-Tomas (BSC, Spain - saskia.loosveldt@bsc.es) Ruth Lorenz (ETH Zurich, Switzerland - ruth.lorenz@env.ethz.ch) Benjamin Mueller (LMU, Germany - b.mueller@iggf.geo.uni-muenchen.de) Valeriu Predoi (URead, UK - valeriu.predoi@ncas.ac.uk) Mattia Righi (DLR, Germany - mattia.righi@dlr.de) Manuel Schlund (DLR, Germany - manuel.schlund@dlr.de) Breixo Solino Fernandez (DLR, Germany - breixo.solinofernandez@dlr.de) Javier Vegas-Regidor (BSC, Spain - javier.vegas@bsc.es) Klaus Zimmermann (SMHI, Sweden - klaus.zimmermann@smhi.se) For further help, please read the documentation at http://docs.esmvaltool.org. Have fun! 2023-05-31 09:38:29,516 UTC [661745] INFO esmvalcore._main:496 Package versions 2023-05-31 09:38:29,516 UTC [661745] INFO esmvalcore._main:497 ---------------- 2023-05-31 09:38:29,516 UTC [661745] INFO esmvalcore._main:498 ESMValCore: 2.8.0 2023-05-31 09:38:29,516 UTC [661745] INFO esmvalcore._main:500 ESMValTool: 2.8.0 2023-05-31 09:38:29,516 UTC [661745] INFO esmvalcore._main:501 ---------------- 2023-05-31 09:38:29,516 UTC [661745] INFO esmvalcore._main:502 Using config file /nird/home/tylo/.esmvaltool/config-user.yml 2023-05-31 09:38:29,516 UTC [661745] INFO esmvalcore._main:503 Writing program log files to: /projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_mydiag_20230531_093829/run/main_log.txt /projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_mydiag_20230531_093829/run/main_log_debug.txt 2023-05-31 09:38:30,493 UTC [661745] INFO esmvalcore._main:85 Starting the Earth System Model Evaluation Tool at time: 2023-05-31 09:38:30 UTC 2023-05-31 09:38:30,493 UTC [661745] INFO esmvalcore._main:89 ---------------------------------------------------------------------- 2023-05-31 09:38:30,493 UTC [661745] INFO esmvalcore._main:90 RECIPE = /nird/home/tylo/esmvaltool_workshop/recipe_mydiag.yml 2023-05-31 09:38:30,493 UTC [661745] INFO esmvalcore._main:91 RUNDIR = /projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_mydiag_20230531_093829/run 2023-05-31 09:38:30,493 UTC [661745] INFO esmvalcore._main:92 WORKDIR = /projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_mydiag_20230531_093829/work 2023-05-31 09:38:30,493 UTC [661745] INFO esmvalcore._main:93 PREPROCDIR = /projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_mydiag_20230531_093829/preproc 2023-05-31 09:38:30,494 UTC [661745] INFO esmvalcore._main:94 PLOTDIR = /projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_mydiag_20230531_093829/plots 2023-05-31 09:38:30,494 UTC [661745] INFO esmvalcore._main:95 ---------------------------------------------------------------------- 2023-05-31 09:38:30,495 UTC [661745] INFO esmvalcore._main:98 Running tasks using at most 2 processes 2023-05-31 09:38:30,496 UTC [661745] INFO esmvalcore._main:100 If your system hangs during execution, it may not have enough memory for keeping this number of tasks in memory. 2023-05-31 09:38:30,496 UTC [661745] INFO esmvalcore._main:103 If you experience memory problems, try reducing 'max_parallel_tasks' in your user configuration file. 2023-05-31 09:38:30,496 UTC [661745] DEBUG esmvalcore._recipe.check:52 Checking recipe against schema /diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_recipe/recipe_schema.yml 2023-05-31 09:38:30,514 UTC [661745] DEBUG esmvalcore._recipe.recipe:1014 Retrieving diagnostics from recipe 2023-05-31 09:38:30,515 UTC [661745] DEBUG esmvalcore._recipe.recipe:1042 Setting script for diagnostic diag_name 2023-05-31 09:38:30,515 UTC [661745] INFO esmvalcore._recipe.recipe:1232 Creating tasks from recipe 2023-05-31 09:38:30,515 UTC [661745] INFO esmvalcore._recipe.recipe:1241 Creating tasks for diagnostic diag_name 2023-05-31 09:38:30,515 UTC [661745] INFO esmvalcore._recipe.recipe:1163 Creating diagnostic task diag_name/myscript 2023-05-31 09:38:30,515 UTC [661745] DEBUG esmvalcore._recipe.recipe:1091 Linking tasks for diagnostic diag_name script myscript 2023-05-31 09:38:30,515 UTC [661745] INFO esmvalcore._recipe.recipe:1281 These tasks will be executed: diag_name/myscript 2023-05-31 09:38:30,516 UTC [661745] DEBUG esmvalcore._main:120 Recipe summary: DiagnosticTask: diag_name/myscript script: ~/esmvaltool_workshop/mydiag.py settings: {'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'log_level': 'info', 'output_file_type': 'png', 'plot_dir': '/projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_mydiag_20230531_093829/plots/diag_name/myscript', 'profile_diagnostic': False, 'recipe': PosixPath('recipe_mydiag.yml'), 'run_dir': '/projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_mydiag_20230531_093829/run/diag_name/myscript', 'script': 'myscript', 'version': '2.8.0', 'work_dir': '/projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_mydiag_20230531_093829/work/diag_name/myscript'} ancestors: None 2023-05-31 09:38:30,519 UTC [661745] INFO esmvalcore._recipe.recipe:1344 Wrote recipe with version numbers and wildcards to: file:///projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_mydiag_20230531_093829/run/recipe_mydiag_filled.yml 2023-05-31 09:38:30,519 UTC [661745] INFO esmvalcore._task:746 Running 1 tasks using 1 processes 2023-05-31 09:38:30,566 UTC [661901] INFO esmvalcore._task:259 Starting task diag_name/myscript in process [661901] 2023-05-31 09:38:30,574 UTC [661901] INFO esmvalcore._task:500 Running command ['/diagnostics/esmvaltool/2.8.0/bin/python', '/nird/home/tylo/esmvaltool_workshop/mydiag.py', '/projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_mydiag_20230531_093829/run/diag_name/myscript/settings.yml'] 2023-05-31 09:38:30,574 UTC [661901] DEBUG esmvalcore._task:501 in environment {'MPLBACKEND': 'Agg'} 2023-05-31 09:38:30,574 UTC [661901] DEBUG esmvalcore._task:503 in current working directory: /projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_mydiag_20230531_093829/run/diag_name/myscript 2023-05-31 09:38:30,574 UTC [661901] INFO esmvalcore._task:504 Writing output to /projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_mydiag_20230531_093829/work/diag_name/myscript 2023-05-31 09:38:30,575 UTC [661901] INFO esmvalcore._task:505 Writing plots to /projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_mydiag_20230531_093829/plots/diag_name/myscript 2023-05-31 09:38:30,575 UTC [661901] INFO esmvalcore._task:506 Writing log to /projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_mydiag_20230531_093829/run/diag_name/myscript/log.txt 2023-05-31 09:38:30,575 UTC [661901] INFO esmvalcore._task:516 To re-run this diagnostic script, run: cd /projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_mydiag_20230531_093829/run/diag_name/myscript; MPLBACKEND="Agg" /diagnostics/esmvaltool/2.8.0/bin/python /nird/home/tylo/esmvaltool_workshop/mydiag.py /projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_mydiag_20230531_093829/run/diag_name/myscript/settings.yml 2023-05-31 09:38:30,663 UTC [661745] INFO esmvalcore._task:778 Progress: 1 tasks running, 0 tasks waiting for ancestors, 0/1 done 2023-05-31 09:38:34,591 UTC [661901] INFO esmvalcore._task:126 Maximum memory used (estimate): 0.5 GB 2023-05-31 09:38:34,592 UTC [661901] INFO esmvalcore._task:128 Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. 2023-05-31 09:38:34,592 UTC [661901] DEBUG esmvalcore._task:589 Script ~/esmvaltool_workshop/mydiag.py completed successfully 2023-05-31 09:38:34,593 UTC [661901] WARNING esmvalcore._task:602 No provenance information was written to /projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_mydiag_20230531_093829/run/diag_name/myscript/diagnostic_provenance.yml. Unable to record provenance for files created by diagnostic script ~/esmvaltool_workshop/mydiag.py in task diag_name/myscript 2023-05-31 09:38:34,593 UTC [661901] INFO esmvalcore._task:264 Successfully completed task diag_name/myscript (priority 0) in 0:00:04.026558 2023-05-31 09:38:34,669 UTC [661745] INFO esmvalcore._task:778 Progress: 0 tasks running, 0 tasks waiting for ancestors, 1/1 done 2023-05-31 09:38:34,669 UTC [661745] INFO esmvalcore._task:783 Successfully completed all tasks. 2023-05-31 09:38:34,682 UTC [661745] INFO esmvalcore._recipe.recipe:1309 Wrote recipe with version numbers and wildcards to: file:///projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_mydiag_20230531_093829/run/recipe_mydiag_filled.yml 2023-05-31 09:38:34,715 UTC [661745] INFO esmvalcore.experimental.recipe_output:205 Wrote recipe output to: file:///projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_mydiag_20230531_093829/index.html 2023-05-31 09:38:34,716 UTC [661745] INFO esmvalcore._main:125 Ending the Earth System Model Evaluation Tool at time: 2023-05-31 09:38:34 UTC 2023-05-31 09:38:34,716 UTC [661745] INFO esmvalcore._main:128 Time for running the recipe was: 0:00:04.223117 2023-05-31 09:38:35,584 UTC [661745] INFO esmvalcore._task:126 Maximum memory used (estimate): 1.2 GB 2023-05-31 09:38:35,585 UTC [661745] INFO esmvalcore._task:128 Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. 2023-05-31 09:38:35,585 UTC [661745] INFO esmvalcore._main:453 Run was successful