2023-05-31 13:22:12,454 UTC [748236] INFO esmvalcore._main:495 ______________________________________________________________________ _____ ____ __ ____ __ _ _____ _ | ____/ ___|| \/ \ \ / /_ _| |_ _|__ ___ | | | _| \___ \| |\/| |\ \ / / _` | | | |/ _ \ / _ \| | | |___ ___) | | | | \ V / (_| | | | | (_) | (_) | | |_____|____/|_| |_| \_/ \__,_|_| |_|\___/ \___/|_| ______________________________________________________________________ ESMValTool - Earth System Model Evaluation Tool. http://www.esmvaltool.org CORE DEVELOPMENT TEAM AND CONTACTS: Birgit Hassler (Co-PI; DLR, Germany - birgit.hassler@dlr.de) Alistair Sellar (Co-PI; Met Office, UK - alistair.sellar@metoffice.gov.uk) Bouwe Andela (Netherlands eScience Center, The Netherlands - b.andela@esciencecenter.nl) Lee de Mora (PML, UK - ledm@pml.ac.uk) Niels Drost (Netherlands eScience Center, The Netherlands - n.drost@esciencecenter.nl) Veronika Eyring (DLR, Germany - veronika.eyring@dlr.de) Bettina Gier (UBremen, Germany - gier@uni-bremen.de) Remi Kazeroni (DLR, Germany - remi.kazeroni@dlr.de) Nikolay Koldunov (AWI, Germany - nikolay.koldunov@awi.de) Axel Lauer (DLR, Germany - axel.lauer@dlr.de) Saskia Loosveldt-Tomas (BSC, Spain - saskia.loosveldt@bsc.es) Ruth Lorenz (ETH Zurich, Switzerland - ruth.lorenz@env.ethz.ch) Benjamin Mueller (LMU, Germany - b.mueller@iggf.geo.uni-muenchen.de) Valeriu Predoi (URead, UK - valeriu.predoi@ncas.ac.uk) Mattia Righi (DLR, Germany - mattia.righi@dlr.de) Manuel Schlund (DLR, Germany - manuel.schlund@dlr.de) Breixo Solino Fernandez (DLR, Germany - breixo.solinofernandez@dlr.de) Javier Vegas-Regidor (BSC, Spain - javier.vegas@bsc.es) Klaus Zimmermann (SMHI, Sweden - klaus.zimmermann@smhi.se) For further help, please read the documentation at http://docs.esmvaltool.org. Have fun! 2023-05-31 13:22:12,455 UTC [748236] INFO esmvalcore._main:496 Package versions 2023-05-31 13:22:12,455 UTC [748236] INFO esmvalcore._main:497 ---------------- 2023-05-31 13:22:12,455 UTC [748236] INFO esmvalcore._main:498 ESMValCore: 2.8.0 2023-05-31 13:22:12,455 UTC [748236] INFO esmvalcore._main:500 ESMValTool: 2.8.0 2023-05-31 13:22:12,455 UTC [748236] INFO esmvalcore._main:501 ---------------- 2023-05-31 13:22:12,455 UTC [748236] INFO esmvalcore._main:502 Using config file /nird/home/daco/.esmvaltool/config-user.yml 2023-05-31 13:22:12,455 UTC [748236] INFO esmvalcore._main:503 Writing program log files to: /projects/NS9560K/www/diagnostics/esmvaltool/daco/tmp/recipe_mydiag_20230531_132212/run/main_log.txt /projects/NS9560K/www/diagnostics/esmvaltool/daco/tmp/recipe_mydiag_20230531_132212/run/main_log_debug.txt 2023-05-31 13:22:13,145 UTC [748236] INFO esmvalcore._main:85 Starting the Earth System Model Evaluation Tool at time: 2023-05-31 13:22:13 UTC 2023-05-31 13:22:13,146 UTC [748236] INFO esmvalcore._main:89 ---------------------------------------------------------------------- 2023-05-31 13:22:13,146 UTC [748236] INFO esmvalcore._main:90 RECIPE = /nird/home/daco/esmvaltool_workshop/recipe_mydiag.yml 2023-05-31 13:22:13,146 UTC [748236] INFO esmvalcore._main:91 RUNDIR = /projects/NS9560K/www/diagnostics/esmvaltool/daco/tmp/recipe_mydiag_20230531_132212/run 2023-05-31 13:22:13,146 UTC [748236] INFO esmvalcore._main:92 WORKDIR = /projects/NS9560K/www/diagnostics/esmvaltool/daco/tmp/recipe_mydiag_20230531_132212/work 2023-05-31 13:22:13,146 UTC [748236] INFO esmvalcore._main:93 PREPROCDIR = /projects/NS9560K/www/diagnostics/esmvaltool/daco/tmp/recipe_mydiag_20230531_132212/preproc 2023-05-31 13:22:13,146 UTC [748236] INFO esmvalcore._main:94 PLOTDIR = /projects/NS9560K/www/diagnostics/esmvaltool/daco/tmp/recipe_mydiag_20230531_132212/plots 2023-05-31 13:22:13,146 UTC [748236] INFO esmvalcore._main:95 ---------------------------------------------------------------------- 2023-05-31 13:22:13,147 UTC [748236] INFO esmvalcore._main:98 Running tasks using at most 2 processes 2023-05-31 13:22:13,147 UTC [748236] INFO esmvalcore._main:100 If your system hangs during execution, it may not have enough memory for keeping this number of tasks in memory. 2023-05-31 13:22:13,147 UTC [748236] INFO esmvalcore._main:103 If you experience memory problems, try reducing 'max_parallel_tasks' in your user configuration file. 2023-05-31 13:22:13,148 UTC [748236] DEBUG esmvalcore._recipe.check:52 Checking recipe against schema /diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_recipe/recipe_schema.yml 2023-05-31 13:22:13,169 UTC [748236] DEBUG esmvalcore._recipe.to_datasets:344 Populating list of datasets for variable tas_map in diagnostic temperature_map 2023-05-31 13:22:13,170 UTC [748236] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: tas, Amon, CMIP6, EC-Earth3, historical, r1i1p1f1, gr 2023-05-31 13:22:13,170 UTC [748236] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: tas, Amon, CMIP6, BCC-ESM1, historical, r1i1p1f1, gn 2023-05-31 13:22:13,170 UTC [748236] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: tas, Amon, CMIP6, NorESM2-LM, historical, r1i1p1f1, gn 2023-05-31 13:22:13,171 UTC [748236] DEBUG esmvalcore._recipe.recipe:1014 Retrieving diagnostics from recipe 2023-05-31 13:22:13,171 UTC [748236] DEBUG esmvalcore._recipe.recipe:1042 Setting script for diagnostic temperature_map 2023-05-31 13:22:13,171 UTC [748236] INFO esmvalcore._recipe.recipe:1232 Creating tasks from recipe 2023-05-31 13:22:13,171 UTC [748236] INFO esmvalcore._recipe.recipe:1241 Creating tasks for diagnostic temperature_map 2023-05-31 13:22:13,171 UTC [748236] INFO esmvalcore._recipe.recipe:1163 Creating diagnostic task temperature_map/myscript 2023-05-31 13:22:13,171 UTC [748236] INFO esmvalcore._recipe.recipe:1216 Creating preprocessor task temperature_map/tas_map 2023-05-31 13:22:13,171 UTC [748236] INFO esmvalcore._recipe.recipe:849 Creating preprocessor 'pp_map' task for variable 'tas_map' 2023-05-31 13:22:13,172 UTC [748236] WARNING esmvalcore.local:426 'CMIP6' rootpaths '/scratch/daco/ESGF/CMIP6' set in config-user.yml do not exist 2023-05-31 13:22:13,172 UTC [748236] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3/historical/r1i1p1f1/Amon/tas/gr/*/tas_Amon_EC-Earth3_historical_r1i1p1f1_gr*.nc /projects/NS9560K-datalake/ESGF/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3/historical/r1i1p1f1/Amon/tas/gr/*/tas_Amon_EC-Earth3_historical_r1i1p1f1_gr*.nc /scratch/daco/ESGF/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3/historical/r1i1p1f1/Amon/tas/gr/*/tas_Amon_EC-Earth3_historical_r1i1p1f1_gr*.nc 2023-05-31 13:22:13,191 UTC [748236] DEBUG esmvalcore._recipe.recipe:446 Using input files for variable tas of dataset EC-Earth3: /projects/NS9560K-datalake/ESGF/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3/historical/r1i1p1f1/Amon/tas/gr/v20200310/tas_Amon_EC-Earth3_historical_r1i1p1f1_gr_199001-199012.nc /projects/NS9560K-datalake/ESGF/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3/historical/r1i1p1f1/Amon/tas/gr/v20200310/tas_Amon_EC-Earth3_historical_r1i1p1f1_gr_199101-199112.nc /projects/NS9560K-datalake/ESGF/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3/historical/r1i1p1f1/Amon/tas/gr/v20200310/tas_Amon_EC-Earth3_historical_r1i1p1f1_gr_199201-199212.nc /projects/NS9560K-datalake/ESGF/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3/historical/r1i1p1f1/Amon/tas/gr/v20200310/tas_Amon_EC-Earth3_historical_r1i1p1f1_gr_199301-199312.nc /projects/NS9560K-datalake/ESGF/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3/historical/r1i1p1f1/Amon/tas/gr/v20200310/tas_Amon_EC-Earth3_historical_r1i1p1f1_gr_199401-199412.nc /projects/NS9560K-datalake/ESGF/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3/historical/r1i1p1f1/Amon/tas/gr/v20200310/tas_Amon_EC-Earth3_historical_r1i1p1f1_gr_199501-199512.nc /projects/NS9560K-datalake/ESGF/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3/historical/r1i1p1f1/Amon/tas/gr/v20200310/tas_Amon_EC-Earth3_historical_r1i1p1f1_gr_199601-199612.nc /projects/NS9560K-datalake/ESGF/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3/historical/r1i1p1f1/Amon/tas/gr/v20200310/tas_Amon_EC-Earth3_historical_r1i1p1f1_gr_199701-199712.nc /projects/NS9560K-datalake/ESGF/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3/historical/r1i1p1f1/Amon/tas/gr/v20200310/tas_Amon_EC-Earth3_historical_r1i1p1f1_gr_199801-199812.nc /projects/NS9560K-datalake/ESGF/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3/historical/r1i1p1f1/Amon/tas/gr/v20200310/tas_Amon_EC-Earth3_historical_r1i1p1f1_gr_199901-199912.nc 2023-05-31 13:22:13,191 UTC [748236] INFO esmvalcore._recipe.recipe:717 Found input files for Dataset: tas, Amon, CMIP6, EC-Earth3, CMIP, historical, r1i1p1f1, gr, v20200310 2023-05-31 13:22:13,194 UTC [748236] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP6/CMIP/BCC/BCC-ESM1/historical/r1i1p1f1/Amon/tas/gn/*/tas_Amon_BCC-ESM1_historical_r1i1p1f1_gn*.nc /projects/NS9560K-datalake/ESGF/CMIP6/CMIP/BCC/BCC-ESM1/historical/r1i1p1f1/Amon/tas/gn/*/tas_Amon_BCC-ESM1_historical_r1i1p1f1_gn*.nc /scratch/daco/ESGF/CMIP6/CMIP/BCC/BCC-ESM1/historical/r1i1p1f1/Amon/tas/gn/*/tas_Amon_BCC-ESM1_historical_r1i1p1f1_gn*.nc 2023-05-31 13:22:13,195 UTC [748236] DEBUG esmvalcore._recipe.recipe:446 Using input files for variable tas of dataset BCC-ESM1: /projects/NS9560K-datalake/ESGF/CMIP6/CMIP/BCC/BCC-ESM1/historical/r1i1p1f1/Amon/tas/gn/v20181214/tas_Amon_BCC-ESM1_historical_r1i1p1f1_gn_185001-201412.nc 2023-05-31 13:22:13,195 UTC [748236] INFO esmvalcore._recipe.recipe:717 Found input files for Dataset: tas, Amon, CMIP6, BCC-ESM1, CMIP, historical, r1i1p1f1, gn, v20181214 2023-05-31 13:22:13,196 UTC [748236] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/*/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn*.nc /projects/NS9560K-datalake/ESGF/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/*/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn*.nc /scratch/daco/ESGF/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/*/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn*.nc 2023-05-31 13:22:13,200 UTC [748236] DEBUG esmvalcore._recipe.recipe:446 Using input files for variable tas of dataset NorESM2-LM: /projects/NS9560K-datalake/ESGF/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/v20190815/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_199001-199912.nc 2023-05-31 13:22:13,200 UTC [748236] INFO esmvalcore._recipe.recipe:717 Found input files for Dataset: tas, Amon, CMIP6, NorESM2-LM, CMIP, historical, r1i1p1f1, gn, v20190815 2023-05-31 13:22:13,202 UTC [748236] INFO esmvalcore._recipe.recipe:873 PreprocessingTask temperature_map/tas_map created. 2023-05-31 13:22:13,202 UTC [748236] DEBUG esmvalcore._recipe.recipe:874 PreprocessingTask temperature_map/tas_map will create the files: /projects/NS9560K/www/diagnostics/esmvaltool/daco/tmp/recipe_mydiag_20230531_132212/preproc/temperature_map/tas_map/CMIP6_BCC-ESM1_Amon_historical_r1i1p1f1_tas_gn_1990-1999.nc /projects/NS9560K/www/diagnostics/esmvaltool/daco/tmp/recipe_mydiag_20230531_132212/preproc/temperature_map/tas_map/CMIP6_EC-Earth3_Amon_historical_r1i1p1f1_tas_gr_1990-1999.nc /projects/NS9560K/www/diagnostics/esmvaltool/daco/tmp/recipe_mydiag_20230531_132212/preproc/temperature_map/tas_map/CMIP6_NorESM2-LM_Amon_historical_r1i1p1f1_tas_gn_1990-1999.nc 2023-05-31 13:22:13,202 UTC [748236] DEBUG esmvalcore._recipe.recipe:1091 Linking tasks for diagnostic temperature_map script myscript 2023-05-31 13:22:13,203 UTC [748236] DEBUG esmvalcore._recipe.recipe:1100 Pattern temperature_map/tas_map matches ['temperature_map/tas_map'] 2023-05-31 13:22:13,203 UTC [748236] INFO esmvalcore._recipe.recipe:1281 These tasks will be executed: temperature_map/tas_map, temperature_map/myscript 2023-05-31 13:22:13,203 UTC [748236] DEBUG esmvalcore._main:120 Recipe summary: DiagnosticTask: temperature_map/myscript script: /nird/home/daco/esmvaltool_workshop/mydiag.py settings: {'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'log_level': 'info', 'output_file_type': 'png', 'plot_dir': '/projects/NS9560K/www/diagnostics/esmvaltool/daco/tmp/recipe_mydiag_20230531_132212/plots/temperature_map/myscript', 'profile_diagnostic': False, 'recipe': PosixPath('recipe_mydiag.yml'), 'run_dir': '/projects/NS9560K/www/diagnostics/esmvaltool/daco/tmp/recipe_mydiag_20230531_132212/run/temperature_map/myscript', 'script': 'myscript', 'version': '2.8.0', 'work_dir': '/projects/NS9560K/www/diagnostics/esmvaltool/daco/tmp/recipe_mydiag_20230531_132212/work/temperature_map/myscript'} ancestors: PreprocessingTask: temperature_map/tas_map order: ['load', 'regrid', 'climate_statistics', 'convert_units', 'remove_supplementary_variables', 'save'] PreprocessorFile: /projects/NS9560K/www/diagnostics/esmvaltool/daco/tmp/recipe_mydiag_20230531_132212/preproc/temperature_map/tas_map/CMIP6_BCC-ESM1_Amon_historical_r1i1p1f1_tas_gn_1990-1999.nc input files: [LocalFile('/projects/NS9560K-datalake/ESGF/CMIP6/CMIP/BCC/BCC-ESM1/historical/r1i1p1f1/Amon/tas/gn/v20181214/tas_Amon_BCC-ESM1_historical_r1i1p1f1_gn_185001-201412.nc')] settings: {'climate_statistics': {'operator': 'mean'}, 'convert_units': {'units': 'degree_C'}, 'load': {'callback': 'default'}, 'regrid': {'scheme': 'linear', 'target_grid': '1x1'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS9560K/www/diagnostics/esmvaltool/daco/tmp/recipe_mydiag_20230531_132212/preproc/temperature_map/tas_map/CMIP6_BCC-ESM1_Amon_historical_r1i1p1f1_tas_gn_1990-1999.nc')}} PreprocessorFile: /projects/NS9560K/www/diagnostics/esmvaltool/daco/tmp/recipe_mydiag_20230531_132212/preproc/temperature_map/tas_map/CMIP6_EC-Earth3_Amon_historical_r1i1p1f1_tas_gr_1990-1999.nc input files: [LocalFile('/projects/NS9560K-datalake/ESGF/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3/historical/r1i1p1f1/Amon/tas/gr/v20200310/tas_Amon_EC-Earth3_historical_r1i1p1f1_gr_199001-199012.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3/historical/r1i1p1f1/Amon/tas/gr/v20200310/tas_Amon_EC-Earth3_historical_r1i1p1f1_gr_199101-199112.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3/historical/r1i1p1f1/Amon/tas/gr/v20200310/tas_Amon_EC-Earth3_historical_r1i1p1f1_gr_199201-199212.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3/historical/r1i1p1f1/Amon/tas/gr/v20200310/tas_Amon_EC-Earth3_historical_r1i1p1f1_gr_199301-199312.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3/historical/r1i1p1f1/Amon/tas/gr/v20200310/tas_Amon_EC-Earth3_historical_r1i1p1f1_gr_199401-199412.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3/historical/r1i1p1f1/Amon/tas/gr/v20200310/tas_Amon_EC-Earth3_historical_r1i1p1f1_gr_199501-199512.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3/historical/r1i1p1f1/Amon/tas/gr/v20200310/tas_Amon_EC-Earth3_historical_r1i1p1f1_gr_199601-199612.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3/historical/r1i1p1f1/Amon/tas/gr/v20200310/tas_Amon_EC-Earth3_historical_r1i1p1f1_gr_199701-199712.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3/historical/r1i1p1f1/Amon/tas/gr/v20200310/tas_Amon_EC-Earth3_historical_r1i1p1f1_gr_199801-199812.nc'), LocalFile('/projects/NS9560K-datalake/ESGF/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3/historical/r1i1p1f1/Amon/tas/gr/v20200310/tas_Amon_EC-Earth3_historical_r1i1p1f1_gr_199901-199912.nc')] settings: {'climate_statistics': {'operator': 'mean'}, 'convert_units': {'units': 'degree_C'}, 'load': {'callback': 'default'}, 'regrid': {'scheme': 'linear', 'target_grid': '1x1'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS9560K/www/diagnostics/esmvaltool/daco/tmp/recipe_mydiag_20230531_132212/preproc/temperature_map/tas_map/CMIP6_EC-Earth3_Amon_historical_r1i1p1f1_tas_gr_1990-1999.nc')}} PreprocessorFile: /projects/NS9560K/www/diagnostics/esmvaltool/daco/tmp/recipe_mydiag_20230531_132212/preproc/temperature_map/tas_map/CMIP6_NorESM2-LM_Amon_historical_r1i1p1f1_tas_gn_1990-1999.nc input files: [LocalFile('/projects/NS9560K-datalake/ESGF/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/v20190815/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_199001-199912.nc')] settings: {'climate_statistics': {'operator': 'mean'}, 'convert_units': {'units': 'degree_C'}, 'load': {'callback': 'default'}, 'regrid': {'scheme': 'linear', 'target_grid': '1x1'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS9560K/www/diagnostics/esmvaltool/daco/tmp/recipe_mydiag_20230531_132212/preproc/temperature_map/tas_map/CMIP6_NorESM2-LM_Amon_historical_r1i1p1f1_tas_gn_1990-1999.nc')}} ancestors: None 2023-05-31 13:22:13,209 UTC [748236] INFO esmvalcore._recipe.recipe:1344 Wrote recipe with version numbers and wildcards to: file:///projects/NS9560K/www/diagnostics/esmvaltool/daco/tmp/recipe_mydiag_20230531_132212/run/recipe_mydiag_filled.yml 2023-05-31 13:22:13,209 UTC [748236] INFO esmvalcore._task:746 Running 2 tasks using 2 processes 2023-05-31 13:22:13,264 UTC [748380] INFO esmvalcore._task:259 Starting task temperature_map/tas_map in process [748380] 2023-05-31 13:22:13,319 UTC [748380] DEBUG esmvalcore.preprocessor:660 Running block ['regrid', 'climate_statistics', 'convert_units'] 2023-05-31 13:22:13,319 UTC [748380] DEBUG esmvalcore.preprocessor:667 Applying single-model steps to PreprocessorFile: /projects/NS9560K/www/diagnostics/esmvaltool/daco/tmp/recipe_mydiag_20230531_132212/preproc/temperature_map/tas_map/CMIP6_NorESM2-LM_Amon_historical_r1i1p1f1_tas_gn_1990-1999.nc 2023-05-31 13:22:13,320 UTC [748380] DEBUG esmvalcore.esgf._download:535 All required data is available locally, not downloading anything. 2023-05-31 13:22:13,321 UTC [748380] DEBUG esmvalcore.preprocessor:369 Running preprocessor step fix_file 2023-05-31 13:22:13,321 UTC [748380] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'fix_file' on the data LocalFile('/projects/NS9560K-datalake/ESGF/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/v20190815/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_199001-199912.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/v20190815/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_199001-199912.nc')] with function argument(s) output_dir = PosixPath('/projects/NS9560K/www/diagnostics/esmvaltool/daco/tmp/recipe_mydiag_20230531_132212/preproc/fixed_files/tas_Amon_CMIP6_NorESM2-LM_CMIP_historical_r1i1p1f1_gn_v20190815_'), add_unique_suffix = True, short_name = 'tas', preprocessor = 'pp_map', mip = 'Amon', dataset = 'NorESM2-LM', project = 'CMIP6', exp = 'historical', ensemble = 'r1i1p1f1', grid = 'gn', timerange = '1990/1999', variable_group = 'tas_map', diagnostic = 'temperature_map', recipe_dataset_index = 2, alias = 'NorESM2-LM', institute = ['NCC'], activity = 'CMIP', original_short_name = 'tas', standard_name = 'air_temperature', long_name = 'Near-Surface Air Temperature', units = 'K', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20190815' 2023-05-31 13:22:13,323 UTC [748380] DEBUG esmvalcore.preprocessor:390 Result [LocalFile('/projects/NS9560K-datalake/ESGF/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/v20190815/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_199001-199912.nc')] 2023-05-31 13:22:13,323 UTC [748380] DEBUG esmvalcore.preprocessor:369 Running preprocessor step load 2023-05-31 13:22:13,323 UTC [748380] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'load' on the data LocalFile('/projects/NS9560K-datalake/ESGF/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/v20190815/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_199001-199912.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/v20190815/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_199001-199912.nc')] with function argument(s) callback = 'default' 2023-05-31 13:22:13,323 UTC [748380] DEBUG esmvalcore.preprocessor._io:152 Loading: /projects/NS9560K-datalake/ESGF/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/v20190815/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_199001-199912.nc 2023-05-31 13:22:13,361 UTC [748236] INFO esmvalcore._task:778 Progress: 1 tasks running, 1 tasks waiting for ancestors, 0/2 done 2023-05-31 13:22:13,368 UTC [748380] DEBUG esmvalcore.preprocessor._io:182 Done with loading /projects/NS9560K-datalake/ESGF/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/v20190815/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_199001-199912.nc 2023-05-31 13:22:13,368 UTC [748380] DEBUG esmvalcore.preprocessor:390 Result [] 2023-05-31 13:22:13,372 UTC [748380] DEBUG esmvalcore.preprocessor._io:307 Saving cubes [] to /projects/NS9560K/www/diagnostics/esmvaltool/daco/tmp/recipe_mydiag_20230531_132212/preproc/temperature_map/tas_map/CMIP6_NorESM2-LM_Amon_historical_r1i1p1f1_tas_gn_1990-1999/00_load.nc 2023-05-31 13:22:13,595 UTC [748380] DEBUG esmvalcore.preprocessor:369 Running preprocessor step fix_metadata 2023-05-31 13:22:13,597 UTC [748380] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'fix_metadata' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/v20190815/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_199001-199912.nc')] with function argument(s) check_level = , short_name = 'tas', preprocessor = 'pp_map', mip = 'Amon', dataset = 'NorESM2-LM', project = 'CMIP6', exp = 'historical', ensemble = 'r1i1p1f1', grid = 'gn', timerange = '1990/1999', variable_group = 'tas_map', diagnostic = 'temperature_map', recipe_dataset_index = 2, alias = 'NorESM2-LM', institute = ['NCC'], activity = 'CMIP', original_short_name = 'tas', standard_name = 'air_temperature', long_name = 'Near-Surface Air Temperature', units = 'K', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20190815' 2023-05-31 13:22:13,602 UTC [748380] DEBUG esmvalcore.preprocessor:390 Result [] 2023-05-31 13:22:13,604 UTC [748380] DEBUG esmvalcore.preprocessor._io:307 Saving cubes [] to /projects/NS9560K/www/diagnostics/esmvaltool/daco/tmp/recipe_mydiag_20230531_132212/preproc/temperature_map/tas_map/CMIP6_NorESM2-LM_Amon_historical_r1i1p1f1_tas_gn_1990-1999/01_fix_metadata.nc 2023-05-31 13:22:13,654 UTC [748380] DEBUG esmvalcore.preprocessor:369 Running preprocessor step concatenate 2023-05-31 13:22:13,656 UTC [748380] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'concatenate' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/v20190815/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_199001-199912.nc')] with function argument(s) 2023-05-31 13:22:13,656 UTC [748380] DEBUG esmvalcore.preprocessor:390 Result [] 2023-05-31 13:22:13,657 UTC [748380] DEBUG esmvalcore.preprocessor._io:307 Saving cubes [] to /projects/NS9560K/www/diagnostics/esmvaltool/daco/tmp/recipe_mydiag_20230531_132212/preproc/temperature_map/tas_map/CMIP6_NorESM2-LM_Amon_historical_r1i1p1f1_tas_gn_1990-1999/02_concatenate.nc 2023-05-31 13:22:13,707 UTC [748380] DEBUG esmvalcore.preprocessor:369 Running preprocessor step cmor_check_metadata 2023-05-31 13:22:13,708 UTC [748380] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'cmor_check_metadata' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/v20190815/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_199001-199912.nc')] with function argument(s) check_level = , cmor_table = 'CMIP6', mip = 'Amon', frequency = 'mon', short_name = 'tas' 2023-05-31 13:22:13,710 UTC [748380] DEBUG esmvalcore.preprocessor:390 Result [] 2023-05-31 13:22:13,711 UTC [748380] DEBUG esmvalcore.preprocessor._io:307 Saving cubes [] to /projects/NS9560K/www/diagnostics/esmvaltool/daco/tmp/recipe_mydiag_20230531_132212/preproc/temperature_map/tas_map/CMIP6_NorESM2-LM_Amon_historical_r1i1p1f1_tas_gn_1990-1999/03_cmor_check_metadata.nc 2023-05-31 13:22:13,756 UTC [748380] DEBUG esmvalcore.preprocessor:369 Running preprocessor step clip_timerange 2023-05-31 13:22:13,757 UTC [748380] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'clip_timerange' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/CMIP6/CMIP/NCC/NorESM2-LM/historical/r1i1p1f1/Amon/tas/gn/v20190815/tas_Amon_NorESM2-LM_historical_r1i1p1f1_gn_199001-199912.nc')] with function argument(s) timerange = '1990/1999' 2023-05-31 13:22:13,763 UTC [748380] DEBUG esmvalcore.preprocessor:390 Result [] 2023-05-31 13:22:13,764 UTC [748380] DEBUG esmvalcore.preprocessor._io:307 Saving cubes [] to /projects/NS9560K/www/diagnostics/esmvaltool/daco/tmp/recipe_mydiag_20230531_132212/preproc/temperature_map/tas_map/CMIP6_NorESM2-LM_Amon_historical_r1i1p1f1_tas_gn_1990-1999/04_clip_timerange.nc 2023-05-31 13:22:14,461 UTC [748236] INFO esmvalcore._task:126 Maximum memory used (estimate): 1.1 GB 2023-05-31 13:22:14,462 UTC [748236] INFO esmvalcore._task:128 Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur.