2023-05-30 12:30:16,867 UTC [351294] INFO esmvalcore._main:495 ______________________________________________________________________ _____ ____ __ ____ __ _ _____ _ | ____/ ___|| \/ \ \ / /_ _| |_ _|__ ___ | | | _| \___ \| |\/| |\ \ / / _` | | | |/ _ \ / _ \| | | |___ ___) | | | | \ V / (_| | | | | (_) | (_) | | |_____|____/|_| |_| \_/ \__,_|_| |_|\___/ \___/|_| ______________________________________________________________________ ESMValTool - Earth System Model Evaluation Tool. http://www.esmvaltool.org CORE DEVELOPMENT TEAM AND CONTACTS: Birgit Hassler (Co-PI; DLR, Germany - birgit.hassler@dlr.de) Alistair Sellar (Co-PI; Met Office, UK - alistair.sellar@metoffice.gov.uk) Bouwe Andela (Netherlands eScience Center, The Netherlands - b.andela@esciencecenter.nl) Lee de Mora (PML, UK - ledm@pml.ac.uk) Niels Drost (Netherlands eScience Center, The Netherlands - n.drost@esciencecenter.nl) Veronika Eyring (DLR, Germany - veronika.eyring@dlr.de) Bettina Gier (UBremen, Germany - gier@uni-bremen.de) Remi Kazeroni (DLR, Germany - remi.kazeroni@dlr.de) Nikolay Koldunov (AWI, Germany - nikolay.koldunov@awi.de) Axel Lauer (DLR, Germany - axel.lauer@dlr.de) Saskia Loosveldt-Tomas (BSC, Spain - saskia.loosveldt@bsc.es) Ruth Lorenz (ETH Zurich, Switzerland - ruth.lorenz@env.ethz.ch) Benjamin Mueller (LMU, Germany - b.mueller@iggf.geo.uni-muenchen.de) Valeriu Predoi (URead, UK - valeriu.predoi@ncas.ac.uk) Mattia Righi (DLR, Germany - mattia.righi@dlr.de) Manuel Schlund (DLR, Germany - manuel.schlund@dlr.de) Breixo Solino Fernandez (DLR, Germany - breixo.solinofernandez@dlr.de) Javier Vegas-Regidor (BSC, Spain - javier.vegas@bsc.es) Klaus Zimmermann (SMHI, Sweden - klaus.zimmermann@smhi.se) For further help, please read the documentation at http://docs.esmvaltool.org. Have fun! 2023-05-30 12:30:16,867 UTC [351294] INFO esmvalcore._main:496 Package versions 2023-05-30 12:30:16,867 UTC [351294] INFO esmvalcore._main:497 ---------------- 2023-05-30 12:30:16,867 UTC [351294] INFO esmvalcore._main:498 ESMValCore: 2.8.0 2023-05-30 12:30:16,867 UTC [351294] INFO esmvalcore._main:500 ESMValTool: 2.8.0 2023-05-30 12:30:16,867 UTC [351294] INFO esmvalcore._main:501 ---------------- 2023-05-30 12:30:16,867 UTC [351294] INFO esmvalcore._main:502 Using config file /nird/home/tylo/esmvaltool_workshop/config-user.yml 2023-05-30 12:30:16,868 UTC [351294] INFO esmvalcore._main:503 Writing program log files to: /projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_extract_shape_20230530_123016/run/main_log.txt /projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_extract_shape_20230530_123016/run/main_log_debug.txt 2023-05-30 12:30:17,510 UTC [351294] INFO esmvalcore._main:85 Starting the Earth System Model Evaluation Tool at time: 2023-05-30 12:30:17 UTC 2023-05-30 12:30:17,510 UTC [351294] INFO esmvalcore._main:89 ---------------------------------------------------------------------- 2023-05-30 12:30:17,510 UTC [351294] INFO esmvalcore._main:90 RECIPE = /nird/home/tylo/esmvaltool/esmvaltool/recipes/examples/recipe_extract_shape.yml 2023-05-30 12:30:17,511 UTC [351294] INFO esmvalcore._main:91 RUNDIR = /projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_extract_shape_20230530_123016/run 2023-05-30 12:30:17,511 UTC [351294] INFO esmvalcore._main:92 WORKDIR = /projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_extract_shape_20230530_123016/work 2023-05-30 12:30:17,511 UTC [351294] INFO esmvalcore._main:93 PREPROCDIR = /projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_extract_shape_20230530_123016/preproc 2023-05-30 12:30:17,511 UTC [351294] INFO esmvalcore._main:94 PLOTDIR = /projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_extract_shape_20230530_123016/plots 2023-05-30 12:30:17,511 UTC [351294] INFO esmvalcore._main:95 ---------------------------------------------------------------------- 2023-05-30 12:30:17,512 UTC [351294] INFO esmvalcore._main:98 Running tasks using at most 2 processes 2023-05-30 12:30:17,513 UTC [351294] INFO esmvalcore._main:100 If your system hangs during execution, it may not have enough memory for keeping this number of tasks in memory. 2023-05-30 12:30:17,513 UTC [351294] INFO esmvalcore._main:103 If you experience memory problems, try reducing 'max_parallel_tasks' in your user configuration file. 2023-05-30 12:30:17,514 UTC [351294] DEBUG esmvalcore._recipe.check:52 Checking recipe against schema /diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/_recipe/recipe_schema.yml 2023-05-30 12:30:17,530 UTC [351294] DEBUG esmvalcore._recipe.to_datasets:344 Populating list of datasets for variable tas in diagnostic diagnostic 2023-05-30 12:30:17,530 UTC [351294] DEBUG esmvalcore._recipe.to_datasets:368 Found Dataset: tas, Amon, CMIP5, CanESM2, historical, r1i1p1 2023-05-30 12:30:17,530 UTC [351294] DEBUG esmvalcore._recipe.recipe:1014 Retrieving diagnostics from recipe 2023-05-30 12:30:17,530 UTC [351294] DEBUG esmvalcore._recipe.recipe:1042 Setting script for diagnostic diagnostic 2023-05-30 12:30:17,531 UTC [351294] INFO esmvalcore._recipe.recipe:1232 Creating tasks from recipe 2023-05-30 12:30:17,531 UTC [351294] INFO esmvalcore._recipe.recipe:1241 Creating tasks for diagnostic diagnostic 2023-05-30 12:30:17,531 UTC [351294] INFO esmvalcore._recipe.recipe:1163 Creating diagnostic task diagnostic/script1 2023-05-30 12:30:17,531 UTC [351294] INFO esmvalcore._recipe.recipe:1216 Creating preprocessor task diagnostic/tas 2023-05-30 12:30:17,531 UTC [351294] INFO esmvalcore._recipe.recipe:849 Creating preprocessor 'preproc' task for variable 'tas' 2023-05-30 12:30:17,532 UTC [351294] DEBUG esmvalcore.config._config:48 Loading extra facets from /diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/config/extra_facets/cmip5-fx.yml 2023-05-30 12:30:17,532 UTC [351294] DEBUG esmvalcore.config._config:48 Loading extra facets from /diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/config/extra_facets/cmip5-institutes.yml 2023-05-30 12:30:17,560 UTC [351294] DEBUG esmvalcore.config._config:48 Loading extra facets from /diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvalcore/config/extra_facets/cmip5-product.yml 2023-05-30 12:30:17,568 UTC [351294] WARNING esmvalcore.local:426 'CMIP5' rootpaths '/scratch/tylo/ESGF/cmip5/output1' set in config-user.yml do not exist 2023-05-30 12:30:17,569 UTC [351294] DEBUG esmvalcore.local:458 Looking for files matching: /projects/NS9034K/CMIP5/output1/CCCMA/CanESM2/historical/mon/atmos/Amon/r1i1p1/*/tas/tas_Amon_CanESM2_historical_r1i1p1*.nc /projects/NS9034K/CMIP5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/*/tas/tas_Amon_CanESM2_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/CCCMA/CanESM2/historical/mon/atmos/Amon/r1i1p1/*/tas/tas_Amon_CanESM2_historical_r1i1p1*.nc /projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/*/tas/tas_Amon_CanESM2_historical_r1i1p1*.nc /scratch/tylo/ESGF/cmip5/output1/CCCMA/CanESM2/historical/mon/atmos/Amon/r1i1p1/*/tas/tas_Amon_CanESM2_historical_r1i1p1*.nc /scratch/tylo/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/*/tas/tas_Amon_CanESM2_historical_r1i1p1*.nc 2023-05-30 12:30:17,574 UTC [351294] DEBUG esmvalcore._recipe.recipe:446 Using input files for variable tas of dataset CanESM2: /projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/tas/tas_Amon_CanESM2_historical_r1i1p1_185001-200512.nc 2023-05-30 12:30:17,574 UTC [351294] INFO esmvalcore._recipe.recipe:717 Found input files for Dataset: tas, Amon, CMIP5, CanESM2, historical, r1i1p1, v20120718 2023-05-30 12:30:17,576 UTC [351294] INFO esmvalcore._recipe.recipe:873 PreprocessingTask diagnostic/tas created. 2023-05-30 12:30:17,576 UTC [351294] DEBUG esmvalcore._recipe.recipe:874 PreprocessingTask diagnostic/tas will create the files: /projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_extract_shape_20230530_123016/preproc/diagnostic/tas/CMIP5_CanESM2_Amon_historical_r1i1p1_tas_2000-2002.nc 2023-05-30 12:30:17,576 UTC [351294] DEBUG esmvalcore._recipe.recipe:1091 Linking tasks for diagnostic diagnostic script script1 2023-05-30 12:30:17,576 UTC [351294] DEBUG esmvalcore._recipe.recipe:1100 Pattern diagnostic/tas matches ['diagnostic/tas'] 2023-05-30 12:30:17,576 UTC [351294] INFO esmvalcore._recipe.recipe:1281 These tasks will be executed: diagnostic/script1, diagnostic/tas 2023-05-30 12:30:17,577 UTC [351294] DEBUG esmvalcore._main:120 Recipe summary: DiagnosticTask: diagnostic/script1 script: examples/diagnostic.py settings: {'auxiliary_data_dir': PosixPath('/projects/NS9560K-datalake/ESGF/auxiliary_data'), 'log_level': 'info', 'output_file_type': 'png', 'plot_dir': '/projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_extract_shape_20230530_123016/plots/diagnostic/script1', 'profile_diagnostic': False, 'quickplot': {'plot_type': 'pcolormesh'}, 'realms': ['atmos'], 'recipe': PosixPath('recipe_extract_shape.yml'), 'run_dir': '/projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_extract_shape_20230530_123016/run/diagnostic/script1', 'script': 'script1', 'themes': ['phys'], 'version': '2.8.0', 'work_dir': '/projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_extract_shape_20230530_123016/work/diagnostic/script1'} ancestors: PreprocessingTask: diagnostic/tas order: ['load', 'regrid', 'extract_shape', 'climate_statistics', 'remove_supplementary_variables', 'save'] PreprocessorFile: /projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_extract_shape_20230530_123016/preproc/diagnostic/tas/CMIP5_CanESM2_Amon_historical_r1i1p1_tas_2000-2002.nc input files: [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/tas/tas_Amon_CanESM2_historical_r1i1p1_185001-200512.nc')] settings: {'climate_statistics': {'operator': 'mean'}, 'extract_shape': {'shapefile': '/projects/NS9560K-datalake/ESGF/auxiliary_data/Elbe.shp'}, 'load': {'callback': 'default'}, 'regrid': {'scheme': 'linear', 'target_grid': '0.25x0.25'}, 'remove_supplementary_variables': {}, 'save': {'compress': False, 'filename': PosixPath('/projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_extract_shape_20230530_123016/preproc/diagnostic/tas/CMIP5_CanESM2_Amon_historical_r1i1p1_tas_2000-2002.nc')}} ancestors: None 2023-05-30 12:30:17,582 UTC [351294] INFO esmvalcore._recipe.recipe:1344 Wrote recipe with version numbers and wildcards to: file:///projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_extract_shape_20230530_123016/run/recipe_extract_shape_filled.yml 2023-05-30 12:30:17,582 UTC [351294] INFO esmvalcore._task:746 Running 2 tasks using 2 processes 2023-05-30 12:30:17,624 UTC [351439] INFO esmvalcore._task:259 Starting task diagnostic/tas in process [351439] 2023-05-30 12:30:17,674 UTC [351439] DEBUG esmvalcore.preprocessor:660 Running block ['regrid', 'extract_shape', 'climate_statistics'] 2023-05-30 12:30:17,674 UTC [351439] DEBUG esmvalcore.preprocessor:667 Applying single-model steps to PreprocessorFile: /projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_extract_shape_20230530_123016/preproc/diagnostic/tas/CMIP5_CanESM2_Amon_historical_r1i1p1_tas_2000-2002.nc 2023-05-30 12:30:17,674 UTC [351439] DEBUG esmvalcore.esgf._download:535 All required data is available locally, not downloading anything. 2023-05-30 12:30:17,675 UTC [351439] DEBUG esmvalcore.preprocessor:369 Running preprocessor step fix_file 2023-05-30 12:30:17,675 UTC [351439] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'fix_file' on the data LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/tas/tas_Amon_CanESM2_historical_r1i1p1_185001-200512.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/tas/tas_Amon_CanESM2_historical_r1i1p1_185001-200512.nc')] with function argument(s) output_dir = PosixPath('/projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_extract_shape_20230530_123016/preproc/fixed_files/tas_Amon_CMIP5_CanESM2_historical_r1i1p1_v20120718_'), add_unique_suffix = True, mip = 'Amon', preprocessor = 'preproc', dataset = 'CanESM2', project = 'CMIP5', exp = 'historical', ensemble = 'r1i1p1', short_name = 'tas', timerange = '2000/2002', variable_group = 'tas', diagnostic = 'diagnostic', recipe_dataset_index = 0, alias = 'CanESM2', product = ['output1', 'output2'], institute = ['CCCma', 'CCCMA'], original_short_name = 'tas', standard_name = 'air_temperature', long_name = 'Near-Surface Air Temperature', units = 'K', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120718' 2023-05-30 12:30:17,677 UTC [351439] DEBUG esmvalcore.preprocessor:390 Result [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/tas/tas_Amon_CanESM2_historical_r1i1p1_185001-200512.nc')] 2023-05-30 12:30:17,677 UTC [351439] DEBUG esmvalcore.preprocessor:369 Running preprocessor step load 2023-05-30 12:30:17,677 UTC [351439] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'load' on the data LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/tas/tas_Amon_CanESM2_historical_r1i1p1_185001-200512.nc') loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/tas/tas_Amon_CanESM2_historical_r1i1p1_185001-200512.nc')] with function argument(s) callback = 'default' 2023-05-30 12:30:17,677 UTC [351439] DEBUG esmvalcore.preprocessor._io:152 Loading: /projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/tas/tas_Amon_CanESM2_historical_r1i1p1_185001-200512.nc 2023-05-30 12:30:17,721 UTC [351294] INFO esmvalcore._task:778 Progress: 1 tasks running, 1 tasks waiting for ancestors, 0/2 done 2023-05-30 12:30:17,831 UTC [351439] DEBUG esmvalcore.preprocessor._io:182 Done with loading /projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/tas/tas_Amon_CanESM2_historical_r1i1p1_185001-200512.nc 2023-05-30 12:30:17,831 UTC [351439] DEBUG esmvalcore.preprocessor:390 Result [] 2023-05-30 12:30:17,834 UTC [351439] DEBUG esmvalcore.preprocessor._io:307 Saving cubes [] to /projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_extract_shape_20230530_123016/preproc/diagnostic/tas/CMIP5_CanESM2_Amon_historical_r1i1p1_tas_2000-2002/00_load.nc 2023-05-30 12:30:18,205 UTC [351439] DEBUG esmvalcore.preprocessor:369 Running preprocessor step fix_metadata 2023-05-30 12:30:18,207 UTC [351439] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'fix_metadata' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/tas/tas_Amon_CanESM2_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , mip = 'Amon', preprocessor = 'preproc', dataset = 'CanESM2', project = 'CMIP5', exp = 'historical', ensemble = 'r1i1p1', short_name = 'tas', timerange = '2000/2002', variable_group = 'tas', diagnostic = 'diagnostic', recipe_dataset_index = 0, alias = 'CanESM2', product = ['output1', 'output2'], institute = ['CCCma', 'CCCMA'], original_short_name = 'tas', standard_name = 'air_temperature', long_name = 'Near-Surface Air Temperature', units = 'K', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120718' 2023-05-30 12:30:18,213 UTC [351439] DEBUG esmvalcore.preprocessor:390 Result [] 2023-05-30 12:30:18,214 UTC [351439] DEBUG esmvalcore.preprocessor._io:307 Saving cubes [] to /projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_extract_shape_20230530_123016/preproc/diagnostic/tas/CMIP5_CanESM2_Amon_historical_r1i1p1_tas_2000-2002/01_fix_metadata.nc 2023-05-30 12:30:18,385 UTC [351439] DEBUG esmvalcore.preprocessor:369 Running preprocessor step concatenate 2023-05-30 12:30:18,387 UTC [351439] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'concatenate' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/tas/tas_Amon_CanESM2_historical_r1i1p1_185001-200512.nc')] with function argument(s) 2023-05-30 12:30:18,387 UTC [351439] DEBUG esmvalcore.preprocessor:390 Result [] 2023-05-30 12:30:18,388 UTC [351439] DEBUG esmvalcore.preprocessor._io:307 Saving cubes [] to /projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_extract_shape_20230530_123016/preproc/diagnostic/tas/CMIP5_CanESM2_Amon_historical_r1i1p1_tas_2000-2002/02_concatenate.nc 2023-05-30 12:30:18,569 UTC [351439] DEBUG esmvalcore.preprocessor:369 Running preprocessor step cmor_check_metadata 2023-05-30 12:30:18,571 UTC [351439] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'cmor_check_metadata' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/tas/tas_Amon_CanESM2_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'tas' 2023-05-30 12:30:18,576 UTC [351439] DEBUG esmvalcore.preprocessor:390 Result [] 2023-05-30 12:30:18,577 UTC [351439] DEBUG esmvalcore.preprocessor._io:307 Saving cubes [] to /projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_extract_shape_20230530_123016/preproc/diagnostic/tas/CMIP5_CanESM2_Amon_historical_r1i1p1_tas_2000-2002/03_cmor_check_metadata.nc 2023-05-30 12:30:18,769 UTC [351439] DEBUG esmvalcore.preprocessor:369 Running preprocessor step clip_timerange 2023-05-30 12:30:18,770 UTC [351439] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'clip_timerange' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/tas/tas_Amon_CanESM2_historical_r1i1p1_185001-200512.nc')] with function argument(s) timerange = '2000/2002' 2023-05-30 12:30:18,782 UTC [351439] DEBUG esmvalcore.preprocessor:390 Result [] 2023-05-30 12:30:18,783 UTC [351439] DEBUG esmvalcore.preprocessor._io:307 Saving cubes [] to /projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_extract_shape_20230530_123016/preproc/diagnostic/tas/CMIP5_CanESM2_Amon_historical_r1i1p1_tas_2000-2002/04_clip_timerange.nc 2023-05-30 12:30:18,908 UTC [351439] DEBUG esmvalcore.preprocessor:369 Running preprocessor step fix_data 2023-05-30 12:30:18,909 UTC [351439] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'fix_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/tas/tas_Amon_CanESM2_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , mip = 'Amon', preprocessor = 'preproc', dataset = 'CanESM2', project = 'CMIP5', exp = 'historical', ensemble = 'r1i1p1', short_name = 'tas', timerange = '2000/2002', variable_group = 'tas', diagnostic = 'diagnostic', recipe_dataset_index = 0, alias = 'CanESM2', product = ['output1', 'output2'], institute = ['CCCma', 'CCCMA'], original_short_name = 'tas', standard_name = 'air_temperature', long_name = 'Near-Surface Air Temperature', units = 'K', modeling_realm = ['atmos'], frequency = 'mon', version = 'v20120718' 2023-05-30 12:30:18,910 UTC [351439] DEBUG esmvalcore.preprocessor:390 Result [] 2023-05-30 12:30:18,911 UTC [351439] DEBUG esmvalcore.preprocessor._io:307 Saving cubes [] to /projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_extract_shape_20230530_123016/preproc/diagnostic/tas/CMIP5_CanESM2_Amon_historical_r1i1p1_tas_2000-2002/05_fix_data.nc 2023-05-30 12:30:19,037 UTC [351439] DEBUG esmvalcore.preprocessor:369 Running preprocessor step cmor_check_data 2023-05-30 12:30:19,038 UTC [351439] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'cmor_check_data' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/tas/tas_Amon_CanESM2_historical_r1i1p1_185001-200512.nc')] with function argument(s) check_level = , cmor_table = 'CMIP5', mip = 'Amon', frequency = 'mon', short_name = 'tas' 2023-05-30 12:30:19,038 UTC [351439] DEBUG esmvalcore.preprocessor:390 Result [] 2023-05-30 12:30:19,039 UTC [351439] DEBUG esmvalcore.preprocessor._io:307 Saving cubes [] to /projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_extract_shape_20230530_123016/preproc/diagnostic/tas/CMIP5_CanESM2_Amon_historical_r1i1p1_tas_2000-2002/06_cmor_check_data.nc 2023-05-30 12:30:19,174 UTC [351439] DEBUG esmvalcore.preprocessor:369 Running preprocessor step add_supplementary_variables 2023-05-30 12:30:19,175 UTC [351439] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'add_supplementary_variables' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/tas/tas_Amon_CanESM2_historical_r1i1p1_185001-200512.nc')] with function argument(s) supplementary_cubes = [] 2023-05-30 12:30:19,175 UTC [351439] DEBUG esmvalcore.preprocessor:390 Result [] 2023-05-30 12:30:19,176 UTC [351439] DEBUG esmvalcore.preprocessor._io:307 Saving cubes [] to /projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_extract_shape_20230530_123016/preproc/diagnostic/tas/CMIP5_CanESM2_Amon_historical_r1i1p1_tas_2000-2002/07_add_supplementary_variables.nc 2023-05-30 12:30:19,301 UTC [351439] DEBUG esmvalcore.preprocessor:369 Running preprocessor step regrid 2023-05-30 12:30:19,302 UTC [351439] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'regrid' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/tas/tas_Amon_CanESM2_historical_r1i1p1_185001-200512.nc')] with function argument(s) scheme = 'linear', target_grid = '0.25x0.25' 2023-05-30 12:30:19,309 UTC [351439] DEBUG esmvalcore.preprocessor:390 Result [] 2023-05-30 12:30:19,310 UTC [351439] DEBUG esmvalcore.preprocessor._io:307 Saving cubes [] to /projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_extract_shape_20230530_123016/preproc/diagnostic/tas/CMIP5_CanESM2_Amon_historical_r1i1p1_tas_2000-2002/08_regrid.nc 2023-05-30 12:30:21,027 UTC [351439] DEBUG esmvalcore.preprocessor:369 Running preprocessor step extract_shape 2023-05-30 12:30:21,028 UTC [351439] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'extract_shape' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/tas/tas_Amon_CanESM2_historical_r1i1p1_185001-200512.nc')] with function argument(s) shapefile = '/projects/NS9560K-datalake/ESGF/auxiliary_data/Elbe.shp' 2023-05-30 12:30:21,029 UTC [351439] DEBUG fiona._env:315 GDAL_DATA found in environment. 2023-05-30 12:30:21,029 UTC [351439] DEBUG fiona._env:315 PROJ_DATA found in environment. 2023-05-30 12:30:21,088 UTC [351439] DEBUG fiona._env:315 GDAL_DATA found in environment. 2023-05-30 12:30:21,088 UTC [351439] DEBUG fiona._env:315 PROJ_DATA found in environment. 2023-05-30 12:30:21,096 UTC [351439] DEBUG fiona.ogrext:444 OLC_FASTSETNEXTBYINDEX: 1 2023-05-30 12:30:21,096 UTC [351439] DEBUG fiona.ogrext:444 OLC_FASTFEATURECOUNT: 1 2023-05-30 12:30:21,096 UTC [351439] DEBUG fiona.ogrext:444 Next index: 0 2023-05-30 12:30:21,096 UTC [351439] DEBUG fiona.ogrext:458 Next index: 1 2023-05-30 12:30:21,107 UTC [351439] DEBUG esmvalcore.preprocessor._area:465 Shape "0" found 2023-05-30 12:30:21,108 UTC [351439] DEBUG fiona.collection:665 Flushed buffer 2023-05-30 12:30:21,108 UTC [351439] DEBUG fiona.collection:667 Stopped session 2023-05-30 12:30:21,112 UTC [351439] DEBUG esmvalcore.preprocessor:390 Result [] 2023-05-30 12:30:21,113 UTC [351439] DEBUG esmvalcore.preprocessor._io:307 Saving cubes [] to /projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_extract_shape_20230530_123016/preproc/diagnostic/tas/CMIP5_CanESM2_Amon_historical_r1i1p1_tas_2000-2002/09_extract_shape.nc 2023-05-30 12:30:21,125 UTC [351439] WARNING py.warnings:109 /diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/iris/fileformats/netcdf/saver.py:307: FutureWarning: elementwise comparison failed; returning scalar instead, but in the future will perform elementwise comparison contains_value = arraylib.any(data == check_value) 2023-05-30 12:30:22,507 UTC [351439] DEBUG esmvalcore.preprocessor:369 Running preprocessor step climate_statistics 2023-05-30 12:30:22,508 UTC [351439] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'climate_statistics' on the data loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/tas/tas_Amon_CanESM2_historical_r1i1p1_185001-200512.nc')] with function argument(s) operator = 'mean' 2023-05-30 12:30:22,520 UTC [351439] DEBUG esmvalcore.preprocessor._time:764 climate_statistics changed dtype from float32 to float64, changing back 2023-05-30 12:30:22,521 UTC [351439] DEBUG esmvalcore.preprocessor:390 Result [] 2023-05-30 12:30:22,522 UTC [351439] DEBUG esmvalcore.preprocessor._io:307 Saving cubes [] to /projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_extract_shape_20230530_123016/preproc/diagnostic/tas/CMIP5_CanESM2_Amon_historical_r1i1p1_tas_2000-2002/10_climate_statistics.nc 2023-05-30 12:30:22,531 UTC [351439] WARNING py.warnings:109 /diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/iris/fileformats/netcdf/saver.py:307: FutureWarning: elementwise comparison failed; returning scalar instead, but in the future will perform elementwise comparison contains_value = arraylib.any(data == check_value) 2023-05-30 12:30:23,917 UTC [351439] DEBUG esmvalcore.preprocessor:369 Running preprocessor step save 2023-05-30 12:30:23,919 UTC [351439] DEBUG esmvalcore.preprocessor:323 Running preprocessor function 'save' on the data [] loaded from original input file(s) [LocalFile('/projects/NS9560K-datalake/ESGF/cmip5/output1/CCCma/CanESM2/historical/mon/atmos/Amon/r1i1p1/v20120718/tas/tas_Amon_CanESM2_historical_r1i1p1_185001-200512.nc')] with function argument(s) compress = False, filename = PosixPath('/projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_extract_shape_20230530_123016/preproc/diagnostic/tas/CMIP5_CanESM2_Amon_historical_r1i1p1_tas_2000-2002.nc') 2023-05-30 12:30:23,919 UTC [351439] DEBUG esmvalcore.preprocessor._io:307 Saving cubes [] to /projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_extract_shape_20230530_123016/preproc/diagnostic/tas/CMIP5_CanESM2_Amon_historical_r1i1p1_tas_2000-2002.nc 2023-05-30 12:30:23,930 UTC [351439] WARNING py.warnings:109 /diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/iris/fileformats/netcdf/saver.py:307: FutureWarning: elementwise comparison failed; returning scalar instead, but in the future will perform elementwise comparison contains_value = arraylib.any(data == check_value) 2023-05-30 12:30:25,413 UTC [351439] INFO esmvalcore._task:264 Successfully completed task diagnostic/tas (priority 1) in 0:00:07.788508 2023-05-30 12:30:25,432 UTC [351294] INFO esmvalcore._task:778 Progress: 0 tasks running, 1 tasks waiting for ancestors, 1/2 done 2023-05-30 12:30:25,435 UTC [351440] INFO esmvalcore._task:259 Starting task diagnostic/script1 in process [351440] 2023-05-30 12:30:25,439 UTC [351440] INFO esmvalcore._task:500 Running command ['/diagnostics/esmvaltool/2.8.0/bin/python', '/diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvaltool/diag_scripts/examples/diagnostic.py', '/projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_extract_shape_20230530_123016/run/diagnostic/script1/settings.yml'] 2023-05-30 12:30:25,439 UTC [351440] DEBUG esmvalcore._task:501 in environment {'MPLBACKEND': 'Agg'} 2023-05-30 12:30:25,439 UTC [351440] DEBUG esmvalcore._task:503 in current working directory: /projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_extract_shape_20230530_123016/run/diagnostic/script1 2023-05-30 12:30:25,439 UTC [351440] INFO esmvalcore._task:504 Writing output to /projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_extract_shape_20230530_123016/work/diagnostic/script1 2023-05-30 12:30:25,439 UTC [351440] INFO esmvalcore._task:505 Writing plots to /projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_extract_shape_20230530_123016/plots/diagnostic/script1 2023-05-30 12:30:25,439 UTC [351440] INFO esmvalcore._task:506 Writing log to /projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_extract_shape_20230530_123016/run/diagnostic/script1/log.txt 2023-05-30 12:30:25,439 UTC [351440] INFO esmvalcore._task:516 To re-run this diagnostic script, run: cd /projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_extract_shape_20230530_123016/run/diagnostic/script1; MPLBACKEND="Agg" /diagnostics/esmvaltool/2.8.0/bin/python /diagnostics/esmvaltool/2.8.0/lib/python3.10/site-packages/esmvaltool/diag_scripts/examples/diagnostic.py /projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_extract_shape_20230530_123016/run/diagnostic/script1/settings.yml 2023-05-30 12:30:25,532 UTC [351294] INFO esmvalcore._task:778 Progress: 1 tasks running, 0 tasks waiting for ancestors, 1/2 done 2023-05-30 12:30:30,454 UTC [351440] INFO esmvalcore._task:126 Maximum memory used (estimate): 0.5 GB 2023-05-30 12:30:30,455 UTC [351440] INFO esmvalcore._task:128 Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. 2023-05-30 12:30:30,456 UTC [351440] DEBUG esmvalcore._task:589 Script examples/diagnostic.py completed successfully 2023-05-30 12:30:30,456 UTC [351440] DEBUG esmvalcore._task:608 Collecting provenance from /projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_extract_shape_20230530_123016/run/diagnostic/script1/diagnostic_provenance.yml 2023-05-30 12:30:30,524 UTC [351440] DEBUG PIL.PngImagePlugin:204 STREAM b'IHDR' 16 13 2023-05-30 12:30:30,524 UTC [351440] DEBUG PIL.PngImagePlugin:204 STREAM b'tEXt' 41 57 2023-05-30 12:30:30,524 UTC [351440] DEBUG PIL.PngImagePlugin:204 STREAM b'pHYs' 110 9 2023-05-30 12:30:30,524 UTC [351440] DEBUG PIL.PngImagePlugin:204 STREAM b'IDAT' 131 9460 2023-05-30 12:30:30,562 UTC [351440] DEBUG esmvalcore._task:683 Collecting provenance of task diagnostic/script1 took 0.1 seconds 2023-05-30 12:30:30,562 UTC [351440] INFO esmvalcore._task:264 Successfully completed task diagnostic/script1 (priority 0) in 0:00:05.126432 2023-05-30 12:30:30,567 UTC [351294] INFO esmvalcore._task:778 Progress: 0 tasks running, 0 tasks waiting for ancestors, 2/2 done 2023-05-30 12:30:30,567 UTC [351294] INFO esmvalcore._task:783 Successfully completed all tasks. 2023-05-30 12:30:30,594 UTC [351294] INFO esmvalcore._recipe.recipe:1309 Wrote recipe with version numbers and wildcards to: file:///projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_extract_shape_20230530_123016/run/recipe_extract_shape_filled.yml 2023-05-30 12:30:30,653 UTC [351294] INFO esmvalcore.experimental.recipe_output:205 Wrote recipe output to: file:///projects/NS9560K/www/diagnostics/esmvaltool/tylo/tmp/recipe_extract_shape_20230530_123016/index.html 2023-05-30 12:30:30,653 UTC [351294] INFO esmvalcore._main:125 Ending the Earth System Model Evaluation Tool at time: 2023-05-30 12:30:30 UTC 2023-05-30 12:30:30,653 UTC [351294] INFO esmvalcore._main:128 Time for running the recipe was: 0:00:13.143451 2023-05-30 12:30:30,913 UTC [351294] INFO esmvalcore._task:126 Maximum memory used (estimate): 2.0 GB 2023-05-30 12:30:30,913 UTC [351294] INFO esmvalcore._task:128 Sampled every second. It may be inaccurate if short but high spikes in memory consumption occur. 2023-05-30 12:30:30,914 UTC [351294] INFO esmvalcore._main:453 Run was successful