[2025-11-20 15:31:31,489] : DEBUG : abi_l1b_geotiff : _prepare_initial_logging : Starting script with arguments: -r abi_l1b -w geotiff -p true_color_night -f /input/OR_ABI-L1b-RadC-M6C01_G18_s20253241526186_e20253241528560_c20253241528597.nc /input/OR_ABI-L1b-RadC-M6C02_G18_s20253241521186_e20253241523559_c20253241523595.nc /input/OR_ABI-L1b-RadC-M6C02_G18_s20253241526186_e20253241528559_c20253241528586.nc /input/OR_ABI-L1b-RadC-M6C14_G18_s20253241526186_e20253241528560_c20253241529059.nc -vv [2025-11-20 15:31:31,489] : INFO : abi_l1b_geotiff : _run_processing : Sorting and reading input files... [2025-11-20 15:31:31,489] : DEBUG : abi_l1b_geotiff : _set_preferred_chunk_size : Setting preferred chunk size to 1356 pixels or 14MiB [2025-11-20 15:31:31,499] : DEBUG : satpy.readers.yaml_reader : load_yaml_configs : Reading ('/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/satpy/etc/readers/abi_l1b.yaml',) [2025-11-20 15:31:31,584] : DEBUG : satpy.readers.yaml_reader : create_filehandlers : Assigning to abi_l1b: ['/input/OR_ABI-L1b-RadC-M6C01_G18_s20253241526186_e20253241528560_c20253241528597.nc', '/input/OR_ABI-L1b-RadC-M6C02_G18_s20253241526186_e20253241528559_c20253241528586.nc', '/input/OR_ABI-L1b-RadC-M6C02_G18_s20253241521186_e20253241523559_c20253241523595.nc', '/input/OR_ABI-L1b-RadC-M6C14_G18_s20253241526186_e20253241528560_c20253241529059.nc'] [2025-11-20 15:31:31,807] : PID 144 : DEBUG : polar2grid.core.script_utils : rename_log_file : Log renamed from '/output/abi_l1b_geotiff_fail.log' to 'abi_l1b_geotiff_20251120_152118.log' [2025-11-20 15:31:31,808] : PID 144 : INFO : abi_l1b_geotiff : _run_processing : Loading product metadata from files... [2025-11-20 15:31:31,808] : PID 144 : DEBUG : satpy.composites.config_loader : load_compositor_configs_for_sensor : Looking for composites config file abi.yaml [2025-11-20 15:31:32,185] : PID 144 : DEBUG : satpy.composites.config_loader : load_compositor_configs_for_sensor : Looking for composites config file visir.yaml [2025-11-20 15:31:32,266] : PID 144 : DEBUG : satpy.node : _create_optional_subtrees : Skipping optional DataQuery(name='solar_zenith_angle', calibration='reflectance'): Unknown dataset DataQuery(name='solar_zenith_angle', calibration='reflectance') [2025-11-20 15:31:32,274] : PID 144 : DEBUG : satpy.node : _create_optional_subtrees : Skipping optional DataQuery(name='satellite_azimuth_angle', calibration='reflectance'): Unknown dataset DataQuery(name='satellite_azimuth_angle', calibration='reflectance') [2025-11-20 15:31:32,275] : PID 144 : DEBUG : satpy.node : _create_optional_subtrees : Skipping optional DataQuery(name='satellite_zenith_angle', calibration='reflectance'): Unknown dataset DataQuery(name='satellite_zenith_angle', calibration='reflectance') [2025-11-20 15:31:32,275] : PID 144 : DEBUG : satpy.node : _create_optional_subtrees : Skipping optional DataQuery(name='solar_azimuth_angle', calibration='reflectance'): Unknown dataset DataQuery(name='solar_azimuth_angle', calibration='reflectance') [2025-11-20 15:31:32,276] : PID 144 : DEBUG : satpy.node : _create_optional_subtrees : Skipping optional DataQuery(name='solar_zenith_angle', calibration='reflectance'): Unknown dataset DataQuery(name='solar_zenith_angle', calibration='reflectance') [2025-11-20 15:31:32,280] : PID 144 : DEBUG : satpy.node : _create_optional_subtrees : Skipping optional DataQuery(name='solar_zenith_angle', calibration='reflectance'): Unknown dataset DataQuery(name='solar_zenith_angle', calibration='reflectance') [2025-11-20 15:31:32,288] : PID 144 : DEBUG : satpy.node : _create_optional_subtrees : Skipping optional DataQuery(name='satellite_azimuth_angle', calibration='reflectance'): Unknown dataset DataQuery(name='satellite_azimuth_angle', calibration='reflectance') [2025-11-20 15:31:32,288] : PID 144 : DEBUG : satpy.node : _create_optional_subtrees : Skipping optional DataQuery(name='satellite_zenith_angle', calibration='reflectance'): Unknown dataset DataQuery(name='satellite_zenith_angle', calibration='reflectance') [2025-11-20 15:31:32,289] : PID 144 : DEBUG : satpy.node : _create_optional_subtrees : Skipping optional DataQuery(name='solar_azimuth_angle', calibration='reflectance'): Unknown dataset DataQuery(name='solar_azimuth_angle', calibration='reflectance') [2025-11-20 15:31:32,289] : PID 144 : DEBUG : satpy.node : _create_optional_subtrees : Skipping optional DataQuery(name='solar_zenith_angle', calibration='reflectance'): Unknown dataset DataQuery(name='solar_zenith_angle', calibration='reflectance') [2025-11-20 15:31:32,293] : PID 144 : DEBUG : satpy.node : _create_optional_subtrees : Skipping optional DataQuery(name='solar_zenith_angle', calibration='reflectance'): Unknown dataset DataQuery(name='solar_zenith_angle', calibration='reflectance') [2025-11-20 15:31:32,296] : PID 144 : DEBUG : satpy.readers.abi_l1b : get_dataset : Reading in get_dataset C14. [2025-11-20 15:31:32,391] : PID 144 : DEBUG : satpy.readers.abi_l1b : get_dataset : Reading in get_dataset C02. [2025-11-20 15:31:32,451] : PID 144 : DEBUG : satpy.readers.abi_l1b : get_dataset : Reading in get_dataset C02. [2025-11-20 15:31:32,521] : PID 144 : DEBUG : satpy.readers.abi_l1b : get_dataset : Reading in get_dataset C01. [2025-11-20 15:31:32,584] : PID 144 : WARNING : satpy.readers.yaml_reader : _get_file_handlers : Required file type 'c03' not found or loaded for 'C03' [2025-11-20 15:31:32,586] : PID 144 : DEBUG : satpy.modifiers.geometry : __call__ : Applying sun zen correction [2025-11-20 15:31:32,586] : PID 144 : DEBUG : satpy.modifiers.geometry : __call__ : Computing sun zenith angles. [2025-11-20 15:31:32,597] : PID 144 : DEBUG : satpy.modifiers.geometry : _apply_correction : Apply the standard sun-zenith correction [1/cos(sunz)] [2025-11-20 15:31:32,600] : PID 144 : DEBUG : satpy.modifiers.geometry : __call__ : Applying sun zen correction [2025-11-20 15:31:32,600] : PID 144 : DEBUG : satpy.modifiers.geometry : __call__ : Computing sun zenith angles. [2025-11-20 15:31:32,614] : PID 144 : DEBUG : satpy.modifiers.geometry : _apply_correction : Apply the standard sun-zenith correction [1/cos(sunz)] [2025-11-20 15:31:32,629] : PID 144 : DEBUG : h5py._conv : : Creating converter from 7 to 5 [2025-11-20 15:31:32,630] : PID 144 : DEBUG : h5py._conv : : Creating converter from 5 to 7 [2025-11-20 15:31:32,630] : PID 144 : DEBUG : h5py._conv : : Creating converter from 7 to 5 [2025-11-20 15:31:32,630] : PID 144 : DEBUG : h5py._conv : : Creating converter from 5 to 7 [2025-11-20 15:31:32,654] : PID 144 : DEBUG : satpy.scene : _generate_composite : Delaying generation of DataID(name='C01', wavelength=WavelengthRange(min=0.45, central=0.47, max=0.49, unit='µm'), resolution=1000, calibration=, modifiers=('sunz_corrected', 'rayleigh_corrected')) because of incompatible areas [2025-11-20 15:31:32,683] : PID 144 : INFO : satpy.modifiers.atmosphere : __call__ : Removing Rayleigh scattering with atmosphere 'us-standard' and aerosol type 'rayleigh_only' for 'C02' [2025-11-20 15:31:32,685] : PID 144 : INFO : pyspectral.rayleigh : __init__ : Atmosphere chosen: us-standard [2025-11-20 15:31:32,687] : PID 144 : DEBUG : pyspectral.rayleigh : __init__ : LUT filename: /software/geo2grid_v_1_1/pyspectral_data/rayleigh_only/rayleigh_lut_us-standard.h5 [2025-11-20 15:31:32,688] : PID 144 : DEBUG : pyspectral.rsr_reader : _get_filename : Filename: /software/geo2grid_v_1_1/pyspectral_data/rsr_abi_GOES-18.h5 [2025-11-20 15:31:32,688] : PID 144 : DEBUG : pyspectral.rsr_reader : _check_filename_exist : Filename: /software/geo2grid_v_1_1/pyspectral_data/rsr_abi_GOES-18.h5 [2025-11-20 15:31:32,690] : PID 144 : DEBUG : h5py._conv : __getitem__ : Creating converter from 3 to 5 [2025-11-20 15:31:32,691] : PID 144 : DEBUG : pyspectral.rsr_reader : get_number_of_detectors4bandname : No detectors found - assume only one... [2025-11-20 15:31:32,693] : PID 144 : DEBUG : pyspectral.rsr_reader : get_number_of_detectors4bandname : No detectors found - assume only one... [2025-11-20 15:31:32,694] : PID 144 : DEBUG : pyspectral.rsr_reader : get_number_of_detectors4bandname : No detectors found - assume only one... [2025-11-20 15:31:32,696] : PID 144 : DEBUG : pyspectral.rsr_reader : get_number_of_detectors4bandname : No detectors found - assume only one... [2025-11-20 15:31:32,698] : PID 144 : DEBUG : pyspectral.rsr_reader : get_number_of_detectors4bandname : No detectors found - assume only one... [2025-11-20 15:31:32,700] : PID 144 : DEBUG : pyspectral.rsr_reader : get_number_of_detectors4bandname : No detectors found - assume only one... [2025-11-20 15:31:32,702] : PID 144 : DEBUG : pyspectral.rsr_reader : get_number_of_detectors4bandname : No detectors found - assume only one... [2025-11-20 15:31:32,703] : PID 144 : DEBUG : pyspectral.rsr_reader : get_number_of_detectors4bandname : No detectors found - assume only one... [2025-11-20 15:31:32,705] : PID 144 : DEBUG : pyspectral.rsr_reader : get_number_of_detectors4bandname : No detectors found - assume only one... [2025-11-20 15:31:32,707] : PID 144 : DEBUG : pyspectral.rsr_reader : get_number_of_detectors4bandname : No detectors found - assume only one... [2025-11-20 15:31:32,709] : PID 144 : DEBUG : pyspectral.rsr_reader : get_number_of_detectors4bandname : No detectors found - assume only one... [2025-11-20 15:31:32,711] : PID 144 : DEBUG : pyspectral.rsr_reader : get_number_of_detectors4bandname : No detectors found - assume only one... [2025-11-20 15:31:32,712] : PID 144 : DEBUG : pyspectral.rsr_reader : get_number_of_detectors4bandname : No detectors found - assume only one... [2025-11-20 15:31:32,714] : PID 144 : DEBUG : pyspectral.rsr_reader : get_number_of_detectors4bandname : No detectors found - assume only one... [2025-11-20 15:31:32,716] : PID 144 : DEBUG : pyspectral.rsr_reader : get_number_of_detectors4bandname : No detectors found - assume only one... [2025-11-20 15:31:32,718] : PID 144 : DEBUG : pyspectral.rsr_reader : get_number_of_detectors4bandname : No detectors found - assume only one... [2025-11-20 15:31:32,724] : PID 144 : DEBUG : pyspectral.rayleigh : _get_effective_wavelength_and_band_name : Band name: ch2 Effective wavelength: 0.635057um [2025-11-20 15:31:32,727] : PID 144 : ERROR : abi_l1b_geotiff : exc_handler : Unexpected error. Enable debug messages (-vvv) or see log file for details. [2025-11-20 15:31:32,727] : PID 144 : DEBUG : abi_l1b_geotiff : exc_handler : Unexpected error exception: Traceback (most recent call last): File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/runpy.py", line 196, in _run_module_as_main return _run_code(code, main_globals, None, File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/runpy.py", line 86, in _run_code exec(code, run_globals) File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/polar2grid/glue.py", line 494, in sys.exit(main()) File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/polar2grid/glue.py", line 277, in main ret = processor() File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/polar2grid/glue.py", line 331, in __call__ return self._run_processing() File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/polar2grid/glue.py", line 362, in _run_processing scn.generate_possible_composites(True) File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/satpy/scene.py", line 1417, in generate_possible_composites keepables = self._generate_composites_from_loaded_datasets() File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/satpy/scene.py", line 1436, in _generate_composites_from_loaded_datasets return self._generate_composites_nodes_from_loaded_datasets(needed_comp_nodes) File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/satpy/scene.py", line 1442, in _generate_composites_nodes_from_loaded_datasets self._generate_composite(node, keepables) File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/satpy/scene.py", line 1466, in _generate_composite prereq_datasets = self._get_prereq_datasets( File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/satpy/scene.py", line 1548, in _get_prereq_datasets self._generate_composite(prereq_node, keepables) File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/satpy/scene.py", line 1466, in _generate_composite prereq_datasets = self._get_prereq_datasets( File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/satpy/scene.py", line 1548, in _get_prereq_datasets self._generate_composite(prereq_node, keepables) File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/satpy/scene.py", line 1500, in _generate_composite composite = compositor(prereq_datasets, File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/satpy/modifiers/atmosphere.py", line 71, in __call__ refl_cor_band = corrector.get_reflectance(sunz, satz, ssadiff, File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/pyspectral/rayleigh.py", line 270, in get_reflectance res = _map_blocks_or_direct_call(self._relax_rayleigh_refl_correction_where_cloudy, File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/pyspectral/rayleigh.py", line 59, in _map_blocks_or_direct_call return da.map_blocks(func, *args, **kwargs) File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/dask/array/core.py", line 873, in map_blocks out = blockwise( File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/dask/array/blockwise.py", line 269, in blockwise raise ValueError( ValueError: Dimension 0 has 10 blocks, adjust_chunks specified with 2 blocks [2025-11-20 15:31:32,730] : PID 144 : ERROR : traceback : exc_handler : Dimension 0 has 10 blocks, adjust_chunks specified with 2 blocks Traceback (most recent call last): File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/runpy.py", line 196, in _run_module_as_main return _run_code(code, main_globals, None, File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/runpy.py", line 86, in _run_code exec(code, run_globals) File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/polar2grid/glue.py", line 494, in sys.exit(main()) File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/polar2grid/glue.py", line 277, in main ret = processor() File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/polar2grid/glue.py", line 331, in __call__ return self._run_processing() File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/polar2grid/glue.py", line 362, in _run_processing scn.generate_possible_composites(True) File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/satpy/scene.py", line 1417, in generate_possible_composites keepables = self._generate_composites_from_loaded_datasets() File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/satpy/scene.py", line 1436, in _generate_composites_from_loaded_datasets return self._generate_composites_nodes_from_loaded_datasets(needed_comp_nodes) File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/satpy/scene.py", line 1442, in _generate_composites_nodes_from_loaded_datasets self._generate_composite(node, keepables) File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/satpy/scene.py", line 1466, in _generate_composite prereq_datasets = self._get_prereq_datasets( File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/satpy/scene.py", line 1548, in _get_prereq_datasets self._generate_composite(prereq_node, keepables) File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/satpy/scene.py", line 1466, in _generate_composite prereq_datasets = self._get_prereq_datasets( File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/satpy/scene.py", line 1548, in _get_prereq_datasets self._generate_composite(prereq_node, keepables) File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/satpy/scene.py", line 1500, in _generate_composite composite = compositor(prereq_datasets, File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/satpy/modifiers/atmosphere.py", line 71, in __call__ refl_cor_band = corrector.get_reflectance(sunz, satz, ssadiff, File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/pyspectral/rayleigh.py", line 270, in get_reflectance res = _map_blocks_or_direct_call(self._relax_rayleigh_refl_correction_where_cloudy, File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/pyspectral/rayleigh.py", line 59, in _map_blocks_or_direct_call return da.map_blocks(func, *args, **kwargs) File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/dask/array/core.py", line 873, in map_blocks out = blockwise( File "/software/geo2grid_v_1_1/libexec/python_runtime/lib/python3.10/site-packages/dask/array/blockwise.py", line 269, in blockwise raise ValueError( ValueError: Dimension 0 has 10 blocks, adjust_chunks specified with 2 blocks