Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Initial implementation of EUMETSAT IASI-NG reader #2879

Open
wants to merge 46 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
46 commits
Select commit Hold shift + click to select a range
0de793d
Adding minimal test class on iasi ng l2 reader
Aug 7, 2024
683c211
Merge branch 'main' into eum_iasi_ng_reader_impl
Aug 7, 2024
bdb2cc8
Fixing sanity unit test
Aug 7, 2024
8373695
Added initial version of file pattern and unit test
Aug 7, 2024
2167484
Fixing minor error in file pattern
Aug 7, 2024
53c7e52
Adding simple properties in reader
Aug 7, 2024
252808a
Preparing initial support to read datasets in iasi_ng handler
Aug 8, 2024
3e7ec22
Fixing value filling process and updated unit tests
Aug 8, 2024
e4ea66d
Adding support for missing value handling in unit test
Aug 8, 2024
e094de9
Using float 64 for lat/lon datasets
Aug 8, 2024
51727f8
Adding dedicated dataset descs array
Aug 8, 2024
2e57be9
Adding support for datetime conversion
Aug 8, 2024
d98c9bf
Optimized data description in unit test
Aug 8, 2024
7f648d8
Adding support for dataset renaming
Aug 8, 2024
2eb0311
Replacing dataset alais symbol in yaml file
Aug 8, 2024
86dd68f
Updating unit test on available datasets
Aug 8, 2024
34e03ed
Adding diagnostic variables
Aug 8, 2024
b80f68c
Adding surface info datasets
Aug 8, 2024
aa2988a
Adding support to broadcast onboard_utc variable
Aug 8, 2024
9c2f3ec
fixing warning in unit test
Aug 8, 2024
b113750
Optimized variables discovery process.
Aug 9, 2024
becb81c
Updated onboard_utc broadcast process.
Aug 9, 2024
3be91cb
Installed pre-commit hook
Aug 9, 2024
3cdaee7
Fixing pre-commit issues
Aug 9, 2024
17fc430
Refactoring parse_file_content to reduce complexity
Aug 9, 2024
b906f4c
Refactoring add_rand_data to reduce complexity
Aug 9, 2024
f660cb1
Removing lat/lon unit test duplication
Aug 9, 2024
efc8865
Reduced get_test_content complexity
Aug 9, 2024
c237c10
Added support for O3_ and CO_ products
Aug 27, 2024
90f7016
Adding my name to authors.md
Aug 27, 2024
87cf5ea
Minor change trying to fix the readthedocs build process
Aug 27, 2024
430fcd2
Updated IASI ng L2 reader description
Aug 27, 2024
e69de92
Fixing readthedocs build process
Aug 27, 2024
daa56c6
Merge branch 'pytroll:main' into eum_iasi_ng_reader_impl
roche-emmanuel Aug 27, 2024
51ad0d9
Merge branch 'contributing_and_rtd_build_fixes' into eum_iasi_ng_read…
Aug 27, 2024
93c509f
Renaming contributing.rst file correctly
Aug 27, 2024
02c8feb
Merge branch 'contributing_and_rtd_build_fixes' into eum_iasi_ng_read…
Aug 30, 2024
439e700
Merge branch 'pytroll:main' into eum_iasi_ng_reader_impl
roche-emmanuel Aug 30, 2024
1c8741d
Updated reader to enable optimal_estimations and use dataset name ali…
Sep 30, 2024
5d2871b
Merge branch 'eum_iasi_ng_reader_impl' of github.com:roche-emmanuel/s…
Sep 30, 2024
14dfc44
Merge branch 'pytroll:main' into eum_iasi_ng_reader_impl
roche-emmanuel Sep 30, 2024
e542e60
Fixing pytest.fixture syntax
Sep 30, 2024
6021c92
Adding collection of unit tests on IASI-NG l2 reader.
Oct 2, 2024
837e844
Cleaning code removing debug statements.
Oct 2, 2024
82f62e5
Adding more unit tests.
Oct 2, 2024
c1303f3
Added a few additional unit tests for coverage.
Oct 4, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
30 changes: 30 additions & 0 deletions satpy/etc/readers/iasi_ng_l2_nc.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,30 @@
reader:
name: iasi_ng_l2_nc
short_name: IASI-NG L2 NC Reader
long_name: IASI-NG Level-2 NetCDF Reader
description: Reader for IASI-NG Level-2 NetCDF files
sensors: [iasi]
reader: !!python/name:satpy.readers.yaml_reader.FileYAMLReader
status: Alpha
supports_fsspec: false

file_types:
iasi_ng_l2_nc:
file_reader: !!python/name:satpy.readers.iasi_ng_l2_nc.IASINGL2NCFileHandler
file_patterns:
[
"{pflag}_{country}-{organization}-{location},{data_designator},{spacecraft}-{instrument}-{processing_level}-{product_type:3s}_{oflag}_{originator}_{generation_time}_{mission_type}_{environment}_{sensing_start_time:%Y%m%d%H%M%S}_{sensing_end_time:%Y%m%d%H%M%S}_{disposition_mode}_{processing_mode}_{free_text1}_{free_text2}_{free_text3}_{extension}.nc",
]

# keeping optimal_estimation folder for the moment due to feature freeze,
# but it might be necessary to re-introduce this in a near future.
# So keeping this reference entry here for now.
# ignored_patterns:
# - /optimal_estimation/ # cf. eum respase2 task2 issue #4

dataset_aliases:
"/optimal_estimation/(.+)$": "${VAR_NAME}_oem"

# Define if we should broadcast the timestamps from
# dims (n_lines, n_for) to (n_lines, n_for, n_fov):
broadcast_timestamps: true
Loading
Loading