Skip to content

Latest commit

 

History

History
171 lines (126 loc) · 9.72 KB

CHANGELOG.md

File metadata and controls

171 lines (126 loc) · 9.72 KB
Raw

Changelog

All notable changes to this project will be documented in this file.

The format is based on Keep a Changelog, and this project adheres to PEP 440 and uses Semantic Versioning.

[0.3.7]

[0.3.6]

  • Updates dem-stitcher to 2.5.6 to which updated to a new url for reading the Geoid EGM 2008. See this issue.

[0.3.5]

Added

[0.3.4]

Changed

  • ISCE2 shenanigans (PYTHON_PATH, PATH, and logging changes) are now handled in the isce2_topsapp.__init__ ensuring we only have to do it once, no matter where we are in the package.
  • Update dataset version from 3.0.0 -> 3.0.1 to track products over areas processed during development of v3 product. In other words, large scale processing was done during v3 development but not all v3 products will be delivered to DAAC - we have standardized numerous attributes and layers. Utlimately, 3.0.0 and 3.0.1 at the DAAC will represent the v3 products created by this repository.

Fixed

  • The root logger is no longer set to DEBUG by ISCE2 preventing excessive logging from all packages in the environment

[0.3.3]

Fixed

  • Orbit downloading cleanup - ensures no circular references seen in partial function

[0.3.2]

Changed

  • We ensured that ASF is checked for orbits before ESA to improve reliability. Aims to resolve orbit download issues seen here seen in large processing campaigns and possible errors associated with ESA downloading.
  • We include natural earth data in the plugin to exclude hitting the natural earth server and aims to resolve such issues identified here in large processing campaigns.

[0.3.1]

Added

  • Provides CLI options for:
    • output resolution: 30 meters or 90 meters (the latter is default and the standardized GUNW resolution)
    • unfiltered coherence layer (True/False)
    • Goldstein filtering power - power that phase is raised to in patch FFT - default .5 (can be any number >= 0)
    • Dense offsets layers (True/false)
  • Codifies (in documentation and in plugin) what is meant by "standard" GUNW with respect to exposed parameters including:
    • 90 m resolution
    • .5 value in the Goldstein filter for InSAR phase
    • No ESD or dense offsets
    • Additional layers: ionosophere, SET, and unfiltered coherence.
    • uses pydantic to record relevant topsapp parameters for "standard" GUNW
  • Records parameters in the product including the CLI command to regenerate said product
  • If parameters are not standard uses prefix S1-GUNW_CUSTOM-...
  • Pydantic dependency for parameter accounting

Changed

  • The CLI now requires frame_id (use frame_id = -1 for old API and what is now considered a "non"-standard product)
  • Water mask now uses tile-mate>=0.0.8 to download and merge water mask tiles (Pekel Occurence data >= 95 is the default)
  • All water masks applied to processing/packaging use Pekel Occurence (>= 95 percent occurence): ionosphere processing, browse imagery, and global attributes associate with mean coherence
  • Some function names associated to writing global attributes in the netcdf file were renamed to be more descriptive e.g. record_stats became record_stats_as_global_attrs

[0.3.0]

Added

  • check_esa_credentials function to __main__.py to check for the existence of Dataspace credentials before processing begins.

Changed

  • Updated hyp3lib to v2.0.2+, which uses the new Copernicus Dataspace Ecosystem API to download orbit files.
  • Calls to downloadSentinelOrbitFile now specify the esa_credentials argument.

[0.2.5]

Fixed

  • For SET azimuth time interpolation, overlapping orbits produces errors with prepping state vectors for azimuth time grid. We now ensure state-vecotors are both unique and in order before creating a orbit object in ISCE2.

[0.2.4]

Added

  • ++omp-num-threads parameter to the main() entrypoint to limit the number of threads used by ISCE2 during multiprocessing.

Fixed

  • For Solid Earth Tide computation, use azimuth timing to calculate solid earth tide in science/grids/imagingGeometry reference frame using ISCE2 rdr2geo.
  • Include topsapp_iono template.
  • Increases DEM buffer to .4 from .1 to ensure the extent of at least two bursts (~40 km) are added when retrieving DEM (because estimated footprint can differ from what ISCE2 generates for a GUNW extent)
  • Catch warnings in tests and match messages to ensure package warnings do not fail test suite
  • Read low resolution Natural Earth land masses from public url due to removal from geopandas package.
  • For ionosphere computation over water, includes masking conncomp zero, phase bridging, and modified adaptive gaussian filtering
  • Fix for #135, skip iono computation if there are not land (all zero values) and skip using water mask if the area is outside of SWBD coverage
  • Fix for #145 and SET - duplicate orbit xmls for computing azimuth time grid with ISCE2 geo2rdr (duplicate state vectors likely culprit). Ensures orbit object is intialized with unique set of orbit xmls passed. Also, localized metadata appropriately.

Added

  • localize_data within main.py added option to use/not use water mask for ionosphere processing
  • Added option to estimate burst phase jumps in ionosphere computation
  • Added additional attributes for ionosphere computation into GUNW ionosphere layer metadata: processing_steps, water_mask, mask_connected_component_zero (flag) , do_phase_bridging (flag), swath_mode (flag), swath_ramp_removal (flag), swath_mode_description, multilook_az_rg1, multilook_az_rg2, iono_height
  • Added packing of additional attributes for ionosphere computation into GUNW
  • fsspec is now required in environment due to burst processing.

[0.2.3]

Updated

  • Explode footprints polygons
  • Added support for using water mask in ionospheric correction computation

Removed

  • Python 3.8 Support

[0.2.2]

Added

  • Provide prototype (internal) for burst analysis thanks to Forrest Williams and Joseph Kennedy (see PR #73)
  • CLI (and API) can switch between burst and SLC ifg generation thanks to entry point magic (see PR #73 for details)
  • Exposes a number of new corrections/ISCE2 processing options including: ionosphere, and ESD threshold arguments in CLI. Examples in README.
  • Exposes frame-id parameter for fixed frame cropping. Discussion, references, and examples in README.
  • Latitude aligned frames and their expected extents are added as geojson in repository as zip file.
  • Pins ISCE2 version to 2.6.1 and numpy / scipy to previous versions (see environment.yml) - to be amended when newest ISCE2 build is sorted out
  • Includes frame_id and temporal_baseline_days in json metadata for CMR handshake. The former is the fixed frame id and the latter is the number of days between images (will be multiple of 6).
  • Added support to compute and embed solid earth tide correction layers into GUNW products (see PR #91) - reference and secondary have own groups
  • Raises warning if there is at least 80% of water in the IFG area using Natural Earth Land mask.

Fixed

  • Ensures that when Solid Earth Tide or Ionosphere is added to GUNW, that the internal version attribute is updated from '1b' to '1c'
  • Ensures that correct (i.e. enough) DEM extents are obtained for frame job submission
  • Uses dem-stitcher 2.4.0 to resolve #89 - ensures only polygonal intersection of tiles
  • Fix variable name error in localize_slc.py
  • Removes dummy Solid Earth Tide variable from GUNW
  • Ensures dates and time in GUNW name are derived from center of secondary and reference pass.

Changed

  • Metadata intersection_geo is changed to gunw_geo.
  • Differentiates gunw_geo (and bounds) for DEM acquisition and processing_geo for ISCE2 for frame job submission.

[0.2.1]

  • Fixes write of start/stop sensing times due to changes in ASF Search v5.0.0 (see #79)

[0.2.0]

Added

  • A prototype burst processing skeleton (non-functional)

Changed

  • Uses updated API dem-stitcher for square resolution cells and translation/resampling (>=2.2.0)
  • Updates dataset (patch change) from 2.0.5 to 2.0.6
  • Sort imports for updated files

Fixed

  • Uses dem-stitcher>=v2.3.0, which by default, fills in glo-30 tiles that are missing over Armenia and Azerbaijan with the available glo-90 tiles (upsampled).
  • Uses dem-stitcher>=v2.3.1 to fix URLs for glo-30 and srtm_v3

[0.1.2]

Fixed

  • Sentinel-1 A/B aux-cal files are found at url: https://sar-mpc.eu/ipf-adf/aux_cal/
  • Unpack aux-cal with python standard package zipfile
  • Fix aux-cal bug (only S1A was being downloaded)

[0.1.1]

Fixed

  • DEM bounds are rounded to the nearest integer to reflect ISCE convention and avoid geocoding artifacts.

[0.1.0]

Initial release of the ARIA/JPL DockerizedTopsApp science processor, and HyP3 plugin, for generating an ARIA Sentinel-1 Geocoded Unwrapped Interferogram (GUNW) product from a collection of valid Sentinel-1 IW-mode Single Look Complex (SLC) scenes using ISCE2.