CHANGELOG.md

Changelog

All notable changes to this project will be documented in this file.

The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.

[8.0.0] - 2024-09-09

Added

• #415 breaking change : auxiliary files stage out

[7.14.0] - 2024-09-09

Changed

• #419 feat: trying to get docs page working

[7.13.1] - 2024-08-13

Fixed

• #411 fix: check by id first to see if the granule exists before updating it

[7.13.0] - 2024-08-12

Changed

• #402 feat: daac sender + receiver logic

[7.12.2] - 2024-08-06

Fixed

• #407 fix: download from http with stream enabled

[7.12.1] - 2024-07-23

Fixed

• #399 fix: replace health check ssm

[7.12.0] - 2024-07-23

Changed

• #398 feat: add mock daac lambda logic

[7.11.0] - 2024-07-22

Changed

• #396 feat: adding daac archive config

[7.10.1] - 2024-07-10

Fixed

• #393 fix: less than 200 is ok. not error

[7.10.0] - 2024-07-09

Changed

• #390 feat: add additional role to s3 bucket policy

[7.9.0] - 2024-07-01

Changed

• #385 feat: different web service for stac browser

[7.8.1] - 2024-06-27

Fixed

• #373 fix: updating path for httpd testing

[7.8.0] - 2024-06-27

Changed

• #372 feat: market place bucket

[7.7.0] - 2024-05-13

Changed

• #369 feat: add cnm response archival lambda

[7.6.0] - 2024-05-13

Changed

• #368 feat: adding automated ingestion lambda

[7.5.0] - 2024-04-24

Changed

• #365 feat: add granuile cnm ingester tf

[7.4.0] - 2024-04-15

Changed

• #361 feat: uploading successful feature collection to s3

[7.3.0] - 2024-04-15

Changed

• #362 feat: add health check ssm

[Unity Release 24.1] - 2024-04-09

Repository Tags

• unity-data-services : 7.2.1

Added

• #254 breaking: allow custom-metadata in granules dapa query
• #333 breaking: catalog & collection endpoint + items link

Changed

• #295 feat: download granule json is public url
• #297 feat: granule stac asset with "roles" logic
• #303 feat: find stac metadata file
• #312 feat: stage in step to use dapa url to get the queries.
• #339 feat: testing stac browser ui
• #344 feat: update stac catalog list

Fixed

• #316 fix: granules cnm bug fixes
• #320 fix: stage out result file in a different directory
• #325 fix: replace anything not alphanumeric to 3 underscores
• #335 fix: split into different catalog base url
• #337 fix: add cors to fast api
• #342 fix: no filename in main data.stac.json file
• #347 fix: downgrade pystac to 1.9

[7.2.1] - 2024-04-08

Fixed

• #347 fix: downgrade pystac to 1.9

[7.2.0] - 2024-04-03

Changed

• #344 feat: update stac catalog list

[7.1.1] - 2024-04-02

Fixed

• #342 fix: no filename in main data.stac.json file

[7.1.0] - 2024-03-28

Changed

• #339 feat: testing stac browser ui

[7.0.2] - 2024-03-11

Fixed

• #337 fix: add cors to fast api

[7.0.1] - 2024-03-01

Fixed

• #335 fix: split into different catalog base url

[7.0.0] - 2024-02-29

Added

• #333 breaking: catalog & collection endpoint + items link

[6.4.3] - 2024-02-06

Fixed

• #325 fix: replace anything not alphanumeric to 3 underscores

[6.4.2] - 2024-02-05

Fixed

• #320 fix: stage out result file in a different directory

[6.4.1] - 2024-02-01

Fixed

• #316 fix: granules cnm bug fixes

[6.4.0] - 2024-02-01

Changed

• #312 feat: stage in step to use dapa url to get the queries.

[6.3.0] - 2024-01-29

Changed

• #303 feat: find stac metadata file

[6.2.0] - 2024-01-25

Changed

• #297 feat: granule stac asset with "roles" logic

[6.1.0] - 2024-01-23

Changed

• #295 feat: download granule json is public url

[6.0.0] - 2024-01-10

Added

• #254 breaking: allow custom-metadata in granules dapa query

[5.7.2] - 2024-01-04

Fixed

• #282 fix: no double version update pr - tested

[5.7.1] - 2024-01-04

Fixed

• #263 fix: metadata stac generate cmr file postfix

[5.7.0] - 2024-01-04

Changed

• #264 feat: collection validation in catalog

[5.6.1] - 2024-01-03

Fixed

• #270 fix: pr creationg to update version failed

[5.6.0] - 2023-10-31

Fixed

• #253 fix: Stage out succeeded when there is an error

[5.5.5] - 2023-10-09

Fixed

• #252 fix: version update + changelog via pr

[5.5.4] - 2023-10-03

Fixed

• #249 chore: update version + change log

[5.5.3] - 2023-10-03

Fixed

• #248 fix: github action write protected branch 15

[5.5.2] - 2023-10-02

Fixed

• #233 fix: github action write protected branch 7

[5.5.1] - 2023-09-21

Changed

• #207 feat: upper limit = 50 for collections

[5.5.0] - 2023-09-28

Added

• #201 feat: Custom metadata mechanism

[5.4.0] - 2023-08-16

Added

• #95 feat: elasticsearch branch

[5.3.3] - 2023-09-18

Changed

• #204 chore: clean.up - remove old codes

[5.3.2] - 2023-08-28

Changed

• #200 fix: parallelize upload

[5.3.1] - 2023-08-16

Changed

• #194 fix: Cataloging large number asynchronously by batch + download is stuck when there are large number of files

[5.3.0] - 2023-08-07

Changed

• #190 feat: Using Fastapi for all API endpoints

[5.2.3] - 2023-08-07

Changed

• #193 fix: add collection folder in s3 upload

[5.2.2] - 2023-07-21

Changed

• #188 fix: Update stage out task to read STAC items from STAC catalog

[Unity Release 23.2] - 2023-07-20

Repository Tags

• unity-data-services : 5.2.1

Added

• #119 Update data download task to allow staging data from DAAC HTTPS to local work directory
• #123 Update metadata reader to parse metadata from CHIRP xml files
• #157 Update stage-in to support HTTP/HTTPS download that doesn't require EDL
• #170 Parallelize data download in stage in task

Changed

• #125 Update metadata parser/transformer names to reflect metadata format instead of data processing level
• #128 UDS search docker image to perform CMR search + pagination
• #129 UDS search docker image to perform UDS search + pagination
• #130 Update stage out (upload data to S3) to read catalog.json
• #133 Update stage in task to take as input STAC input file
• #141 Update stage in to modify input STAC JSON to point to local urls
• #147 UDS tasks to support optional output file parameter
• #151 Update catalog task to take stac input file
• #155 Update UDS catalog task to wait for granules to be registered
• #158 Update stage in task to use relative path for href in STAC
• #159 Update stage out task to not require integration with UDS DAPA
• #160 Update stage in to require FeatureCollection STAC as input and only download specific assets

Fixed

• #167 Add retry logic for temporary failure in name resolution in Earth Data Login
• #181 Update stage in task to auto retry upon 502 errors

[5.2.1] - 2023-07-10

Added

• #182 fix: Retry if Download Error in DAAC

[5.2.0] - 2023-07-05

Added

• #169 feat: parallelize download

[5.1.0] - 2023-06-08

Added

• #156 feat: added filter keyword in granules endpoint + repeatedly checking with time boundary for cataloging result

[5.0.1] - 2023-06-21

Added

• #165 fix: convert all outputs into json str

[5.0.0] - 2023-06-13

Added

• #163 breaking: new upload implementation for complete catalog (no connection to DAPA)

[4.0.0] - 2023-06-13

Changed

• #161 breaking: search to return feature-collection. download to read feature-collection + return localized feature-collection w/ relative paths

[3.8.2] - 2023-05-23

Added

• #154 fix: production datetime not in +00:00 format

[3.8.1] - 2023-05-22

Added

• #152 fix: allow catalog stage input from file

[3.8.0] - 2023-05-04

Added

• #149 feat: writing output content to a file if ENV is provided

[3.7.1] - 2023-05-04

Changed

• #148 fix: use cas structure to generate metadata for stac

[3.7.0] - 2023-04-25

Added

• #146 feat: Stac metadata extraction

[3.6.1] - 2023-04-24

Changed

• #144 fix: downloaded stac to return local absolute path

[3.6.0] - 2023-04-24

Added

• #142 feat: Support DAAC download files stac file, not just direct json text

[3.5.0] - 2023-04-18

Added

• #138 feat: Checkout stage with STAC catalog json

[3.4.0] - 2023-04-17

Added

• #132 feat: add DAAC download logic

[3.3.1] - 2023-04-13

Changed

• #136 fix: uncomment temporal in CMR granules search

[3.3.0] - 2023-04-11

Added

• #134 feat: add option to parse downloading stac from file

[3.2.0] - 2023-04-11

Added

• #131 granules query pagination

[3.1.0] - 2023-04-11

Added

• #126 reduce pystac length by keeping only data asset

[3.0.0] - 2023-03-27

Breaking

• #124 configurable file postfixes for PDS metadata extraction + rename function names which will break previous terraforms

[2.0.0] - 2023-01-23

Breaking

• #120 breakup upload and download dockers into search + download & upload + catalog

[1.10.1] - 2023-01-23

Fixed

• #112 update dockerfile base images

[1.10.0] - 2022-12-19

Added

• #104 added Updated time in collection & item STAC dictionaries

Changed

• #104 use pystac library objects to create collection and item STAC dictionaries

[1.9.3] - 2022-12-19

Added

• #103 return a dictionary including HREFs instead of a string REGISTERED

[1.9.2] - 2022-11-16

Fixed

• #100 status=completed is only for granules, not for collections

[1.9.1] - 2022-11-15

Added

• #94 Added DAPA lambdas function name to parameter store for UCS API Gateway integration

Fixed

• #98 accept provider from ENV or optionally from user call

[1.8.1] - 2022-09-27

Added

• #79 Collection Creation endpoint with DAPA format

Changed

• #80 level.1.a.missing.filename
• #82 not honoring offset and limit in Collection query
• #89 check pathParameters is None

Fixed

[1.7.0] - 2022-09-06

Added

• #62 Added OpenAPI spec for DAPA endpoints
• #66 Added pagination links to STAC response of DAPA endpoints
• #64 Added temporal coverage to DAPA collection endpoint

Changed

• #67 Updated STAC collection schema to be compatible with PySTAC library

Fixed

[1.6.17] - 2022-07-28

Added

Fixed

• l1A granule id is <collection-id>___<collection-version>:<granule-id> not to duplicate re-runs

[1.6.16] - 2022-07-25

Added

• Added: use username & password to login to cognito to get the token

Fixed

[0.1.0] - 2022-04-14

Added

• Added lambda for parsing metadata from Sounder SIPS L0 metadata files #14

Fixed

• Pushed docker image to ghcr.io