v12.0.1

• CUMULUS-2995
  • Updated Moment.js package to 2.29.4 to address security vulnerability. See GHSA-wc69-rhjr-hc9g

v13.0.1

Fixed

• CUMULUS-2995
  • Updated Moment.js package to 2.29.4 to address security vulnerability. See GHSA-wc69-rhjr-hc9g

v10.1.3

Release v10.1.3 [Backport]

Added

• CUMULUS-2966
  • Added extractPath operation and support of nested string replacement to url_path in the collection configuration

v11.1.3

Release v11.1.3

Please note changes in 11.1.3 may not yet be released in future versions, as
this is a backport and patch release on the 11.1.x series of releases. Updates that
are included in the future will have a corresponding CHANGELOG entry in future
releases.

Notable changes

• CUMULUS-2929
  • Updated move-granule task to check the optional collection configuration parameter
    meta.granuleMetadataFileExtension to determine the granule metadata file.
    If none is specified, the granule CMR metadata or ISO metadata file is used.

Added

• CUMULUS-2929
  • Added optional collection configuration meta.granuleMetadataFileExtension to specify CMR metadata
    file extension for tasks that utilize metadata file lookups
• CUMULUS-2966
  • Added extractPath operation and support of nested string replacement to url_path in the collection configuration

Fixed

• CUMULUS-2863
  • Fixed @cumulus/api validateAndUpdateSqsRule method to allow 0 retries
    and 0 visibilityTimeout in rule's meta.
• CUMULUS-2959
  • Fixed @cumulus/api granules module to convert numeric productVolume to string
    when an old granule record is retrieved from DynamoDB.
• CUMULUS-2961
  • Fixed data-migration2 granule migration logic to allow for DynamoDb granules that have a null/empty string value for execution. The migration will now migrate them without a linked execution.

v13.0.0

Release v13.0.0

MIGRATION NOTES

• The changes introduced in CUMULUS-2955 should result in removal of
  files_granule_cumulus_id_index from the files table (added in the v11.1.1
  release). The success of this operation is dependent on system ingest load.

  In rare cases where data-persistence deployment fails because the
  postgres-db-migration times out, it may be required to manually remove the
  index and then redeploy:

  DROP INDEX IF EXISTS files_granule_cumulus_id_index;
  

Breaking Changes

• CUMULUS-2931

  • Updates CustomBootstrap lambda to default to failing if attempting to remove
    a pre-existing cumulus-alias index that would collide with the required
    cumulus-alias alias. A configuration parameter
    elasticsearch_remove_index_alias_conflict on the cumulus and
    archive modules has been added to enable the original behavior that would
    remove the invalid index (and all it's data).
  • Updates @cumulus/es-client.bootstrapElasticSearch signature to be
    parameterized and accommodate a new parameter removeAliasConflict which
    allows/disallows the deletion of a conflicting cumulus-alias index

Notable changes

• CUMULUS-2929
  • Updated move-granule task to check the optional collection configuration parameter
    meta.granuleMetadataFileExtension to determine the granule metadata file.
    If none is specified, the granule CMR metadata or ISO metadata file is used.

Added

• CUMULUS-2929

  • Added optional collection configuration meta.granuleMetadataFileExtension to specify CMR metadata
    file extension for tasks that utilize metadata file lookups

• CUMULUS-2939

  • Added @cumulus/api/lambdas/start-async-operation to start an async operation

Changed

• CUMULUS-2955

  • Updates 20220126172008_files_granule_id_index to not create an index on
    granule_cumulus_id on the files table.
  • Adds 20220609024044_remove_files_granule_id_index migration to revert
    changes from 20220126172008_files_granule_id_index on any deployed stacks
    that might have the index to ensure consistency in deployed stacks

• CUMULUS-2923

  • Changed public key setup for SFTP local testing.

• CUMULUS-2939

  • Updated @cumulus/api granules/bulk*, elasticsearch/index-from-database and
    POST reconciliationReports endpoints to invoke StartAsyncOperation lambda

v11.1.2

Release v11.1.2

Please note changes in 11.1.2 may not yet be released in future versions, as
this is a backport and patch release on the 11.1.x series of releases. Updates that
are included in the future will have a corresponding CHANGELOG entry in future
releases.

MIGRATION NOTES

• The changes introduced in CUMULUS-2955 should result in removal of
  files_granule_cumulus_id_index from the files table (added in the v11.1.1
  release). The success of this operation is dependent on system ingest load

  In rare cases where data-persistence deployment fails because the
  postgres-db-migration times out, it may be required to manually remove the
  index and then redeploy:

 DROP INDEX IF EXISTS files_granule_cumulus_id_index;

Changed

• CUMULUS-2955
  • Updates 20220126172008_files_granule_id_index to not create an index on
    granule_cumulus_id on the files table.
  • Adds 20220609024044_remove_files_granule_id_index migration to revert
    changes from 20220126172008_files_granule_id_index on any deployed stacks
    that might have the index to ensure consistency in deployed stacks

v12.0.0

Breaking Changes

• CUMULUS-2903
  • The minimum supported version for all published Cumulus Core npm packages is now Node 14.19.1
  • Tasks using the cumuluss/cumulus-ecs-task Docker image must be updated to
    cumuluss/cumulus-ecs-task:1.8.0. This can be done by updating the image
    property of any tasks defined using the cumulus_ecs_service Terraform
    module.

Changed

• CUMULUS-2932
  • Updates SyncGranule task to include disableOrDefaultAcl function that uses
    the configuration ACL parameter to set ACL to private by default or disable ACL.
  • Updates @cumulus/sync-granule download() function to take in ACL parameter
  • Updates @cumulus/ingest proceed() function to take in ACL parameter
  • Updates @cumulus/ingest addLock() function to take in an optional ACL parameter
  • Updates SyncGranule example worfklow config
    example/cumulus-tf/sync_granule_workflow.asl.json to include ACL
    parameter.

v11.1.1

Release v11.1.1

Added

Changed

• CUMULUS-2885

  • Updated @cumulus/aws-client to use new AWS SDK v3 packages for S3 requests:
    • @aws-sdk/client-s3
    • @aws-sdk/lib-storage
    • @aws-sdk/s3-request-presigner
  • Updated code for compatibility with updated @cumulus/aws-client and AWS SDK v3 S3 packages:
    • @cumulus/api
    • @cumulus/async-operations
    • @cumulus/cmrjs
    • @cumulus/common
    • @cumulus/collection-config-store
    • @cumulus/ingest
    • @cumulus/launchpad-auth
    • @cumulus/sftp-client
    • @cumulus/tf-inventory
    • lambdas/data-migration2
    • tasks/add-missing-file-checksums
    • tasks/hyrax-metadata-updates
    • tasks/lzards-backup
    • tasks/sync-granule

• CUMULUS-2920

  • Update npm version for Core build to 8.6

• CUMULUS-2922

  • Added @cumulus/example-lib package to example project to allow unit tests example/script/lib dependency.
  • Updates Mutex unit test to address changes made in #2902

• CUMULUS-2924

  • Update acquireTimeoutMillis to 400 seconds for the db-provision-lambda module to address potential timeout issues on RDS database start

• CUMULUS-2925

  • Updates CI to utilize audit-ci v6.2.0
  • Updates CI to utilize a on-container filesystem when building Core in 'uncached' mode
  • Updates CI to selectively bootstrap Core modules in the cleanup job phase

v10.0.2

Release v10.0.2

Please note changes in 10.0.2 may not yet be released in future versions, as
this is a backport and patch release on the 10.0.x series of releases. Updates that
are included in the future will have a corresponding CHANGELOG entry in future
releases.

Changed

• CUMULUS-2837
  • Update process-s3-dead-letter-archive to unpack SQS events in addition to
    Cumulus Messages
  • Update process-s3-dead-letter-archive to look up execution status using
    getCumulusMessageFromExecutionEvent (common method with sfEventSqsToDbRecords)
  • Move methods in api/lib/cwSfExecutionEventUtils to
    @cumulus/message/StepFunctions

v11.1.0

Release v11.1.0

MIGRATION NOTES

• 11.1.0 is an amendment release and supersedes 11.0.0. However, follow the migration steps for 11.0.0 when updating from prior versions.

• CUMULUS-2905

  • Updates migration script with new migrateAndOverwrite and
    migrateOnlyFiles options.

Added

• CUMULUS-2860
  • Added an optional configuration parameter skipMetadataValidation to hyrax-metadata-updates task
• CUMULUS-2870
  • Added last_modified_date as output to all tasks in Terraform ingest module.
• CUMULUS-NONE
  • Added documentation on choosing and configuring RDS at deployment/choosing_configuring_rds.

Changed

• CUMULUS-2703
  • Updated ORCA Backup reconciliation report to report cumulusFilesCount and orcaFilesCount
• CUMULUS-2849
  • Updated @cumulus/aws-client to use new AWS SDK v3 packages for DynamoDB requests:
    • @aws-sdk/client-dynamodb
    • @aws-sdk/lib-dynamodb
    • @aws-sdk/util-dynamodb
  • Updated code for compatibility with AWS SDK v3 Dynamo packages
    • @cumulus/api
    • @cumulus/errors
    • @cumulus/tf-inventory
    • lambdas/data-migration2
    • packages/api/ecs/async-operation
• CUMULUS-2864
  • Updated @cumulus/cmr-client/ingestUMMGranule and @cumulus/cmr-client/ingestConcept
    functions to not perform separate validation request
• CUMULUS-2870
  • Updated hello_world_service module to pass in lastModified parameter in command list to trigger a Terraform state change when the hello_world_task is modified.

Fixed

• CUMULUS-2849
  • Fixed AWS service client memoization logic in @cumulus/aws-client