Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(search): update to support OpenSearch 2.x #8852

Conversation

david-leifker
Copy link
Collaborator

@david-leifker david-leifker commented Sep 17, 2023

  • Upgrade Elasticsearch to use the OpenSearch client 2.9.0 which supports Elasticsearch 7.10, OpenSearch 1.x and 2.x
  • Unit tests are refactored to control the concurrency of running test containers
  • testng, the primary java test framework, updated version
  • Created test suites in testng for opensearch/elasticsearch implementations
  • Updated h2 version used in testing
  • Smoke-test updated to use OpenSearch, docker-compose environment variables created to override the Elasticsearch default

Checklist

  • The PR conforms to DataHub's Contributing Guideline (particularly Commit Message Format)
  • Links to related issues (if applicable)
  • Tests for the changes have been added/updated (if applicable)
  • Docs related to the changes have been added/updated (if applicable). If a new feature has been added a Usage Guide has been added for the same.
  • For any breaking change/potential downtime/deprecation/big changes an entry has been made in Updating DataHub

@github-actions github-actions bot added ingestion PR or Issue related to the ingestion of metadata product PR or Issue related to the DataHub UI/UX devops PR or Issue related to DataHub backend & deployment smoke_test Contains changes related to smoke tests labels Sep 17, 2023
@david-leifker david-leifker force-pushed the elasticsearch-opensearch-upgrade branch 5 times, most recently from 16c3cf0 to 5d0f7da Compare September 19, 2023 00:43
@david-leifker david-leifker merged commit 21eb4df into datahub-project:master Sep 21, 2023
58 of 62 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
devops PR or Issue related to DataHub backend & deployment ingestion PR or Issue related to the ingestion of metadata product PR or Issue related to the DataHub UI/UX smoke_test Contains changes related to smoke tests
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants