Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Updating coordinator stats branch with main. #6

Merged
merged 98 commits into from
Sep 11, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
98 commits
Select commit Hold shift + click to select a range
a1d8beb
Set replication type to SEGMENT in remote store enabled cluster if no…
linuxpi Aug 28, 2023
569d5c2
Bugfix: add replica information in remote store restore flow (#8951)
sachinpkale Aug 28, 2023
f4106a4
Add support to use trace propagated from client (#9506)
Gaganjuneja Aug 28, 2023
a08d588
Add Secure Bwc documentation to TESTING.md (#9414)
stephen-crawford Aug 28, 2023
e5c4f9d
For sort request on timeseries field use non concurrent search path (…
sohami Aug 28, 2023
012c4fa
[Segment Replication] Fix bug where replica shows stale doc count dur…
mch2 Aug 28, 2023
61d4d43
[Segment Replication] Add ClusterState utility to identify SEGMENT re…
dreamer-89 Aug 29, 2023
bb7d23c
Bump io.grpc:grpc-api from 1.57.1 to 1.57.2 in /plugins/repository-gc…
dependabot[bot] Aug 29, 2023
60787b8
Add SearchExtBuilders to SearchResponse (#9379)
austintlee Aug 29, 2023
81c7b97
Fix GH runners memory issue by increasing swapfile (#9596)
gaiksaya Aug 29, 2023
8324b88
[Remote Store] Retry RemoteIndexShardTests flaky tests (#9597)
dreamer-89 Aug 30, 2023
78eea27
[BWC and API enforcement] Decorate the existing APIs with proper anno…
reta Aug 30, 2023
6cd576f
Fix SegmentReplicationUsingRemoteStoreIT#testDropPrimaryDuringReplica…
mch2 Aug 30, 2023
bb38ed4
Update the minimum version check on SearchExtBuilder support in Searc…
austintlee Aug 30, 2023
0274095
Allow MockTracingTelemetry to await for asynchronous tasks terminatio…
reta Aug 30, 2023
cc007e4
Add benchmark to measure performance of CustomBinaryDocValuesField (#…
kkmr Aug 30, 2023
e563a0c
Adding concurrent search versions of query count and time metrics (#9…
jed326 Aug 30, 2023
ff65403
[Segment Replication] Handle failover in mixed cluster mode (#9536)
Poojita-Raj Aug 31, 2023
c294c91
[Remote Store] Add tracker factory to manage remote store stats track…
Aug 31, 2023
d66df10
Decouple replication lag from logic to fail stale replicas (#9507)
ankitkala Aug 31, 2023
79e5aee
[Remote State] Create service to publish cluster state to remote stor…
soosinha Aug 31, 2023
f9a661c
Add Crypto Handler abstractions for encryption/decryption and Crypto…
vikasvb90 Aug 31, 2023
082d425
Added sampler based on Blanket Probabilistic Sampling rate and Overri…
devagarwal1803 Aug 31, 2023
1126d2f
Expose DelimitedTermFrequencyTokenFilter (#9479)
russcam Aug 31, 2023
6765b16
Add async blob read and download support using multiple streams (#9592)
kotwanikunal Sep 1, 2023
04c90c7
Mute RemoteIndexShardTests primary promotion flaky tests (#9679)
dreamer-89 Sep 1, 2023
f5d3fd2
Introduce cluster default remote translog buffer interval setting (#9…
ashking94 Sep 1, 2023
2fb4694
remove redundent column headers in pit segments response (#9615)
bugmakerrrrrr Sep 1, 2023
96e851b
[Segment Replication] Allow segment replication with on disk files no…
dreamer-89 Sep 1, 2023
dbb868a
[Tracing Framework] Redefine telemetry context restoration and propag…
Gaganjuneja Sep 1, 2023
f9b6694
Fix Segment Replication stats bytes behind metric (#9686)
mch2 Sep 1, 2023
ff4b23b
[Remote Store] Mute RemoteIndexRecoveryIT.testReplicaRecovery flaky t…
dreamer-89 Sep 1, 2023
079c3e9
Add average query concurrency metric for concurrent segment search (#…
jed326 Sep 2, 2023
422dd3c
Add support download latest index metadata from remote (#9477)
linuxpi Sep 2, 2023
e98ded6
Disable shard/segment level search_after short cutting if track_total…
gashutos Sep 2, 2023
731e043
Segment Replication - Block snapshot creation if the target primary s…
mch2 Sep 4, 2023
d375e4c
[Remote state] Integrate remote cluster state in publish/commit flow …
soosinha Sep 4, 2023
4294d44
Fix null_pointer_exception when creating or updating ingest pipeline …
gaobinlong Sep 4, 2023
63ce832
Add encryption support for repository (#9289)
vikasvb90 Sep 4, 2023
cf50add
[Remote Store] Add support for Remote Translog Store stats in `_remot…
Sep 4, 2023
aa83670
[Segment Replication] Adding segment replication statistics rolled up…
Poojita-Raj Sep 4, 2023
d426801
Update version back to 2_10_0 in Segmentstats. (#9745)
Rishikesh1159 Sep 5, 2023
56a8736
Fix bwc version for concurrent segment search stats (#9722)
jed326 Sep 5, 2023
63644cc
Bump org.apache.ant:ant from 1.10.13 to 1.10.14 in /buildSrc (#9579)
dependabot[bot] Sep 5, 2023
3d54d96
BWC compatibility fix for crypto settings in put repository request (…
vikasvb90 Sep 5, 2023
7c8effb
Initial commit of crypto-kms plugin (#8465)
vikasvb90 Sep 5, 2023
19a13f0
[Tracing Framework] Add proper API annotations (#9706)
reta Sep 5, 2023
7a22587
Add Peter Nied as a Maintainer (#9765)
dbwiddis Sep 5, 2023
8fdd9b4
Rename remote store stats field names (#9763)
ashking94 Sep 5, 2023
a737446
Add support for query profiler with concurrent aggregation (#9248)
ticheng-aws Sep 5, 2023
9602d1d
[Segment Replication] Fix shrink Index bug with segment replication. …
Rishikesh1159 Sep 5, 2023
9d6c43a
Remove org.bouncycastle:bcprov-jdk15to18: not needed and breaks the p…
reta Sep 5, 2023
37bdb6b
Cleanup Unreferenced file on segment merge failure (#9503)
RS146BIJAY Sep 6, 2023
ff2b127
Retry download of RemoteFSTranslog to fix transient race conditions (…
gbbafna Sep 6, 2023
9119b6d
[Remote Store] Changes to perform repository registration during boot…
psychbot Sep 6, 2023
6fe9388
fix: flaky test ClusterMetadataManifestTests (#9728)
r1walz Sep 6, 2023
1b41fa0
[Remote Store] Fixing flaky test - RemoteIndexPrimaryRelocationIT (#9…
psychbot Sep 6, 2023
f21619e
[Remote Store] Add support for Remote Translog Store upload stats in …
Sep 6, 2023
1b32913
Fix searchable snapshot to not sync from remote (#9791)
shourya035 Sep 6, 2023
742267d
Crypto Metadata support in repo registration (#9802)
gbbafna Sep 6, 2023
92b2095
[Remote Cluster State] Parallel and Multipart IndexMetadata uploads (…
linuxpi Sep 6, 2023
76f1b52
Introducing ZStd compression codec plugin (#9658)
sarthakaggarwal97 Sep 6, 2023
81d2ae1
[Remote Store] Add support to remote restore IndexMetadata (#9086)
linuxpi Sep 6, 2023
9b26bd9
Validate MockTracingTelemetry span state on shutdown. (#9818)
Gaganjuneja Sep 6, 2023
ee8dae3
Remvoving ESDK changes from core (#9833)
vikasvb90 Sep 6, 2023
e4a1841
Mute flaky test ReadContextListenerTests.testReadContextListenerFailu…
kotwanikunal Sep 6, 2023
305c8a8
[Remote Store] Muting RemoteStoreRefreshListenerTests.testReplicaProm…
shourya035 Sep 7, 2023
3f18e0c
Bump 2.x version to 2.11 (#9856)
kotwanikunal Sep 7, 2023
951f051
[Snapshot Interop] Fix Flakiness in Snapshot Interop Code (#9795)
harishbhakuni Sep 7, 2023
199123d
Decrease store refcount on any failure to create NRTReplicationEngine…
sachinpkale Sep 7, 2023
91f28d4
Mute org.opensearch.index.codec.MultiCodecMergeIT.testForceMergeMulti…
sachinpkale Sep 7, 2023
e6a7202
[Remote Store] Update version check for Remote Translog Store upload …
Sep 7, 2023
7760074
Removing asserts based on translog stats as it is not applicable for …
gbbafna Sep 7, 2023
d58943d
[Remote Cluster State] Move remote cluster state related settings to …
linuxpi Sep 7, 2023
bdf6f1d
Add logic to fetch previousClusterUUID (#9746)
soosinha Sep 7, 2023
6a0c50e
[Remote Store] Removing feature flag to mark feature GA (#9761)
shourya035 Sep 7, 2023
731b13f
Fix flaky codec tests (#9889)
sarthakaggarwal97 Sep 7, 2023
0bc1d5b
Restore cluster metadata during bootstrap (#9831)
soosinha Sep 7, 2023
224accf
Unmute testIndexingWithPrimaryOnBwcNodes (#9742)
dreamer-89 Sep 7, 2023
4ccecd6
changing compat version back to 2.10 (#9899)
shourya035 Sep 7, 2023
2a35f15
[Remote Cluster State] Remove stale remote cluster state (#9719)
linuxpi Sep 7, 2023
bbe6b2d
Fix default tracer flaky test (#9782)
Gaganjuneja Sep 7, 2023
c99ba63
Mute the query profile IT with concurrent execution (#9840)
ticheng-aws Sep 8, 2023
967ef31
Disable remote integrity check for encrypted repos for ChecksumBlobst…
linuxpi Sep 8, 2023
7abfc17
Improve performance of rounding dates in date_histogram aggregation (…
ketanv3 Sep 8, 2023
8e5e54b
Allow parameterization of tests with OpenSearchIntegTestCase.SuiteSco…
neetikasinghal Sep 8, 2023
caf4c80
[Segment Replication] Support realtime TermVector requests with Segme…
Rishikesh1159 Sep 8, 2023
4e1022e
Add Tracing Instrumentation at Network and Rest layer (#9415)
Gaganjuneja Sep 8, 2023
5ad472f
Remove custom-codecs plugin (#9944)
andrross Sep 8, 2023
5c3d26d
Fix ReadContextListenerTests to avoid inconsistent WindowsFS file han…
kotwanikunal Sep 8, 2023
0a0a42e
Add release notes for 2.10 (#9955)
kotwanikunal Sep 8, 2023
c6fe745
Mute CorrelationCodecTests.testCorrelationVectorIndex (#9956)
andrross Sep 9, 2023
c100c0c
Update single comment for check compatibility (#9954)
andrross Sep 9, 2023
77f0df3
Fixing various javadocs (#9817)
ker2x Sep 10, 2023
1c8d171
Bump peter-evans/create-or-update-comment from 2 to 3 (#9575)
dependabot[bot] Sep 10, 2023
b7dbf46
Bump actions/checkout from 2 to 4 (#9968)
dependabot[bot] Sep 11, 2023
9e7baaa
Addressing comments and adding CHANGELOG
sgup432 Sep 11, 2023
3857542
Merge branch 'main' into CoordinatorStats
sgup432 Sep 11, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
1 change: 1 addition & 0 deletions .ci/bwcVersions
Original file line number Diff line number Diff line change
Expand Up @@ -23,3 +23,4 @@ BWC_VERSION:
- "2.9.0"
- "2.9.1"
- "2.10.0"
- "2.11.0"
2 changes: 1 addition & 1 deletion .github/CODEOWNERS
Validating CODEOWNERS rules …
Original file line number Diff line number Diff line change
@@ -1 +1 @@
* @reta @anasalkouz @andrross @reta @Bukhtawar @CEHENKLE @dblock @gbbafna @setiah @kartg @kotwanikunal @mch2 @nknize @owaiskazi19 @Rishikesh1159 @ryanbogan @saratvemulapalli @shwetathareja @dreamer-89 @tlfeng @VachaShah @dbwiddis @sachinpkale @sohami @msfroh
* @reta @anasalkouz @andrross @Bukhtawar @CEHENKLE @dblock @gbbafna @setiah @kartg @kotwanikunal @mch2 @nknize @owaiskazi19 @peternied @Rishikesh1159 @ryanbogan @saratvemulapalli @shwetathareja @dreamer-89 @tlfeng @VachaShah @dbwiddis @sachinpkale @sohami @msfroh
8 changes: 8 additions & 0 deletions .github/dependabot.yml
Original file line number Diff line number Diff line change
Expand Up @@ -975,6 +975,14 @@ updates:
labels:
- "dependabot"
- "dependencies"
- directory: /plugins/crypto-kms/
open-pull-requests-limit: 1
package-ecosystem: gradle
schedule:
interval: weekly
labels:
- "dependabot"
- "dependencies"
- directory: /qa/
open-pull-requests-limit: 1
package-ecosystem: gradle
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/auto-release.yml
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@ jobs:
- name: Get tag
id: tag
uses: dawidd6/action-get-tag@v1
- uses: actions/checkout@v2
- uses: actions/checkout@v4
- uses: ncipollo/release-action@v1
with:
github_token: ${{ steps.github_app_token.outputs.token }}
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/changelog_verifier.yml
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ jobs:
if: github.repository == 'opensearch-project/OpenSearch'
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v3
- uses: actions/checkout@v4
with:
token: ${{ secrets.GITHUB_TOKEN }}
ref: ${{ github.event.pull_request.head.sha }}
Expand Down
21 changes: 20 additions & 1 deletion .github/workflows/check-compatibility.yml
Original file line number Diff line number Diff line change
Expand Up @@ -11,10 +11,19 @@ jobs:
contents: read
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v3
- uses: actions/checkout@v4
with:
ref: ${{ github.event.pull_request.head.sha }}

- name: Increase swapfile
run: |
sudo swapoff -a
sudo fallocate -l 10G /swapfile
sudo chmod 600 /swapfile
sudo mkswap /swapfile
sudo swapon /swapfile
sudo swapon --show

- name: Run compatibility task
run: ./gradlew checkCompatibility -i | tee $HOME/gradlew-check.out

Expand Down Expand Up @@ -43,8 +52,18 @@ jobs:
with:
name: results.txt

- name: Find Comment
uses: peter-evans/find-comment@v2
id: fc
with:
issue-number: ${{ github.event.number }}
comment-author: 'github-actions[bot]'
body-includes: 'Compatibility status:'

- name: Add comment on the PR
uses: peter-evans/create-or-update-comment@v3
with:
comment-id: ${{ steps.fc.outputs.comment-id }}
issue-number: ${{ github.event.number }}
body-path: results.txt
edit-mode: replace
2 changes: 1 addition & 1 deletion .github/workflows/create-documentation-issue.yml
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,7 @@ jobs:
installation_id: 22958780

- name: Checkout code
uses: actions/checkout@v2
uses: actions/checkout@v4

- name: Edit the issue template
run: |
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/dependabot_pr.yml
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@ jobs:
installation_id: 22958780

- name: Check out code
uses: actions/checkout@v2
uses: actions/checkout@v4
with:
token: ${{ steps.github_app_token.outputs.token }}

Expand Down
10 changes: 5 additions & 5 deletions .github/workflows/gradle-check.yml
Original file line number Diff line number Diff line change
Expand Up @@ -23,7 +23,7 @@ jobs:
timeout-minutes: 130
steps:
- name: Checkout OpenSearch repo
uses: actions/checkout@v3
uses: actions/checkout@v4
with:
ref: ${{ github.event.pull_request.head.sha }}

Expand All @@ -50,7 +50,7 @@ jobs:
echo "pr_number=Null" >> $GITHUB_ENV

- name: Checkout opensearch-build repo
uses: actions/checkout@v3
uses: actions/checkout@v4
with:
repository: opensearch-project/opensearch-build
ref: main
Expand Down Expand Up @@ -78,7 +78,7 @@ jobs:

- name: Create Comment Success
if: ${{ github.event_name == 'pull_request_target' && success() && env.result == 'SUCCESS' }}
uses: peter-evans/create-or-update-comment@v2
uses: peter-evans/create-or-update-comment@v3
with:
issue-number: ${{ env.pr_number }}
body: |
Expand All @@ -104,7 +104,7 @@ jobs:

- name: Create Comment Flaky
if: ${{ github.event_name == 'pull_request_target' && success() && env.result != 'SUCCESS' }}
uses: peter-evans/create-or-update-comment@v2
uses: peter-evans/create-or-update-comment@v3
with:
issue-number: ${{ env.pr_number }}
body: |
Expand All @@ -116,7 +116,7 @@ jobs:

- name: Create Comment Failure
if: ${{ github.event_name == 'pull_request_target' && failure() }}
uses: peter-evans/create-or-update-comment@v2
uses: peter-evans/create-or-update-comment@v3
with:
issue-number: ${{ env.pr_number }}
body: |
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/links.yml
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ jobs:
runs-on: ubuntu-latest

steps:
- uses: actions/checkout@v2
- uses: actions/checkout@v4
- name: lychee Link Checker
id: lychee
uses: lycheeverse/[email protected]
Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/lucene-snapshots.yml
Original file line number Diff line number Diff line change
Expand Up @@ -21,15 +21,15 @@ jobs:
contents: read

steps:
- uses: actions/checkout@v2
- uses: actions/checkout@v4
- name: Set up JDK 17
uses: actions/setup-java@v3
with:
java-version: '17'
distribution: 'adopt'

- name: Checkout Lucene
uses: actions/checkout@v2
uses: actions/checkout@v4
with:
repository: 'apache/lucene'
path: lucene
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/poc-checklist.yml
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@ jobs:
issues: write
steps:
- name: Add comment
uses: peter-evans/create-or-update-comment@v2
uses: peter-evans/create-or-update-comment@v3
with:
issue-number: ${{ github.event.issue.number }}
body: |
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/precommit.yml
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ jobs:
matrix:
os: [ubuntu-latest, windows-latest, macos-latest]
steps:
- uses: actions/checkout@v3
- uses: actions/checkout@v4
- name: Set up JDK 11
uses: actions/setup-java@v3
with:
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/publish-maven-snapshots.yml
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@ jobs:
contents: write

steps:
- uses: actions/checkout@v3
- uses: actions/checkout@v4
- name: Set up JDK 17
uses: actions/setup-java@v3
with:
Expand Down
8 changes: 4 additions & 4 deletions .github/workflows/version.yml
Original file line number Diff line number Diff line change
Expand Up @@ -19,7 +19,7 @@ jobs:
private_key: ${{ secrets.APP_PRIVATE_KEY }}
installation_id: 22958780

- uses: actions/checkout@v2
- uses: actions/checkout@v4
- name: Fetch Tag and Version Information
run: |
TAG=$(echo "${GITHUB_REF#refs/*/}")
Expand All @@ -44,7 +44,7 @@ jobs:
echo "NEXT_VERSION=$NEXT_VERSION" >> $GITHUB_ENV
echo "NEXT_VERSION_UNDERSCORE=$NEXT_VERSION_UNDERSCORE" >> $GITHUB_ENV
echo "NEXT_VERSION_ID=$NEXT_VERSION_ID" >> $GITHUB_ENV
- uses: actions/checkout@v2
- uses: actions/checkout@v4
with:
ref: ${{ env.BASE }}
token: ${{ steps.github_app_token.outputs.token }}
Expand Down Expand Up @@ -73,7 +73,7 @@ jobs:
body: |
I've noticed that a new tag ${{ env.TAG }} was pushed, and incremented the version from ${{ env.CURRENT_VERSION }} to ${{ env.NEXT_VERSION }}.

- uses: actions/checkout@v2
- uses: actions/checkout@v4
with:
ref: ${{ env.BASE_X }}
token: ${{ steps.github_app_token.outputs.token }}
Expand All @@ -100,7 +100,7 @@ jobs:
body: |
I've noticed that a new tag ${{ env.TAG }} was pushed, and added a bwc version ${{ env.NEXT_VERSION }}.

- uses: actions/checkout@v2
- uses: actions/checkout@v4
with:
ref: main
token: ${{ steps.github_app_token.outputs.token }}
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/wrapper.yml
Original file line number Diff line number Diff line change
Expand Up @@ -7,5 +7,5 @@ jobs:
if: github.repository == 'opensearch-project/OpenSearch'
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v2
- uses: actions/checkout@v4
- uses: gradle/wrapper-validation-action@v1
Loading
Loading