…store from remote state (opensearch-project#10665)

* Restore remote index shards with ExistingStoreRecoverySource after restore from remote state

Signed-off-by: bansvaru <[email protected]>

Signed-off-by: Dhwanil Patel <[email protected]>

Signed-off-by: Dhwanil Patel <[email protected]>

)

* Add tracing instrumentation for indexing paths

Signed-off-by: Shreyansh Ray <[email protected]>

* Fix failing tests and review changes

Signed-off-by: Shreyansh Ray <[email protected]>

* Fix test failures due to Span not being properly closed

Signed-off-by: Shreyansh Ray <[email protected]>

* Changes to spans in primary and replica actions

Signed-off-by: Shreyansh Ray <[email protected]>

* Review comments fixes and refactoring

Signed-off-by: Shreyansh Ray <[email protected]>

* Precommit auto-changes

Signed-off-by: Shreyansh Ray <[email protected]>

* Add refresh policy as attribute

Signed-off-by: Shreyansh Ray <[email protected]>

* Fix changelog entry

Signed-off-by: Shreyansh Ray <[email protected]>

* Instrument primary/replica write in TransportWriteAction instead of TransportShardBulkAction

Signed-off-by: Shreyansh Ray <[email protected]>

* Modify SpanBuilder

Signed-off-by: Shreyansh Ray <[email protected]>

* spotlessApply and precommit

Signed-off-by: Shreyansh Ray <[email protected]>

* Change span names

Signed-off-by: Shreyansh Ray <[email protected]>

* Pass Noop Tracer instead of injected tracer

Signed-off-by: Shreyansh Ray <[email protected]>

* Reverting previous changes

Signed-off-by: Shreyansh Ray <[email protected]>

* Remove tracer variable from TransportShardBulkAction

Signed-off-by: Shreyansh Ray <[email protected]>

---------

Signed-off-by: Shreyansh Ray <[email protected]>

opensearch-project#10761)

* [Remote Store] Fix relocation failure due to transport receive timeout

Signed-off-by: Ashish Singh <[email protected]>

* Fix existing extended shardIdle for remote backed shards

Signed-off-by: Ashish Singh <[email protected]>

* Incorporate PR review comments

Signed-off-by: Ashish Singh <[email protected]>

---------

Signed-off-by: Ashish Singh <[email protected]>

…ling checks (opensearch-project#10751)

* Update Github pull request template to have a task for inspecting failing checks

Signed-off-by: Andriy Redko <[email protected]>

* Add failing builds troubleshooting section to CONTRIBUTING.md

Signed-off-by: Andriy Redko <[email protected]>

* Address review comments

Signed-off-by: Andriy Redko <[email protected]>

---------

Signed-off-by: Andriy Redko <[email protected]>

The remote recovery thread pool does blocking I/O when downloading
files, so the "half processor count max 10" was definitely too small.
This can be shown by triggering recoveries on a node that is also doing
segment replication, and the replication lag will increase due to
contention on that thread pool. Some amount of contention is inevitable,
but the change here to increase the download thread pool, and also limit
the concurrent usage of that thread pool by any single
recovery/replication to 25% of the threads does help.

Long term, we can improve this even further by moving to fully async I/O
to avoid blocking threads in the application on draining InputStreams.

Signed-off-by: Andrew Ross <[email protected]>

…into account for replication lag (opensearch-project#10723)

* Return unformatted segrep metrics in stats

Signed-off-by: Poojita Raj <[email protected]>

* Take upload time into account for replication time lag

Signed-off-by: Poojita Raj <[email protected]>

* unformat segrep stats

Signed-off-by: Poojita Raj <[email protected]>

* remove unused field names

Signed-off-by: Poojita Raj <[email protected]>

---------

Signed-off-by: Poojita Raj <[email protected]>

…estPrimaryRelocation (opensearch-project#10701)

* Add primary mode check before assserting on primary mode.

Signed-off-by: Rishikesh1159 <[email protected]>

* remove unnecessary shardRouting check.

Signed-off-by: Rishikesh1159 <[email protected]>

* Add test logging.

Signed-off-by: Rishikesh1159 <[email protected]>

* Addressing comments on PR.

Signed-off-by: Rishikesh1159 <[email protected]>

---------

Signed-off-by: Rishikesh1159 <[email protected]>

…stats to _nodes/stats (opensearch-project#10656)

* Initial WIP for adding segrep backpressure to node stats.

Signed-off-by: Rishikesh1159 <[email protected]>

* Bind SegmentReplicarionStatsTracker in Node.java

Signed-off-by: Rishikesh1159 <[email protected]>

* remove additional segrep backpressure info from node stats

Signed-off-by: Rishikesh1159 <[email protected]>

* fix metric name in node stats

Signed-off-by: Rishikesh1159 <[email protected]>

* Fix compile error.

Signed-off-by: Rishikesh1159 <[email protected]>

* Fix compile errors.

Signed-off-by: Rishikesh1159 <[email protected]>

* Address comments on PR.

Signed-off-by: Rishikesh1159 <[email protected]>

* Update java docs.

Signed-off-by: Rishikesh1159 <[email protected]>

* Address comments on PR and fix compile errors.

Signed-off-by: Rishikesh1159 <[email protected]>

* Address comments on PR.

Signed-off-by: Rishikesh1159 <[email protected]>

* Update unit test.

Signed-off-by: Rishikesh1159 <[email protected]>

---------

Signed-off-by: Rishikesh1159 <[email protected]>
Signed-off-by: Rishikesh Pasham <[email protected]>

…rvice for RateLimiting (opensearch-project#9286)

* Changes for AdmissionControl Interceptor and AdmissionControlService for RateLimiting (opensearch-project#9286)

Signed-off-by: Ajay Kumar Movva <[email protected]>

…or refresh lag (opensearch-project#10803)

* [Remote Store] Use time elapsed since last successful local refresh for time lag

Signed-off-by: Ashish Singh <[email protected]>

* Incorporate PR review comments

Signed-off-by: Ashish Singh <[email protected]>

---------

Signed-off-by: Ashish Singh <[email protected]>

…Stats

Signed-off-by: Ajay Kumar Movva <[email protected]>