8.18 test plan

[endorama]

Manual Test Plan

List of changes: v8.18.0...v8.17.1 (v8.18.0 tag is yet to be created)

When picking up a test case, please add your name to this overview beforehand and tick the checkbox when finished.
Testing can be started when the first build candidate (BC) is available in the CFT region.

Smoke Testing ESS setup

Thanks to #8303 further smoke tests are run automatically on ESS now.
Consider extending the smoke tests to include more test cases which we'd like to cover

go-docappender library

Upgraded to 2.4.0, which includes:

• Add per event pipeline go-docappender#227

apm-data library

No relevant changes.

Test cases from the GitHub board

apm-server 8.18.0 test-plan

Add yourself as assignee on the PR before you start testing.

Tasks

Preview Give feedback

1. TBS: log a warning with error field on processing trace failed #15492
   backport-8.18 backport-8.x backport-9.0 test-plan v8.18.0 +5
   
2. Fix clearscroll request fmt string #15416
   backport-8.x test-plan v8.18.0 +3
3. feat: start hiding beats monitoring behind otel abstraction  #15360
4. feat: add fleet agent cfg deprecation notice #15260
   test-plan test-plan-ok v8.18.0 +3
   
5. TBS: Add sampling.tail.discard_on_write_failure config #15159
   backport-8.16 backport-8.17 backport-8.x test-plan v8.18.0 +5
   
6. fix: bump memlimit check to 30s interval #14939
   backport-skip test-plan test-plan-ok v8.18.0 +4
   
7. feat: auto set GOMEMLIMIT when memory is limited #14882
   backport-skip test-plan test-plan-ok v8.18.0 +4
   

Regressions

[inge4pres]

#14882 and #14939 are tested and working fine

[endorama]

#15260 includes an automatic test case, skipping manual test

[endorama]

#15177 is a minor refactor without any functional changes, I removed it from 8.18 test plan

[endorama]

#15212 includes a non functional change: apm-data has been updated to allow specifying a custom hash function but in 8.x we want to retain using crypto/md5. I removed it from 8.18 test plan.

@inge4pres I suspect this introduced some different changes in 9.x that we need to review.

[endorama]

go-docappender elastic/go-docappender#227 has automatic test cases, skipping manual testing

[endorama]

#15360 has been confirmed by @kruskall that will target 8.19 and I confirmed backports have been merged after feature freeze so should not be tested for 8.18.

[1pkg]

#15492 and #15159 were validated against 8.18 using a local APM Server binary with the following TBS config:

  sampling.tail:
    enabled: true
    interval: 1m
    policies:
      - sample_rate: .01
    storage_limit: 1B
    discard_on_write_failure: false/true

The indexing worked as expected and the following logs were observed:

Negative case{"log.level":"warn","@timestamp":"2025-02-11T15:24:49.511-0800","log.logger":"sampling","log.origin":{"function":"github.com/elastic/apm-server/x-pack/apm-server/sampling.(*Processor).ProcessBatch","file.name":"sampling/processor.go","file.line":152},"message":"processing trace failed, discarding by default","service.name":"apm-server","error":{"message":"configured storage limit reached (current: 510, limit: 1)"},"ecs.version":"1.6.0"}

Positive case {"log.level":"warn","@timestamp":"2025-02-11T15:25:44.620-0800","log.logger":"sampling","log.origin":{"function":"github.com/elastic/apm-server/x-pack/apm-server/sampling.(*Processor).ProcessBatch","file.name":"sampling/processor.go","file.line":155},"message":"processing trace failed, indexing by default","service.name":"apm-server","error":{"message":"configured storage limit reached (current: 530, limit: 1)"},"ecs.version":"1.6.0"}