[tempo-distributed] Problem with updating to version chart 1.30.0

[ymrsmns]

Hi

I get an error when updating a chart from version 1.28.0 to version 1.30.0. Variables are specified only for s3 and ingress. What could be the problem?

watch

kg po -w
NAME                                   READY   STATUS    RESTARTS      AGE
tempo-compactor-869d894fdc-f5bcc       1/1     Running   0             5m18s
tempo-distributor-84664845b8-pnxmh     1/1     Running   0             5m18s
tempo-ingester-0                       1/1     Running   0             3m5s
tempo-ingester-1                       1/1     Running   0             4m8s
tempo-ingester-2                       1/1     Running   0             5m12s
tempo-querier-6f75d4cf-64rxb           1/1     Running   0             5m16s
tempo-query-frontend-f7cb66c48-4g2pq  1/2     Error     3 (33s ago)   52s
tempo-query-frontend-f7cb66c48-4g2pq   1/2     CrashLoopBackOff   3 (12s ago)   58s
tempo-query-frontend-f7cb66c48-4g2pq  1/2     Error              4 (42s ago)   88s
tempo-query-frontend-f7cb66c48-4g2pq   1/2     CrashLoopBackOff   4 (14s ago)   101s
...

log

klo tempo-query-frontend-f7cb66c48-4g2pq -c tempo-query
flag provided but not defined: -query.base-path
Usage of /tempo-query:
  -config string
    	A path to the plugin's configuration file

describe

kdpo tempo-query-frontend-f7cb66c48-4g2pq
Name:             tempo-query-frontend-f7cb66c48-4g2pq
Namespace:        tempo
Priority:         0
Service Account:  tempo
Node:             cl1hsoq4an2cftpcvssj-odef/10.0.35.8
Start Time:       Thu, 16 Jan 2025 13:05:22 +0300
Labels:           app.kubernetes.io/component=query-frontend
                  app.kubernetes.io/instance=tempo
                  app.kubernetes.io/managed-by=Helm
                  app.kubernetes.io/name=tempo
                  app.kubernetes.io/version=2.7.0
                  helm.sh/chart=tempo-distributed-1.30.0
                  pod-template-hash=f7cb66c48
Annotations:      checksum/config: a03adfd4d9c5c3409682b02d11ff29ad35823d3aaec4e3049701d4e54e5a9986
Status:           Running
IP:               10.50.165.62
IPs:
  IP:           10.50.165.62
Controlled By:  ReplicaSet/tempo-query-frontend-f7cb66c48
Containers:
  query-frontend:
    Container ID:  containerd://e7676e79f09da16030679fbd326b5f48e0ff7bd36716f55b41d8450c07859b5b
    Image:         docker.io/grafana/tempo:2.7.0
    Image ID:      docker.io/grafana/tempo@sha256:12e904cc509a8e0bd87815e0bc719b6167933bc3f2532716a85811af967780f6
    Ports:         3100/TCP, 9095/TCP
    Host Ports:    0/TCP, 0/TCP
    Args:
      -target=query-frontend
      -config.file=/conf/tempo.yaml
      -mem-ballast-size-mbs=1024
    State:          Running
      Started:      Thu, 16 Jan 2025 13:05:22 +0300
    Ready:          True
    Restart Count:  0
    Environment:    <none>
    Mounts:
      /conf from config (rw)
      /runtime-config from runtime-config (rw)
      /var/tempo from tempo-queryfrontend-store (rw)
  tempo-query:
    Container ID:  containerd://b432e730d1a0ce9c0f4b5ee7d6a8b79978808183971c8f711fad1f4fbf64447f
    Image:         docker.io/grafana/tempo-query:2.7.0
    Image ID:      docker.io/grafana/tempo-query@sha256:f0b12722ab2a81badb225d40f87bd1ad54b8f69aeaa74304c5127be423ac8637
    Ports:         3100/TCP, 16687/TCP
    Host Ports:    0/TCP, 0/TCP
    Args:
      --query.base-path=/
      --grpc-storage-plugin.configuration-file=/conf/tempo-query.yaml
      --query.bearer-token-propagation=true
    State:          Waiting
      Reason:       CrashLoopBackOff
    Last State:     Terminated
      Reason:       Error
      Exit Code:    2
      Started:      Thu, 16 Jan 2025 13:11:00 +0300
      Finished:     Thu, 16 Jan 2025 13:11:00 +0300
    Ready:          False
    Restart Count:  6
    Environment:    <none>
    Mounts:
      /conf from config (rw)
      /tmp from jaeger-query-store (rw)
Conditions:
  Type              Status
  Initialized       True
  Ready             False
  ContainersReady   False
  PodScheduled      True
Volumes:
  config:
    Type:      ConfigMap (a volume populated by a ConfigMap)
    Name:      tempo-config
    Optional:  false
  runtime-config:
    Type:      ConfigMap (a volume populated by a ConfigMap)
    Name:      tempo-runtime
    Optional:  false
  tempo-queryfrontend-store:
    Type:       EmptyDir (a temporary directory that shares a pod's lifetime)
    Medium:
    SizeLimit:  <unset>
  jaeger-query-store:
    Type:                     EmptyDir (a temporary directory that shares a pod's lifetime)
    Medium:
    SizeLimit:                32Mi
QoS Class:                    BestEffort
Node-Selectors:               tempo=true

[tcpecheanu]

This also happens to us, I suppose the issue is with the args here:

helm-charts/charts/tempo-distributed/templates/query-frontend/deployment-query-frontend.yaml

Line 110 in 5b3b469

- --query.base-path=/