cant' run spark-operator pipelines

[s-elh]

What happened?

when testing a pipeline from the Github https://github.com/sbakiu/kubeflow-spark, we get errors

Reproduction Code

create pipeline using the yaml from the repo, create run and wait.

Expected behavior

no errors

Actual behavior

time="2025-01-23T16:47:49.824Z" level=info msg="capturing logs" argo=true

• object_path=/tmp/inputs/Object/data
• output_name_path=/tmp/outputs/Name/data
• output_kind_path=/tmp/outputs/Kind/data
• output_object_path=/tmp/outputs/Object/data
  ++ dirname /tmp/outputs/Name/data
• mkdir -p /tmp/outputs/Name
  ++ dirname /tmp/outputs/Kind/data
• mkdir -p /tmp/outputs/Kind
  ++ dirname /tmp/outputs/Object/data
• mkdir -p /tmp/outputs/Object
• kubectl apply -f /tmp/inputs/Object/data --output=json
  Error from server (Forbidden): error when retrieving current configuration of:
  Resource: "sparkoperator.k8s.io/v1beta2, Resource=sparkapplications", GroupVersionKind: "sparkoperator.k8s.io/v1beta2, Kind=SparkApplication"
  Name: "pyspark-pi-1736774458", Namespace: "kubeflow"
  Object: &{map["apiVersion":"sparkoperator.k8s.io/v1beta2" "kind":"SparkApplication" "metadata":map["annotations":map["kubectl.kubernetes.io/last-applied-configuration":""] "name":"pyspark-pi-1736774458" "namespace":"kubeflow"] "spec":map["driver":map["coreLimit":"1200m" "cores":'\x01' "labels":map["version":"3.1.3"] "memory":"512m" "serviceAccount":"spark-operator-webhook-svc"] "executor":map["cores":'\x01' "instances":'\x01' "labels":map["version":"3.1.3"] "memory":"512m"] "image":"10.96.2.101:443/amoudni/apache/spark-py:v3.1.3" "imagePullPolicy":"Always" "mainApplicationFile":"local:///opt/spark/examples/src/main/python/pi.py" "mode":"cluster" "pythonVersion":"3" "restartPolicy":map["onFailureRetries":'\x03' "onFailureRetryInterval":'\n' "onSubmissionFailureRetries":'\x05' "onSubmissionFailureRetryInterval":'\x14' "type":"OnFailure"] "sparkVersion":"3.1.3" "type":"Python"]]}
  from server for: "/tmp/inputs/Object/data": sparkapplications.sparkoperator.k8s.io "pyspark-pi-1736774458" is forbidden: User "system:serviceaccount:lhimer:default-editor" cannot get resource "sparkapplications" in API group "sparkoperator.k8s.io" in the namespace "kubeflow"
  time="2025-01-23T16:47:50.379Z" level=error msg="cannot save parameter /tmp/outputs/Name/data" argo=true error="open /tmp/outputs/Name/data: no such file or directory"
  time="2025-01-23T16:47:50.379Z" level=error msg="cannot save artifact /tmp/outputs/Kind/data" argo=true error="stat /tmp/outputs/Kind/data: no such file or directory"
  time="2025-01-23T16:47:50.379Z" level=error msg="cannot save artifact /tmp/outputs/Name/data" argo=true error="stat /tmp/outputs/Name/data: no such file or directory"
  time="2025-01-23T16:47:50.379Z" level=info msg="/tmp/outputs/Object/data -> /var/run/argo/outputs/artifacts/tmp/outputs/Object/data.tgz" argo=true
  time="2025-01-23T16:47:50.380Z" level=info msg="Taring /tmp/outputs/Object/data"
  Error: exit status 1

Environment & Versions

Additional context

Impacted by this bug?

Give it a 👍 We prioritize the issues with most 👍