spark-submit operator dag issue with standalone server #13280
Unanswered
Karthik-PlantSense
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
hi everyone,
i want to submit my python code through spark submit operator. but the dag got import error.
it is saying
Broken DAG: [/home/chaithanya/karthik/airflow/dags/sparkDag.py] Traceback (most recent call last): File "/home/chaithanya/karthik/airflow/lib64/python3.6/site-packages/airflow/providers/apache/spark/hooks/spark_submit.py", line 32, in <module> from airflow.kubernetes import kube_client File "/home/chaithanya/karthik/airflow/lib64/python3.6/site-packages/airflow/kubernetes/kube_client.py", line 101, in <module> ) -> client.CoreV1Api: NameError: name 'client' is not defined
anyone help me to submit my python file.
and also the connection for spark is
Beta Was this translation helpful? Give feedback.
All reactions