You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I'm running a fairly complicated pipeline but it works surprisingly well.
( this dag calls this dag which calls this dag )
However, sometimes, I encounter this error below on the DAG. All the tasks, however, complete just fine.
Any idea what this may come from? Have you seen this before? Any tips on debugging? I will also keep searching myself but I thought I'd flag this.
Traceback (most recent call last):
File "/home/xf11bm/miniconda3/envs/lightflow-pipeline/lib/python3.6/site-packages/kombu/serialization.py", line 50, in _reraise_errors
yield
File "/home/xf11bm/miniconda3/envs/lightflow-pipeline/lib/python3.6/site-packages/kombu/serialization.py", line 263, in loads
return decode(data)
File "/home/xf11bm/projects/lightflow/lightflow/queue/pickle.py", line 15, in cloudpickle_loads
return load(BytesIO(s))
AttributeError: type object 'int64' has no attribute '__index__'
The text was updated successfully, but these errors were encountered:
Just to add, when I re-run this exact pipeline, it seems to be the same dataset. I will try to use the remote debugger a little bit when i have time. Will have to binary search...
I'm running a fairly complicated pipeline but it works surprisingly well.
( this dag calls this dag which calls this dag )
However, sometimes, I encounter this error below on the DAG. All the tasks, however, complete just fine.
Any idea what this may come from? Have you seen this before? Any tips on debugging? I will also keep searching myself but I thought I'd flag this.
The text was updated successfully, but these errors were encountered: