Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix Migration #4560

Closed
wants to merge 5 commits into from
Closed

Fix Migration #4560

wants to merge 5 commits into from

Conversation

AndrewJGaut
Copy link
Contributor

It now appears to work on Prod.

Fixes issue we were saying that gave the following stack trace:

Exception in thread Thread-140:
Traceback (most recent call last):
  File "/opt/conda/lib/python3.7/threading.py", line 917, in _bootstrap_inner
    self.run()
  File "/opt/conda/lib/python3.7/threading.py", line 865, in run
    self._target(*self._args, **self._kwargs)
  File "/opt/codalab-worksheets/codalab/lib/upload_manager.py", line 308, in create_index
    indexFilePath=tmp_index_file.name,
  File "/opt/codalab-worksheets/codalab/lib/beam/SQLiteIndexedTar.py", line 273, in __init__
    self._createIndex(self.tarFileObject)
  File "/opt/codalab-worksheets/codalab/lib/beam/SQLiteIndexedTar.py", line 619, in _createIndex
    for tarInfo in loadedTarFile:
  File "/opt/conda/lib/python3.7/tarfile.py", line 2403, in __iter__
    tarinfo = self.next()
  File "/opt/conda/lib/python3.7/tarfile.py", line 2279, in next
    self.fileobj.seek(self.offset - 1)
  File "/opt/conda/lib/python3.7/tarfile.py", line 517, in seek
    self.read(self.bufsize)
  File "/opt/conda/lib/python3.7/tarfile.py", line 537, in read
    buf = self._read(size)
  File "/opt/conda/lib/python3.7/tarfile.py", line 545, in _read
    return self.__read(size)
  File "/opt/conda/lib/python3.7/tarfile.py", line 568, in __read
    buf = self.fileobj.read(self.bufsize)
  File "indexed_gzip/indexed_gzip.pyx", line 797, in indexed_gzip.indexed_gzip._IndexedGzipFile.readinto
indexed_gzip.indexed_gzip.ZranError: zran_read returned error: ZRAN_READ_FAIL (file: n/a)

Looks like it was due to some issue with our tar_gzip code.

Copy link
Member

@epicfaace epicfaace left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Let's fix format

@AndrewJGaut AndrewJGaut marked this pull request as draft November 10, 2023 02:08
@epicfaace epicfaace closed this Nov 15, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants