Recover after errors opening one of WARC files in a batch

[nvanva]

We have two broken metadata.zst files, zstdcat returns "Read error (39) : premature end ".
Logs for processing these are on NIRD:
two/log_html/archivebot_partial_logs/114.stderr
two/log_html/archivebot_partial_logs/97.stderr

Both end with "file opening failed, skipping this WARC". Seems that after problems with opening one WARC from a batch warc2text doesn't continue with the rest files, and also doesn't close the output zst files correctly.

Would be nice to debug what happens if one of the files in a batch cannot be open or there are other processing errors.

[ZJaume]

Could you copy the problematic warcs to LUMI? I do not have acces to NIRD