Skip to content

Commit

Permalink
Merge pull request #55 from alexandrainst/hotfix/size-of-empty-files
Browse files Browse the repository at this point in the history
fix: size of empty files
  • Loading branch information
AJDERS authored Dec 12, 2023
2 parents 2516f32 + df22a60 commit bb0d073
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion src/coral_models/prepare_raw_data.py
Original file line number Diff line number Diff line change
Expand Up @@ -350,7 +350,7 @@ def prepare_raw_data(

# Check if the file is empty, and if it is, remove it from the dataframe
# and continue to the next file
if filename.stat().st_size < 200000: # Any file smaller than this is empty
if filename.stat().st_size < 10000: # Any file smaller than this is empty
rows_to_remove.append(row_i)
continue

Expand Down

0 comments on commit bb0d073

Please sign in to comment.