[Issue] Parquet file not closed when new parquet file being created.

[hash-data]

Description

When a new Parquet writer is created, the previous Parquet file is not closed. This can lead to potential errors if there are open files that are not actively being written.

Impact

• Unclosed files may lead to resource exhaustion.
• Errors can occur when switching between different Parquet files or partitions.
• Potential data corruption or loss if files remain open unexpectedly.

Expected Behavior

• When a new Parquet writer is created, the previous one should be properly closed before switching.
• Inactive Parquet files should not cause errors if they are not actively being written.

Possible Solution

• Ensure that before creating a new writer, the existing one is explicitly closed.