Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FEA] [AUDIT 4.0] Custom file extensions for CSV write #12089

Closed
mythrocks opened this issue Feb 8, 2025 · 1 comment
Closed

[FEA] [AUDIT 4.0] Custom file extensions for CSV write #12089

mythrocks opened this issue Feb 8, 2025 · 1 comment
Labels
feature request New feature or request

Comments

@mythrocks
Copy link
Collaborator

SPARK-50516 allows Spark 4.0 users to specify custom file extensions for CSV write.

It would be good for spark-rapids to allow for custom file extension in CSV writes, if set in CsvOptions.
@mythrocks mythrocks added ? - Needs Triage Need team to review and classify feature request New feature or request labels Feb 8, 2025
@revans2
Copy link
Collaborator

revans2 commented Feb 11, 2025

We don't support CSV writes yet. We do support the HIVE text file format, that is similar. I don't think that this applies to the HIVE text file format though.

@mattahrens mattahrens removed the ? - Needs Triage Need team to review and classify label Feb 11, 2025
@mattahrens mattahrens closed this as not planned Won't fix, can't repro, duplicate, stale Feb 11, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
feature request New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@revans2 @mattahrens @mythrocks