Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[hotfix-#1745][connector][hdfs][hive] Data loss occurs when multiple tasks write to the same hdfs (or hive) data source #1840

Closed
wants to merge 1 commit into from

Conversation

david-gao1
Copy link
Contributor

…tasks write to the same hdfs (or hive) data source

Purpose of this pull request

Which issue you fix

Fixes # (issue).

Checklist:

  • I have executed the 'mvn spotless:apply' command to format my code.
  • I have a meaningful commit message (including the issue id, the template of commit message is '[label-type-#issue-id][fixed-module] a meaningful commit message.')
  • I have performed a self-review of my own code.
  • I have commented my code, particularly in hard-to-understand areas.
  • I have made corresponding changes to the documentation.
  • I have added tests that prove my fix is effective or that my feature works.
  • New and existing unit tests pass locally with my changes.
  • I have checked my code and corrected any misspellings.
  • My commit is only one. (If there are multiple commits, you can use 'git squash' to compress multiple commits into one.)

…ltiple tasks write to the same hdfs (or hive) data source
@david-gao1
Copy link
Contributor Author

相关讨论:
#1745

@david-gao1
Copy link
Contributor Author

相关讨论:#1769

@david-gao1 david-gao1 closed this Nov 1, 2023
@ll076110
Copy link
Contributor

ll076110 commented Nov 1, 2023

当多个任务同时写同一个目录时,其他任务会删掉正在写的临时目录,最终也会报错

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants