Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Howto: Batch deleting found duplicate files #94

Open
schorfi opened this issue Aug 6, 2022 · 2 comments
Open

Howto: Batch deleting found duplicate files #94

schorfi opened this issue Aug 6, 2022 · 2 comments

Comments

@schorfi
Copy link

schorfi commented Aug 6, 2022

Hello,
I am facing a huge amount of duplicates due to some redundant upload of files from users after the files got sorted and archived.
The UI of the duplicate finder app is providing only limited progress (just 40 files, one click one action) - esp if facing potential 20k of duplicated files.

So, I was asking myself whether it is possible to delete found duplicates based on a rule (e.g. path prefix to delete preferred on upload directories). This could be in the UI or in the command line. For the latter how could this be done or how can I get the output for all found files which I could process in a batch/shell/python script for automated deletion.

Is there an existing way to do that?

@MarkoPaasila
Copy link

Sync to a big enough ssd, then run rmlint.

@ashish-khokhar
Copy link

@MarkoPaasila Yes that's one of the options, However, we need this feature in this plugin, so I think your suggestion is out of context.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants