Optimal way of deleting huge numbers of files

find /path/to/dir/ -type f -exec rm {} +

By: cfajohnson

2009-12-10 04:44:44

find rm

4 Alternatives + Submit Alt

Optimal way of deleting huge numbers of files

Using xargs is better than: find /path/to/dir -type f -exec rm \-f {} \; as the -exec switch uses a separate process for each remove. xargs splits the streamed files into more managable subsets so less processes are required.
This is sample output - yours may be different.
12

find /path/to/dir -type f -print0 | xargs -0 rm

root · 2009-01-26 11:30:47 47
Optimal way of deleting huge numbers of files

Optimal way of deleting huge numbers of files Using -delete is faster than: find /path/to/dir -type f -print0 | xargs -0 rm find /path/to/dir -type f -exec rm {} + find /path/to/dir -type f -exec rm \-f {} \;
This is sample output - yours may be different.
11

find /path/to/dir -type f -delete

SlimG · 2009-12-09 01:30:52 8
Optimal way of deleting huge numbers of files

This command works by rsyncing the target directory (containing the files you want to delete) with an empty directory. The '--delete' switch instructs rsync to remove files that are not present in the source directory. Since there are no files there, all the files will be deleted. I'm not clear on why it's faster than 'find -delete', but it is. Benchmarks here: https://web.archive.org/web/20130929001850/http://linuxnote.net/jianingy/en/linux/a-fast-way-to-remove-huge-number-of-files.html
This is sample output - yours may be different.
11

rsync -a --delete empty-dir/ target-dir/

malathion · 2016-06-07 16:56:55 11
Optimal way of deleting huge numbers of files

cd $target_dir then run the command for fast removal of millions of files
This is sample output - yours may be different.
0

perl -e 'for(<*>){((stat)[9]<(unlink))}'

neocruiser · 2016-07-14 04:05:53 13

What Others Think

So what's the difference between -exec rm {} + and -exec rm {} \;

Rudolf · 460 weeks and 1 day ago

rahimhh21 · 56 weeks and 1 day ago

Perfecthomepugs · 47 weeks and 5 days ago

Many students face similar challenges when it comes to research paper writing. The good news is that there are resources available to help you navigate this process. Your school's writing center is a great place to start, but I know that many students are somehow afraid to reach out to their teachers. Fortunately, you can follow my recommendation and trust seasoned research paper writers. Not each service is worth using, but BestCustomWriting is worth giving a try. Even if you had a negative experience with similar service in the past, place an order here!

vorcy · 20 weeks and 2 days ago

Thanks for picking out the time to discuss this, I feel great about it and love studying more on this topic. It is extremely helpful for me. Thanks for such a valuable help again. embossing folder

mohsinkhatri · 12 weeks and 5 days ago

pugpuppies95 · 9 weeks and 6 days ago

I am very much pleased with the contents you have mentioned. I wanted to thank you for this great article. slot gacor

mohsinkhatri · 7 weeks and 5 days ago

Thanks for taking the time to discuss this, I feel strongly about it and love learning more on this topic. If possible, as you gain expertise, would you mind updating your blog with extra information? It is extremely helpful for me. square watch

mohsinkhatri · 4 weeks and 3 days ago

Took me time to read all the comments, but I really enjoyed the article. It proved to be Very helpful to me and I am sure to all the commenters here! It’s always nice when you can not only be informed, but also entertained! ielts mock test

mohsinkhatri · 2 weeks and 4 days ago

I definitely enjoying every little bit of it. It is a great website and nice share. I want to thank you. Good job! You guys do a great blog, and have some great contents. Keep up the good work. Terrahills

mohsinkhatri · 2 weeks ago

Wow i can say that this is another great article as expected of this blog.Bookmarked this site.. https://start.me/p/yda4B2

mohsinkhatri · 5 days ago

What do you think?

Any thoughts on this command? Does it work on your machine? Can you do the same thing with only 14 characters?

You must be signed in to comment.

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Similar Commands

Delete huge numbers of files without intensive cpu load

Sequential revision numbers in Git

Precide a bunch of files with a number in a pattern for example to indisperse a podcast backlock with more recent podcasts

Deleting Files from svn which are missing

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)