Optimal way of deleting huge numbers of files

find /path/to/dir/ -type f -exec rm {} +

By: cfajohnson

2009-12-10 04:44:44

find rm

4 Alternatives + Submit Alt

Optimal way of deleting huge numbers of files

Using xargs is better than: find /path/to/dir -type f -exec rm \-f {} \; as the -exec switch uses a separate process for each remove. xargs splits the streamed files into more managable subsets so less processes are required.
This is sample output - yours may be different.
12

find /path/to/dir -type f -print0 | xargs -0 rm

root · 2009-01-26 11:30:47 62
Optimal way of deleting huge numbers of files

Optimal way of deleting huge numbers of files Using -delete is faster than: find /path/to/dir -type f -print0 | xargs -0 rm find /path/to/dir -type f -exec rm {} + find /path/to/dir -type f -exec rm \-f {} \;
This is sample output - yours may be different.
11

find /path/to/dir -type f -delete

SlimG · 2009-12-09 01:30:52 13
Optimal way of deleting huge numbers of files

This command works by rsyncing the target directory (containing the files you want to delete) with an empty directory. The '--delete' switch instructs rsync to remove files that are not present in the source directory. Since there are no files there, all the files will be deleted. I'm not clear on why it's faster than 'find -delete', but it is. Benchmarks here: https://web.archive.org/web/20130929001850/http://linuxnote.net/jianingy/en/linux/a-fast-way-to-remove-huge-number-of-files.html
This is sample output - yours may be different.
11

rsync -a --delete empty-dir/ target-dir/

malathion · 2016-06-07 16:56:55 18
Optimal way of deleting huge numbers of files

cd $target_dir then run the command for fast removal of millions of files
This is sample output - yours may be different.
0

perl -e 'for(<*>){((stat)[9]<(unlink))}'

neocruiser · 2016-07-14 04:05:53 13

What Others Think

So what's the difference between -exec rm {} + and -exec rm {} \;

Rudolf · 490 weeks ago

rahimhh21 · 86 weeks ago

Perfecthomepugs · 77 weeks and 4 days ago

Many students face similar challenges when it comes to research paper writing. The good news is that there are resources available to help you navigate this process. Your school's writing center is a great place to start, but I know that many students are somehow afraid to reach out to their teachers. Fortunately, you can follow my recommendation and trust seasoned research paper writers. Not each service is worth using, but BestCustomWriting is worth giving a try. Even if you had a negative experience with similar service in the past, place an order here!

vorcy · 50 weeks and 1 day ago

Thanks for picking out the time to discuss this, I feel great about it and love studying more on this topic. It is extremely helpful for me. Thanks for such a valuable help again. embossing folder

mohsinkhatri · 42 weeks and 5 days ago

pugpuppies95 · 39 weeks and 5 days ago

I am very much pleased with the contents you have mentioned. I wanted to thank you for this great article. slot gacor

mohsinkhatri · 37 weeks and 4 days ago

Thanks for taking the time to discuss this, I feel strongly about it and love learning more on this topic. If possible, as you gain expertise, would you mind updating your blog with extra information? It is extremely helpful for me. square watch

mohsinkhatri · 34 weeks and 2 days ago

Took me time to read all the comments, but I really enjoyed the article. It proved to be Very helpful to me and I am sure to all the commenters here! It’s always nice when you can not only be informed, but also entertained! ielts mock test

mohsinkhatri · 32 weeks and 3 days ago

I definitely enjoying every little bit of it. It is a great website and nice share. I want to thank you. Good job! You guys do a great blog, and have some great contents. Keep up the good work. Terrahills

mohsinkhatri · 31 weeks and 6 days ago

Wow i can say that this is another great article as expected of this blog.Bookmarked this site.. https://start.me/p/yda4B2

mohsinkhatri · 30 weeks and 4 days ago

I wanted to thank you for this excellent read!! I definitely loved every little bit of it. I have you bookmarked your site to check out the new stuff you post. libid gel funciona mesmo ou é mito

mohsinkhatri · 25 weeks and 6 days ago

Your website is really cool and this is a great inspiring article. Affluence services dubai

mohsinkhatri · 24 weeks and 2 days ago

Watch Bigg Boss 17 All Episode By Colors In Full HD Video, Indian Channel Voot Desi Serial Bigg Boss 17 Download Full Episodes Online. Bigg Boss 17 episodes

mohsinkhatri · 21 weeks and 1 day ago

I visit your blog regularly and recommend it to all of those who wanted to enhance their knowledge with ease. The style of writing is excellent and also the content is top-notch. Thanks for that shrewdness you provide the readers! g11bet

mohsinkhatri · 19 weeks and 3 days ago

This article gives the light in which we can observe the reality. This is very nice one and gives indepth information. Thanks for this nice article. toddler shirts 3t

mohsinkhatri · 18 weeks and 1 day ago

AP CFMS Bill Status check online by cfms Bill no, challan status AP cfms beneficiary search by pan, aadhaar, Bank Account no login cfms ap gov in. AP CFMS Bill Status

mohsinkhatri · 17 weeks and 1 day ago

Ensure your online anonymity with Ez Temp Mail. Access temporary email for Discord, social media, Reddit, Snapchat, Netflix, and other platforms through our user-friendly temp mail generator. Temp mail generator

mohsinkhatri · 16 weeks and 4 days ago

It is a good site post without fail. Not too many people would actually, the way you just did. I am impressed that there is so much information about this subject that has been uncovered and you’ve defeated yourself this time, with so much quality. Good Works! Britannia Distributorship

mohsinkhatri · 11 weeks and 1 day ago

Your blog is too much amazing. I have found with ease what I was looking. Moreover, the content quality is awesome. Thanks for the nudge! Eco-friendly personalized products

mohsinkhatri · 10 weeks and 2 days ago

Yes, I am entirely agreed with this article, and I just want say that this article is very helpful and enlightening. I also have some precious piece of concerned info !!!!!!Thanks. software for blogging

mohsinkhatri · 1 week and 5 days ago

What do you think?

Any thoughts on this command? Does it work on your machine? Can you do the same thing with only 14 characters?

You must be signed in to comment.

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Similar Commands

Delete huge numbers of files without intensive cpu load

Sequential revision numbers in Git

Precide a bunch of files with a number in a pattern for example to indisperse a podcast backlock with more recent podcasts

remove the last of all html files in a directory

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)