Find dupe files by checking md5sum

find /glftpd/site/archive -type f|grep '([0-9]\{1,9\})\.[^.]\+$'|parallel -n1 -j200% md5sum ::: |awk 'x[$1]++ { print $2 " :::"}'|sed 's/^/Dupe: /g'|sed 's,Dupe,\x1B[31m&\x1B[0m,'

6
By: wuziduzi
2019-10-22 16:02:15

What Others Think

Do we really need the -n1 option for parallel? I did a little experiment as below: diff <(find . -type f | parallel --no-notice -n1 -j200% md5sum ::: | awk 'x[$1]++ { print $2 " :::"}' | sed 's/^/Dupe: /g'|sed 's,Dupe,\x1B[31m&\x1B[0m,') <(find . -type f | parallel --no-notice -j200% md5sum ::: | awk 'x[$1]++ { print $2 " :::"}' | sed 's/^/Dupe: /g'|sed 's,Dupe,\x1B[31m&\x1B[0m,') # nothing here So seems both the commands give the same result. I am suppressing the notice printing with the --no-notice option to parallel.
atul_s_khot · 105 weeks and 4 days ago
are there any recent updates with hair extensions baltimore?
looneyhans · 60 weeks and 6 days ago
i really liked your article. baby photography Thanks for sharing such a wonderful post.
idasanka · 56 weeks and 1 day ago
private investigator san diego Great site! I wish I found this much earlier
yeoyeo · 54 weeks and 4 days ago
love this soo much! fly
sammm · 51 weeks and 3 days ago
How to Check EPF Account Balance Without UAN Number : How to check PF balance using UAN, mobile number, SMS, and EPFO portal. PF Balance Check – Using UAN / Mobile Number – Check EPF Account Balance & Statements from EPFO. You can check your EPF balance using any of these facilities- Umang App,The SMS must be sent from the registered mobile number of UAN. PF Balance Check Without UAN Number
KayGasaway · 8 weeks and 4 days ago
Thanks for taking the time to discuss that, I feel strongly about this and so really like getting to know more on this kind of field. Do you mind updating your blog post with additional insight? It should be really useful for all of us. http://www.ironandrailings.ca">Toronto Iron Railings
KayGasaway · 8 weeks and 4 days ago
very interesting post.this is my first time visit here.i found so mmany interesting stuff in your blog especially its discussion..thanks for the post! bathrooms nearby
KayGasaway · 8 weeks and 2 days ago
I have been checking out a few of your stories and i can state pretty good stuff. I will definitely bookmark your blog https://mylifelogin.org
KayGasaway · 8 weeks and 2 days ago
The executive condominium North Gaia is located in Yishun, Singapore. The condo located in that area is ... Website: https://www.northsgaia.com.sg/. North Gaia EC
KayGasaway · 8 weeks ago
Hello! I simply wish to give you a huge thumbs up with the excellent info you’ve got here with this post. I will be returning to your site for more soon. Instagram Likes kaufen
wenilak444 · 8 weeks ago
never saw a website like this, relaly impressed. compared to other blogs with this article this was definatly the best site. will save. US VISA APPLICATION
wenilak444 · 7 weeks and 5 days ago
Best Transmission Fluid Beyond Performances is an Amsoil Dealer that provides the best Amsoil diesel oil, amsoil motor oil, best transmission fluid, and engine lubricants. https://beyondperformances.com/
wenilak444 · 7 weeks and 4 days ago
Here at Hazzler, we truly believe we have some of the most innovative products in the world and we back that up with our Customer Satisfaction Guarantee. Our Customer Support team will do our best to ensure you are 100% satisfied with your purchase. 4g lte smartwatch
KayGasaway · 7 weeks and 3 days ago
You will learn to play online for free with our simple easy online games. We have action games suitable for all audiences, you will compete with skilled drivers in our online racing games; If, on the other hand, you are a strategy player, you will be able to put your intelligence to the test with our free online strategy games. Jueguitos gratis
KayGasaway · 7 weeks and 2 days ago
An fascinating discussion will probably be worth comment. I do think that you need to write read more about this topic, it might not become a taboo subject but normally consumers are there are not enough to dicuss on such topics. To another. Cheers wniosek o wiz? kanadyjsk? online
wenilak444 · 7 weeks and 1 day ago
Chinese furniture recommended wood (solid wood) Panana Furniture Online UK 690451331 As well as other styles of furniture in Europe and America, they tend to develop vertically and widely, while the oriental style focuses on the practicality of the living room, which belongs to the balanced and downward development, reducing the height of vision, thus feeling more open space.
wenilak444 · 6 weeks and 6 days ago
Explore save emails as pdf & Save emails or labels to PDF directly from Gmail™. This extension lets you easily save Gmail™ emails as a PDF document. Our service works in just 1 click, and you're done! Export Gmail™ emails and labels to PDF with one click save emails as pdf
KayGasaway · 6 weeks and 4 days ago
Looking for Best & Approved Skin whitening Injection? Dr James Glutathione Injection 1500mg Skin Whitening Injection. #1 Selling Glutathione Injection Brand in India. Made In USA FDA Approved. Buy Now by clicking here ?The miraculous and wonderful whitening injections introduced by Dr James are known to be one of the best ones in today's entire skincare market.
KayGasaway · 6 weeks and 4 days ago
Christmas is comming and you might be looking for best affordable secret santa gift ideas ??Find the best Christmas gift ideas and secret Santa gifts that will make the holidays merry and bright. Shop for Christmas gifts in Singapore today. Christmas Gift Ideas – Explore Innerfyre website & make your loved once day special
KayGasaway · 6 weeks and 4 days ago
somtimes i also sell stuffs on craigslists because there are many users in it* Marketing agency Manchester
nakav51247 · 6 weeks and 3 days ago
If You are looking to remove black magic forever. Instantly! Using A Unique Method, remove black magic ?instantly efficiently Voodoo, spells, curses, programs, entities, spirits, buildings etc, Visit this website and get Free heading video, or get in touch for more details. You will get Free emergency (First Aid) Magic Cleaning Video on the webiste. Thank You.
KayGasaway · 6 weeks and 2 days ago
Wonderful site. Lots of helpful info here. I¡¦m sending it to some buddies ans additionally sharing in delicious. And certainly, thank you for your effort! ???? ???? ????"?
nakav51247 · 6 weeks and 2 days ago
Wonderful site. Lots of helpful info here. I¡¦m sending it to some buddies ans additionally sharing in delicious. And certainly, thank you for your effort! ???? ???? ????"?
nakav51247 · 6 weeks and 2 days ago
john barban weight loss powder our experts noticed that this product can be out of stock at any moment so if you want to take the benefits of this product then please act fast otherwise you will end up waiting 64 days or more
KayGasaway · 6 weeks and 2 days ago
Adkins Law is a law firm located in Huntersville, North Carolina. Our team has over 20 years of combined experience representing individuals in a range of legal matters including family law, estate planning ,traffic matters and catawba county divorce lawyer
KayGasaway · 6 weeks and 1 day ago
At Allegra & Co., we offer a beautiful selection of high quality Affordable Engagement Rings at prices that won't break the bank. All our rings are backed with a Warranty and a 100% satisfaction guarantee. Browse our selection of products to find exactly what you need. Please visit our by clicking here ?get discounts & special deals. Thank You.
KayGasaway · 6 weeks and 1 day ago
Explore revexpo, A Indian review website, Their article will help you to pick the right helmet camera along with a proper buying guide. A helmet camera is a most useful and very famous gadget in today s generation Also called a micro video camera or a closed circuit camera. They have listed the best Ladies Helmet & Helmets for Men along with a buyers guide.
KayGasaway · 6 weeks and 1 day ago
If You are looking for Best headband headphone then Dormi Original™ wireless headphones are the most comfortable sleep band headphones . Secured in a soft headband, they are comfortable even for side-sleepers. Shorter charging time, a thinner headband are the most comfortable headphones to sleep in Shop now! & and get 10% OFF your order!
KayGasaway · 6 weeks and 1 day ago
Explore circadi yin weight loss ??- Does it Really Works or Scam for Weight Loss ? CircadiYin Reviews, Another way to help keep off weight and keep your weight down is to take a supplement such as CircadiYin The reason we say another way is because it won't... Explore it by clicking anchor text.
KayGasaway · 6 weeks ago
Get easy permit chicago for new construction and building renovations, We have previously worked with city officials and other departmental employees on other permit applications. This gives us an advantage when it comes to getting information, solving problems, understanding fee structures, and negotiating when necessary. Please click here to visit our website and get more info, Thank You easy permit chicago
KayGasaway · 5 weeks and 6 days ago
Our cute and aesthetic barbie phone case is the perfect everyday case for your iPhone. The case is tough and durable, It’s sure to protect your device against high-impact drops, scuffs, and scratches. A brand you can trust. Gurl Cases creates cases that aren’t just cute iPhone cases, but also durable so your phone is protected from everything life throws at it. Protect your phone in style with a Gurl Case! Protect your phone in style with a Gurl Case, visit website & be the first to hear about our exclusive offers and latest arrivals.
KayGasaway · 5 weeks and 6 days ago
Visit this website & get ?? (Takeout Services), The service that will be used is actually a lot of small gatherings , mini parties as small as two or three people will be called. As the pneumonia epidemic continues, more and more people will have to order to eat, but many people are relatively new to ordering takeaways, and most people think that traditional takeaways are the first for many people to eat. ??
KayGasaway · 5 weeks and 5 days ago
If you have concerns regarding investments you purchased through Royal Alliance Associates and would like to speak with a securities attorney, Find out best attorney for yout Royal Alliance complaints, Decades of Legal Experience with Over $100 Million in Client Recoveries, Unlike most commercial litigation law firms, MDF Law takes all our cases on contingency. This means we are not paid a legal fee unless our clients successfully recover money. We prefer working on contingency because we become partners with our clients and have a shared financial stake in the outcome of our cases. Royal Alliance complaints
KayGasaway · 5 weeks and 5 days ago
Management Business Software for Accelerators and Incubators ??Startup Hubs. Create a group account for Business Incubators, Accelerators, Small Business Hubs or investors to be able to sponsor a group of companies to utilise the software, to ensure that they are employing best practices in governance and accountability. Please visit our website & Start with a 14-day FREE trial - no credit card needed. Thank You
KayGasaway · 5 weeks and 1 day ago
Give meaningful and eco friendly corporate gifts in Singapore, whether they re gifts for corporate executives, clients or employees http://www.authorstream.com/corporategifts02/">corporate gifts
KayGasaway · 5 weeks ago
???????????,??????,????????? ???????????????????????????????????????????????????????????????https www hatuasolutions com ? ?????
KayGasaway · 5 weeks ago
Best ERISA lawyer las vegas ?- Law Office of Julie Mersch, Call Julie Mersch Law at 702 387 5868 nevada long term disability lawyer near you Expert Attorney Over 20 years of experience She offers premium legal services, Visit our website and find out how we can fight for you. Thank You.
wenilak444 · 5 weeks ago
????????? ?????? ???????https www stepspokane com ???????????????????????????????????????????????????????????????????? www.stepspokane.com
KayGasaway · 5 weeks ago
Discover odor removal orange county ?, Home Odor Removal, Odor Eliminator, Smoke and Odor Remediation, Disinfection and Sanitizing Service with Ozone in Orange County Get rid of House and Car Smells Cigarette Smoke Removal Service. #1 Odor Removal and Disinfection Service with Ozone in Orange County, CA.
wenilak444 · 5 weeks ago
If You are looking for best delta 8 products ?KC Hemp Co.® | Voted Best CBD in KC Using only certified organic hemp and ingredients, a small batch and handcrafted approach to production, and full transparency, you can feel confident you're getting the highest quality products on the market with KC Hemp Co.®.
KayGasaway · 5 weeks ago
Find the Maldives Tour Package & right Luxury hotel for your Maldives Honeymoon or Holidays Rawnaq Tourism recommends the Best Maldives Hotels depending on your individual needs
KayGasaway · 4 weeks and 6 days ago
Buy the best disposable vape kits at UK ECIG STORE. We have a great selection of some of the best disposable vape kits ?and pod devices to buy online. These disposable vapes and pod devices can be used up until the battery is fully drained and then safely disposed of. This makes them ideal for holidays and for those occasions when you are unable to use your daily vaping equipment.
wenilak444 · 4 weeks and 6 days ago
Oh my goodness! a wonderful write-up dude. Many thanks Nevertheless We’re experiencing trouble with ur rss . Don’t know why Unable to sign up to it. Can there be everyone obtaining identical rss difficulty? Anybody who knows kindly respond. Thnkx Kan?das t?risma v?za
wenilak444 · 4 weeks and 5 days ago
Aw, this became an extremely nice post. In concept I have to devote writing like that additionally – taking time and actual effort to generate a great article… but so what can I say… I procrastinate alot through no indicates often go completed. VISA VOOR INDIA
wenilak444 · 4 weeks and 5 days ago
Explore Bigg Boss Tamil is the fresh reality show on Vijay Television in India. Legendary actor Kamal Haasan hosted the season 1 and season 2 and season 3. Now its back with season 5 vote, Visit website to get more info like: online bigg boss vote tamil , missed call numbers.
KayGasaway · 4 weeks and 2 days ago
What’s Going down i’m new to this, I stumbled upon this I have discovered It positively useful and it has aided me out loads. I’m hoping to give a contribution & help different users like its aided me. Good job. https://www.MM88IT.com
lemeyiy711 · 4 weeks and 2 days ago
and i would love it if they could develop more position players from the minorsbut that only works if you have a manager and gm that will provide the opportunities for that to occur ?????
nakav51247 · 4 weeks ago
Very interesting topic , thankyou for posting . https://www.ULTRACLUBASIA.com
wenilak444 · 3 weeks and 6 days ago
Urban Garden Landscaping Services in Singapore offers one of the best landscape services in Singapore for commercial and residential areas. landscape contractors Singapore
wenilak444 · 3 weeks and 5 days ago
web design company in Malaysia Superweb has 13 years of experience to serve company website development Call us at 603 2726 2810 for free company web design consultation. Our team of talented website designers, using the latest technology in website development, have created and launched successful high traffic websites since our inception, for different types of businesses.
nakav51247 · 3 weeks and 3 days ago
another hot day in the sunshine house on appleton drive ..|janedoeeUHHH| Web design Manchester
lemeyiy711 · 3 weeks and 2 days ago
Explore eHealth Quotes, & Connect with agents who can offer health insurance for small businesses, health insurance for individuals, dental and vision plans. Get a free health quote, fill out a form by visiting this website ?and we will connect you to an agent hassle free.
KayGasaway · 3 weeks ago
I discovered your blog internet site on google and check a few of your early posts. Continue to keep up the extremely good operate. I just extra up your RSS feed to my MSN News Reader. Looking for forward to reading much more from you later on!… APLIKASI VISA AS ONLINE
wenilak444 · 3 weeks ago
usually, the best sounding ringtones are coming from paid ringtone donwload sites“ ????????joker123
wenilak444 · 2 weeks and 6 days ago
I can see you are an expert at your field! I am launching a website soon, and your details will be really fascinating for me.. Thanks for all your assist and wishing you all of the success. INDIEN TURISTVISUM
wenilak444 · 2 weeks and 1 day ago
WitLink is a global AI marketplace for AI services and pool of decentralized computing resources - Custom-built AI Solutions. AI Services and Machine Learning Training Programs. AI Services at WetLink.ai | Blockchain-Powered AI Marketplace. ai marketplaces
KayGasaway · 1 week and 1 day ago
Discover samsung mobile repair ??in UAE. Authorized Samsung Mobile Repair Center | 20+ Year of Trust Get the best Samsung mobile repair service in Dubai at your doorstep or our axiom care Book your Samsung mobile repair now at affordable price at Axiom care
wenilak444 · 6 days ago
Philadelphia wedding photographers dedicated professionals will be there rain, snow or shine so you will be able to worry about the important things and leave the photos up to us. Philadelphia wedding photographers
KayGasaway · 5 days ago
Discover electrical contractor near me TOP 10 Electrical Contractors ?& Electricians in Contra Costa County CA » Selectedly. Visit the website.
KayGasaway · 5 days ago

What do you think?

Any thoughts on this command? Does it work on your machine? Can you do the same thing with only 14 characters?

You must be signed in to comment.

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands



Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for: