Find dupe files by checking md5sum

find /glftpd/site/archive -type f|grep '([0-9]\{1,9\})\.[^.]\+$'|parallel -n1 -j200% md5sum ::: |awk 'x[$1]++ { print $2 " :::"}'|sed 's/^/Dupe: /g'|sed 's,Dupe,\x1B[31m&\x1B[0m,'

6
By: wuseman1
2019-10-22 16:02:15

What Others Think

Do we really need the -n1 option for parallel? I did a little experiment as below: diff <(find . -type f | parallel --no-notice -n1 -j200% md5sum ::: | awk 'x[$1]++ { print $2 " :::"}' | sed 's/^/Dupe: /g'|sed 's,Dupe,\x1B[31m&\x1B[0m,') <(find . -type f | parallel --no-notice -j200% md5sum ::: | awk 'x[$1]++ { print $2 " :::"}' | sed 's/^/Dupe: /g'|sed 's,Dupe,\x1B[31m&\x1B[0m,') # nothing here So seems both the commands give the same result. I am suppressing the notice printing with the --no-notice option to parallel.
atul_s_khot · 127 weeks and 3 days ago
are there any recent updates with hair extensions baltimore?
looneyhans · 82 weeks and 4 days ago
i really liked your article. baby photography Thanks for sharing such a wonderful post.
idasanka · 77 weeks and 6 days ago
private investigator san diego Great site! I wish I found this much earlier
yeoyeo · 76 weeks and 2 days ago
love this soo much! fly
sammm · 73 weeks and 1 day ago
How to Check EPF Account Balance Without UAN Number : How to check PF balance using UAN, mobile number, SMS, and EPFO portal. PF Balance Check – Using UAN / Mobile Number – Check EPF Account Balance & Statements from EPFO. You can check your EPF balance using any of these facilities- Umang App,The SMS must be sent from the registered mobile number of UAN. PF Balance Check Without UAN Number
KayGasaway · 30 weeks and 2 days ago
Thanks for taking the time to discuss that, I feel strongly about this and so really like getting to know more on this kind of field. Do you mind updating your blog post with additional insight? It should be really useful for all of us. http://www.ironandrailings.ca">Toronto Iron Railings
KayGasaway · 30 weeks and 2 days ago
very interesting post.this is my first time visit here.i found so mmany interesting stuff in your blog especially its discussion..thanks for the post! bathrooms nearby
KayGasaway · 30 weeks ago
I have been checking out a few of your stories and i can state pretty good stuff. I will definitely bookmark your blog https://mylifelogin.org
KayGasaway · 30 weeks ago
The executive condominium North Gaia is located in Yishun, Singapore. The condo located in that area is ... Website: https://www.northsgaia.com.sg/. North Gaia EC
KayGasaway · 29 weeks and 5 days ago
Hello! I simply wish to give you a huge thumbs up with the excellent info you’ve got here with this post. I will be returning to your site for more soon. Instagram Likes kaufen
wenilak444 · 29 weeks and 5 days ago
never saw a website like this, relaly impressed. compared to other blogs with this article this was definatly the best site. will save. US VISA APPLICATION
wenilak444 · 29 weeks and 3 days ago
Best Transmission Fluid Beyond Performances is an Amsoil Dealer that provides the best Amsoil diesel oil, amsoil motor oil, best transmission fluid, and engine lubricants. https://beyondperformances.com/
wenilak444 · 29 weeks and 3 days ago
Here at Hazzler, we truly believe we have some of the most innovative products in the world and we back that up with our Customer Satisfaction Guarantee. Our Customer Support team will do our best to ensure you are 100% satisfied with your purchase. 4g lte smartwatch
KayGasaway · 29 weeks and 2 days ago
You will learn to play online for free with our simple easy online games. We have action games suitable for all audiences, you will compete with skilled drivers in our online racing games; If, on the other hand, you are a strategy player, you will be able to put your intelligence to the test with our free online strategy games. Jueguitos gratis
KayGasaway · 29 weeks ago
An fascinating discussion will probably be worth comment. I do think that you need to write read more about this topic, it might not become a taboo subject but normally consumers are there are not enough to dicuss on such topics. To another. Cheers wniosek o wiz? kanadyjsk? online
wenilak444 · 28 weeks and 6 days ago
Chinese furniture recommended wood (solid wood) Panana Furniture Online UK 690451331 As well as other styles of furniture in Europe and America, they tend to develop vertically and widely, while the oriental style focuses on the practicality of the living room, which belongs to the balanced and downward development, reducing the height of vision, thus feeling more open space.
wenilak444 · 28 weeks and 4 days ago
Explore save emails as pdf & Save emails or labels to PDF directly from Gmail™. This extension lets you easily save Gmail™ emails as a PDF document. Our service works in just 1 click, and you're done! Export Gmail™ emails and labels to PDF with one click save emails as pdf
KayGasaway · 28 weeks and 2 days ago
Looking for Best & Approved Skin whitening Injection? Dr James Glutathione Injection 1500mg Skin Whitening Injection. #1 Selling Glutathione Injection Brand in India. Made In USA FDA Approved. Buy Now by clicking here ?The miraculous and wonderful whitening injections introduced by Dr James are known to be one of the best ones in today's entire skincare market.
KayGasaway · 28 weeks and 2 days ago
Christmas is comming and you might be looking for best affordable secret santa gift ideas ??Find the best Christmas gift ideas and secret Santa gifts that will make the holidays merry and bright. Shop for Christmas gifts in Singapore today. Christmas Gift Ideas – Explore Innerfyre website & make your loved once day special
KayGasaway · 28 weeks and 2 days ago
somtimes i also sell stuffs on craigslists because there are many users in it* Marketing agency Manchester
nakav51247 · 28 weeks and 2 days ago
If You are looking to remove black magic forever. Instantly! Using A Unique Method, remove black magic ?instantly efficiently Voodoo, spells, curses, programs, entities, spirits, buildings etc, Visit this website and get Free heading video, or get in touch for more details. You will get Free emergency (First Aid) Magic Cleaning Video on the webiste. Thank You.
KayGasaway · 28 weeks ago
Wonderful site. Lots of helpful info here. I¡¦m sending it to some buddies ans additionally sharing in delicious. And certainly, thank you for your effort! ???? ???? ????"?
nakav51247 · 28 weeks ago
Wonderful site. Lots of helpful info here. I¡¦m sending it to some buddies ans additionally sharing in delicious. And certainly, thank you for your effort! ???? ???? ????"?
nakav51247 · 28 weeks ago
john barban weight loss powder our experts noticed that this product can be out of stock at any moment so if you want to take the benefits of this product then please act fast otherwise you will end up waiting 64 days or more
KayGasaway · 28 weeks ago
Adkins Law is a law firm located in Huntersville, North Carolina. Our team has over 20 years of combined experience representing individuals in a range of legal matters including family law, estate planning ,traffic matters and catawba county divorce lawyer
KayGasaway · 28 weeks ago
At Allegra & Co., we offer a beautiful selection of high quality Affordable Engagement Rings at prices that won't break the bank. All our rings are backed with a Warranty and a 100% satisfaction guarantee. Browse our selection of products to find exactly what you need. Please visit our by clicking here ?get discounts & special deals. Thank You.
KayGasaway · 27 weeks and 6 days ago
Explore revexpo, A Indian review website, Their article will help you to pick the right helmet camera along with a proper buying guide. A helmet camera is a most useful and very famous gadget in today s generation Also called a micro video camera or a closed circuit camera. They have listed the best Ladies Helmet & Helmets for Men along with a buyers guide.
KayGasaway · 27 weeks and 6 days ago
If You are looking for Best headband headphone then Dormi Original™ wireless headphones are the most comfortable sleep band headphones . Secured in a soft headband, they are comfortable even for side-sleepers. Shorter charging time, a thinner headband are the most comfortable headphones to sleep in Shop now! & and get 10% OFF your order!
KayGasaway · 27 weeks and 6 days ago
Explore circadi yin weight loss ??- Does it Really Works or Scam for Weight Loss ? CircadiYin Reviews, Another way to help keep off weight and keep your weight down is to take a supplement such as CircadiYin The reason we say another way is because it won't... Explore it by clicking anchor text.
KayGasaway · 27 weeks and 5 days ago
Get easy permit chicago for new construction and building renovations, We have previously worked with city officials and other departmental employees on other permit applications. This gives us an advantage when it comes to getting information, solving problems, understanding fee structures, and negotiating when necessary. Please click here to visit our website and get more info, Thank You easy permit chicago
KayGasaway · 27 weeks and 5 days ago
Our cute and aesthetic barbie phone case is the perfect everyday case for your iPhone. The case is tough and durable, It’s sure to protect your device against high-impact drops, scuffs, and scratches. A brand you can trust. Gurl Cases creates cases that aren’t just cute iPhone cases, but also durable so your phone is protected from everything life throws at it. Protect your phone in style with a Gurl Case! Protect your phone in style with a Gurl Case, visit website & be the first to hear about our exclusive offers and latest arrivals.
KayGasaway · 27 weeks and 4 days ago
Visit this website & get ?? (Takeout Services), The service that will be used is actually a lot of small gatherings , mini parties as small as two or three people will be called. As the pneumonia epidemic continues, more and more people will have to order to eat, but many people are relatively new to ordering takeaways, and most people think that traditional takeaways are the first for many people to eat. ??
KayGasaway · 27 weeks and 3 days ago
If you have concerns regarding investments you purchased through Royal Alliance Associates and would like to speak with a securities attorney, Find out best attorney for yout Royal Alliance complaints, Decades of Legal Experience with Over $100 Million in Client Recoveries, Unlike most commercial litigation law firms, MDF Law takes all our cases on contingency. This means we are not paid a legal fee unless our clients successfully recover money. We prefer working on contingency because we become partners with our clients and have a shared financial stake in the outcome of our cases. Royal Alliance complaints
KayGasaway · 27 weeks and 3 days ago
Management Business Software for Accelerators and Incubators ??Startup Hubs. Create a group account for Business Incubators, Accelerators, Small Business Hubs or investors to be able to sponsor a group of companies to utilise the software, to ensure that they are employing best practices in governance and accountability. Please visit our website & Start with a 14-day FREE trial - no credit card needed. Thank You
KayGasaway · 27 weeks ago
Give meaningful and eco friendly corporate gifts in Singapore, whether they re gifts for corporate executives, clients or employees http://www.authorstream.com/corporategifts02/">corporate gifts
KayGasaway · 26 weeks and 5 days ago
???????????,??????,????????? ???????????????????????????????????????????????????????????????https www hatuasolutions com ? ?????
KayGasaway · 26 weeks and 5 days ago
Best ERISA lawyer las vegas ?- Law Office of Julie Mersch, Call Julie Mersch Law at 702 387 5868 nevada long term disability lawyer near you Expert Attorney Over 20 years of experience She offers premium legal services, Visit our website and find out how we can fight for you. Thank You.
wenilak444 · 26 weeks and 5 days ago
????????? ?????? ???????https www stepspokane com ???????????????????????????????????????????????????????????????????? www.stepspokane.com
KayGasaway · 26 weeks and 5 days ago
Discover odor removal orange county ?, Home Odor Removal, Odor Eliminator, Smoke and Odor Remediation, Disinfection and Sanitizing Service with Ozone in Orange County Get rid of House and Car Smells Cigarette Smoke Removal Service. #1 Odor Removal and Disinfection Service with Ozone in Orange County, CA.
wenilak444 · 26 weeks and 5 days ago
If You are looking for best delta 8 products ?KC Hemp Co.® | Voted Best CBD in KC Using only certified organic hemp and ingredients, a small batch and handcrafted approach to production, and full transparency, you can feel confident you're getting the highest quality products on the market with KC Hemp Co.®.
KayGasaway · 26 weeks and 5 days ago
Find the Maldives Tour Package & right Luxury hotel for your Maldives Honeymoon or Holidays Rawnaq Tourism recommends the Best Maldives Hotels depending on your individual needs
KayGasaway · 26 weeks and 5 days ago
Buy the best disposable vape kits at UK ECIG STORE. We have a great selection of some of the best disposable vape kits ?and pod devices to buy online. These disposable vapes and pod devices can be used up until the battery is fully drained and then safely disposed of. This makes them ideal for holidays and for those occasions when you are unable to use your daily vaping equipment.
wenilak444 · 26 weeks and 4 days ago
Oh my goodness! a wonderful write-up dude. Many thanks Nevertheless We’re experiencing trouble with ur rss . Don’t know why Unable to sign up to it. Can there be everyone obtaining identical rss difficulty? Anybody who knows kindly respond. Thnkx Kan?das t?risma v?za
wenilak444 · 26 weeks and 3 days ago
Aw, this became an extremely nice post. In concept I have to devote writing like that additionally – taking time and actual effort to generate a great article… but so what can I say… I procrastinate alot through no indicates often go completed. VISA VOOR INDIA
wenilak444 · 26 weeks and 3 days ago
Explore Bigg Boss Tamil is the fresh reality show on Vijay Television in India. Legendary actor Kamal Haasan hosted the season 1 and season 2 and season 3. Now its back with season 5 vote, Visit website to get more info like: online bigg boss vote tamil , missed call numbers.
KayGasaway · 26 weeks and 1 day ago
What’s Going down i’m new to this, I stumbled upon this I have discovered It positively useful and it has aided me out loads. I’m hoping to give a contribution & help different users like its aided me. Good job. https://www.MM88IT.com
lemeyiy711 · 26 weeks ago
and i would love it if they could develop more position players from the minorsbut that only works if you have a manager and gm that will provide the opportunities for that to occur ?????
nakav51247 · 25 weeks and 5 days ago
Very interesting topic , thankyou for posting . https://www.ULTRACLUBASIA.com
wenilak444 · 25 weeks and 4 days ago
Urban Garden Landscaping Services in Singapore offers one of the best landscape services in Singapore for commercial and residential areas. landscape contractors Singapore
wenilak444 · 25 weeks and 3 days ago
web design company in Malaysia Superweb has 13 years of experience to serve company website development Call us at 603 2726 2810 for free company web design consultation. Our team of talented website designers, using the latest technology in website development, have created and launched successful high traffic websites since our inception, for different types of businesses.
nakav51247 · 25 weeks and 2 days ago
another hot day in the sunshine house on appleton drive ..|janedoeeUHHH| Web design Manchester
lemeyiy711 · 25 weeks and 1 day ago
Explore eHealth Quotes, & Connect with agents who can offer health insurance for small businesses, health insurance for individuals, dental and vision plans. Get a free health quote, fill out a form by visiting this website ?and we will connect you to an agent hassle free.
KayGasaway · 24 weeks and 6 days ago
I discovered your blog internet site on google and check a few of your early posts. Continue to keep up the extremely good operate. I just extra up your RSS feed to my MSN News Reader. Looking for forward to reading much more from you later on!… APLIKASI VISA AS ONLINE
wenilak444 · 24 weeks and 5 days ago
usually, the best sounding ringtones are coming from paid ringtone donwload sites“ ????????joker123
wenilak444 · 24 weeks and 5 days ago
I can see you are an expert at your field! I am launching a website soon, and your details will be really fascinating for me.. Thanks for all your assist and wishing you all of the success. INDIEN TURISTVISUM
wenilak444 · 23 weeks and 6 days ago
WitLink is a global AI marketplace for AI services and pool of decentralized computing resources - Custom-built AI Solutions. AI Services and Machine Learning Training Programs. AI Services at WetLink.ai | Blockchain-Powered AI Marketplace. ai marketplaces
KayGasaway · 22 weeks and 6 days ago
Discover samsung mobile repair ??in UAE. Authorized Samsung Mobile Repair Center | 20+ Year of Trust Get the best Samsung mobile repair service in Dubai at your doorstep or our axiom care Book your Samsung mobile repair now at affordable price at Axiom care
wenilak444 · 22 weeks and 4 days ago
Philadelphia wedding photographers dedicated professionals will be there rain, snow or shine so you will be able to worry about the important things and leave the photos up to us. Philadelphia wedding photographers
KayGasaway · 22 weeks and 3 days ago
Discover electrical contractor near me TOP 10 Electrical Contractors ?& Electricians in Contra Costa County CA » Selectedly. Visit the website.
KayGasaway · 22 weeks and 3 days ago
We work with any brand including GE, GE Monogram, Kenmore, KitchenAid, LG, Maytag, Samsung, Sub Zero, Viking, Whirlpool, Wolf and many many more. We repair refrigerators of any make and models, gas and electric ranges & ovens, front and top load washing machines and dryers, rangetops & cooktops, and dishwashers. We don’t want to end up fixing your appliance repair multiple times. It is an unspoken rule that you can trust us to make your appliance working like new. subzero freezer not working
nakav51247 · 21 weeks and 2 days ago
we have the lowest repair costs of our workforce in this area. If you are facing any issues with your Sub-Zero lg refrigerator repair , whether your Sub Zero fridge is not cooling properly, your Wolf range is not lighting anymore, or your Cove dishwasher leaves the dishes unclean, no matter what issue or issues your have in it, just give us a call at 512-663-8852, and we’ll take care of it.
nakav51247 · 21 weeks and 1 day ago
Discover samsung appliance repair- Appliance Repair Services In Austin TX We Service Refrigerators, Washers And Dryers, Ovens, Ranges Of Any Brands Of Appliances In Austin Area
nakav51247 · 21 weeks ago
EXPLORE refrigerator repair ?- Your refrigerator is the workhorse of the house, tirelessly keeping food cool or frozen all day, all night. So it is no wonder that troubles might happen from time to time. Appliance Repair Services In Austin TX We Service Refrigerators, Washers And Dryers, Ovens, Ranges Of Any Brands Of Appliances In Austin Area
nakav51247 · 21 weeks ago
where to get shrooms dried mushrooms african pyramid mushroom african transkei mushroom albino penis envy b+ mushrooms blue meanies mushroom brazilian magic mushroom burmese mushroom golden teacher mushroom ko samui super strain malabar coast martinique mexican mushroom mushroom british columbia super thai mushroom nepalese chitwan mushroom penis envy texas penis envy 6 texas yellow caps vietnamese white jedi mind fuck tri coloured ecuadorian mushroom magic mushsroom edibles mexican cubensis psychedelic chocolate bar where to get shrooms dried mushrooms african pyramid mushroom african transkei mushroom albino penis envy b+ mushrooms blue meanies mushroom brazilian magic mushroom burmese mushroom golden teacher mushroom ko samui super strain malabar coast martinique mexican mushroom mushroom british columbia super thai mushroom nepalese chitwan mushroom penis envy texas penis envy 6 texas yellow caps vietnamese white jedi mind fuck tri coloured ecuadorian mushroom magic mushsroom edibles mexican cubensis psychedelic chocolate bar midnight mint psychedelic chocolate bar origin mango psilo gummies 0.25g-1g origin strawberry psilo gummies 0.25g-1g penis envy psychedelic chocolate bar psilocybin cube gummies vegan dark chocolate psychedelic chocolate bar microdoses brain capsules 50mg-200mg chill capsules 50mg-200mg clarity capsules 50mg-200mg health capsules 50mg-200mg love capsules 50mg-200mg mood capsules 50mg-200mg pure capsules 50mg-200mg social capsules 30 pack 350mg social capsules 5 pack 350mg
johnson20007 · 20 weeks and 6 days ago
IT LABS PRO est la meilleure société de services d'ingénierie informatique au Maroc, en vous déplaçant à son siège à Marrakech - gueliz vous allez bénéficier des meilleurs services de création de sites et applications de gestion web, cette dernière privilégie ses clients et mettez à leur disposition toutes ses ressources pour l'accomplissement de leurs projets tout en offrant son expertise en conseillant ses clients et les accompagnant pour améliorer leurs images sur intérêt et mieux gérer leurs business. Creation site web maroc
itlabspro · 13 weeks and 2 days ago
If you love to wear movies and celebrity outfits so So here's the Tom Cruise bomber jacket for you, this jacket is available in two different types of leather so upgrade your style with this amazing tom cruise leather jacket.
emmawatson3848 · 3 weeks and 1 day ago

What do you think?

Any thoughts on this command? Does it work on your machine? Can you do the same thing with only 14 characters?

You must be signed in to comment.

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands



Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for: