Commands tagged deduplicate sorted by votes

Commands tagged deduplicate (3)

sorted by

Compare directories (using cmp to compare files byte by byte) to find files of the same name that differ

Compare the content of the files in the current directory with files of the same name in the duplicate directory. Pop Quiz: You have a duplicate of a directory with files of the same name that might differ. What do you do? You could use diff to compare the directories, but that's boring and it isn't as clever as find -print0 with xargs. Note: You must omit stderr redirect 2>/dev/null to see the list of missing files from DUPDIR, if any. Hint: Redirect stderr to a new file to produce a more readable list of files that are missing from DUPDIR. Warning: This doesn't tell you if DUPDIR contains files not found in the current directory so don't delete DUPDIR. Show Sample Output
This is sample output - yours may be different.
```
./DIFFER.PNG /DUPDIR/./DIFFER.PNG differ: char 59, line 3
cmp: /DUPDIR/./NOMATCH.PNG: No such file or directory
```
0

find . -maxdepth 1 -mindepth 1 -print0 | xargs -0 -n 1 -I % cmp % /DUPDIR/% 2>/dev/null

RiskNerd · 2018-07-08 02:25:57 247
delete duplicate files
This is sample output - yours may be different.
-1

fdupes -rdN $folder

markussesser · 2011-06-03 06:24:02 5
delete duplicate files

This command deletes all but the first occurrence of a duplicate file in one or more folders. Show Sample Output
This is sample output - yours may be different.
```
[torrid@sabiton/tmp]$ yes 1 | fdupes  -rd india/
[1] india/2008-12-06/PC068616.ORF       
[2] india/2008-12-06/pc068616.orf

Set 1 of 1, preserve files [1 - 2, all]: 
   [+] india/2008-12-06/PC068616.ORF
   [-] india/2008-12-06/pc068616.orf
```
-2

yes 1 | fdupes -rd $folder

torrid · 2011-06-02 18:15:24 3

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Mount iso to /mnt on Solaris

Unmount $ umount /mnt Delete loopback file device $ lofiadm -d /dev/lofi/1

pretend to be busy in office to enjoy a cup of coffee

Dialog's gauge widget accepts progress updates on stdin. This version runs dialog once and updates it every second. There's no need to use timeout which causes screen flicker since it restarts dialog for each update.

move cursor to beginning of command line

Pressing Ctrl combined with 'a' will move the cursor to the beginning of the command under bash (other shells?). I used to do this after arrowing up for the last command, then typing 'sudo ' to run the last command as root, but of course the all time greatest command here `sudo !!` is more succinct. Still Ctrl+A can be very useful when you want to edit something at/close to the beginning of the command line.

Connect to all running screen instances

There was another line that was dependent on having un-named screen sessions. This just wouldn't do. This one works no matter what the name is. A possible improvement would be removing the perl dependence, but that doesn't effect me.

Calculate days on which Friday the 13th occurs

I removed the dependency of the English language

Using mplayer to play the audio only but suppress the video

Sometimes you only want to linsten the audio while output the video will be a waste of CPU resource and an annoying window. With option -vo null, you will enjoy the audio!

Sort IP addresses

Sort IP address by order

Ping all hosts on 192.168.1.0/24

-b option takes the broadcast address.

Clear your history saved into .bash_history file!

Note the space before the command; that prevents your history eliminating command from being recorded. ' history -c && rm -f ~/.bash_history' Both steps are needed. 'history -c' clears what you see in the history command. 'rm -f ~/.bash_history' deletes the history file in your home directory.

get the ascii number with bash builtin printf

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands tagged deduplicate

Commands tagged deduplicate (3) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands tagged deduplicate (3)

sorted by