Commands using md5sum sorted by votes

Commands using md5sum (59)

sorted by

Find Duplicate Files (based on size first, then MD5 hash)

This dup finder saves time by comparing size first, then md5sum, it doesn't delete anything, just lists them.
This is sample output - yours may be different.
82

find -not -empty -type f -printf "%s\n" | sort -rn | uniq -d | xargs -I{} -n1 find -type f -size {}c -print0 | xargs -0 md5sum | sort | uniq -w32 --all-repeated=separate

grokskookum · 2009-09-21 00:24:14 61
Create strong, but easy to remember password

Why remember? Generate! Up to 48 chars, works on any unix-like system (NB: BSD use md5 instead of md5sum) Show Sample Output
This is sample output - yours may be different.
```
YzFj3mM1YzAjNJQ2
```
23

read -s pass; echo $pass | md5sum | base64 | cut -c -16

bugmenot · 2011-11-24 20:23:47 28
Find Duplicate Files (based on MD5 hash)

Calculates md5 sum of files. sort (required for uniq to work). uniq based on only the hash. use cut ro remove the hash from the result.
This is sample output - yours may be different.
18

find -type f -exec md5sum '{}' ';' | sort | uniq --all-repeated=separate -w 33 | cut -c 35-

infinull · 2009-08-04 07:05:12 6
Generat a Random MAC address

Original author unknown (I believe off of a wifi hacking forum). Used in conjuction with ifconfig and cron.. can be handy (especially spoofing AP's) Show Sample Output
This is sample output - yours may be different.
```
00:12:2F:22:32:16
```
17

MAC=`(date; cat /proc/interrupts) | md5sum | sed -r 's/^(.{10}).*$/\1/; s/([0-9a-f]{2})/\1:/g; s/:$//;'`

vaporub · 2009-02-16 07:09:43 118
Identify differences between directories (possibly on different servers)

This can be much faster than downloading one or both trees to a common servers and comparing the files there. After, only those files could be copied down for deeper comparison if needed. Show Sample Output
This is sample output - yours may be different.
```
5,7c7,9
< 5955632baf6598bd56668bf45aae31c3  ./hibernate.properties
< 54ba5e4ebe18ef4855fa2796dfb2521e  ./logging.xml
< 388a7f1823574252e26ddbdbd68a02bf  ./manager.properties
---
> 165768e0b454c90ab1b26150b7954fd2  ./hibernate.properties
> 0ad95a5ab764bfdede2dc713f84ecfc0  ./logging.xml
> 636d9444bc20ffe2dc2433b90b2535e7  ./manager.properties
```
14

diff <(ssh server01 'cd config; find . -type f -exec md5sum {} \;| sort -k 2') <(ssh server02 'cd config;find . -type f -exec md5sum {} \;| sort -k 2')

arcege · 2009-09-11 15:24:59 17
generate a unique and secure password for every website that you login to

usage: sitepass MaStErPaSsWoRd example.com description: An admittedly excessive amount of hashing, but this will give you a pretty secure password, It also eliminates repeated characters and deletes itself from your command history. tr '!-~' 'P-~!-O' # this bit is rot47, kinda like rot13 but more nerdy rev # this avoids the first few bytes of gzip payload, and the magic bytes. Show Sample Output
This is sample output - yours may be different.
```
$ sitepass  iHeartLinux commandlinefu.com
^Uk+j{,jl~
```
13

sitepass() { echo -n "$@" | md5sum | sha1sum | sha224sum | sha256sum | sha384sum | sha512sum | gzip - | strings -n 1 | tr -d "[:space:]" | tr -s '[:print:]' | tr '!-~' 'P-~!-O' | rev | cut -b 2-11; history -d $(($HISTCMD-1)); }

grokskookum · 2009-10-01 20:14:57 14
Find Malware in the current and sub directories by MD5 hashes

Command makes use of the Malware Hash Registry (http://www.team-cymru.org/Services/MHR/). It parses the current directory and subdirectories and calculates the md5 hash of the files, then prints the name and sends the hash to the MHR for a lookup in their database. The 3rd value in the result is the detection percentage across a mix of AV packages. Show Sample Output
This is sample output - yours may be different.
```
Checking:  ./yffix3Qs.zip
d95a72eb35820cc1dc3d750b53090b78 1318649640 NO_DATA
Checking:  ./B_Malware_210911/soft.exe
52ca815d29da154fc1dff687505feab3 1318649641 NO_DATA
Checking:  ./B_Malware_210911/sistem_nod.exe
6325547dd016d2e47e258396dc695ed7 1316696641 18
Checking:  ./B_Malware_210911/yabotovrot.exe
33b76caf40a7ac013fded283b0f87c1e 1317442076 39
Checking:  ./cat
332fc925297433af694c835afb8609f7 1318649646 NO_DATA
Checking:  ./alot_symbolleiste_lexika_installer.exe
7cf02c378e195a85f586bbb83f7f4660 1318649647 NO_DATA
```
11

IFS=$'\n' && for f in `find . -type f -exec md5sum "{}" \;`; do echo $f | sed -r 's/^[^ ]+/Checking:/'; echo $f | cut -f1 -d' ' | netcat hash.cymru.com 43 ; done

Neo23x0 · 2011-10-15 03:38:47 7
[re]verify a disc with very friendly output

[re]verify those burned CD's early and often - better safe than sorry - at a bare minimum you need the good old `dd` and `md5sum` commands, but why not throw in a super "user-friendly" progress gauge with the `pv` command - adjust the ``-s'' "size" argument to your needs - 700 MB in this case, and capture that checksum in a "test.md5" file with `tee` - just in-case for near-future reference. *uber-bonus* ability - positively identify those unlabeled mystery discs - for extra credit, what disc was used for this sample output? Show Sample Output
This is sample output - yours may be different.
```
190MB 0:01:42 [ 2.3MB/s] [========>                          ] 27% ETA 0:04:33
...
698MB 0:04:33 [2.55MB/s] [=================================> ] 99%            
589f13da46e34789cb13b7dc574ccc6c  -
```
10

dd if=/dev/cdrom | pv -s 700m | md5sum | tee test.md5

asmoore82 · 2009-03-09 00:11:42 13
Generate MD5 hash for a string
This is sample output - yours may be different.
10

md5sum <<<"test"

unefunge · 2010-11-24 12:04:41 16
recurisvely md5 all files in a tree

Found this little gem here: http://info.michael-simons.eu/2008/10/25/recursively-md5sum-all-files-in-a-directory-tree/
This is sample output - yours may be different.
8

find ./backup -type f -print0 | xargs -0 md5sum > /checksums_backup.md5

hooobs · 2009-02-12 19:39:12 21
Diff 2 file struct - Useful for branch diff and jars diff(uncompressed)

This is usefull to diff 2 paths in branches of software, or in different versions of a same zip file. So you can get the real file diff. Show Sample Output
This is sample output - yours may be different.
```
5469c5470
< e388cca0b1566dddf56362a223a003b1  ./META-INF/MANIFEST.MF
---
> 9dc47f8a8175dc93c4c2393ad3e09ce9  ./META-INF/MANIFEST.MF
```
7

diff <(cd A; find -type f|xargs md5sum ) <(cd B; find -type f | xargs md5sum )

glaudiston · 2013-07-02 18:02:05 10
Verify MD5SUMS but only print failures

All valid files are withheld so only failures show up. No output, all checks good.
This is sample output - yours may be different.
6

md5sum --check MD5SUMS | grep -v ": OK"

gpenguin · 2009-10-02 05:21:17 7
Calculate md5 sums for every file in a directory tree
This is sample output - yours may be different.
6

find . -type f -exec md5sum {} \; > sum.md5

Tungmar · 2010-08-24 09:37:31 8
Find dupe files by checking md5sum
This is sample output - yours may be different.
6

find /glftpd/site/archive -type f|grep '([0-9]\{1,9\})\.[^.]\+$'|parallel -n1 -j200% md5sum ::: |awk 'x[$1]++ { print $2 " :::"}'|sed 's/^/Dupe: /g'|sed 's,Dupe,\x1B[31m&\x1B[0m,'

wuseman1 · 2019-10-22 16:02:15 370
Create a random password encrypted with md5 with custom lenght

This was useful to generate random passwords to some webpage users, using the sample code, inside a bash script Show Sample Output
This is sample output - yours may be different.
```
PASSSIZE=6
mypass=`/usr/bin/perl -le'print map+(A..Z,a..z,0..9)[rand 62],1..'$PASSSIZE`
echo -n $mypass | md5sum | awk {'print $1'}
```
2

echo -n $mypass | md5sum | awk {'print $1'}

tororebelde · 2009-03-10 13:12:21 6
Find Duplicate Files, excluding .svn-directories (based on size first, then MD5 hash)

Improvement of the command "Find Duplicate Files (based on size first, then MD5 hash)" when searching for duplicate files in a directory containing a subversion working copy. This way the (multiple dupicates) in the meta-information directories are ignored. Can easily be adopted for other VCS as well. For CVS i.e. change ".svn" into ".csv": find -type d -name ".csv" -prune -o -not -empty -type f -printf "%s\n" | sort -rn | uniq -d | xargs -I{} -n1 find -type d -name ".csv" -prune -o -type f -size {}c -print0 | xargs -0 md5sum | sort | uniq -w32 --all-repeated=separate Show Sample Output
This is sample output - yours may be different.
```
[...]
f2e6bb247f110dcab63b4d38ff7b2dee  ./themes/darkblue_orange/img/b_relations.png
f2e6bb247f110dcab63b4d38ff7b2dee  ./themes/original/img/b_relations.png

f5309bd2a2fc5e512a0cc38ac6f10c09  ./themes/darkblue_orange/img/b_deltbl.png
f5309bd2a2fc5e512a0cc38ac6f10c09  ./themes/original/img/b_deltbl.png

f60bfbb7ce218a55650c1abbbbee06ae  ./themes/darkblue_orange/img/s_lang.png
f60bfbb7ce218a55650c1abbbbee06ae  ./themes/original/img/s_lang.png

f63a5ad833147eeb94adb4496ddbec41  ./themes/darkblue_orange/img/s_theme.png
f63a5ad833147eeb94adb4496ddbec41  ./themes/original/img/s_theme.png

f6ae61146ce3de8fa11b9e84e086bd04  ./themes/darkblue_orange/img/bd_drop.png
f6ae61146ce3de8fa11b9e84e086bd04  ./themes/original/img/bd_drop.png

f95d66c11bfed9198d13a278269c32b2  ./themes/darkblue_orange/img/s_loggoff.png
f95d66c11bfed9198d13a278269c32b2  ./themes/original/img/s_loggoff.png
[...]
```
2

find -type d -name ".svn" -prune -o -not -empty -type f -printf "%s\n" | sort -rn | uniq -d | xargs -I{} -n1 find -type d -name ".svn" -prune -o -type f -size {}c -print0 | xargs -0 md5sum | sort | uniq -w32 --all-repeated=separate

2chg · 2010-01-28 09:45:29 6
Generat a Random MAC address
This is sample output - yours may be different.
2

od -An -N10 -x /dev/random | md5sum | sed -r 's/^(.{10}).*$/\1/; s/([0-9a-f]{2})/\1:/g; s/:$//;'

unixmonkey12364 · 2010-09-23 00:15:30 5
cymru malware check
This is sample output - yours may be different.
2

md5sum filename | ncat hash.cymru.com 43

opexxx · 2013-03-18 14:24:12 6
Find Duplicate Files (based on size first, then MD5 hash)

Finds duplicates based on MD5 sum. Compares only files with the same size. Performance improvements on: find -not -empty -type f -printf "%s\n" | sort -rn | uniq -d | xargs -I{} -n1 find -type f -size {}c -print0 | xargs -0 md5sum | sort | uniq -w32 --all-repeated=separate The new version takes around 3 seconds where the old version took around 17 minutes. The bottle neck in the old command was the second find. It searches for the files with the specified file size. The new version keeps the file path and size from the beginning.
This is sample output - yours may be different.
2

find -not -empty -type f -printf "%-30s'\t\"%h/%f\"\n" | sort -rn -t$'\t' | uniq -w30 -D | cut -f 2 -d $'\t' | xargs md5sum | sort | uniq -w32 --all-repeated=separate

fobos3 · 2014-10-19 02:00:55 10
Rename all files in a directory to the md5 hash
This is sample output - yours may be different.
2

for i in *; do sum=$(md5sum $i); mv -- "$i" "${sum%% *}"; done

malsploit · 2019-10-17 08:46:22 215
rename a file to its md5sum
This is sample output - yours may be different.
1

md5sum * | sed 's/^$\w*$\s*$.*$/\2 \1/' | while read LINE; do mv $LINE; done

opexxx · 2009-07-30 13:41:39 5
Validating a file with checksum
This is sample output - yours may be different.
1

echo 'c84fa6b830e38ee8a551df61172d53d7 myfile' | md5sum -c

xakon · 2010-01-31 21:07:32 7
Use md5sum to check your music and movie files. Also use diff.

This is a beginning script. You can create a file with > filename. You can also use diff to compare output run at different times to verify no change in your files. I apologize in advance if this is too simple. For some it should be a start.
This is sample output - yours may be different.
1

find . -type f -exec md5sum {}\; > <filename>

wsv123456 · 2010-07-18 22:24:15 4
Compare copies of a file with md5

I had the problem that the Md5 Sum of a file changed after copying it to my external disk. This unhandy command helped me to fix the problem. Show Sample Output
This is sample output - yours may be different.
```
0 #well done!

1 #so much trouble...
```
1

diff <(md5sum render_pack.zip| cut -d " " -f 1) <(md5sum /media/green/render_pack.zip| cut -d " " -f 1);echo $?

schmiddim · 2010-12-27 18:29:00 9
Generate MD5 of string and output only the hash checksum in a readable format

Generates the md5 hash, without the trailing " -" and with the output "broken" into pairs of hexs. Show Sample Output
This is sample output - yours may be different.
```
23 e4 a2 a9 d1 c1 25 73 3a 2e 6b 79 7f 7f 54 ef
```
1

echo -n "String to MD5" | md5sum | sed -e 's/[0-9a-f]\{2\}/& /g' -e 's/ -//'

saibbot · 2011-03-05 11:47:08 4
1 2 3 >

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

List your installed Firefox extensions

Find C/C++ source files

Find C/C++ source files and headers in the current directory.

list files recursively by size

View ~/.ssh/known_hosts key information

Will return the SSH server key information for each host you have in your ~/.ssh/known_hosts file, including key size, key fingerprint, key IP address or domain name, and key type.

List out classes in of all htmls in directory

Lists out all classes used in all *.html files in the currect directory. usefull for checking if you have left out any style definitions, or accidentally given a different name than you intended. ( I have an ugly habit of accidentally substituting camelCase instead of using under_scores: i would name soemthing counterBox instead of counter_box) WARNING: assumes you give classnames in between double quotes, and that you apply only one class per element.

Automator Bash script to create Clean zips in MacOS Finder without __MACOSX metadata

Finder compresses to ZIP but always includes extraneous metadata files (__MACOSX and .DS_Store) files and folders that may confuse other programs. One alternative is creating them and then editing the ZIP. This can work standalone or in an automator script accepting multiple selections (files or folders) and creating one zip per argument/selected file without that metada.

convert single digit to double digits

Uses 'rename' to pad zeros in front of first existing number in each filename. The "--" is not required, but it will prevent errors on filenames which start with "-". You can change the "2d" to any number you want, equaling the total numeric output: aka, 4d = ????, 8d = ????????, etc. I setup a handful of handy functions to this effect (because I couldn't figure out how to insert a var for the value) in the form of 'padnum?', such as: padnum5 () { /usr/bin/rename 's/\d+/sprintf("%05d",$&)/e' -- $@ } Which would change a file "foo-1.txt" to "foo-00001.txt"

fast access to any of your favorite directory.

example: -------------------------------------------------------------------------------------------- user@ubuntu:~/workspace/SVN/haystak-repos/trunk/internal/src$ addpi -------------------------------------------------------------------------------------------- Now that directory is in the list of fast access directories. You can switch to it anytime like this: -------------------------------------------------------------------------------------------- user@ubuntu:~$ pi internal` user@ubuntu:~/workspace/SVN/haystak-repos/trunk/internal/src$ -------------------------------------------------------------------------------------------- Please note the backquote ( the symbol that shares its key with ~ in the keyboard ) pi will switch you to that directory. To see the list of all fast access directories you have to say "cat ~/.pi"

List recorded formular fields of Firefox

When you fill a formular with Firefox, you see things you entered in previous formulars with same field names. This command list everything Firefox has registered. Using a "delete from", you can remove anoying Google queries, for example ;-)

Generate diff of first 500 lines of two files

Useful for massive files where doing a full diff would take too long. This just runs diff on the first 500 lines of each. The use of subshells to feed STDIN is quite a useful construct.

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using md5sum

Commands using md5sum (59) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using md5sum (59)

sorted by