Hide

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again.

Delete that bloated snippets file you've been using and share your personal repository with the world. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

If you have a new feature suggestion or find a bug, please get in touch via http://commandlinefu.uservoice.com/

Get involved!

You can sign-in using OpenID credentials, or register a traditional username and password.

OpenID

First-time OpenID users will be automatically assigned a username which can be changed after signing in.

Hide

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands tagged md5sum

Hide

News

2011-03-12 - Confoo 2011 presentation: Slides are available from the commandlinefu presentation at Confoo 2011: http://presentations.codeinthehole.com/confoo2011/
2011-01-04 - Moderation now required for new commands: To try and put and end to the spamming, new commands require moderation before they will appear on the site.
2010-12-27 - Apologies for not banning the trolls sooner: Have been away from the interwebs over Christmas. Will be more vigilant henceforth.
2010-09-24 - OAuth and pagination problems fixed: Apologies for the delay in getting Twitter's OAuth supported. Annoying pagination gremlin also fixed.

Hide

Functions

Hide

Credits

Site by David Winterbottom (user root).

Commands tagged md5sum

Terminal - Commands tagged md5sum - 19 results

md5sum filename | ncat hash.cymru.com 43

2013-03-18 14:24:12

User: opexxx

Functions: md5sum

Tags: md5sum ncat

Up
Down

cymru malware check

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

cat /var/lib/dpkg/info/*.md5sums|grep usr/sbin/sshd|sed 's,usr,/usr,'|md5sum -c

2013-03-12 11:20:48

User: Ztyx

Functions: cat grep md5sum sed

Tags: md5sum md5 checksum

Up
Down

Verify a file has not been tampered with since dpkg installation

Replace "user/sbin/sshd" with the file you would like to check. If you are doing this due to intrusion, you obviously would want to check size, last modification date and md5 of the md5sum application itself. Also, note that "/var/lib/dpkg/info/*.md5sums" files might have been tampered with themselves. Neither to say, this is a useful command.

find-duplicates () { find "$@" -not -empty -type f -printf "%s\0" | sort -rnz | uniq -dz | xargs -0 -I{} -n1 find "$@" -type f -size {}c -print0 | xargs -0 md5sum | sort | uniq -w32 --all-repeated=separate; }

2013-01-23 23:20:26

User: mpeschke

Functions: find md5sum sort uniq xargs

Tags: bash sort uniq find md5sum xarg

-1

Up
Down

Find Duplicate Files (based on size first, then MD5 hash)

This is a modified version of the OP, wrapped into a bash function.

This version handles newlines and other whitespace correctly, the original has problems with the thankfully rare case of newlines in the file names.

It also allows checking an arbitrary number of directories against each other, which is nice when the directories that you think might have duplicates don't have a convenient common ancestor directory.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

echo -n "password"|md5sum|awk '{print $1}'

2011-11-08 21:34:50

User: windfold

Functions: awk echo

Tags: awk echo md5sum checksum

Up
Down

Generate Sha1, MD5 hash using echo

This is mostly for my own notes but this command will compute a md5 message digest from the command line.

You can also replace md5sum with other checksum commands (e.g., sha1sum)

find . ! -name \*.md5 -exec 'md5sum "{}" > "{}".md5' \;

2011-10-26 21:54:48

User: ioggstream

Functions: find

Tags: ls grep md5sum for loop

Up
Down

create missing md5 for all files in directory

Just use find. No need to test file existence. On gnu find you can limit directory depth. Use "{}" to manage correctly files with spaces

Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

for i in $(find . -name *md5checksum_file* | sed 's/$\.\/.*$md5checksum_file.txt/\1/'); do cd "$i"; md5sum -c "md5checksum_file.txt"; cd -; done | tee ~/checksum_results.txt | grep -v "<current directory>"

2011-05-17 01:08:44

User: gocoogs

Functions: cd find grep md5sum sed tee

Tags: md5sum check recursive checksum

Up
Down

use md5sum -c recursively through subdirectory tree when every directory has its own checksum file

extracts path to each md5 checksum file, then, for each path, cd to it, check the md5sum, then cd - to toggle back to the starting directory. greps at the end to remove cd chattering on about the current directory.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

awk '{command="echo "$2"|md5sum" ;command | getline $2; close(command);sub(/[[:blank:]].*/,"",$2); print $0}'

2011-05-10 15:11:36

User: erichelgeson

Functions: awk command

Tags: awk md5sum

Up
Down

use awk to replace field with it's md5sum

Source: http://www.eggheadcafe.com/software/aspnet/35700746/calculating-md5sum-strings-from-within-awk.aspx

echo -n "String to MD5" | md5sum | sed -e 's/../& /g' -e 's/ -//'

2011-03-06 12:59:07

User: saibbot

Functions: echo md5sum sed

Tags: sed md5sum

Up
Down

Generate MD5 of string and output only the hash checksum in a readable format

Same result with simpler regular expression..

echo -n "String to MD5" | md5sum | cut -b-32

2011-03-05 19:05:50

User: shopeonarope

Functions: cut echo md5sum

Tags: cut md5sum md5 hash checksum

Up
Down

Generate MD5 of string and output only the hash checksum

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

echo -n "String to MD5" | md5sum | sed -e 's/[0-9a-f]\{2\}/& /g' -e 's/ -//'

2011-03-05 11:47:08

User: saibbot

Functions: echo md5sum sed

Tags: sed md5sum

Up
Down

Generate MD5 of string and output only the hash checksum in a readable format

Generates the md5 hash, without the trailing " -" and with the output "broken" into pairs of hexs.

echo -n "String to MD5" | md5sum | cut -f1 -d' '

2011-03-05 03:53:09

User: xakon

Functions: cut echo md5sum

Tags: cut md5sum md5 hash checksum

-2

Up
Down

Generate MD5 of string and output only the hash checksum

Nothing special about hashing here, only the use of cut, I think, could result at fewer keystrokes.

echo -n "String to get MD5" | md5sum | sed "s/ -//"

2011-03-03 23:40:04

User: Tephlon

Functions: echo md5sum sed

Tags: sed md5sum md5 hash checksum

-1

Up
Down

Generate MD5 of string and output only the hash checksum

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

digest -a -v md5 <file-name>

2011-02-08 13:45:11

User: fmuster

Tags: md5sum digest

Up
Down

md5 checksum check

md5sum <<<"test"

2010-11-24 12:04:41

User: unefunge

Functions: md5sum

Tags: bash md5sum

Up
Down

Generate MD5 hash for a string

Comments (8) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

find . -type f -print0 | xargs -0 md5sum

2010-08-24 19:57:24

User: potatoface

Functions: find xargs

Tags: md5sum recursive md5

Up
Down

calculate md5 sums for every file in a directory tree

an alternative

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

find . -type f -exec md5sum {} \; > sum.md5

2010-08-24 09:37:31

User: Tungmar

Functions: find md5sum

Tags: md5sum recursive md5

Up
Down

Calculate md5 sums for every file in a directory tree

Comments (3) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

find -type d -name ".svn" -prune -o -not -empty -type f -printf "%s\n" | sort -rn | uniq -d | xargs -I{} -n1 find -type d -name ".svn" -prune -o -type f -size {}c -print0 | xargs -0 md5sum | sort | uniq -w32 --all-repeated=separate

2010-01-28 09:45:29

User: 2chg

Functions: find md5sum sort uniq xargs

Tags: find duplicate files md5sum VCS subversion

Up
Down

Find Duplicate Files, excluding .svn-directories (based on size first, then MD5 hash)

Improvement of the command "Find Duplicate Files (based on size first, then MD5 hash)" when searching for duplicate files in a directory containing a subversion working copy. This way the (multiple dupicates) in the meta-information directories are ignored.

Can easily be adopted for other VCS as well. For CVS i.e. change ".svn" into ".csv":

find -type d -name ".csv" -prune -o -not -empty -type f -printf "%s\n" | sort -rn | uniq -d | xargs -I{} -n1 find -type d -name ".csv" -prune -o -type f -size {}c -print0 | xargs -0 md5sum | sort | uniq -w32 --all-repeated=separate

diff <(ssh server01 'cd config; find . -type f -exec md5sum {} \;| sort -k 2') <(ssh server02 'cd config;find . -type f -exec md5sum {} \;| sort -k 2')

2009-09-11 15:24:59

User: arcege

Functions: diff find md5sum sort ssh

Tags: ssh diff sort find md5sum

Up
Down

Identify differences between directories (possibly on different servers)

This can be much faster than downloading one or both trees to a common servers and comparing the files there. After, only those files could be copied down for deeper comparison if needed.

echo "A great password" | md5sum

2009-04-24 14:32:56

User: ubersoldat

Functions: echo

Tags: md5sum password

-5

Up
Down

Use md5 to generate a pretty hard to crack password

You can also use sha1sum and variants for longer passwords