Hide

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again.

Delete that bloated snippets file you've been using and share your personal repository with the world. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

If you have a new feature suggestion or find a bug, please get in touch via http://commandlinefu.uservoice.com/

Get involved!

You can sign-in using OpenID credentials, or register a traditional username and password.

OpenID
or
Sign in Register

First-time OpenID users will be automatically assigned a username which can be changed after signing in.

Hide

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

Hide

News

2011-03-12 - Confoo 2011 presentation
Slides are available from the commandlinefu presentation at Confoo 2011: http://presentations.codeinthehole.com/confoo2011/
2011-01-04 - Moderation now required for new commands
To try and put and end to the spamming, new commands require moderation before they will appear on the site.
2010-12-27 - Apologies for not banning the trolls sooner
Have been away from the interwebs over Christmas. Will be more vigilant henceforth.
2010-09-24 - OAuth and pagination problems fixed
Apologies for the delay in getting Twitter's OAuth supported. Annoying pagination gremlin also fixed.
Hide

Tags

Hide

Functions

Hide

Credits

Site by David Winterbottom (user root).

Commands using sort

Commands using sort from sorted by
Terminal - Commands using sort - 528 results
lynx -dump http://example.com/ | awk '/http/{print $2}' | sort -u
2011-10-13 09:49:36
User: mathias
Functions: awk sort
Tags: awk lynx
0
Up
Down
Get all links of a website

This will get all links from a given URL, remove any duplicates, and output the result.

Comments (3) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
tshark -r data.pcap -R "ip.addr==192.168.1.2 && ip.addr==64.12.24.50 && aim" -d tcp.port==443,aim -T fields -e "aim.buddyname" |sort |uniq -c
2011-10-11 15:38:26
User: anhpht
Functions: sort uniq
0
Up
Down
Print out buddy name (aim) which has been capture in pcap
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
tshark -r data.pcap -R "ip.src==192.168.1.2" -T fields -e "ip.dst" |sort |uniq -c
2011-10-11 15:32:17
User: anhpht
Functions: sort uniq
0
Up
Down
Print all connections of a source IP address in pcap
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
dups() { sort "$@" | uniq -d; }
2011-10-04 16:46:00
User: bartonski
Functions: sort uniq
-3
Up
Down
shell function to find duplicate lines in a series of files or in stdin
Comments (2) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
comm -13 <(sort file1) <(sort file2) > file-new
2011-10-01 18:07:54
User: daa
Functions: comm sort
Tags: sort grep textfile comm
-2
Up
Down
Save lines unique to file2

If both file1 and file2 are already sorted:

comm -13 file1 file2 > file-new

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
sudo find / -type f | perl -MFile::Basename -ne '$counts{dirname($_)}++; END { foreach $d (sort keys %counts) {printf("%d\t%s\n",$counts{$d},$d);} }'|sort -rn | tee /tmp/sortedfilecount.out | head
2011-09-14 19:41:19
User: tamouse
Functions: find perl sort sudo tee
Tags: tee sort perl find HEAD
0
Up
Down
Find directories with lots of files in them

Find which directories on your system contain a lot of files.

Edit: much shorter and betterer with -n switch.

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
cd /path/to/pmwiki/wiki.d;/bin/ls -1 | perl -ne 'my ($group,$name)=split(/\./);$counts{$group}++;' -e 'END { foreach $group (sort keys %counts) {printf("%d\t%s\n",$counts{$group},$group);} }'|sort -rn
2011-09-14 19:33:39
User: tamouse
Functions: cd perl sort
Tags: sort perl pmwiki
-2
Up
Down
Group page count in pmwiki data base

PmWiki stores wiki pages as Group.Name. Simply split the directory listing and count frequency of group occurances.

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
fn=$(find . -type f -printf "%T@\t%p\n"|sort -n|tail -1|cut -f2); echo $(date -r "$fn") "$fn"
2011-09-13 14:26:20
User: tzot
Functions: cut date echo find sort tail
Tags: find stat mtime
0
Up
Down
Hunt for the newest file.
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
netstat -tn | awk 'NR>2 {print $6}' | sort | uniq -c | sort -rn
2011-09-12 23:29:39
User: evandrix
Functions: awk netstat sort uniq
7
Up
Down
Quick network status of machine

credit to tumblr engineering blog @ http://engineering.tumblr.com/

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
curl -sm1 http://www.website.com/ | grep -o 'http://[^"]*jpg' | sort -u | wget -qT1 -i-
2011-09-10 19:21:13
User: kev
Functions: grep sort wget
Tags: wget
0
Up
Down
download all jpg in webpage
Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
du -h /path | sort -h
2011-09-02 13:26:23
User: moogmusic
Functions: du sort
Tags: size directory directory size,du
16
Up
Down
List by size all of the directories in a given tree.
Comments (5) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
cat dirtyfile.txt | awk '{gsub(/[[:punct:]]/,"")}1' | tr A-Z a-z | sed 's/[0-9]*//g' | sed -e 's/ //g' | strings | tr -cs '[:alpha:]' '\ ' | sed -e 's/ /\n/g' | tr A-Z a-z | sort -u > cleanfile.txt
2011-08-28 01:26:04
User: purehate
Functions: awk cat sed sort strings tr
0
Up
Down
Clean a wordlist for use with password cracking tools and rules

Using large wordlists is cumbersome. Using password cracking programs with rules such as Hashcat or John the ripper is much more effective. In order to do this many times we need to "clean" a wordlist removing all numbers, special characters, spaces, whitespace and other garbage. This command will covert a entire wordlist to all lowercase with no garbage.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
grep "HTTP/1.1\" 404" access_log | awk '{print $7 } ' | sort | uniq -c | sort -n
2011-08-25 12:01:14
User: Koobiac
Functions: awk grep sort uniq
Tags: extract awk accesslog 404
1
Up
Down
Extract all 404 errors from your apache accesslog (prefix lines by occurrences number)
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
find . -type f | sed -n 's/..*\.//p' | sort -f | uniq -ic
2011-08-19 00:19:43
User: tyler_l
Functions: find sed sort uniq
Tags: bash find count extension
0
Up
Down
Count files by extension

Change "sort -f" to "sort" and "uniq -ic" to "uniq -c" to make it case sensitive.

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
timeDNS () { { for x in "${local_DNS}" "208.67.222.222" "208.67.220.220" "198.153.192.1" "198.153.194.1" "156.154.70.1" "156.154.71.1" "8.8.8.8" "8.8.4.4"; do ({ echo -n "$x "; dig @"$x" "$*"|grep Query ; }|sponge &) done ; } | sort -n -k5 ; }
2011-08-18 01:11:53
User: unixmonkey365
Functions: dig echo grep sort
Tags: function dig sponge
0
Up
Down
a function to find the fastest free DNS server

Evoke from the command like as:

timeDNS commandlinefu.com

.

This isn't too terribly practical, but it is a good code example of using subshells to run the queries in parallel and the use of an "anonymous function" (a/k/a "inline group") to group i/o.

.

I'm assuming you have already defined your local DNS cache as ${local_DNS}, (here, it's 192.168.0.1).

.

You do need to install `moreutils` to get `sponge`.

.

If you're willing to wait, a slower version w/o sponge, (and w/o sorting), is this:

.

DNS () { for x in "192.168.0.1" "208.67.222.222" "208.67.220.220" "198.153.192.1" "198.153.194.1" "156.154.70.1" "156.154.71.1" "8.8.8.8" "8.8.4.4"; do (echo -n "$x "; dig @"$x" "$*"|grep Query) ; done ; }

Show sample output | Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
ps aux | sort -nk 6
2011-08-16 11:04:45
User: totti
Functions: ps sort
Tags: sort ps
2
Up
Down
Sort output by column

(separator = $IFS)

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
sort -R /usr/share/dict/british | grep -v -m4 ^\{1,10\}$ | tr [:upper:] [:lower:] | tr "\n" " " | tr -d "'s" | xargs -0 echo
2011-08-16 10:11:21
User: takac
Functions: grep sort tr xargs
Tags: tr xkcd
-1
Up
Down
Generate an XKCD #936 style 4 word password

Doesn't use shuf, its much faster with "shuf -n4" instead of sort -R

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
awk -F" " '{ if ( NF == 1 ) { print $0 } }' KINDLE_NOTES_FILE.txt | sed -e '/^=/d' | sed -e '/^[[:space:]]*$/d' -e 's/,//g' | sort | comm -12 List_of_language_words.txt - | uniq
2011-08-15 14:35:33
User: parmegv
Functions: awk comm sed sort
1
Up
Down
Single words from Amazon Kindle 3 notes

You can use any dictionary you want, in any language.

This command will output all single-word annotations that you have underlined in your Kindle device (provided the file) given a list of language-specific words.

If you want to learn vocabulary, this command is ideal.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
lsr() { find "${@:-.}" -print0 |sort -z |xargs -0 ls $LS_OPTIONS -dla; }
2011-08-15 03:10:58
User: h3xx
Functions: find ls sort xargs
Tags: sort find ls xargs function list
2
Up
Down
Sorted, recursive long file listing

Tells you everything you could ever want to know about all files and subdirectories. Great for package creators. Totally secure too.

On my Slackware box, this gets set upon login:

LS_OPTIONS='-F -b -T 0 --color=auto'

and

alias ls='/bin/ls $LS_OPTIONS'

which works great.

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
vim -p `grep -r PATTERN TARGET_DIR | cut -f1 -d: | sort | uniq | xargs echo -n`
2011-08-05 16:34:31
User: kovagoz
Functions: cut echo sort uniq vim xargs
Tags: vim grep
0
Up
Down
Grep across a directory and open matching files in vim (one tab per file)

vim 7 required

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
netstat -an |grep ":80" |awk '{print $5}' | sed s/::ffff://g | cut -d: -f1 |sort |uniq -c |sort -n | tail -1000 | grep -v "0.0.0.0"
2011-07-28 09:36:08
User: zeros
Functions: awk cut grep netstat sed sort tail uniq
0
Up
Down
Find all IP connected to my host through TCP connection and count it

Count and Find all IP connected to my host through TCP connection.

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
netstat -nut | sed '/ESTABLISHED/!d;s/.*[\t ]\+\(.*\):.*/\1/' | sort -u
2011-07-27 07:25:25
User: bitbasher
Functions: netstat sed sort
-1
Up
Down
All IP connected to my host
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
netstat -nut | awk '$NF=="ESTABLISHED" {print $5}' | cut -d: -f1 | sort -u
2011-07-27 07:24:10
User: bitbasher
Functions: awk cut netstat sort
-1
Up
Down
All IP connected to my host

find all computer connected to my host through TCP connection

Show sample output | Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
netstat -lantp | grep ESTABLISHED |awk '{print $5}' | awk -F: '{print $1}' | sort -u
2011-07-21 21:23:10
User: bitbasher
Functions: awk grep netstat sort
16
Up
Down
All IP connected to my host

find all computer connected to my host through TCP connection.

Show sample output | Comments (6) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
find src/ -name "*.java" | while read f; do echo -n "$f "; cat "$f" | tr -dc '{}'; echo; done | awk '{ print length($2), $1 }' | sort -n
2011-07-21 01:25:31
User: mindsocket
Functions: awk cat echo find read sort tr
Tags: Programming java analysis complexity
0
Up
Down
Find .java files with high complexity (counting curly braces)
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate