Hide

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again.

Delete that bloated snippets file you've been using and share your personal repository with the world. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

If you have a new feature suggestion or find a bug, please get in touch via http://commandlinefu.uservoice.com/

Get involved!

You can sign-in using OpenID credentials, or register a traditional username and password.

OpenID
or
Sign in Register

First-time OpenID users will be automatically assigned a username which can be changed after signing in.

Hide

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

Hide

News

2011-03-12 - Confoo 2011 presentation
Slides are available from the commandlinefu presentation at Confoo 2011: http://presentations.codeinthehole.com/confoo2011/
2011-01-04 - Moderation now required for new commands
To try and put and end to the spamming, new commands require moderation before they will appear on the site.
2010-12-27 - Apologies for not banning the trolls sooner
Have been away from the interwebs over Christmas. Will be more vigilant henceforth.
2010-09-24 - OAuth and pagination problems fixed
Apologies for the delay in getting Twitter's OAuth supported. Annoying pagination gremlin also fixed.
Hide

Tags

Hide

Functions

Hide

Credits

Site by David Winterbottom (user root).

Commands using awk

Commands using awk from sorted by
Terminal - Commands using awk - 985 results
awk '!array[$1]++' file.txt
2012-08-23 21:04:51
User: bede
Functions: awk
0
Up
Down
Output entire line once per unique value of the first column

Removes duplicates in the specified field/column while outputting entire lines. An elegant command for processing tab (or otherwise) delimited data.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
tcpdump -ntr NAME_OF_CAPTURED_FILE.pcap 'tcp[13] = 0x02 and dst port 80' | awk '{print $4}' | tr . ' ' | awk '{print $1"."$2"."$3"."$4}' | sort | uniq -c | awk ' {print $2 "\t" $1 }'
2012-08-22 21:26:10
User: efuoax
Functions: awk sort tcpdump tr uniq
Tags: awk uniq tcpdump print
1
Up
Down
Read a tcpdump file and count SYN packets to port 80, Order column by destination.
Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
curl -s "http://subfusion.net/cgi-bin/quote.pl?quote=futurama&number=1" |awk '/<body><br><br><b><hr><br>/ {flag=1;next} /<br><br><hr><br>/{flag=0} flag {print}'
2012-08-17 20:57:28
User: wreck23
Functions: awk
0
Up
Down
Random Futurama quote

Random Futurama quote from http://cubemonkey.net/quotes/. Change the quote= to change the quote source.

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
awk '{print $1}' /proc/net/dev|grep :|sed "s/:.*//g"
2012-08-17 13:36:47
User: kro
Functions: awk grep sed
0
Up
Down
Network Interfaces

Linux only

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
grep -e "[sh]d[a-l][0-9]\?" /proc/partitions | awk '{print $4}'
2012-08-17 13:15:46
User: kro
Functions: awk grep
0
Up
Down
list all available disks and disk partitions

grep -e "[sh]d[a-l]$" /proc/partitions | awk '{print $4}' # for disks only

grep -e "[sh]d[a-l][0-9]\+" /proc/partitions | awk '{print $4}' # for partitions only

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
screen -x $(screen -ls | awk 'NR == 2 { print $1 }')
2012-08-17 02:03:26
User: codecaine
Functions: awk screen
0
Up
Down
Connected to first screen session created
Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
sudo apt-get remove $(dpkg -l|awk '/^ii linux-image-/{print $2}'|sed 's/linux-image-//'|awk -v v=`uname -r` 'v>$0'|sed 's/-generic*//'|awk '{printf("linux-headers-%s\nlinux-headers-%s-generic*\nlinux-image-%s-generic*\n",$0,$0,$0)}')
2012-08-15 10:02:12
User: mtron
Functions: awk sed sudo
Tags: Debian Linux awk apt-get grep kernel dpkg
2
Up
Down
Remove all unused kernels with apt-get

Remove old kernels (*-generic and *-generic-pae) via apt-get on debian/ubuntu based systems. Tested on ubuntu 10.04 - 12.04.

Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
wget --no-use-server-timestamps $(curl $(curl http://wallbase.cc/random/23/eqeq/1920x1080/0/100/20 | grep 'wallpaper/' | awk -F'"' '{print $2}' | head -n1) | grep -A4 bigwall | grep img | awk -F'"' '{print $2}'); feh --bg-center $(ls -1t | head -n1)
2012-08-14 22:06:27
User: yosh
Functions: awk grep head ls wget
0
Up
Down
Random (sfw, 1920x1080) wallpaper from wallbase.cc
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
ps wwwwuax|awk '/command/ { printf("kill -9 %s\n",$2) }'|/bin/sh
2012-08-14 21:44:38
User: jetdillo
Functions: awk ps
0
Up
Down
Kill all processes belonging to a user

Okay, commands like this are a bit of a personal peeve. awk(1) operates on a /pattern/ {action} paradigm and yet I see people leave out the /pattern/ portion of an awk command all the time, opting to use grep or sed instead. You'll save yourself some typing and time if you include the /pattern/ with your {action}.

Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
cat /dev/urandom|od -t x1|awk 'NR > line { pos=int(rand()*15)+2;printf("%s",$pos);line=NR+(rand()*1000);digits = digits+2 } digits == 64 { print("\n");exit }'
2012-08-14 19:02:00
User: jetdillo
Functions: awk cat exit od
Tags: Os X Linux awk bsd random od /dev/urandom
1
Up
Down
extracts 64 bytes of random digits from random lines out of /dev/random sent to stdio

Use this the next time you need to come up with a reasonably random bitstring, like for a WPA/WPA2 PSK or something. Takes a continuous stream of bytes coming from /dev/urandom, runs it through od(1), picking a random field ($0 and $1 excluded) from a random line and then prints it.

Show sample output | Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
find . -type f -exec file '{}' + | grep shell | awk -F':' '{print $1}' | xargs chmod u+x
2012-08-09 18:53:08
User: llebegue
Functions: awk chmod file find grep xargs
0
Up
Down
Add executable bit to all shell scripts under current directory recursively.

Allows to change 'shell' compatible files execution bit even if their name is not *.sh

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
lsof -p `pidof pidgin` | awk '{ print $9 }'|egrep `hostname` | grep -o ">[^:]\+:" | tr -d ":>" | while read line; do host $line; done;
2012-08-08 14:47:20
User: NaN0
Functions: awk egrep grep host read tr
Tags: IP pidgin ip address
0
Up
Down
Display IP addresses Pidgin IM Client is connected to
Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
export PATH= $(echo $PATH | tr ':' '\n' | awk '!/matching string/' | paste -sd:)
2012-07-29 00:30:54
User: bugmenot
Functions: awk echo export paste tr
0
Up
Down
Remove from PATH paths containing a string

If there are spaces won't work.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
egrep '.*(("STATUS)|("HEAD)).*' http_access.2012.07.18.log | awk '{sum+=$11; ++n} END {print "Tot="sum"("n")";print "Avg="sum/n}'
2012-07-27 12:18:29
User: fanchok
Functions: awk egrep
Tags: bash egrep awk grep summation apache2 access_log average accesslog
0
Up
Down
sum and average of requests responses times or sizes in Apache2 access log

Depending on your Apache access log configuration you may have to change the sum+=$11 to previous or next awk token.

Beware, usually in access log last token is time of response in microseconds, penultimate token is size of response in bytes. You may use this command line to calculate sum and average of responses sizes.

You can also refine the egrep regexp to match specific HTTP requests.

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
echo "DESCRIBE dbname.table_name" | mysql -u dbusername | awk '{print $1}' | grep -v Field
2012-07-26 21:06:11
User: adauto
Functions: awk echo grep
0
Up
Down
Displays all the fields of a table, really usefull to run it inside editor (Emacs or vim)

You can execute this inside an editor to get all the fields inside your buffer and do the magic, really usefull when your tables contain a giant list of fields.

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
egrep 'ServerAlias|ServerName' /etc/apache2/sites-enabled/*.conf | awk '{printf "%s\t%s\n",$2,$3}' | sed 's/www.//' | sort | uniq
2012-07-25 12:51:15
User: staeff
Functions: awk egrep sed sort
0
Up
Down
Get Unique Hostnames from Apache Config Files

Get a list of all the unique hostnames from the apache configuration files. Handy to see what sites are running on a server. When i saw the command i had some ideas to make it shorter. Here is my version.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
ip -f inet a | awk '/inet / { print $2 }'
2012-07-18 15:13:10
User: BorneBjoern
Functions: awk
Tags: awk IP ip address
2
Up
Down
Get the IP address

gives u each configured IP in a seperate line.

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
ip a s eth0 | awk -F"[/ ]+" '/inet / {print $3}'
2012-07-18 02:47:12
User: ilovespam
Functions: awk
Tags: IP
0
Up
Down
Get the IP address
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
ip a s eth0 | awk '/inet / {print $2} | sed -e 's/\/..//g'
2012-07-18 02:43:15
User: ilovespam
Functions: awk sed
Tags: IP
0
Up
Down
Get the IP address
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
ip a s eth0 | grep "inet " | head -n 1 | awk '{print $2}' | cut -f1 -d'/'
2012-07-16 07:54:43
User: thelan
Functions: awk cut grep head
Tags: IP
-4
Up
Down
Get the IP address

Get the first IPv4 address of an interface

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
ifconfig | awk -F"[: ]+" '/inet addr/ {print $4}'
2012-07-16 07:48:33
User: saibbot
Functions: awk ifconfig
Tags: ifconfig
-1
Up
Down
Get the IP address
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
ifconfig | grep "inet" | tail -1 | awk '{print $2}'
2012-07-13 01:27:59
User: wotan
Functions: awk grep ifconfig tail
Tags: ifconfig
0
Up
Down
Get the IP address

more variety

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
ifconfig | grep "inet" | grep "broadcast" | awk '{print $2}'
2012-07-13 01:24:42
User: wotan
Functions: awk grep ifconfig
Tags: ifconfig
0
Up
Down
Get the IP address
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
ps -fu $USER | awk {'print $2'} | xargs kill [-9]
2012-07-06 21:17:01
User: carlossiscomtec
Functions: awk kill ps xargs
1
Up
Down
Kill all processes belonging to a user
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
sudo apt-get remove $(dpkg -l|awk '/^ii linux-image-/{print $2}'|sed 's/linux-image-//'|awk -v v=`uname -r` 'v>$0'|sed 's/-generic-pae//'|awk '{printf("linux-headers-%s\nlinux-headers-%s-generic*\nlinux-image-%s-generic*\n",$0,$0,$0)}')
2012-07-02 08:10:32
User: mtron
Functions: awk sed sudo
Tags: Debian Linux awk grep kernel dpkg aptitude
1
Up
Down
Remove all unused kernels with apt-get
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate