Hide

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again.

Delete that bloated snippets file you've been using and share your personal repository with the world. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

If you have a new feature suggestion or find a bug, please get in touch via http://commandlinefu.uservoice.com/

Get involved!

You can sign-in using OpenID credentials, or register a traditional username and password.

OpenID
or
Sign in Register

First-time OpenID users will be automatically assigned a username which can be changed after signing in.

Hide

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

Hide

News

2011-03-12 - Confoo 2011 presentation
Slides are available from the commandlinefu presentation at Confoo 2011: http://presentations.codeinthehole.com/confoo2011/
2011-01-04 - Moderation now required for new commands
To try and put and end to the spamming, new commands require moderation before they will appear on the site.
2010-12-27 - Apologies for not banning the trolls sooner
Have been away from the interwebs over Christmas. Will be more vigilant henceforth.
2010-09-24 - OAuth and pagination problems fixed
Apologies for the delay in getting Twitter's OAuth supported. Annoying pagination gremlin also fixed.
Hide

Tags

Hide

Functions

Hide

Credits

Site by David Winterbottom (user root).

Commands using awk from sorted by
Terminal - Commands using awk - 1,113 results
dpkg-query -l| grep -v "ii " | grep "rc " | awk '{print $2" "}' | tr -d "\n" | xargs aptitude purge -y
2009-04-28 19:25:53
User: thepicard
Functions: awk grep tr xargs
Tags: Debian awk xargs grep aptitude dpkg-query tr
-3
Up
Down
remove unneeded configuration files in debian

This will, for an application that has already been removed but had its configuration left behind, purge that configuration from the system. To test it out first, you can remove the last -y, and it will show you what it will purge without actually doing it. I mean it never hurts to check first, "just in case." ;)

Comments (3) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
sudo aptitude purge `dpkg --get-selections | grep deinstall | awk '{print $1}'`
2009-04-28 11:44:04
User: kelevra
Functions: awk grep sudo
Tags: Debian aptitude
13
Up
Down
Purge configuration files of removed packages on debian based systems

Purge all configuration files of removed packages

Show sample output | Comments (5) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
sudo apt-get remove --purge `dpkg -l | awk '{print $2}' | grep gnome` && apt-get autoremove
2009-04-28 10:34:42
User: kelevra
Functions: awk grep sudo
Tags: awk apt-get dpkg
-4
Up
Down
Remove packages by pattern on debian and based systems

Useful for removes a package and its depends, for example to remove the gnome desktop environment, also configuration files will be removed, you should be carefully and sure that you want to do this.

Show sample output | Comments (7) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
ifconfig en1 | awk '/inet / {print $2}' | mail -s "hello world" email@email.com
2009-04-28 06:01:52
User: rez0r
Functions: awk ifconfig mail
Tags: ifconfig awk macosx IP osx mac email
9
Up
Down
sends your internal IP by email

This is useful if you have need to do port forwarding and your router doesn't assign static IPs, you can add it to a script in a cron job that checks if you IP as recently changed or with a trigger script.

This was tested on Mac OSX.

Comments (4) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
netstat -an | grep ESTABLISHED | awk '{print $5}' | awk -F: '{print $1}' | sort | uniq -c | awk '{ printf("%s\t%s\t",$2,$1) ; for (i = 0; i < $1; i++) {printf("*")}; print "" }'
2009-04-27 22:02:19
User: knassery
Functions: awk grep netstat sort uniq
46
Up
Down
Graph # of connections for each hosts.

Written for linux, the real example is how to produce ascii text graphs based on a numeric value (anything where uniq -c is useful is a good candidate).

Show sample output | Comments (7) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
awk 'BEGIN {srand()} {print int(rand()*1000000) "\t" $0}' FILE | sort -n | cut -f 2-
2009-04-19 20:04:58
User: udim
Functions: awk cut sort
-3
Up
Down
Randomize the order of lines in a text file.

Replace FILE with a filename (or - for stdin).

Comments (2) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
find /path/to/my/files/ -type f -name "*txt*" | xargs du -k | awk 'BEGIN{x=0}{x=x+$1}END{print x}'
2009-04-16 14:17:04
User: unixmonkey3280
Functions: awk du find xargs
2
Up
Down
Summarise the size of all files matching a simple regex

Use the find command to match certain files and summarise their total size in KBytes.

Show sample output | Comments (3) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
awk '/sshd/ && /Failed/ {gsub(/invalid user/,""); printf "%-12s %-16s %s-%s-%s\n", $9, $11, $1, $2, $3}' /var/log/auth.log
2009-04-16 00:56:23
User: frailotis
Functions: awk printf
11
Up
Down
Displays the attempted user name, ip address, and time of SSH failed logins on Debian machines

A variation of a script I found on this site and then slimmed down to just use awk. It displays all users who have attempted to login to the box and failed using SSH. Pipe it to the sort command to see which usernames have the most failed logins.

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
/sbin/ifconfig -a | awk '/(cast)/ { print $2 }' | cut -d':' -f2 | head -1
2009-04-15 06:44:18
User: d4n3sh
Functions: awk cut head
Tags: Network ifconfig IP network card
3
Up
Down
Get the IP address of a machine. Just the IP, no junk.
Comments (8) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
find | sed -e "s/^.*\///" | awk ' BEGIN { FS=""} { print NF " " $0 } ' | sort -nrf | head -10
2009-04-13 21:03:07
User: nitehawk
Functions: awk find head sed sort
5
Up
Down
get the top 10 longest filenames
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
cd ~/.mozilla/firefox/ && sqlite3 `cat profiles.ini | grep Path | awk -F= '{print $2}'`/formhistory.sqlite "select * from moz_formhistory" && cd - > /dev/null
2009-04-13 20:23:37
User: klipz
Functions: awk cd grep
19
Up
Down
List recorded formular fields of Firefox

When you fill a formular with Firefox, you see things you entered in previous formulars with same field names. This command list everything Firefox has registered. Using a "delete from", you can remove anoying Google queries, for example ;-)

Comments (3) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
svn status | grep "^\?" | awk '{print $2}' | xargs svn add
2009-04-13 18:37:58
User: miguelbaldi
Functions: awk grep xargs
Tags: svn
2
Up
Down
Recursively Add Changed Files to Subversion

Extracted from http://www.howtogeek.com/wiki/Recursively_Add_Changed_Files_to_Subversion

Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
svn status | grep '^?' | awk '{ print $2; }' | xargs svn add
2009-04-10 21:55:37
User: unixmonkey4200
Functions: awk grep xargs
Tags: svn awk xargs
1
Up
Down
sync svn working copy and remote repository (auto adding new files)

Lists the local files that are not present in the remote repository (lines beginning with ?)

and add them.

Show sample output | Comments (2) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
grep "install " /var/log/dpkg.log | awk '{print $4}' | xargs apt-get -y remove --purge
2009-04-06 13:06:04
User: skygreg
Functions: awk grep xargs
Tags: Debian
4
Up
Down
Remove today's installed packages
Comments (3) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
history|awk '{print $2}'|awk 'BEGIN {FS="|"} {print $1}'|sort|uniq -c|sort -r
2009-04-05 13:40:56
User: kayowas
Functions: awk sort uniq
7
Up
Down
See most used commands

It will return a ranked list of your most commonly-entered commands using your command history

Show sample output | Comments (5) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
find . -type f -size +25000k -exec ls -lh {} \; | awk '{ print $8 ": " $5 }'
2009-04-02 15:01:17
User: benajnim
Functions: awk find ls
5
Up
Down
List files above a given threshold

List files above a given size threshold.

Show sample output | Comments (3) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
nmap -sP your network/submask | awk "/^Host/"'{ print $2 }'
2009-04-02 12:41:54
User: rauhmaru
Functions: awk
0
Up
Down
Display only hosts up in network

This command will display only the hosts that are active in the network.

Show sample output | Comments (3) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
find ./ -not -type d | xargs wc -l | cut -c 1-8 | awk '{total += $1} END {print total}'
2009-04-01 15:14:15
User: benschw
Functions: awk cut find wc xargs
1
Up
Down
Recursive Line Count
Comments (5) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
man beep | sed -e '1,/Note/d; /BUGS/,$d' | awk '{print $2}' | xargs -IX sudo beep -f X -l 500
2009-04-01 06:48:48
User: jnash
Functions: awk man sed sudo xargs
4
Up
Down
Play musical notes from octave of middle C

Are there any creative pieces of music that can be created using beep and the shell? I'd love to hear it!

Comments (4) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
awk '{print > $3".txt"}' FILENAME
2009-03-31 15:14:13
User: alperyilmaz
Functions: awk
Tags: awk sorting redirection
2
Up
Down
sorting file contents into individual files with awk

This command will sort the contents of FILENAME by redirecting the output to individual .txt files in which 3rd column will be used for sorting. If FILENAME contents are as follows:

foo foo A foo

bar bar B bar

lorem ipsum A lorem

Then two files called A.txt and B.txt will be created and their contents will be:

A.txt

foo foo A foo

lorem ipsum A lorem

and B.txt will be

bar bar B bar

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
[[ $(COLUMNS=200 ps faux | awk '/grep/ {next} /ssh -N -R 4444/ {i++} END {print i}') ]] || nohup ssh -N -R 4444:localhost:22 user@relay &
2009-03-31 09:39:59
User: j0rn
Functions: awk nohup ps ssh
Tags: ssh cronjob
4
Up
Down
ensure your ssh tunnel will always be up (add in crontab)

I find it ugly & sexy at the same time isn't it ?

Comments (3) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
cat /var/log/secure | grep smtp | awk '{print $9}' | cut -f2 -d= | sort | uniq -c | sort -n | tail
2009-03-30 15:49:54
User: empulse
Functions: awk cat cut grep sort uniq
-2
Up
Down
List SMTP connections by host

Searches /var/log/secure for smtp connections then lists these by number of connections made and hosts.

Comments (2) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
cat /var/log/secure | grep sshd | grep Failed | sed 's/invalid//' | sed 's/user//' | awk '{print $11}' | sort | uniq -c | sort -n
2009-03-30 15:48:24
User: empulse
Functions: awk cat grep sed sort sshd uniq
8
Up
Down
Find brute force attempts on SSHd

Searches the /var/log/secure log file for Failed and/or invalid user log in attempts.

Show sample output | Comments (7) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
netstat -ntu | awk '{print $5}' | cut -d: -f1 | sort | uniq -c | sort -n
2009-03-28 21:02:26
User: tiagofischer
Functions: awk cut netstat sort uniq
Tags: sort awk uniq netstat cut
14
Up
Down
Number of open connections per ip.

Here is a command line to run on your server if you think your server is under attack. It prints our a list of open connections to your server and sorts them by amount.

BSD Version:

netstat -na |awk '{print $5}' |cut -d "." -f1,2,3,4 |sort |uniq -c |sort -nr
Show sample output | Comments (4) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
awk '/start_pattern/,/stop_pattern/' file.txt
2009-03-28 14:28:59
User: atoponce
Functions: awk
80
Up
Down
Display a block of text with AWK

I find this terribly useful for grepping through a file, looking for just a block of text. There's "grep -A # pattern file.txt" to see a specific number of lines following your pattern, but what if you want to see the whole block? Say, the output of "dmidecode" (as root):

dmidecode | awk '/Battery/,/^$/'

Will show me everything following the battery block up to the next block of text. Again, I find this extremely useful when I want to see whole blocks of text based on a pattern, and I don't care to see the rest of the data in output. This could be used against the '/etc/securetty/user' file on Unix to find the block of a specific user. It could be used against VirtualHosts or Directories on Apache to find specific definitions. The scenarios go on for any text formatted in a block fashion. Very handy.

Comments (6) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate