Hide

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again.

Delete that bloated snippets file you've been using and share your personal repository with the world. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

If you have a new feature suggestion or find a bug, please get in touch via http://commandlinefu.uservoice.com/

Get involved!

You can sign-in using OpenID credentials, or register a traditional username and password.

OpenID
or
Sign in Register

First-time OpenID users will be automatically assigned a username which can be changed after signing in.

Hide

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

Hide

News

2011-03-12 - Confoo 2011 presentation
Slides are available from the commandlinefu presentation at Confoo 2011: http://presentations.codeinthehole.com/confoo2011/
2011-01-04 - Moderation now required for new commands
To try and put and end to the spamming, new commands require moderation before they will appear on the site.
2010-12-27 - Apologies for not banning the trolls sooner
Have been away from the interwebs over Christmas. Will be more vigilant henceforth.
2010-09-24 - OAuth and pagination problems fixed
Apologies for the delay in getting Twitter's OAuth supported. Annoying pagination gremlin also fixed.
Hide

Tags

Hide

Functions

Hide

Credits

Site by David Winterbottom (user root).

Commands tagged awk from sorted by
Terminal - Commands tagged awk - 295 results
cat ~/.ssh/id_rsa.pub | ssh <REMOTE> "(cat > tmp.pubkey ; mkdir -p .ssh ; touch .ssh/authorized_keys ; sed -i.bak -e '/$(awk '{print $NF}' ~/.ssh/id_rsa.pub)/d' .ssh/authorized_keys; cat tmp.pubkey >> .ssh/authorized_keys; rm tmp.pubkey)"
2011-09-30 07:39:24
User: tamouse
Functions: cat ssh
Tags: ssh awk
4
Up
Down
Copy your ssh public key to a server from a machine that doesn't have ssh-copy-id

This one is a bit more robust -- the remote machine may not have an .ssh directory, and it may not have an authorized_keys file, but if it does already, and you want to replace your ssh public key for some reason, this will work in that case as well, without duplicating the entry.

Comments (2) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
echo "command lines" | rev | cut -c 2- | rev
2011-09-21 11:27:52
User: ztank1013
Functions: cut echo ping rev
Tags: sed awk cut rev
0
Up
Down
Remove the last string character using rev and cut

In case sed and awk are not available you may use this to remove the last character from a string with "rev" and "cut".

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
tail -f LOGFILE | awk '{system("say \"" $0 "\"");}'
2011-09-16 06:20:06
User: tamouse
Functions: awk tail
Tags: awk tail say
-1
Up
Down
speak a chat log file while it's running

like #9295, but awkish instead of perlish

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
grep "HTTP/1.1\" 404" access_log | awk '{print $7 } ' | sort | uniq -c | sort -n
2011-08-25 12:01:14
User: Koobiac
Functions: awk grep sort uniq
Tags: extract awk accesslog 404
2
Up
Down
Extract all 404 errors from your apache accesslog (prefix lines by occurrences number)
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
shuf /usr/share/dict/words |grep "^[^']\{3,5\}$" |head -n4
2011-08-24 03:43:55
User: menachem
Functions: grep head
Tags: awk xkcd
0
Up
Down
Generate an XKCD #936 style 4 word password

This does the same thing that the command 'j_melis' submitted, but does it a lot quicker.

That command takes 43 seconds to complete on my system, while the command I submitted takes 6 seconds.

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
echo $(grep "^[^']\{3,5\}$" /usr/share/dict/words|shuf -n4)
2011-08-23 21:15:18
User: j_melis
Functions: echo grep
Tags: awk xkcd
1
Up
Down
Generate an XKCD #936 style 4 word password

The improvement of this command over Strawp's original alternative is that you can specify the size of the words, in this particular case words between 3 and 5 character's long. It also excludes words that contain apostrophes, if you'd rather keep those words simply substitue [^'] for .

Show sample output | Comments (3) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
awk 'BEGIN {srand} /^[a-z]{4,8}$/ {w[i++]=$0} END {while (j++<4) print w[int(rand*i)]}' /usr/share/dict/words
2011-08-18 02:09:42
User: putnamhill
Functions: awk
Tags: awk xkcd
-1
Up
Down
Generate an XKCD #936 style 4 word password

If you do not have shuf or an -R option in sort, you can fall back on awk. This provides maximum portability IMO. The command first collects words from the dictionary that match the criteria - in this case: lower case words with no punctuation that are 4 to 8 characters long. It then prints 4 random entries. I decided to print each word on a separate line to improve readability.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
awk -F\" '/^DocumentRoot/{print $2}' $(httpd -V | awk -F\" '/\.conf/{print $2}')
2011-08-15 13:19:57
User: putnamhill
Functions: awk
Tags: awk apache httpd
1
Up
Down
How To Get the Apache Document Root
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
TIME=$( { time redis-cli PING; } 2>&1 ) ; echo $TIME | awk '{print $3}' | sed 's/0m//; s/\.//; s/s//; s/^0.[^[1-9]*//g;'
2011-08-11 19:09:49
User: allrightname
Functions: awk echo sed time
Tags: bash sed awk time redis
-1
Up
Down
Time redis ping in thousands of a second.

Outputs the real time it takes a Redis ping to run in thousands of a second without any proceeding 0's. Useful for logging or scripted action.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
ls *.zip|awk '{$a="zip -fo "$1" FILENAME"; system($a);}'
2011-07-27 10:22:21
User: youkey
Functions: awk ls
Tags: awk zip
0
Up
Down
Updates file in all the zips

- all zips are in current folder

- FILENAME is file name that should be subsitute in all zips (new version of this file is in current folder)

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
curl -s --compressed http://funnyjunk.com | awk -F'"' '/ '"'"'mainpagetop24h'"'"'/ { print "http://funnyjunk.com"$4 }' | xargs curl -s | grep -o 'ht.*m/pictures/.*\.jpg\|ht.*m/gifs/.*\.gif' | grep "_......_" | uniq | xargs wget
2011-07-21 15:57:21
User: laniner
Functions: awk uniq xargs
Tags: sort sed awk xargs grep curl download images
0
Up
Down
Download 40 top funnyjunk Images to the current directory

If your version of curl does not support the --compressed option, use

curl -s http://funnyjunk.com | gunzip

instead of

curl -s --compressed http://funnyjunk.com
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
find . -type f -name "*.py" -exec wc -l {} \; | awk '{ SUM += $1} END {print SUM }'
2011-07-08 13:38:11
User: dheerosaur
Functions: awk find wc
Tags: awk find loc
0
Up
Down
Find lines of code (LOC) of a filetype in a project.

Replace .py with .rb or .java to get the LOC of that particular filetype. An alternative is http://www.commandlinefu.com/commands/view/2812/make-a-statistic-about-the-lines-of-code

Show sample output | Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
netstat -nt | awk -F":" '{print $2}' | sort | uniq -c
2011-07-05 07:53:29
User: sreimann
Functions: awk netstat sort uniq
Tags: sort awk uniq netstat
0
Up
Down
netstat with group by (ip adress)

count connections, group by IP and port

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
ps -fu userid | awk '/userid/{print $2}' | xargs kill
2011-06-16 12:20:19
User: unxscorob
Functions: awk ps xargs
Tags: awk
0
Up
Down
all out

to be executed from root. this works well on most commercial unix systems, have not tried on linux systems.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
pkill -KILL -u username
2011-06-16 11:40:57
User: SuperFly
Tags: awk grep who
11
Up
Down
all out

How to force a userid to log out of a Linux host, by killing all processes owned by the user, including login shells:

Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
gpg --refresh-keys
2011-06-11 07:53:51
User: unixmonkey22522
Functions: gpg
Tags: GPG sed awk grep key update keyring
-3
Up
Down
Update all GPG keys in your keyring
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
ifconfig | awk '/HWaddr/ { print $1, $5 }'
2011-06-02 12:11:08
User: Wazutiman
Functions: awk ifconfig
Tags: ifconfig awk grep
0
Up
Down
List your interfaces and MAC addresses

Why use grep and awk?

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
ifconfig | grep HWaddr | awk '{print $1,$5}'
2011-05-28 23:12:01
User: jaimerosario
Functions: awk grep ifconfig
Tags: ifconfig awk grep
1
Up
Down
List your interfaces and MAC addresses
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
awk '{x+=$2; y+=$3} NR%5==0{print x/5,y/5; x=y=0}' file.txt
2011-05-26 11:48:32
User: kev
Functions: awk
Tags: awk
0
Up
Down
group every five lines
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
seq 20 | awk 'ORS=NR%5?FS:RS'
2011-05-26 11:39:34
User: kev
Functions: awk seq
Tags: awk
0
Up
Down
join every five lines

seq 20 | awk '{line=line sep $0; sep=" "} !(NR%5){print line; line=sep=""}'

Show sample output | Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
echo $(( $( date +%s ) - $( stat -c %Y * | sort -nr | head -n 1 ) ))
2011-05-12 14:29:45
User: depesz
Functions: date echo head sort stat
Tags: bash awk stat mtime
-1
Up
Down
Show seconds since modified of newest modified file in directory
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
ls -atr /home/reports/*.csv -o --time-sty=+%s | tail -1 | awk '{print systime()-$5}'
2011-05-12 13:58:56
User: MiKatp
Functions: awk ls tail
Tags: bash awk
0
Up
Down
Show seconds since modified of newest modified file in directory
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
FILE=`ls -ltr /var/lib/pgsql/backups/daily/ | tail -n1 | awk '{print $NF}'`; TIME=`stat -c %Y /var/lib/pgsql/backups/daily/$FILE`; NOW=`date +%s`; echo $((NOW-TIME))
2011-05-12 13:21:37
User: allrightname
Functions: awk echo tail
Tags: bash awk stat mtime
0
Up
Down
Show seconds since modified of newest modified file in directory
Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
awk '{command="echo "$2"|md5sum" ;command | getline $2; close(command);sub(/[[:blank:]].*/,"",$2); print $0}'
2011-05-10 15:11:36
User: erichelgeson
Functions: awk command
Tags: awk md5sum
0
Up
Down
use awk to replace field with it's md5sum

Source: http://www.eggheadcafe.com/software/aspnet/35700746/calculating-md5sum-strings-from-within-awk.aspx

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
apt-get install `ssh root@host_you_want_to_clone "dpkg -l | grep ii" | awk '{print $2}'`
2011-05-10 13:33:51
User: TuxOtaku
Functions: apt awk install
Tags: ssh apt awk apt-get grep dpkg
12
Up
Down
"Clone" a list of installed packages from one Debian/Ubuntu Server to another
Comments (3) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate