Hide

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again.

Delete that bloated snippets file you've been using and share your personal repository with the world. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

If you have a new feature suggestion or find a bug, please get in touch via http://commandlinefu.uservoice.com/

Get involved!

You can sign-in using OpenID credentials, or register a traditional username and password.

OpenID
or
Sign in Register

First-time OpenID users will be automatically assigned a username which can be changed after signing in.

Hide

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

Hide

News

2011-03-12 - Confoo 2011 presentation
Slides are available from the commandlinefu presentation at Confoo 2011: http://presentations.codeinthehole.com/confoo2011/
2011-01-04 - Moderation now required for new commands
To try and put and end to the spamming, new commands require moderation before they will appear on the site.
2010-12-27 - Apologies for not banning the trolls sooner
Have been away from the interwebs over Christmas. Will be more vigilant henceforth.
2010-09-24 - OAuth and pagination problems fixed
Apologies for the delay in getting Twitter's OAuth supported. Annoying pagination gremlin also fixed.
Hide

Tags

Hide

Functions

Hide

Credits

Site by David Winterbottom (user root).

Commands tagged awk

Commands tagged awk from sorted by
Terminal - Commands tagged awk - 252 results
tcpdump -ntr NAME_OF_CAPTURED_FILE.pcap 'tcp[13] = 0x02 and dst port 80' | awk '{print $4}' | tr . ' ' | awk '{print $1"."$2"."$3"."$4}' | sort | uniq -c | awk ' {print $2 "\t" $1 }'
2012-08-22 21:26:10
User: efuoax
Functions: awk sort tcpdump tr uniq
Tags: awk uniq tcpdump print
1
Up
Down
Read a tcpdump file and count SYN packets to port 80, Order column by destination.
Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
sudo apt-get remove $(dpkg -l|awk '/^ii linux-image-/{print $2}'|sed 's/linux-image-//'|awk -v v=`uname -r` 'v>$0'|sed 's/-generic*//'|awk '{printf("linux-headers-%s\nlinux-headers-%s-generic*\nlinux-image-%s-generic*\n",$0,$0,$0)}')
2012-08-15 10:02:12
User: mtron
Functions: awk sed sudo
Tags: Debian Linux awk apt-get grep kernel dpkg
2
Up
Down
Remove all unused kernels with apt-get

Remove old kernels (*-generic and *-generic-pae) via apt-get on debian/ubuntu based systems. Tested on ubuntu 10.04 - 12.04.

Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
cat /dev/urandom|od -t x1|awk 'NR > line { pos=int(rand()*15)+2;printf("%s",$pos);line=NR+(rand()*1000);digits = digits+2 } digits == 64 { print("\n");exit }'
2012-08-14 19:02:00
User: jetdillo
Functions: awk cat exit od
Tags: Os X Linux awk bsd random od /dev/urandom
1
Up
Down
extracts 64 bytes of random digits from random lines out of /dev/random sent to stdio

Use this the next time you need to come up with a reasonably random bitstring, like for a WPA/WPA2 PSK or something. Takes a continuous stream of bytes coming from /dev/urandom, runs it through od(1), picking a random field ($0 and $1 excluded) from a random line and then prints it.

Show sample output | Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
egrep '.*(("STATUS)|("HEAD)).*' http_access.2012.07.18.log | awk '{sum+=$11; ++n} END {print "Tot="sum"("n")";print "Avg="sum/n}'
2012-07-27 12:18:29
User: fanchok
Functions: awk egrep
Tags: bash egrep awk grep summation apache2 access_log average accesslog
0
Up
Down
sum and average of requests responses times or sizes in Apache2 access log

Depending on your Apache access log configuration you may have to change the sum+=$11 to previous or next awk token.

Beware, usually in access log last token is time of response in microseconds, penultimate token is size of response in bytes. You may use this command line to calculate sum and average of responses sizes.

You can also refine the egrep regexp to match specific HTTP requests.

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
hostname -I
2012-07-18 19:43:48
User: bashfan
Functions: hostname
Tags: awk IP ip address
0
Up
Down
Get the IP address

That's the easiest way to do it. -I (or capital i) display all network addresses of a host

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
ip -f inet a | awk '/inet / { print $2 }'
2012-07-18 15:13:10
User: BorneBjoern
Functions: awk
Tags: awk IP ip address
2
Up
Down
Get the IP address

gives u each configured IP in a seperate line.

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
sudo apt-get remove $(dpkg -l|awk '/^ii linux-image-/{print $2}'|sed 's/linux-image-//'|awk -v v=`uname -r` 'v>$0'|sed 's/-generic-pae//'|awk '{printf("linux-headers-%s\nlinux-headers-%s-generic*\nlinux-image-%s-generic*\n",$0,$0,$0)}')
2012-07-02 08:10:32
User: mtron
Functions: awk sed sudo
Tags: Debian Linux awk grep kernel dpkg aptitude
1
Up
Down
Remove all unused kernels with apt-get
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
netstat -tn | grep :80 | awk '{print $5}'| grep -v ':80' | cut -f1 -d: |cut -f1,2,3 -d. | sort | uniq -c| sort -n
2012-06-26 08:29:37
User: krishnan
Functions: awk cut grep netstat sort uniq
Tags: sort awk IP grep netstat connection range user
0
Up
Down
Number of connections per IP with range 24

cut -f1,2 - IP range 16

cut -f1,2,3 - IP range 24

cut -f1,2,3,4 - IP range 24

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
svn status | grep "^M" | while read entry; do file=`echo $entry | awk '{print $2}'`; echo $file; svn revert $file; done
2012-06-17 16:01:06
User: wsams
Functions: awk echo grep read
Tags: svn awk grep svn revert
0
Up
Down
Revert all modified files in an SVN repo

This command allows you to revert every modified file one-by-one in a while loop, but also after "echo $file;" you can do any sort of processing you might want to add before the revert happens.

Show sample output | Comments (6) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
awk -F'\t' '{print $0 >>$5.tsv}'
2012-05-16 18:18:16
User: pykler
Functions: awk
Tags: awk split tsv
0
Up
Down
Split tsv file by fifth column ... or any column

Will split the std input lines into files grouped by the 5th column content.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
cal 04 2012 | awk '{ $7 && X=$7 } END { print X }'
2012-05-06 23:43:21
User: flatcap
Functions: awk cal
Tags: Date manipulation awk date cal
2
Up
Down
Get the date for the last Saturday of a given month

If your locale has Monday as the first day of the week, like mine in the UK, change the two $7 into $6

Show sample output | Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
echo `disklabel mfid1s4 | sed -n '$p' | awk '{print $2}'` / 1024 / 1024 | bc -l
2012-05-04 12:48:58
User: RageJello
Functions: awk bc echo sed
Tags: csh sed awk bc -l FreeBSD disklabel bsdlabel
0
Up
Down
Converts the output of disklabel from bytes to Gigabytes on FreeBSD

This was done in csh.

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
cal 04 2012 | awk 'NF <= 7 { print $7 }' | grep -v "^$" | tail -1
2012-05-03 16:57:45
User: javidjamae
Functions: awk cal grep tail
Tags: Date manipulation awk tail grep date dates cal
-2
Up
Down
Get the date for the last Saturday of a given month

This is a little trickier than finding the last Sunday, because you know the last Sunday is in the first position of the last line. The trick is to use the NF less than or equal to 7 so it picks up all the lines then grep out any empty lines.

Show sample output | Comments (4) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
lynx -dump http://www.cooks4arab.com | awk '/http/{print $2}' | egrep "^https{0,1}"
2012-04-23 10:43:33
User: khaled_eng15
Functions: awk egrep
Tags: awk lynx
0
Up
Down
Get all links of a website
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
lynx -dump http://www.domain.com | awk '/http/{print $2}' | egrep "^https{0,1}"
2012-04-23 10:41:02
User: khaled_eng15
Functions: awk egrep
Tags: awk lynx
0
Up
Down
Get all links of a website
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
for k in $(git branch | sed /\*/d); do echo "$(git log -1 --pretty=format:"%ct" $k) $k"; done | sort -r | awk '{print $2}'
2012-04-07 11:19:00
User: dahuie
Functions: awk echo sed sort
Tags: bash git sed awk
0
Up
Down
Show git branches by date - useful for showing active branches

Simpler and without all of the coloring gimmicks. This just returns a list of branches with the most recent first. This should be useful for cleaning your remotes.

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
sudo apt-get remove $(dpkg -l|awk '/^ii linux-image-/{print $2}'|sed 's/linux-image-//'|awk -v v=`uname -r` 'v>$0'|sed 's/-generic//'|awk '{printf("linux-headers-%s\nlinux-headers-%s-generic\nlinux-image-%s-generic\n",$0,$0,$0)}')
2012-04-02 10:53:40
User: mtron
Functions: awk sed sudo
Tags: Debian Linux awk grep kernel dpkg aptitude
-1
Up
Down
Remove all unused kernels with apt-get

small update for this command to work with linux kernels 3.x

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
ps h --ppid $(cat /var/run/apache2.pid) | awk '{print"-p " $1}' | xargs sudo strace
2012-03-21 01:59:41
User: colinmollenhour
Functions: awk cat ps sudo xargs
Tags: awk apache ps strace
1
Up
Down
easily strace all your apache *child* processes

Like the original version except it does not include the parent apache process or the grep process and adds "sudo" so it can be run by user.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
curl -s mobile.twitter.com/search | sed -n '/trend_footer_list/,/\ul>/p' | awk -F\> '{print $3}' | awk -F\< '{print $1}' | sed '/^$/d'
2012-03-15 17:17:06
User: articmonkey
Functions: awk sed
Tags: twitter awk curl
0
Up
Down
Print trending topics on Twitter

Prints top 5 twitter topics. Not very well written at all but none of the others worked.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
find /path/to/dir -iname "*.ext" -print0 | xargs -0 mplayer -really-quiet -cache 64 -vo dummy -ao dummy -identify 2>/dev/null | awk '/ID_LENGTH/{gsub(/ID_LENGTH=/,"")}{SUM += $1}END{ printf "%02d:%02d:%02d\n",SUM/3600,SUM%3600/60,SUM%60}'
2012-03-11 12:28:48
User: DarkSniper
Functions: awk find printf xargs
Tags: video audio mplayer awk find
0
Up
Down
Get the total length of all video / audio in the current dir (and below) in H:m:s

Improvement on Coderjoe's Solution. Gets rid of grep and cut (and implements them in awk) and specifies some different mplayer options that speed things up a bit.

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
awk 'FNR==100 {print;exit}' file
2012-03-04 20:25:57
User: Testuser_01
Functions: awk
Tags: awk time LINES
0
Up
Down
Output specific line in a very big file and exit afterwards

This will save parsing time for operations on very big files.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
awk '{cmd="date --date=\""$1"\" +\"%Y/%m/%d %H:%M:%S\" "; cmd | getline convdate; print cmd";"convdate }' file.txt
2012-02-28 14:08:52
User: EBAH
Functions: awk
Tags: Date manipulation awk date embed
0
Up
Down
awk date convert

Convert readable date/time with `date` command

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
print "$(lsvg -Lo |xargs lsvg -L|grep "TOTAL PPs"|awk -F"(" '{print$2}'|sed -e "s/)//g" -e "s/megabytes/+/g"|xargs|sed -e "s/^/(/g" -e "s/+$/)\/1000/g"|bc ) GB"
2012-02-03 13:58:41
User: janvanderwijk
Tags: sed awk xargs grep print aix lsvg
0
Up
Down
See the total amount of data on an AIX machine

Not figured by me, but a colleague of mine.

See the total amount of data on an AIX machine.

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
sed -r 's/(\[|])//g' | awk ' { $1=strftime("%D %T",$1); print }'
2012-02-03 13:07:37
User: Zulu
Functions: awk sed
Tags: sed awk timestamp
0
Up
Down
Change time format in log, UNIX Timestamp to Human readable

It remove the square bracket and convert UNIX time to human readable time for all line of a stream (or file).

Show sample output | Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
ps -fea | grep PATTERN | awk {'print $2'} | xargs kill -9
2012-01-27 20:31:36
User: k4ch0
Functions: awk grep kill ps xargs
Tags: awk xargs grep kill print ps
0
Up
Down
Kill processes associated with PATTERN

Kill all process that concide whit PATTERN

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate