Hide

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again.

Delete that bloated snippets file you've been using and share your personal repository with the world. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Get involved!

You can sign-in using OpenID credentials, or register a traditional username and password.

OpenID
or
Sign in Register

First-time OpenID users will be automatically assigned a username which can be changed after signing in.

Universal configuration monitoring and system of record for IT.
Hide

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

Hide

News

May 19, 2015 - A Look At The New Commandlinefu
I've put together a short writeup on what kind of newness you can expect from the next iteration of clfu. Check it out here.
March 2, 2015 - New Management
I'm Jon, I'll be maintaining and improving clfu. Thanks to David for building such a great resource!
Hide

Top Tags


awk, bash, curl, find, grep, Linux, sed
Hide

Functions

Hide

Credits

Maintained by Jon H.

Site originally by David Winterbottom (user root).

Psst. Open beta.

Wow, didn't really expect you to read this far down. The latest iteration of the site is in open beta. It's a gentle open beta-- not in prime-time just yet. It's being hosted over at UpGuard (link) and you are more than welcome to give it a shot. Couple things:

  • » The open beta is running a copy of the database that will not carry over to the final version. Don't post anything you don't mind losing.
  • » If you wish to use your user account, you will probably need to reset your password.
Your feedback is appreciated via the form on the beta page. Thanks! -Jon & CLFU Team

Commands using awk from sorted by
Terminal - Commands using awk - 1,210 results
ps aux| grep -v grep| grep httpd| awk {'print $2'}| xargs kill -9
2009-12-06 05:39:50
User: r00t4u
Functions: awk grep kill ps xargs
-2
Up
Down
Killing multiplpe process for one program like apache, wget, postfix etc.
Comments (4) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
ipcalc $(ifconfig eth0 | grep "inet addr:" | cut -d':' -f2,4 | sed 's/.+Bcast:/\//g') | awk '/Network/ { print $2 } '
2009-12-05 15:00:32
User: solarislackware
Functions: awk cut grep ifconfig sed
Tags: Network
-1
Up
Down
Show Network IP and Subnet

same thing as the other

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
awk '/inet end/ {print $3}' <(ifconfig eth0)
2009-12-05 10:45:31
User: voyeg3r
Functions: awk ifconfig
-3
Up
Down
Return IP Address
Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
awk 'NR==2 {print $1}' /proc/net/arp
2009-12-05 10:36:06
User: voyeg3r
Functions: awk
0
Up
Down
Router discovery
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
ifconfig -a| awk 'BEGIN{FS="[ :]+"} /Bcast/{print $4}'
2009-12-05 00:18:24
User: unixmonkey7109
Functions: awk ifconfig
Tags: ifconfig cut ip address awk grep
0
Up
Down
Return IP Address
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
ifconfig -a|grep Bcast:|cut -d\: -f2|awk '{print $1}'
2009-12-04 21:00:46
User: metalx1000
Functions: awk cut grep ifconfig
Tags: ifconfig cut ip address awk grep
-3
Up
Down
Return IP Address

grabs your local IP Address.

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
/usr/sbin/ifconfig -a|awk -F" " 'NR==4{print $2}'
2009-12-04 18:41:29
User: elZaphod
Functions: awk
Tags: ip address
-1
Up
Down
Return IP Address

Tested on Solaris.

Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
curl -s 'xkcd.com' | awk -F\" '/^<img/{printf("<?xml version=\"1.0\"?>\n<xkcd>\n<item>\n <title>%s</title>\n <comment>%s</comment>\n <image>%s</image>\n</item>\n</xkcd>\n", $6, $4, $2)}'
2009-12-03 19:49:37
User: putnamhill
Functions: awk
Tags: awk curl xkcd comic webcomic
0
Up
Down
View the newest xkcd comic.

I wasn't sure how to display the image, so I thought I'd try xml for a different twist.

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
lynx --dump --source http://www.xkcd.com | grep `lynx --dump http://www.xkcd.com | egrep '(png|jpg)'` | grep title | cut -d = -f2,3 | cut -d '"' -f2,4 | sed -e 's/"/|/g' | awk -F"|" ' { system("display " $1);system("echo "$2); } '
2009-12-03 18:53:57
User: solarislackware
Functions: awk cut egrep grep
Tags: bash curl function xkcd comic webcomic
-1
Up
Down
View the newest xkcd comic.

Same thing just a different way to get there. You will need lynx

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
dd if=/dev/zero of=/fs/to/fill/dummy00 bs=8192 count=$(df --block-size=8192 / | awk 'NR!=1 {print $4-100}')
2009-12-03 15:20:18
User: arcege
Functions: awk dd df
Tags: dd df
-3
Up
Down
Fill up disk space (for testing)

For disk space constraint testing. Leaves a little space available for creating temp files, etc. Easily free up the used disk space again by deleting the dummy00 file. Can tailor the testing by building smaller 'blocks' to suit the needs of the testing.

WARNING: do not do this to the '/' (root) filesystem unless you know what you are doing... on some systems it could crash the OS.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
MYSQL="mysql -h HOST -u USERNAME -pPASSWORD -D DB_NAME" ; $MYSQL -BNe "show tables" | awk '{print "set foreign_key_checks=0; drop table `" $1 "`;"}' | $MYSQL unset MYSQL
2009-12-01 17:42:38
User: gadget00
Functions: awk unset
1
Up
Down
Drop all tables from a database, without deleting it
Comments (3) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
awk '/<link>/{gsub(/.*<link>|<\/link>.*/,"");print "<li><a href=\042"$0"\042> "t"</a>" } /<title>/{gsub(/.*<title>|<\/title>.*/,"");t=$0 }' file
2009-11-28 15:49:06
User: unixmonkey7109
Functions: awk
2
Up
Down
last.fm rss parser

you can just use one awk script to parse the rss feed. No need to pipe so many awk's and sed's. Its ugly and inefficient.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
egrep "<link>|<title>" recenttracks.rss | awk 'ORS=NR%2?" ":"\n"' | awk -F "</title>" '{print $2, $1}' | sed -e 's/\<link\>/\<li\>\<a href\=\"/' -e 's/\<\/link\>/\">/' -e 's/\<title\>//' -e 's/$/\<\/a\>\<\/li\>/g' -e '1,1d' -e 's/^[ \t]*//'
2009-11-28 13:19:05
User: HerbT
Functions: awk egrep sed
3
Up
Down
last.fm rss parser

Quick and kludgy rss parser for the recent tracks rss feed from last.fm. Extracts artist and track link.

Show sample output | Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
cho "(Something like http://foo.com/blah_blah)" | awk '{for(i=1;i<=NF;i++){if($i~/^(http|ftp):\/\//)print $i}}'
2009-11-28 03:31:41
User: unixmonkey7109
Functions: awk
Tags: perl regex url match url matching
-1
Up
Down
Match a URL

don't have to be that complicated

Comments (3) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
netstat | awk '/EST/{print $5}' | sort
2009-11-24 14:32:12
User: unixmonkey7109
Functions: awk netstat
3
Up
Down
Sorted list of established destination connections

no need grep. its redundant when awk is present.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
netstat | grep EST | awk '{print $5}' | sort
2009-11-24 13:38:28
User: unixoid
Functions: awk grep netstat
-2
Up
Down
Sorted list of established destination connections

Sometimes I need a quick visual way to determine if there is a particular server who is opening too many connections to the database machine.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
ls -l `ls -l |awk '/^l/ {print $8}'`
2009-11-23 16:02:18
User: yooreck
Functions: awk ls
-3
Up
Down
List all symbolic links in current directory

ls -l may vary depending on operating system, so "print $8" may have to be changed

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
awk '/q=/{print $11}' /var/log/httpd/access_log.4 | awk -F 'q=' '{print $2}' | sed 's/+/ /g;s/%22/"/g;s/q=//' | cut -d "&" -f 1
2009-11-22 17:13:48
User: isma
Functions: awk sed
Tags: bash sed awk cut mail httpd access_log
1
Up
Down
Checks apache's access_log file, strips the search queries and shoves them up your e-mail

as unixmonkey7109 pointed out, first awk parse replaces three steps.

Comments (8) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
cat /var/log/httpd/access_log | grep q= | awk '{print $11}' | awk -F 'q=' '{print $2}' | sed 's/+/ /g;s/%22/"/g;s/q=//' | cut -d "&" -f 1 | mail [email protected] -s "[your-site] search strings for `date`"
2009-11-22 03:03:06
User: isma
Functions: awk cat grep sed strings
Tags: cat bash sed awk grep cut mail httpd access_log
-2
Up
Down
Checks apache's access_log file, strips the search queries and shoves them up your e-mail

It's not a big line, and it *may not* work for everybody, I guess it depends on the detail of access_log configuration in your httpd.conf. I use it as a prerotate command for logrotate in httpd section so it executes before access_log rotation, everyday at midnight.

Comments (3) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
ls -l | awk '$5 > 1000000' | sort -k5n
2009-11-20 21:18:45
User: cfajohnson
Functions: awk ls sort
1
Up
Down
Show sorted list of files with sizes more than 1MB in the current dir
Comments (3) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
find <dir> -printf '%p : %A@\n' | awk '{FS=" : " ; if($2 < <time in epoc> ) print $1 ;}' | xargs rm --verbose -fr ;
2009-11-20 16:31:58
User: angleto
Functions: awk find rm xargs
-2
Up
Down
remove files and directories with acces time older than a given date

remove files with access time older than a given date.

If you want to remove files with a given modification time replace %A@ with %T@. Use %C@ for the modification time.

The time is expressed in epoc but is easy to use any other format.

Show sample output | Comments (6) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
cat *.c | { printf "se te du\nplot '-' t '' w dots\n"; tr '[[:upper:]]' '[[:lower:]]' | tr -s [[:punct:][:space:]] '\n' | sort | uniq -c | sort -nr | head -n 100 | awk '{print $1}END{print "e"}'; } | gnuplot
2009-11-20 14:53:26
User: taliver
Functions: awk cat head printf sort tr uniq
5
Up
Down
Plot frequency distribution of words from files on a terminal.

Uses the dumb terminal option in gnuplot to plot a graph of frequencies. In this case, we are looking at a frequency analysis of words in all of the .c files.

Show sample output | Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
awk '{print $1}' "/proc/modules" | xargs modinfo | awk '/^(filename|desc|depends)/'
2009-11-20 13:06:25
User: unixmonkey7109
Functions: awk modinfo xargs
Tags: sed xargs lsmod modinfo
4
Up
Down
Short Information about loaded kernel modules
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
for item in *;do echo -n "$item - ";find "$item" -type f -print0 | xargs -0 file -iNf - | grep video | cut -d: -f1 | xargs -d'\n' /usr/share/doc/mplayer/examples/midentify | grep ID_LENGTH | awk -F= '{sum+=$2} END {print(sum/60)}'; done | grep -v ' - 0$'
2009-11-19 06:28:15
User: jnash
Functions: awk cut echo file grep xargs
0
Up
Down
Better "hours of video" summary for each file/dir in the current directory

I know this has been beaten to death but finding video files using mime types and printing the "hours of video" for each directory is (IMHO) easier to parse than just a single total. Output is in minutes.

Among the other niceties is that it omits printing of non-video files/folders

PS: Barely managed to fit it within the 255 character limit :D

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
/usr/share/mplayer/midentify.sh `find . -name "*.avi" -print` | grep ID_LENGTH | awk -F "=" '{sum += $2} END {print sum/60/60; print "hours"}'
2009-11-17 03:33:20
User: equant
Functions: awk grep
4
Up
Down
Shows you how many hours of avi video you have.

midentify.sh is part of mplayer, but you might have to locate it on your box.

Show sample output | Comments (5) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate