Hide

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again.

Delete that bloated snippets file you've been using and share your personal repository with the world. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Get involved!

You can sign-in using OpenID credentials, or register a traditional username and password.

OpenID
or
Sign in Register

First-time OpenID users will be automatically assigned a username which can be changed after signing in.

Universal configuration monitoring and system of record for IT.
Hide

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

Hide

News

May 19, 2015 - A Look At The New Commandlinefu
I've put together a short writeup on what kind of newness you can expect from the next iteration of clfu. Check it out here.
March 2, 2015 - New Management
I'm Jon, I'll be maintaining and improving clfu. Thanks to David for building such a great resource!
Hide

Top Tags


awk, bash, curl, find, grep, Linux, sed
Hide

Functions

Hide

Credits

Maintained by Jon H.

Site originally by David Winterbottom (user root).

Psst. Open beta.

Wow, didn't really expect you to read this far down. The latest iteration of the site is in open beta. It's a gentle open beta-- not in prime-time just yet. It's being hosted over at UpGuard (link) and you are more than welcome to give it a shot. Couple things:

  • » The open beta is running a copy of the database that will not carry over to the final version. Don't post anything you don't mind losing.
  • » If you wish to use your user account, you will probably need to reset your password.
Your feedback is appreciated via the form on the beta page. Thanks! -Jon & CLFU Team

Commands using awk from sorted by
Terminal - Commands using awk - 1,210 results
for i in `seq 1 255`; do ping -c 1 10.10.10.$i | tr \\n ' ' | awk '/1 received/ {print $2}'; done
2009-08-22 09:34:27
User: hemanth
Functions: awk ping tr
Tags: ping
3
Up
Down
Ping sweep without NMAP

Ping sweep without NMAP

Comments (3) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
mailq | grep DrWEB | awk {'print $1'} | sed s/*//g | postsuper -d -
2009-08-21 22:01:41
User: foob4r
Functions: awk grep mailq sed
Tags: Postfix
0
Up
Down
delete all DrWeb status, failure and other messages on a postfix server
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
ps -ef | awk '/process-name/ && !/awk/ {print}'
2009-08-19 11:22:09
User: dopeman
Functions: awk ps
1
Up
Down
Search for an active process without catching the search-process

This does the same thing as many of the 'grep' based alternatives but allows a more finite control over the output. For example if you only wanted the process ID you could change the command:

ps -ef | awk '/mingetty/ && !/awk/ {print $2}'

If you wanted to kill the returned PID's:

ps -ef | awk '/mingetty/ && !/awk/ {print $2}' | xargs -i kill {}
Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
mysql -u<user> -p<password> -s -e 'DESCRIBE <table>' <database> | tail -n +1 | awk '{ printf($1",")}' | head -c -1
2009-08-17 12:54:44
User: Cowboy
Functions: awk head tail
2
Up
Down
Get table column names from an MySQL-database in comma-seperated form
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
awk < file.name '{ system("resolveip -s " $1) }'
2009-08-17 08:09:39
User: alanwilliamson
Functions: awk
1
Up
Down
Resolve a list of domain names to IP addresses

Given a file of FQDN, this simple command resolves the IP addresses of those Useful for log files or anything else that outputs domain names.

Show sample output | Comments (3) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
FFPID=$(pidof firefox-bin) && lsof -p $FFPID | awk '{ if($7>0) print ($7/1024/1024)" MB -- "$9; }' | grep ".mozilla" | sort -rn
2009-08-16 08:58:22
User: josue
Functions: awk grep pidof sort
Tags: sort awk grep firefox lsof
6
Up
Down
Check which files are opened by Firefox then sort by largest size.

Check which files are opened by Firefox then sort by largest size (in MB). You can see all files opened by just replacing grep to "/". Useful if you'd like to debug and check which extensions or files are taking too much memory resources in Firefox.

Show sample output | Comments (3) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
egrep "^lease" /var/lib/dhcp/db/dhcpd.leases |awk '{ print $2 }'
2009-08-14 07:31:00
User: peshay
Functions: awk egrep
0
Up
Down
get IPs with a DHCP lease

You can use that to create a excludefile for nmap, to find hosts, with no DHCP lease in your DHCP range.

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
echo $PATH|awk -F: ' { for (i=1; i <= NF; i++) print $i }'
2009-08-12 07:56:56
User: nitins
Functions: awk echo
Tags: bash awk
-2
Up
Down
List path of binaries
Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
awk -F ',' '{ x = x + $4 } END { print x }' test.csv
2009-08-11 12:10:33
User: coffeeaddict_nl
Functions: awk
Tags: awk column CSV sum
8
Up
Down
Sum columns from CSV column $COL
Comments (3) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
find . -name \*.pdf -exec pdfinfo {} \; | grep Pages | sed -e "s/Pages:\s*//g" | awk '{ sum += $1;} END { print sum; }'
2009-08-10 16:28:24
User: unixmonkey3987
Functions: awk find grep sed sum
3
Up
Down
Count the number of pages of all PDFs in current directory and all subdirs, recursively
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
ls -1 *.jpg | while read fn; do export pa=`exiv2 "$fn" | grep timestamp | awk '{ print $4 " " $5 ".jpg"}' | tr ":" "-"`; mv "$fn" "$pa"; done
2009-08-10 00:52:22
User: axanc
Functions: awk export grep ls mv read tr
0
Up
Down
Picture Renamer

Renames all the jpg files as their timestamps with ".jpg" extension.

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
awk /./ filename
2009-08-09 02:04:46
User: point_to_null
Functions: awk
Tags: awk
1
Up
Down
Remove newlines from output

?Cat and grep? You can use only grep ("grep \. filename"). Better option is awk.

Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
nslookup commandlinefu.com|sed 's/[^0-9. ]//g'|tail -n 1|awk -F " " '{print $2}'
2009-08-07 17:32:55
User: thundernode
Functions: awk nslookup sed tail
1
Up
Down
Get the ip registered to a domain on OpenWRT

I use this in a script on my openwrt router to check if my DynDNS needs to be updated, saves your account from being banned for blank updates.

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
ifconfig | grep "0xffffffff" | awk '{ print $2 }' | xargs -n 1 ifconfig em0 delete
2009-08-04 05:18:36
User: vwal
Functions: awk grep ifconfig xargs
Tags: Network bsd FreeBSD aliases rc.conf
3
Up
Down
Delete all aliases for a network interface on a (Free)BSD system

The example command deletes all aliases for network interface 'em0' assuming that the aliases have netmask of 255.255.255.255 and the master IP has some other netmask (such as 255.255.255.0). See here -> http://my.galagzee.com/2009/07/22/deleting-all-network-interface-aliases/ for more on the rationale of this command.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
curl -s http://isc.sans.org/sources.html|grep "ipinfo.html"|awk -F"ip=" {'print $2'}|awk -F"\"" {'print $1'}|xargs -n1 sudo iptables -A OUTPUT -j DROP -d > 2&>1
2009-08-03 20:18:41
User: din7
Functions: awk grep iptables sudo xargs
4
Up
Down
Retrieve top ip threats from http://isc.sans.org/sources.html and add them into iptables output chain.

Retrieve top ip threats from http://isc.sans.org/sources.html and add them into iptables output chain.

Comments (9) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
du -aB1m|awk '$1 >= 100'
2009-08-01 20:16:33
User: karatatar
Functions: awk du
Tags: Filesystem disk usage size
0
Up
Down
Which files/dirs waste my disk space

Useful for analyzing disk usage. If you prefer GUI try http://en.wikipedia.org/wiki/Filelight or http://www.marzocca.net/linux/baobab/

Show sample output | Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
netstat -ant | grep :80 | grep ESTABLISHED | awk '{print $5}' | awk -F: '{print $1}' | sort | uniq -c | sort -n
2009-07-31 18:28:16
User: garchacesaug
Functions: awk grep netstat sort uniq
3
Up
Down
Show in a web server, running in the port 80, how many ESTABLISHED connections by ip it has.

The command could show you all conecctions if you skip "grep ESTABLISHED"

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
ifconfig | awk '/ddr:[0-9]/ {sub(/addr:/, ""); print $2}'
2009-07-31 09:30:54
User: danny_b85
Functions: awk ifconfig
Tags: Linux ifconfig
1
Up
Down
Get all IPs via ifconfig

The initial version of this command also outputted extra empty lines, so it went like this:

192.168.166.48

127.0.0.1

This happened on Ubuntu, i haven't tested on anything else.

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
ls foo*.jpg | awk '{print("mv "$1" "$1)}' | sed 's/foo/bar/2' | /bin/sh
2009-07-30 13:54:12
User: opexxx
Functions: awk ls sed
3
Up
Down
Batch File Rename with awk and sed
Comments (4) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
svn ls -R | egrep -v -e "\/$" | xargs svn blame | awk '{print $2}' | sort | uniq -c | sort -r
2009-07-29 02:10:45
User: askedrelic
Functions: awk egrep ls sort uniq xargs
Tags: svn count
16
Up
Down
Prints total line count contribution per user for an SVN repository

I'm working in a group project currently and annoyed at the lack of output by my teammates. Wanting hard metrics of how awesome I am and how awesome they aren't, I wrote this command up.

It will print a full repository listing of all files, remove the directories which confuse blame, run svn blame on each individual file, and tally the resulting line counts. It seems quite slow, depending on your repository location, because blame must hit the server for each individual file. You can remove the -R on the first part to print out the tallies for just the current directory.

Show sample output | Comments (6) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
ifconfig | awk -F':| +' '/ddr:/{print $4}'
2009-07-25 22:51:08
User: 0x89
Functions: awk ifconfig
Tags: Linux ifconfig
1
Up
Down
Get all IPs via ifconfig

and, a lot uglier, with sed:

ifconfig | sed -n '/inet addr:/s/[^:]\+:\(\S\+\).*/\1/p'

Edit:

Wanted to be shorter than the perl version. Still think that the perl version is the best..

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
cat /var/log/secure.log | awk '{print substr($0,0,12)}' | uniq -c | sort -nr | awk '{printf("\n%s ",$0) ; for (i = 0; i<$1 ; i++) {printf("*")};}'
2009-07-24 07:20:06
User: knassery
Functions: awk cat sort uniq
17
Up
Down
Show me a histogram of the busiest minutes in a log file:

Busiest seconds:

cat /var/log/secure.log | awk '{print substr($0,0,15)}' | uniq -c | sort -nr | awk '{printf("\n%s ",$0) ; for (i = 0; i<$1 ; i++) {printf("*")};}'
Show sample output | Comments (4) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
awk '{print NR": "$0; for(i=1;i<=NF;++i)print "\t"i": "$i}'
2009-07-23 06:25:31
User: recursiverse
Functions: awk
Tags: awk
16
Up
Down
Analyze awk fields

Breaks down and numbers each line and it's fields. This is really useful when you are going to parse something with awk but aren't sure exactly where to start.

Show sample output | Comments (3) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
$ awk '{ split(sprintf("%1.3e", $1), b, "e"); p = substr("yzafpnum_kMGTPEZY", (b[2]/3)+9, 1); o = sprintf("%f", b[1] * (10 ^ (b[2]%3))); gsub(/\./, p, o); print substr( gensub(/_[[:digit:]]*/, "", "g", o), 1, 4); }' < test.dat
2009-07-22 16:54:14
User: mungewell
Functions: awk
Tags: awk
2
Up
Down
Convert numbers to SI notation

converts any number on the 'stdin' to SI notation. My version limits to 3 digits of precious (working with 10% resistors).

Show sample output | Comments (5) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
curl -u 'username' https://api.del.icio.us/v1/posts/all | sed 's/^.*href=//g;s/>.*$//g;s/"//g' | awk '{print $1}' | grep 'http'
2009-07-22 07:32:59
User: bubo
Functions: awk grep sed
2
Up
Down
get delicious bookmarks on your shell (text version :-))

a variation of avi4now's command - thanks by the way!

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate