Hide

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again.

Delete that bloated snippets file you've been using and share your personal repository with the world. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

If you have a new feature suggestion or find a bug, please get in touch via http://commandlinefu.uservoice.com/

Get involved!

You can sign-in using OpenID credentials, or register a traditional username and password.

OpenID

First-time OpenID users will be automatically assigned a username which can be changed after signing in.

Hide

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using awk

Hide

News

2011-03-12 - Confoo 2011 presentation: Slides are available from the commandlinefu presentation at Confoo 2011: http://presentations.codeinthehole.com/confoo2011/
2011-01-04 - Moderation now required for new commands: To try and put and end to the spamming, new commands require moderation before they will appear on the site.
2010-12-27 - Apologies for not banning the trolls sooner: Have been away from the interwebs over Christmas. Will be more vigilant henceforth.
2010-09-24 - OAuth and pagination problems fixed: Apologies for the delay in getting Twitter's OAuth supported. Annoying pagination gremlin also fixed.

Hide

Functions

Hide

Credits

Site by David Winterbottom (user root).

Commands using awk

Terminal - Commands using awk - 985 results

for i in $(ps -eo pid|grep -v PID);do echo ""; echo -n "==$i== ";awk '/^read|^write/{ORS=" "; print}' /proc/$i/io 2>/dev/null; echo -n " ==$i=="; done|sort -nrk5|awk '{printf "%s\n%s %s\n%s %s\n%s\n\n",$1,$2,$3,$4,$5,$6}'

2012-10-25 17:16:24

User: omatictost

Functions: awk echo grep ps sort

Up
Down

Sort I/O activity by PID number.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

ls /var/log/sa/sa[0-9]*|xargs -I '{}' sar -q -f {}| awk '/Average/'|awk '{runq+=$2;plist+=$3}END{print "average runq-sz:",runq/NR; print "average plist-sz: "plist/NR}'

2012-10-25 17:04:48

User: omatictost

Functions: awk ls xargs

Up
Down

SAR - Get the monthly queue length average using sar -q for both the runq-sz and plist-sz.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

for i in `ls /var/log/sa/|grep -E "sa[0-9][0-9]"`;do echo -ne "$i -- ";sar -r -f /var/log/sa/$i|awk '{ printf "%3.2f\n",($4-$6-$7)*100/(3+$4)}'|grep -Eiv "average|linux|^ --|0.00|^-" |awk '{sum+=$1 }END{printf "Average = %3.2f%%\n",sum/NR}';done

2012-10-25 17:00:58

User: omatictost

Functions: awk echo grep printf

Up
Down

SAR - List the average memory usage for all days recorded under '/var/log/sa/*' using sar -r.

echo "abcdefg"|awk 'BEGIN {FS="''"} {print $2}'

2012-10-25 16:12:28

User: omatictost

Functions: awk echo

Up
Down

Print a single character from a string with AWK.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

/sbin/ifconfig |awk '/bond|eth/{getline i;printf $0" ";printf "%s\n", i" "}'|awk '{print $1,substr($7,6)}'

2012-10-25 16:08:15

User: omatictost

Functions: awk printf

Up
Down

Aligns NIC device names and associated IPs.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

echo 1268727836 | awk '{print strftime("%c",$1)}'

2012-10-25 15:39:08

User: omatictost

Functions: awk echo

Up
Down

Display EPOCH time in human readable format using AWK.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

awk '{print NR "\t" $0}'

2012-10-21 15:45:54

User: tox2ik

Functions: awk

Tags: awk

Up
Down

prints line numbers

Let's not forget awk!

ompload() { wget -O- - "$1" --quiet|curl -# -F file1=@- http://ompldr.org/upload|awk '/Info:|File:|Thumbnail:|BBCode:/{gsub(/<[^<]*?\/?>/,"");$1=$1;print}';}

2012-10-19 22:54:55

User: dzup

Functions: awk wget

-2

Up
Down

upload video to ompload (* not yet tested, let me know if works)

Like i said, i havent test it yet, all becouse my internet its soo slow, if you try and works please share, also be nice to do it using the direct url link.

a=$(stty -a -F /dev/tty1| awk -F'[ ;]' '/columns/ { print $9 }'); fold -w$a /dev/vcs1;echo

2012-10-19 09:43:14

User: knoppix5

Functions: awk fold stty

Up
Down

Lurk what's going on on remote console

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

export proc=chrome && ps aux | grep $proc | grep -v grep |awk '{print $2}'

2012-10-16 07:19:36

User: bknarendra

Functions: awk export grep ps

Up
Down

List process ids (including parent and child process) of a process given its name. Similar to pgrep

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

tshark -qr [cap] -z conv,tcp | awk '{printf("%s:%s:%s\n",$1,$3,$10)}' | awk -F: '{printf("%s %s %s\n",$1,$3,substr($5,1,length($5)-10))}' | sort | uniq -c | sort -nr

2012-10-16 06:39:01

User: knassery

Functions: awk sort uniq

Tags: network performance awk, sort tshark

-1

Up
Down

Tshark to Generate Top Talkers by #TCP conv started per second.

#_connects src_IP dst_IP When_It_Happened_Secs

for P in $(mount | awk '/type nfs / {print $3;}'); do echo $P; sudo umount $P && sudo mount $P && echo "ok :)"; done

2012-10-14 22:39:58

User: amatix

Functions: awk echo mount sudo umount

Tags: Linux mount nfs

Up
Down

Remount all NFS mounts on a host

`mount -o remount` doesn't pick up new NFS options (eg. timeo, soft, retrans, etc) so you need to do a full mount/remount cycle. This one-liner makes it quick and easy :) Update your fstab with the new options, then run it.

netstat -tn | awk '($4 ~ /:22\s*/) && ($6 ~ /^EST/) {print substr($5, 0, index($5,":"))}'

2012-10-03 04:47:54

User: toxick

Functions: awk netstat

Tags: ssh awk netstat

Up
Down

list current ssh clients

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

NUMCPUS=`grep ^proc /proc/cpuinfo | wc -l`; FIRST=`cat /proc/stat | awk '/^cpu / {print $5}'`; sleep 1; SECOND=`cat /proc/stat | awk '/^cpu / {print $5}'`; USED=`echo 2 k 100 $SECOND $FIRST - $NUMCPUS / - p | dc`; echo ${USED}% CPU Usage

2012-10-02 03:57:51

User: toxick

Functions: awk echo sleep wc

Tags: cpu shell usage ps command percentage

Up
Down

Display CPU usage in percentage

Using the output of 'ps' to determine CPU usage is misleading, as the CPU column in 'ps' shows CPU usage per process over the entire lifetime of the process. In order to get *current* CPU usage (without scraping a top screen) you need to pull some numbers from /proc/stat. Here, we take two readings, once second apart, determine how much IDLE time was spent across all CPUs, divide by the number of CPUs, and then subtract from 100 to get non-idle time.

find . $ -iname '*.cpp' -o -iname '*.h' $ -exec wc -l {} \; | sort -n | cut --delimiter=. -f 1 | awk '{s+=$1} END {print s}'

2012-09-19 15:21:01

User: jecxjoopenid

Functions: awk cut find sort wc

Up
Down

Count the number of lines of code, returns total

Searches for *.cpp and *.h in directory structure, counts the number of lines for each matching file and adds the counts together.

awk '{a[$3]++} END {for(i in a) print i}' /var/log/squid/access.log

2012-09-18 12:38:37

User: clfajt

Functions: awk

Tags: squid webproxy

Up
Down

Lists all clients of a Squid proxy

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

for file in `svn st | awk '{print $2}'`; do svn revert $file; done

2012-09-14 11:05:29

User: srounce

Functions: awk file

Tags: svn awk xargs grep

Up
Down

Revert all modified files in an SVN repo

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

function ptop(){ `ps -ef | grep $* | awk 'BEGIN{printf "top "}{printf "-p" $2 " " }'` }

2012-09-13 02:43:57

User: xcwen

Functions: awk grep

Tags: top

Up
Down

top with progame name

for i in $(multipath -ll | grep "3PARdata,VV"|awk '{print $1}') ; do parted -a optimal /dev/mapper/$i --script -- mklabel gpt mkpart primary 1 -1 set 1 lvm on ; done

2012-09-12 15:30:36

User: mhs

Functions: awk grep set

Tags: multipath parted

Up
Down

parted - scripted partitioning (of all multipathed SAN LUNs)

`multipath -ll` requires Device Mapper multipath.conf configuration. And of course, replace "3PARdata,VV" with your disk array's SCSI vendor,LUN name.

- GPT partition table allows you to create >2TB partitions

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

sudo lastb | awk '{if ($3 ~ /([[:digit:]]{1,3}\.){3}[[:digit:]]{1,3}/)a[$3] = a[$3]+1} END {for (i in a){print i " : " a[i]}}' | sort -nk 3

2012-09-11 14:51:10

User: sgowie

Functions: awk lastb sort sudo

Tags: Security Linux sort awk login arch linux lastb

Up
Down

Display IP : Count of failed login attempts

The lastb command presents you with the history of failed login attempts (stored in /var/log/btmp). The reference file is read/write by root only by default. This can be quite an exhaustive list with lots of bots hammering away at your machine. Sometimes it is more important to see the scale of things, or in this case the volume of failed logins tied to each source IP.

The awk statement determines if the 3rd element is an IP address, and if so increments the running count of failed login attempts associated with it. When done it prints the IP and count.

The sort statement sorts numerically (-n) by column 3 (-k 3), so you can see the most aggressive sources of login attempts. Note that the ':' character is the 2nd column, and that the -n and -k can be combined to -nk.

Please be aware that the btmp file will contain every instance of a failed login unless explicitly rolled over. It should be safe to delete/archive this file after you've processed it.

apt-popcon() { (echo \#rank; apt-cache search "$@" |awk '$1 !~ /^lib/ {print " "$1" "}') |grep -Ff- <(wget -qqO- http://popcon.debian.org/by_inst.gz |gunzip); }

2012-09-08 00:29:31

User: khopesh

Functions: apt awk echo grep wget

Tags: Debian Ubuntu apt-cache

Up
Down

Search for packages, ranked by popularity

This will take the packages matching a given `apt-cache search` query (a collection of AND'd words or regexps) and tell you how popular they are. This is particularly nice for those times you have to figure out which solution to use for e.g. a PDF reader or a VNC client.

Substitute "ubuntu.com" for "debian.org" if you want this to use Ubuntu's data instead. Everything else will work perfectly.

top -n2 -d 0.5 | grep ^Cpu | sed 's/[[:alpha:]%]*//g' | awk 'NR == 2 {printf("%.2f\n",100-$5)}'

2012-09-06 12:56:26

User: wizzra

Functions: awk grep sed top

Up
Down

Get Current CPU Usage

Get the current cpu % usage on your system.

git status --porcelain | awk '{print $2}' | xargs git add

2012-09-05 18:07:26

User: brandizzi

Functions: awk xargs

Up
Down

add untracked/changed items to a git repository before doing a commit and/or sending upstream

Uses the --porcelain option, which is garanteed to be stable among git versions and configurations - also, is way easier to parse.

git status|awk '/modified:/ { printf("git add %s\n",$3) }; NF ==2 { printf("git add %s\n",$2) }'|sh

2012-09-03 00:09:04

User: jetdillo

Functions: awk

Up
Down

add untracked/changed items to a git repository before doing a commit and/or sending upstream

I came up with this because I don't have a problem remembering the big major changes I made deep inside my tree for a specific feature or bugfix but always manage to forget the trivial stuff I tweaked or touched along the way that needs to get pushed as well.

SUBNET="192.168.41" ; diff -y <(nmap -sP -n ${SUBNET}.0/24 | grep ${SUBNET}. | awk '{print $5}' | sort -t"." -k4 -n) <(for i in $(seq 1 254); do echo ${SUBNET}.$i; done)

2012-08-28 09:11:18

User: michel_p

Functions: awk diff echo grep seq sort

Up
Down

Look for free ip's in a given /24 subnet.

The command will make it easy to determine free IP ranges in a crowded sub-net.

‹ First < 2 3 4 5 6 > Last ›