Hide

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again.

Delete that bloated snippets file you've been using and share your personal repository with the world. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

If you have a new feature suggestion or find a bug, please get in touch via http://commandlinefu.uservoice.com/

Get involved!

You can sign-in using OpenID credentials, or register a traditional username and password.

OpenID

First-time OpenID users will be automatically assigned a username which can be changed after signing in.

Hide

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands tagged awk

Hide

News

2011-03-12 - Confoo 2011 presentation: Slides are available from the commandlinefu presentation at Confoo 2011: http://presentations.codeinthehole.com/confoo2011/
2011-01-04 - Moderation now required for new commands: To try and put and end to the spamming, new commands require moderation before they will appear on the site.
2010-12-27 - Apologies for not banning the trolls sooner: Have been away from the interwebs over Christmas. Will be more vigilant henceforth.
2010-09-24 - OAuth and pagination problems fixed: Apologies for the delay in getting Twitter's OAuth supported. Annoying pagination gremlin also fixed.

Hide

Functions

Hide

Credits

Site by David Winterbottom (user root).

Commands tagged awk

Terminal - Commands tagged awk - 249 results

awk '!($0 in array) { array[$0]; print }' temp

2013-05-09 08:23:30

User: techie

Functions: awk

Tags: awk

-1

Up
Down

Remove duplicate lines using awk

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

awk '{print $1}' ~/.bash_history | sort | uniq -c | sort -rn | head -n 10

2013-05-03 16:24:30

User: nesses

Functions: awk head sort uniq

Tags: sort awk uniq head,

Up
Down

most used unix commands

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

apt-get -s upgrade | awk '/Inst.+/ {print $2}'

2013-03-25 21:23:11

User: lpanebr

Functions: apt awk

Tags: awk apt-get

Up
Down

List available upgrades from apt (package names only)

Usefull if you only want to see the package names, or if you want to use them in a script.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

find /some/path -type f | gawk -F/ '{print $NF}' | gawk -F. '/\./{print $NF}' | sort | uniq -c | sort -rn

2013-03-18 14:40:26

User: skkzsh

Functions: find gawk sort uniq

Tags: sort awk uniq find extension

Up
Down

list unique file extensions recursively for a path, include extension frequency stats

If you have GNU findutils, you can get only the file name with

find /some/path -type f -printf '%f\n'

instead of

find /some/path -type f | gawk -F/ '{print $NF}'

svn revert .

2013-03-13 06:07:42

User: zhenggc1

Tags: svn awk xargs grep

-2

Up
Down

Revert all modified files in an SVN repo

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

df | awk '{if ($2!=dspace) print "different"; dspace=$2;}'

2013-03-08 12:09:35

User: adimania

Functions: awk df

Tags: awk df

-1

Up
Down

Useful to check if the disks as of same size or not. Helpful in checking Raid configs

Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

ps auxw | grep sbin/apache | awk '{print"-p " $2}' | xargs strace -f

2013-02-19 19:14:57

User: msealand

Functions: awk grep ps strace xargs

Tags: awk token ps tokenizer

Up
Down

easily strace all your apache processes

This version also attaches to new processes forked by the parent apache process. That way you can trace all current and *future* apache processes.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

sudo ifconfig wlan0 | grep inet | awk 'NR==1 {print $2}' | cut -c 6-

2013-02-18 14:10:07

User: mouths

Functions: awk cut grep ifconfig sudo

Tags: ifconfig awk grep cut

-1

Up
Down

Print the local ip on a wireless connection

On wired connections set 'eth0' instead of 'wlan0'

Comments (2) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

awk '{for (i=9;i<=NF;i++) {printf "%s",$i; printf "%s", " ";}; printf "\n"}'

2013-02-12 13:57:43

User: adimania

Functions: awk printf

Tags: awk

Up
Down

Print data from field 9 till the end separated by a white space and new record separated by newline.

It'll print the file names preserving the spaces in their names and adding new line after every new filename.

I wrote this to quickly find out how many files in any directory is owned by a particular user. This can be extended using pipe and grep to do much more.

find . -type f -size +100M

2013-02-07 11:58:10

User: chikondi

Functions: find

Tags: awk find ls file size

Up
Down

Find files with size over 100MB and output with better lay-out

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

load=`uptime|awk -F',' '{print $3}'|awk '{print $3}'`; if [[ $(echo "if ($load > 1.0) 1 else 0" | bc) -eq 1 ]]; then notify-send "Load $load";fi

2013-02-06 08:30:24

User: adimania

Functions: awk echo

Tags: awk load load average

Up
Down

One liner to show a notification on Desktop in case the load exceeds 1.

I run this via crontab every one minute on my machine occasionally to see if a process is eating up my system's resources.

Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

curl http://en.wikipedia.org/wiki/List_of_programming_languages | grep "<li>" | awk -F"title=" '{ print $2 }' | awk -F\" '{ print $2 }'

2013-01-09 21:40:11

User: sxiii

Functions: awk grep

Tags: Programming bash awk grep language

Up
Down

Command to get list of all existing programming languages from Wikipedia article

Requirements: curl, grep, awk, internet connection with access to wikipedia

Loaded page: http://en.wikipedia.org/wiki/List_of_programming_languages

If you can make shorter version of this listgetter, you are welcome to paste it here :)

find . -name "*.pdf" -exec pdftk {} dump_data output \; | grep NumberOfPages | awk '{s+=$2} END {print s}'

2013-01-09 15:26:45

User: sucotronic

Functions: awk find grep

Tags: awk find pdf count sum pdftk

Up
Down

Count the number of pages of all PDFs in current directory and all subdirs, recursively

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

exipick -zi | xargs --max-args=1000 exim -Mrm

2012-12-12 20:46:22

User: jasen

Functions: xargs

Tags: bash awk exim

Up
Down

Purge frozen messages in Exim

do 1000 at a time so that if your doodoo is deep you can avoid avoid "command-line too big" error

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

awk '/^md/ {printf "%s: ", $1}; /blocks/ {print $NF}' </proc/mdstat

2012-11-14 18:13:56

User: malathion

Functions: awk

Tags: awk raid

-2

Up
Down

Print a quick summary of RAID array health.

find . -type f -print | awk -F'.' '{print $NF}' | sort | uniq -c

2012-10-31 12:03:10

User: vishnu81

Functions: awk find sort uniq

Tags: awk find

Up
Down

List all the unique extensions in a folder and print their count

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

awk '{print NR "\t" $0}'

2012-10-21 15:45:54

User: tox2ik

Functions: awk

Tags: awk

Up
Down

prints line numbers

Let's not forget awk!

netstat -tn | awk '($4 ~ /:22\s*/) && ($6 ~ /^EST/) {print substr($5, 0, index($5,":"))}'

2012-10-03 04:47:54

User: toxick

Functions: awk netstat

Tags: ssh awk netstat

Up
Down

list current ssh clients

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

for file in `svn st | awk '{print $2}'`; do svn revert $file; done

2012-09-14 11:05:29

User: srounce

Functions: awk file

Tags: svn awk xargs grep

Up
Down

Revert all modified files in an SVN repo

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

sudo lastb | awk '{if ($3 ~ /([[:digit:]]{1,3}\.){3}[[:digit:]]{1,3}/)a[$3] = a[$3]+1} END {for (i in a){print i " : " a[i]}}' | sort -nk 3

2012-09-11 14:51:10

User: sgowie

Functions: awk lastb sort sudo

Tags: Security Linux sort awk login arch linux lastb

Up
Down

Display IP : Count of failed login attempts

The lastb command presents you with the history of failed login attempts (stored in /var/log/btmp). The reference file is read/write by root only by default. This can be quite an exhaustive list with lots of bots hammering away at your machine. Sometimes it is more important to see the scale of things, or in this case the volume of failed logins tied to each source IP.

The awk statement determines if the 3rd element is an IP address, and if so increments the running count of failed login attempts associated with it. When done it prints the IP and count.

The sort statement sorts numerically (-n) by column 3 (-k 3), so you can see the most aggressive sources of login attempts. Note that the ':' character is the 2nd column, and that the -n and -k can be combined to -nk.

Please be aware that the btmp file will contain every instance of a failed login unless explicitly rolled over. It should be safe to delete/archive this file after you've processed it.

netstat -an | grep 80 | wc -l

2012-09-05 06:17:09

User: mrhassell

Functions: grep netstat wc

Tags: sort awk uniq netstat cut

Up
Down

Number of open connections per ip.

Count on a specific port (80) - FreeBSD friendly.

a=$(xwininfo |gawk 'BEGIN {FS="[x+ \t]*"} /-geometry/ {print int(($3+1)/2)*2"x"int(($4+1)/2)*2"+"$5"+"$6}') ; echo ${a} ; ffmpeg -f x11grab -s ${a} -r 10 -i :0.0 -sameq -f mp4 -s wvga -y /tmp/out.mpg

2012-08-31 14:48:41

User: dwygo

Functions: echo gawk

Tags: ffmpeg awk alsa xwininfo x11grab mp4 wvga

Up
Down

Capture screen and mic input using FFmpeg and ALSA

Now we can capture only a specific window (we have to chose by clicking on it)

ffmpeg complains about "Frame size must be a multiple of 2" so we calculate the upper even number with (g)awk trickery.

We remove the grep, we are already using (g)awk here ....why losing time with grep !!! ;)

tcpdump -ntr NAME_OF_CAPTURED_FILE.pcap 'tcp[13] = 0x02 and dst port 80' | awk '{print $4}' | tr . ' ' | awk '{print $1"."$2"."$3"."$4}' | sort | uniq -c | awk ' {print $2 "\t" $1 }'

2012-08-22 21:26:10

User: efuoax

Functions: awk sort tcpdump tr uniq

Tags: awk uniq tcpdump print

Up
Down

Read a tcpdump file and count SYN packets to port 80, Order column by destination.

Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

sudo apt-get remove $(dpkg -l|awk '/^ii linux-image-/{print $2}'|sed 's/linux-image-//'|awk -v v=`uname -r` 'v>$0'|sed 's/-generic*//'|awk '{printf("linux-headers-%s\nlinux-headers-%s-generic*\nlinux-image-%s-generic*\n",$0,$0,$0)}')

2012-08-15 10:02:12

User: mtron

Functions: awk sed sudo

Tags: Debian Linux awk apt-get grep kernel dpkg

Up
Down

Remove all unused kernels with apt-get

Remove old kernels (*-generic and *-generic-pae) via apt-get on debian/ubuntu based systems. Tested on ubuntu 10.04 - 12.04.

Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

cat /dev/urandom|od -t x1|awk 'NR > line { pos=int(rand()*15)+2;printf("%s",$pos);line=NR+(rand()*1000);digits = digits+2 } digits == 64 { print("\n");exit }'

2012-08-14 19:02:00

User: jetdillo

Functions: awk cat exit od

Tags: Os X Linux awk bsd random od /dev/urandom

Up
Down

extracts 64 bytes of random digits from random lines out of /dev/random sent to stdio

Use this the next time you need to come up with a reasonably random bitstring, like for a WPA/WPA2 PSK or something. Takes a continuous stream of bytes coming from /dev/urandom, runs it through od(1), picking a random field ($0 and $1 excluded) from a random line and then prints it.

1 2 3 > Last ›