Hide

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again.

Delete that bloated snippets file you've been using and share your personal repository with the world. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

If you have a new feature suggestion or find a bug, please get in touch via http://commandlinefu.uservoice.com/

Get involved!

You can sign-in using OpenID credentials, or register a traditional username and password.

OpenID
or
Sign in Register

First-time OpenID users will be automatically assigned a username which can be changed after signing in.

Hide

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

Hide

News

2011-03-12 - Confoo 2011 presentation
Slides are available from the commandlinefu presentation at Confoo 2011: http://presentations.codeinthehole.com/confoo2011/
2011-01-04 - Moderation now required for new commands
To try and put and end to the spamming, new commands require moderation before they will appear on the site.
2010-12-27 - Apologies for not banning the trolls sooner
Have been away from the interwebs over Christmas. Will be more vigilant henceforth.
2010-09-24 - OAuth and pagination problems fixed
Apologies for the delay in getting Twitter's OAuth supported. Annoying pagination gremlin also fixed.
Hide

Tags

Hide

Functions

Hide

Credits

Site by David Winterbottom (user root).

Commands using awk

Commands using awk from sorted by
Terminal - Commands using awk - 985 results
adb shell ps | grep <process name> | awk '{print $2}' | xargs adb shell kill
2012-03-03 01:03:39
User: riansanderson
Functions: awk grep ps xargs
0
Up
Down
kill an arbitrary process running on an Android device attached via USB debug cable

This is great when you need to reboot the system-server, or your own daemon that has gone crazy

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
awk '{cmd="date --date=\""$1"\" +\"%Y/%m/%d %H:%M:%S\" "; cmd | getline convdate; print cmd";"convdate }' file.txt
2012-02-28 14:08:52
User: EBAH
Functions: awk
Tags: Date manipulation awk date embed
0
Up
Down
awk date convert

Convert readable date/time with `date` command

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
kill -9 $(ps -ef | grep [h]ttpd | awk '{print $2}')
2012-02-28 13:15:55
User: peterRepeater
Functions: awk grep kill ps
-1
Up
Down
Force kill all named processes
Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
lsof -n -P|grep FlashXX|awk '{ print "/proc/" $2 "/fd/" substr($4, 1, length($4)-1) }'|while read f;do newname=$(exiftool -FileModifyDate -FileType -t -d %Y%m%d%H%M%S $f|cut -f2|tr '\n' '.'|sed 's/\.$//');echo "$f -> $newname";cp $f ~/Vids/$newname;done
2012-02-25 01:49:45
User: mhs
Functions: awk cp cut echo grep read sed tr
Tags: youtube flash flv exiftool tmpfs
8
Up
Down
Keep a copy of the raw Youtube FLV,MP4,etc stored in /tmp/

Certain Flash video players (e.g. Youtube) write their video streams to disk in /tmp/ , but the files are unlinked. i.e. the player creates the file and then immediately deletes the filename (unlinking files in this way makes it hard to find them, and/or ensures their cleanup if the browser or plugin should crash etc.) But as long as the flash plugin's process runs, a file descriptor remains in its /proc/ hierarchy, from which we (and the player) still have access to the file. The method above worked nicely for me when I had 50 tabs open with Youtube videos and didn't want to have to re-download them all with some tool.

Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
svn st | awk ' {if ( $1 == "?" ){print $1="",$0}} ' | sed -e 's/^[ \t]*//' | sed 's/ /\\ /g' | perl -ne '`svn add ${1}@` if /(.*)(@*)(.*)/'
2012-02-23 18:42:02
User: JulieCaroline
Functions: awk perl sed
Tags: svn perl
0
Up
Down
add all files not under version control to repository

handels @, ?, whitespaces in names.

replace "?" and "add" by "!" and "rm" for svn mass remove.

---> I m looking for a nicer way to write it, perhaps with something using " perl -ne '`blahblah` if /\?(.*)/' "

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
PID=httpd ; ps aux | grep $PID | grep -v grep | awk '{print $2}' | xargs kill -9
2012-02-21 23:27:47
User: esaenz
Functions: awk grep kill ps xargs
-4
Up
Down
kill all pids from $PID

# define user pid to kill

PID=httpd ;

# kill all pids

ps aux | grep $PID | grep -v grep | awk '{print $2}' | xargs kill -9

Show sample output | Comments (3) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
for num in `seq 2 100`;do if [ `factor $num|awk '{print $2}'` == $num ];then echo -n "$num ";fi done;echo
2012-02-18 08:11:19
User: alvinhochun
Functions: awk echo
0
Up
Down
List prime numbers from 2 to 100

This is actually quite slow~

P.S. change `seq 2 100` to `seq 2 1000` and try

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
for i in $(ps -eo pid,pmem,pcpu| sort -k 3 -r|grep -v PID|head -10|awk '{print $1}');do diff -yw <(pidstat -p $i|grep -v Linux) <(ps -o euser,pri,psr,pmem,stat -p $i|tail);done
2012-02-16 20:54:32
User: bob_the_builder
Functions: awk diff grep head ps sort
0
Up
Down
Displays user-defined ps output and pidstat output about the top CPU or MEMory users.

It grabs the PID's top resource users with $(ps -eo pid,pmem,pcpu| sort -k 3 -r|grep -v PID|head -10)

The sort -k is sorting by the third field which would be CPU. Change this to 2 and it will sort accordingly.

The rest of the command is just using diff to display the output of 2 commands side-by-side (-y flag) I chose some good ones for ps.

pidstat comes with the sysstat package(sar, mpstat, iostat, pidstat) so if you don't have it, you should.

I might should take off the timestamp... :|

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
ldd file | grep "=> /" | awk '{print $3}' | xargs -I '{}' cp -v '{}' /destination
2012-02-11 17:50:10
User: rickard2
Functions: awk cp file grep ldd xargs
0
Up
Down
Copy all shared libraries for a binary to directory

When working with jailed environments you need to copy all the shared libraries to your jail environment. This is done by running ldd on a binary which needs to run inside the jail. This command will use the output from ldd to automatically copy the shared libraries to a folder of your choice.

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
TOTAL_RAM=`free | head -n 2 | tail -n 1 | awk '{ print $2 }'`; PROC_RSS=`ps axo rss,comm | grep [h]ttpd | awk '{ TOTAL += $1 } END { print TOTAL }'`; PROC_PCT=`echo "scale=4; ( $PROC_RSS/$TOTAL_RAM ) * 100" | bc`; echo "RAM Used by HTTP: $PROC_PCT%"
2012-02-03 16:10:36
User: 0disse0
Functions: awk echo grep head tail
Tags: memory usage process
0
Up
Down
display memory usage of a process

page where I got inspiration:

http://www.commandlinefu.com/commands/view/5473/get-acurate-memory-usage-of-a-process-in-megabytes

and

http://www.commandlinefu.com/commands/view/10022/display-the-top-10-running-processes-sorted-by-memory-usage

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
netstat -Aan | grep .80 | grep -v 127.0.0.1 | grep EST | awk '{print $6}' | cut -d "." -f1,2,3,4 | sort | uniq
2012-02-03 13:54:11
User: janvanderwijk
Functions: awk cut grep netstat sort
Tags: sort uniq grep netstat cut aix
0
Up
Down
See who are using a specific port

See who is using a specific port. Especially when you're using AIX. In Ubuntu, for example, this can easily be seen with the netstat command.

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
sed -r 's/(\[|])//g' | awk ' { $1=strftime("%D %T",$1); print }'
2012-02-03 13:07:37
User: Zulu
Functions: awk sed
Tags: sed awk timestamp
0
Up
Down
Change time format in log, UNIX Timestamp to Human readable

It remove the square bracket and convert UNIX time to human readable time for all line of a stream (or file).

Show sample output | Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
REJECT_RULE_NO=$(iptables -L RH-Firewall-1-INPUT --line-numbers | grep 'REJECT' | awk '{print $1}');/sbin/iptables -I RH-Firewall-1-INPUT $REJECT_RULE_NO -m state --state NEW -m tcp -p tcp --dport 80 -j ACCEPT -m comment --comment "Permit HTTP Service"
2012-02-02 12:21:06
User: ajmckee
Functions: awk grep iptables
Tags: iptables kickstart
0
Up
Down
Add an iptables rule on RH/CentOs before the reject

Rather then editing the /etc/sysconfig/iptables file, or during a kickstart doing some awk/sed magic, easily add a rule in the correct place within iptables

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
PID=`ps | grep process_name | grep -v grep | head -n 1 | awk '{print $1}'`; cat /proc/$PID/smaps | grep heap -A 2
2012-01-30 13:31:40
User: yohananov
Functions: awk cat grep head
Tags: proc
0
Up
Down
Print heap addresses and size
Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
ps -fea | grep PATTERN | awk {'print $2'} | xargs kill -9
2012-01-27 20:31:36
User: k4ch0
Functions: awk grep kill ps xargs
Tags: awk xargs grep kill print ps
0
Up
Down
Kill processes associated with PATTERN

Kill all process that concide whit PATTERN

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
netstat -tan | awk '$1 == "tcp" && $4 ~ /:/ { port=$4; sub(/^[^:]+:/, "", port); used[int(port)] = 1; } END { for (p = 32768; p <= 61000; ++p) if (! (p in used)) { print p; exit(0); }; exit(1); }'
2012-01-26 20:42:56
User: wirawan0
Functions: awk netstat
0
Up
Down
find an unused unprivileged TCP port

This is also perl-less, and only uses AWK as its postprocessor. Tested with GAWK and MAWK.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
awk -F":" '!list[$3]++{print $3}' /etc/passwd
2012-01-24 12:47:52
User: richard
Functions: awk
Tags: awk uniq duplicate uid /etc/passwd
3
Up
Down
Find duplicate UID in /etc/passwd

You can use only awk

Comments (2) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
history | awk '{$1=""; print $0}' > install_pkg.sh
2012-01-23 06:46:25
User: pmohan
Functions: awk
Tags: history
0
Up
Down
Create a shell script from history of commands

If you are installing some new package. You can first go through the step by step install and then take the commands that you ran from history to create shell script which can used to install the package on other machines say test or production.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
find ./ -type f -size +100000k -exec ls -lh {} \; 2>/dev/null| awk '{ print $8 " : " $5}'
2012-01-21 04:19:35
User: Goez
Functions: awk find ls
Tags: awk find ls file size
0
Up
Down
Find files with size over 100MB and output with better lay-out

This command does a basic find with size. It also improves the printout given (more clearer then default)

Adjusting the ./ will alter the path.

Adjusting the "-size +100000k" will specify the size to search for.

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
grep "cpu " /proc/stat | awk -F ' ' '{total = $2 + $3 + $4 + $5} END {print "idle \t used\n" $5*100/total "% " $2*100/total "%"}'
2012-01-21 04:12:50
User: Goez
Functions: awk grep
Tags: Linux awk grep proc stat
0
Up
Down
Show CPU idle and used time

This command displays the CPU idle + used time using stats from /proc/stat.

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
kded --version | awk -F: 'NR == 2 {print $2}' | sed 's/\s\+//g'
2012-01-17 17:44:23
User: voyeg3r
Functions: awk sed
-2
Up
Down
Get KDE version

kded --version return this

Qt: 3.3.8b

KDE: 3.5.10

KDE Daemon: $Id: kded.cpp 711061 2007-09-11 09:42:51Z tpatzig $

awk -F: ................. Awk Field separator

NR == 2 ................. Register Number, second line

{print $2} ............... second field

sed 's/\s\+//g' .......... remove one space or more \s\+ changing by nothing

Show sample output | Comments (2) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
awk -F: '{print $3}' /etc/passwd | sort |uniq -d
2012-01-17 11:16:35
User: ultips
Functions: awk sort uniq
Tags: uniq duplicate uid /etc/passwd
0
Up
Down
Find duplicate UID in /etc/passwd

Detect duplicate UID in you /etc/passwd (or GID in /etc/group file).

Duplicate UID is often forbidden for it can be a security breach.

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
msgfilter --keep-header -i input.po -o empty.po awk -e '{}'
2012-01-14 13:29:26
User: unhammer
Functions: awk
Tags: po gettext msgfilter
-1
Up
Down
empty a gettext po-file (or, po2pot)

basically create a .pot file from a po-file, ready for translating

Comments (2) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
diff -U99999 original.css modified.css | awk '/^-/{next} {f=f"\n"$0} /^\+.*[^ ]/{yes=1} /}/ {if(yes){print f} f="";yes=0}'
2012-01-12 07:57:22
User: unhammer
Functions: awk diff
Tags: diff awk css wordpress
0
Up
Down
diff two css files to create an overriding css (e.g. for wordpress child themes)

This will extract the differing CSS entries of two files. I've left the initial character (plus or space) in output to show the real differing line, remove the initial character to get a working CSS file. The output CSS file is usable by either adding it in a below the to original.css, or by only using the output but adding @import url("original.css"); in the beginning.

This is very useful for converting Wordpress theme copies into real Wordpress child themes.

Could exclude common lines within entries too, I guess, but that might not be worth the complexity.

Show sample output | Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
find . -type f -print0 | xargs -0r awk '/^\xEF\xBB\xBF/ {print FILENAME} {nextfile}'
2012-01-11 03:15:12
User: unixmonkey24812
Functions: awk find xargs
-1
Up
Down
recursively detecting files with a BOM
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate