Hide

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again.

Delete that bloated snippets file you've been using and share your personal repository with the world. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

If you have a new feature suggestion or find a bug, please get in touch via http://commandlinefu.uservoice.com/

Get involved!

You can sign-in using OpenID credentials, or register a traditional username and password.

OpenID
or
Sign in Register

First-time OpenID users will be automatically assigned a username which can be changed after signing in.

Hide

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

Hide

News

2011-03-12 - Confoo 2011 presentation
Slides are available from the commandlinefu presentation at Confoo 2011: http://presentations.codeinthehole.com/confoo2011/
2011-01-04 - Moderation now required for new commands
To try and put and end to the spamming, new commands require moderation before they will appear on the site.
2010-12-27 - Apologies for not banning the trolls sooner
Have been away from the interwebs over Christmas. Will be more vigilant henceforth.
2010-09-24 - OAuth and pagination problems fixed
Apologies for the delay in getting Twitter's OAuth supported. Annoying pagination gremlin also fixed.
Hide

Tags

Hide

Functions

Hide

Credits

Site by David Winterbottom (user root).

Commands using xargs

Commands using xargs from sorted by
Terminal - Commands using xargs - 521 results
seq 4|xargs -n1 -i bash -c "echo -n 164.85.216.{} - ; nslookup 164.85.216.{} |grep name"|tr -s ' ' ' '|awk '{print $1" - "$5}'|sed 's/.$//'
2009-10-14 19:57:24
User: Waldirio
Functions: awk bash sed seq tr xargs
0
Up
Down
Command to resolve name from Ip address, passing only the last field after seq (C Class for example)
Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
dpkg --get-selections | cut -f1 | while read pkg; do dpkg -L $pkg | xargs -I'{}' bash -c 'if [ ! -d "{}" ]; then echo "{}"; fi' | tr '\n' '\000' | du -c --files0-from - | tail -1 | sed "s/total/$pkg/"; done
2009-10-12 14:57:54
User: pykler
Functions: bash cut du echo read sed tail tr xargs
Tags: Debian wajig
5
Up
Down
List your largest installed packages.

Calculates the size on disk for each package installed on the filesystem (or removed but not purged). This is missing the

| sort -rn

which would put the biggest packges on top. That was purposely left out as the command is slightly on the slow side

Also you may need to run this as root as some files can only be checked by du if you can read them ;)

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
find . -iname ".project"| xargs -I {} dirname {} | LC_ALL=C xargs -I {} svn info {} | grep "Last Changed Rev\|Path" | sed "s/Last Changed Rev: /;/" | sed "s/Path: //" | sed '$!N;s/\n//'
2009-10-07 16:13:27
User: hurz
Functions: dirname find grep info sed xargs
Tags: svn eclipse revision
0
Up
Down
Get last changed revision to all eclipse projects in a SVN working copy

Searches for all .project files in current folder and below and uses "svn info" to get the last changed revision. The last sed joins every two lines.

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
find /proc -user myuser -maxdepth 1 -type d -mtime +7 -exec basename {} \; | xargs kill -9
2009-10-05 14:49:51
User: sharfah
Functions: basename find kill xargs
12
Up
Down
Kill processes that have been running for more than a week
Comments (2) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
ls [FILENAME] | xargs openssl sha1
2009-10-03 02:05:43
User: m00dimus
Functions: ls xargs
1
Up
Down
Generate SHA1 hash for each file in a list

List files and pass to openssl to calculate the hash for each file.

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
sh -c 'S=askapache R=htaccess; find . -mount -type f|xargs -P5 -iFF grep -l -m1 "$S" FF|xargs -P5 -iFF sed -i -e "s%${S}%${R}%g" FF'
2009-10-02 05:03:10
User: AskApache
Functions: find grep sed sh xargs
Tags: cpu usage sed xargs grep multiple background nice search and replace sh processes
9
Up
Down
FAST Search and Replace for Strings in all Files in Directory

I needed a way to search all files in a web directory that contained a certain string, and replace that string with another string. In the example, I am searching for "askapache" and replacing that string with "htaccess". I wanted this to happen as a cron job, and it was important that this happened as fast as possible while at the same time not hogging the CPU since the machine is a server.

So this script uses the nice command to run the sh shell with the command, which makes the whole thing run with priority 19, meaning it won't hog CPU processing. And the -P5 option to the xargs command means it will run 5 separate grep and sed processes simultaneously, so this is much much faster than running a single grep or sed. You may want to do -P0 which is unlimited if you aren't worried about too many processes or if you don't have to deal with process killers in the bg.

Also, the -m1 command to grep means stop grepping this file for matches after the first match, which also saves time.

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
mysql -e 'show databases' | sed -n '2,$p' | xargs -I DB 'mysqldump DB > DB.sql'
2009-09-25 08:43:06
User: mislav
Functions: sed xargs
Tags: mysqldump
5
Up
Down
Backup all MySQL Databases to individual files

No need to loop when we have `xargs`. The sed command filters out the first line of `show databases` output, which is always "Database".

Comments (4) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
find -type f -name "*.avi" -print0 | xargs -0 mplayer -vo dummy -ao dummy -identify 2>/dev/null | perl -nle '/ID_LENGTH=([0-9\.]+)/ && ($t +=$1) && printf "%02d:%02d:%02d\n",$t/3600,$t/60%60,$t%60' | tail -n 1
2009-09-24 15:50:39
User: syssyphus
Functions: find perl printf tail xargs
Tags: video audio mplayer perl find
8
Up
Down
Get the total length of all video / audio in the current dir (and below) in H:m:s

change the *.avi to whatever you want to match, you can remove it altogether if you want to check all files.

Comments (4) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
find . -name "*.txt" | xargs sed -i "s/old/new/"
2009-09-24 15:02:31
User: noblejasper
Functions: find sed xargs
Tags: sed find xargs
0
Up
Down
find . -name "*.txt" | xargs sed -i "s/old/new/"
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
mplayer -vo dummy -ao dummy -identify * 2>&1 | grep ID_LENGTH | sed 's/.*=\([0-9]*\)/\1/' | xargs echo | sed 's/ /+/g' | bc | awk 'S=$1; {printf "%dh:%dm:%ds\n",S/(60*60),S%(60*60)/60,S%60}'
2009-09-24 10:33:19
User: Strawp
Functions: awk bc echo grep sed xargs
5
Up
Down
Get the total length of all videos in the current dir in H:m:s

You're behind on your TV catch-up, but how far behind? This command tries to open mplayer against all files in the current dir. If it's a video file it will contain ID_LENGTH, which is summed and output in hours, minutes and seconds.

Someone better at awk could probably reduce this down a lot.

Show sample output | Comments (3) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
find . -type f -print0 | xargs -0 grep -i <pattern>
2009-09-22 13:31:23
User: xelon
Functions: find grep xargs
2
Up
Down
Search for a string inside all files in the current directory
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
find . | xargs file | grep ".*: .* text" | sed "s;\(.*\): .* text.*;\1;"
2009-09-22 01:50:25
User: matthewbauer
Functions: file find grep sed xargs
Tags: file list text exclude binary
0
Up
Down
List all text files (exclude binary files)

List all text files in the current directory.

Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
find -not -empty -type f -printf "%s\n" | sort -rn | uniq -d | xargs -I{} -n1 find -type f -size {}c -print0 | xargs -0 md5sum | sort | uniq -w32 --all-repeated=separate
2009-09-21 00:24:14
User: syssyphus
Functions: find md5sum sort uniq xargs
42
Up
Down
Find Duplicate Files (based on size first, then MD5 hash)

This dup finder saves time by comparing size first, then md5sum, it doesn't delete anything, just lists them.

Comments (14) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
git diff --numstat | awk '{if ($1 == "0" && $2 == "0") print $3}' | xargs git checkout HEAD
2009-09-17 22:12:50
User: lingo
Functions: awk diff xargs
Tags: git restore permissions modified files
4
Up
Down
(Git) Revert files with changed mode, not content

I sometimes (due to mismanagement!) end up with files in a git repo which have had their modes changed, but not their content. This one-liner lets me revert the mode changes, while leaving changed-content files be, so I can commit just the actual changes made.

Comments (6) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
ls -lt|grep ^-|awk 'NR>5 { print $8 }'|xargs -r rm
2009-09-16 07:43:03
User: karel1980
Functions: awk grep ls xargs
Tags: ls
1
Up
Down
Delete all but the latest 5 files, ignoring directories
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
ls -t | tail +6 | xargs rm
2009-09-16 06:33:07
User: negyvenot
Functions: ls tail xargs
Tags: ls
2
Up
Down
Delete all but the latest 5 files

yes 6 (tail from 6th line)

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
find . -maxdepth 1 ! -name '.' -execdir du -0 -s {} + | sort -znr | gawk 'BEGIN{ORS=RS="\0";} {sub($1 "\t", ""); print $0;}' | xargs -0 du -hs
2009-09-11 16:07:39
User: ashawley
Functions: du find gawk sort xargs
Tags: sort find du xargs GNU/Linux
1
Up
Down
Ultimate current directory usage command

A little bit smaller, faster and should handle files with special characters in the name.

Comments (2) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
cat /var/lib/dpkg/info/*.list > /tmp/listin ; ls /proc/*/exe |xargs -l readlink | grep -xvFf /tmp/listin; rm /tmp/listin
2009-09-09 18:09:14
User: kamathln
Functions: cat grep ls readlink rm xargs
Tags: Debian find dpkg
11
Up
Down
Find running binary executables that were not installed using dpkg

This helped me find a botnet that had made into my system. Of course, this is not a foolproof or guarantied way to find all of them or even most of them. But it helped me find it.

Comments (6) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
find . -not \( -name .svn -prune \) -type f | xargs zip XXXXX.zip
2009-09-08 12:47:37
User: marciocamurati
Functions: find xargs
Tags: svn find zip
0
Up
Down
Create a zip file ignoring .svn files
Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
find . -name \*.c | xargs wc -l | tail -1 | awk '{print $1}'
2009-09-08 08:25:45
User: karpoke
Functions: awk find tail wc xargs
Tags: awk find wc
0
Up
Down
Make a statistic about the lines of code

This is really fast :)

time find . -name \*.c | xargs wc -l | tail -1 | awk '{print $1}'

204753

real 0m0.191s

user 0m0.068s

sys 0m0.116s

Show sample output | Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
find . -maxdepth 1 -type d|xargs du -a --max-depth=0|sort -rn|cut -d/ -f2|sed '1d'|while read i;do echo "$(du -h --max-depth=0 "$i")/";done;find . -maxdepth 1 -type f|xargs du -a|sort -rn|cut -d/ -f2|sed '$d'|while read i;do du -h "$i";done
2009-09-03 20:33:21
User: nickwe
Functions: cut du echo find read sed sort xargs
Tags: bash sort sed echo find xargs read while cut
2
Up
Down
Ultimate current directory usage command

Based on the MrMerry one, just add some visuals and sort directory and files

Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
find . -type f -exec grep -qi 'foo' {} \; -print0 | xargs -0 vim
2009-09-03 17:55:26
User: arcege
Functions: find grep xargs
Tags: vim find grep
-1
Up
Down
Edit all files found having a specific string found by grep

Make sure that find does not touch anything other than regular files, and handles non-standard characters in filenames while passing to xargs.

Comments (4) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
find . -exec grep foobar /dev/null {} \; | awk -F: '{print $1}' | xargs vi
2009-09-03 16:02:18
User: verboEse
Functions: awk find grep xargs
Tags: vim awk find grep
-1
Up
Down
Edit all files found having a specific string found by grep

needs no GNU tools, as far as I see it

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
grep -ir 'foo' * | awk -F '{print $1}' | xargs vim
2009-09-03 15:58:47
User: verboEse
Functions: awk grep xargs
Tags: vim sed awk grep
0
Up
Down
Edit all files found having a specific string found by grep

saves one command. Needs GNU grep though :-(

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
grep -Hrli 'foo' * | xargs vim
2009-09-03 15:44:05
User: dere22
Functions: grep xargs
Tags: vim sed awk grep
3
Up
Down
Edit all files found having a specific string found by grep

The grep switches eliminate the need for awk and sed. Modifying vim with -p will show all files in separate tabs, -o in separate vim windows. Just wish it didn't hose my terminal once I exit vim!!

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate