Hide

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again.

Delete that bloated snippets file you've been using and share your personal repository with the world. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

If you have a new feature suggestion or find a bug, please get in touch via http://commandlinefu.uservoice.com/

Get involved!

You can sign-in using OpenID credentials, or register a traditional username and password.

OpenID
or
Sign in Register

First-time OpenID users will be automatically assigned a username which can be changed after signing in.

Hide

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

Hide

News

2011-03-12 - Confoo 2011 presentation
Slides are available from the commandlinefu presentation at Confoo 2011: http://presentations.codeinthehole.com/confoo2011/
2011-01-04 - Moderation now required for new commands
To try and put and end to the spamming, new commands require moderation before they will appear on the site.
2010-12-27 - Apologies for not banning the trolls sooner
Have been away from the interwebs over Christmas. Will be more vigilant henceforth.
2010-09-24 - OAuth and pagination problems fixed
Apologies for the delay in getting Twitter's OAuth supported. Annoying pagination gremlin also fixed.
Hide

Tags

Hide

Functions

Hide

Credits

Site by David Winterbottom (user root).

Commands using du from sorted by
Terminal - Commands using du - 198 results
du -hs *|grep M|sort -n
2010-03-25 19:20:24
User: tuxlifan
Functions: du grep sort
Tags: disk usage sort du grep quick'n'dirty
3
Up
Down
easily find megabyte eating files or directories

This is easy to type if you are looking for a few (hundred) "missing" megabytes (and don't mind the occasional K slipping in)...

A variation without false positives and also finding gigabytes (but - depending on your keyboard setup - more painful to type):

du -hs *|grep -P '^(\d|,)+(M|G)'|sort -n

(NOTE: you might want to replace the ',' according to your locale!)

Don't forget that you can

modify the globbing as needed! (e.g. '.[^\.]* *' to include hidden files and directories (w/ bash))

in its core similar to:

http://www.commandlinefu.com/commands/view/706/show-sorted-list-of-files-with-sizes-more-than-1mb-in-the-current-dir

Show sample output | Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
( du -xSk || du -kod ) | sort -nr | head
2010-03-16 04:05:14
User: DoNotRememberMe
Functions: du sort
4
Up
Down
Simple top directory usage with du flips for either Linux or base Solaris

No need to type out the full OR clause if you know which OS you're on, but this is easy cut-n-paste or alias to get top ten directories by singleton.

To avoid the error output from du -xSk you could always 2>/dev/null but you might miss relevant STDERR.

Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
du -sh some/directory
2010-02-21 02:08:28
User: Jacolyte
Functions: du
-5
Up
Down
Show the size of a directory

Displays only the subtotal size of a directory with the -s option, and in human readable format.

Show sample output | Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
du -x --max-depth=1 | sort -n | awk '{ print $2 }' | xargs du -hx --max-depth=0
2010-02-18 19:46:47
User: d34dh0r53
Functions: awk du sort xargs
4
Up
Down
Numerically sorted human readable disk usage

Provides numerically sorted human readable du output. I so wish there was just a du flag for this.

Show sample output | Comments (2) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
du -sk ./* | sort -nr
2010-02-04 04:08:05
User: op4
Functions: du sort
4
Up
Down
nice disk usage, sorted by size, see description for full command

full command below, would not let me put full command in text box

du -sk ./* | sort -nr | awk 'BEGIN{ pref[1]="K"; pref[2]="M"; pref[3]="G";} { total = total + $1; x = $1; y = 1; while( x > 1024 ) { x = (x + 1023)/1024; y++; } printf("%g%s\t%s\n",int(x*10)/10,pref[y],$2); } END { y = 1; while( total > 1024 ) { total = (total + 1023)/1024; y++; } printf("Total: %g%s\n",int(total*10)/10,pref[y]); }'

Show sample output | Comments (4) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
find . -type f -size +1100000k |xargs -I% du -sh %
2010-01-31 22:04:07
User: 4fthawaiian
Functions: du find xargs
1
Up
Down
find large files

simple find -> xargs sort of thing that I get a lot of use out of. Helps find huge files and gives an example of how to use xargs to deal with them. Tested on OSX snow leopard (10.6). Enjoy.

Show sample output | Comments (2) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
du -s * | sort -nr | head | cut -f2 | parallel -k du -sh
2010-01-28 12:59:14
User: unixmonkey8046
Functions: cut du head sort
Tags: du xargs parallel
-2
Up
Down
List top ten files/directories sorted by size

If a directory name contains space xargs will do the wrong thing. Parallel https://savannah.nongnu.org/projects/parallel/ deals better with that.

Show sample output | Comments (3) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
dir='path to file'; tar cpf - "$dir" | pv -s $(du -sb "$dir" | awk '{print $1}') | tar xpf - -C /other/path
2010-01-19 19:05:45
User: starchox
Functions: awk dir du tar
Tags: copy tar cp
-2
Up
Down
transfer files locally to be sure that file permissions are kept correctly showing progress

This may seem like a long command, but it is great for making sure all file permissions are kept in tact. What it is doing is streaming the files in a sub-shell and then untarring them in the target directory. Please note that the -z command should not be used for local files and no perfomance increase will be visible as overhead processing (CPU) will be evident, and will slow down the copy.

You also may keep simple with, but you don't have the progress info:

cp -rpf /some/directory /other/path
Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
file='path to file'; tar -cf - "$file" | pv -s $(du -sb "$file" | awk '{print $1}') | gzip -c | ssh -c blowfish user@host tar -zxf - -C /opt/games
2010-01-19 16:02:45
User: starchox
Functions: awk du file gzip ssh tar
Tags: ssh awk tar directory compress cipher
3
Up
Down
improve copy file over ssh showing progress

You set the file/dirname transfer variable, in the end point you set the path destination, this command uses pipe view to show progress, compress the file outut and takes account to change the ssh cipher. Support dirnames with spaces.

Merged ideas and comments by http://www.commandlinefu.com/commands/view/4379/copy-working-directory-and-compress-it-on-the-fly-while-showing-progress and http://www.commandlinefu.com/commands/view/3177/move-a-lot-of-files-over-ssh

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
find dir -size -1024k -type f -print0 | du --files0-from - -bc
2009-12-29 01:33:55
User: bhepple
Functions: dir du find
Tags: size sum
2
Up
Down
find out how much space are occuipied by files smaller than 1024K (sic) - improved

The original didn't use -print0 which fails on weird file names eg with spaces.

The original parsed the output of 'ls -l' which is always a bad idea.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
find /home/bubo/ -type f \( -iname \*.jpg -print0 , -iname \*.png -print0 , -iname \*gif -print0 \) | du -cm --files0-from - | tail -1
2009-12-25 16:21:46
User: bubo
Functions: du find tail
0
Up
Down
show how much diskspace all images in a given directory need
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
tar -cf - . | pv -s $(du -sb . | awk '{print $1}') | gzip > out.tgz
2009-12-18 17:09:08
User: opertinicy
Functions: awk du gzip tar
Tags: awk du tar gzip pv progress
25
Up
Down
copy working directory and compress it on-the-fly while showing progress

What happens here is we tell tar to create "-c" an archive of all files in current dir "." (recursively) and output the data to stdout "-f -". Next we specify the size "-s" to pv of all files in current dir. The "du -sb . | awk ?{print $1}?" returns number of bytes in current dir, and it gets fed as "-s" parameter to pv. Next we gzip the whole content and output the result to out.tgz file. This way "pv" knows how much data is still left to be processed and shows us that it will take yet another 4 mins 49 secs to finish.

Credit: Peteris Krumins http://www.catonmat.net/blog/unix-utilities-pipe-viewer/

Show sample output | Comments (2) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
du -sch ./*
2009-12-12 05:10:40
User: enderst
Functions: du
4
Up
Down
List the size (in human readable form) of all sub folders from the current location
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
find . -maxdepth 1 -type d -not -name . -exec du -sh {} +
2009-12-11 14:37:26
User: sorpigal
Functions: du find
-6
Up
Down
List the size (in human readable form) of all sub folders from the current location

Parsing the output of ls is never a good idea for any reason. Using find this way:

- works with files that have spaces in their names.

- actually lists "sub folders" and not of all files and folders.

- does not break if there are a huge number of files in the current directory.

Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
du -sh */
2009-12-10 16:19:15
User: guxtavo
Functions: du
6
Up
Down
List the size (in human readable form) of all sub folders from the current location
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
ls | xargs du -sh
2009-12-10 15:58:05
User: jyro
Functions: du ls xargs
-4
Up
Down
List the size (in human readable form) of all sub folders from the current location
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
du -ms * 2>/dev/null |sort -nr|head
2009-11-23 16:06:40
User: yooreck
Functions: du sort
1
Up
Down
List the biggest accessible files/dirs in current directory, sorted
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
du | sort -nr | cut -f2- | xargs du -hs
2009-11-20 17:14:40
User: unixmonkey7118
Functions: cut du sort xargs
2
Up
Down
Show sorted list of files with sizes more than 1MB in the current dir

no fancy grep stuff here.

Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
dh() { du -ch --max-depth=1 "${@-.}"|sort -h }
2009-10-30 15:30:16
User: gibboris
Functions: du sort
4
Up
Down
Sort the size usage of a directory tree by gigabytes, kilobytes, megabytes, then bytes.

Since coreutils 7.6 provides sort -h

Show sample output | Comments (3) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
watch -n 60 du /var/log/messages
2009-10-27 14:53:41
User: rbossy
Functions: du watch
1
Up
Down
Monitor a file's size
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
dpkg --get-selections | cut -f1 | while read pkg; do dpkg -L $pkg | xargs -I'{}' bash -c 'if [ ! -d "{}" ]; then echo "{}"; fi' | tr '\n' '\000' | du -c --files0-from - | tail -1 | sed "s/total/$pkg/"; done
2009-10-12 14:57:54
User: pykler
Functions: bash cut du echo read sed tail tr xargs
Tags: Debian wajig
4
Up
Down
List your largest installed packages.

Calculates the size on disk for each package installed on the filesystem (or removed but not purged). This is missing the

| sort -rn

which would put the biggest packges on top. That was purposely left out as the command is slightly on the slow side

Also you may need to run this as root as some files can only be checked by du if you can read them ;)

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
watch -n60 du /var/log/messages
2009-10-09 18:37:45
User: matrixguy
Functions: du watch
8
Up
Down
Monitor a file's size

use "watch" instead of while-loops in these simple cases

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
while [ 1 ]; do du /var/log/messages;sleep 60; done
2009-10-09 17:22:19
User: savanik
Functions: du
0
Up
Down
Monitor a file's size

Got a file you're generating and you want the size without typing in 'ls -l file' all the time? Use this instead.

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
find [path] [expression] -exec du -ab {} \; | awk '{total+=$0}END{print total}'
2009-09-24 17:50:26
User: rehanift
Functions: awk du find
3
Up
Down
Sum size of files returned from FIND
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
find . -maxdepth 1 ! -name '.' -execdir du -0 -s {} + | sort -znr | gawk 'BEGIN{ORS=RS="\0";} {sub($1 "\t", ""); print $0;}' | xargs -0 du -hs
2009-09-11 16:07:39
User: ashawley
Functions: du find gawk sort xargs
Tags: sort find du xargs GNU/Linux
1
Up
Down
Ultimate current directory usage command

A little bit smaller, faster and should handle files with special characters in the name.

Comments (2) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate