Hide

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again.

Delete that bloated snippets file you've been using and share your personal repository with the world. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

If you have a new feature suggestion or find a bug, please get in touch via http://commandlinefu.uservoice.com/

Get involved!

You can sign-in using OpenID credentials, or register a traditional username and password.

OpenID
or
Sign in Register

First-time OpenID users will be automatically assigned a username which can be changed after signing in.

Hide

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

Hide

News

2011-03-12 - Confoo 2011 presentation
Slides are available from the commandlinefu presentation at Confoo 2011: http://presentations.codeinthehole.com/confoo2011/
2011-01-04 - Moderation now required for new commands
To try and put and end to the spamming, new commands require moderation before they will appear on the site.
2010-12-27 - Apologies for not banning the trolls sooner
Have been away from the interwebs over Christmas. Will be more vigilant henceforth.
2010-09-24 - OAuth and pagination problems fixed
Apologies for the delay in getting Twitter's OAuth supported. Annoying pagination gremlin also fixed.
Hide

Tags

Hide

Functions

Hide

Credits

Site by David Winterbottom (user root).

Commands tagged compression

Commands tagged compression from sorted by
Terminal - Commands tagged compression - 12 results
find . -type f -name "*.gz" | while read line ; do gunzip --to-stdout "$line" | bzip2 > "$(echo $line | sed 's/gz$/bz2/g')" ; done
2013-04-12 19:18:21
User: Kaurin
Functions: bzip2 find gunzip read
Tags: gzip compression bzip2
1
Up
Down
Recompress all files in current directory from gzip to bzip2

Find all .gz files and recompress them to bz2 on the fly. No temp files.

edit: forgot the double quotes! jeez!

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
find . -type f -name '*.gz'|awk '{print "zcat", $1, "| bzip2 -c >", $0.".tmp", "&& rename", "s/.gz.tmp/.bz2/", "*.gz.tmp", "&& rm", $0}'|bash
2013-04-11 10:17:57
User: Ztyx
Functions: awk find
Tags: gzip compression bzip2
-2
Up
Down
Recompress all files in current directory from gzip to bzip2

This solution is similar to [1] except that it does not have any dependency on GNU Parallel. Also, it tries to minimize the impact on the running system (using ionice and nice).

[1] http://www.commandlinefu.com/commands/view/7009/recompress-all-.gz-files-in-current-directory-using-bzip2-running-1-job-per-cpu-core-in-parallel

Comments (5) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
XZ_OPT=-9 tar cJf tarfile.tar.xz directory
2013-03-30 06:00:39
User: unixmonkey51864
Functions: tar
Tags: tar compression tar.xz
0
Up
Down
tar xz maximal compression

is preserving creation time, modification time, permission, the directory structure, etc.

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
als some.jar
2012-07-11 22:54:54
User: tebeka
Tags: extract tar gzip compression archive bzip2
1
Up
Down
View any archive

Part of the "atool" package.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
aunpack foo.tar.bz2
2012-07-11 22:53:18
User: tebeka
Tags: extract tar gzip compression bzip2
0
Up
Down
Extract any archive

Part of the "atool" package

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
gs -sDEVICE=pdfwrite -dCompatibilityLevel=1.4 -dPDFSETTINGS=/screen -dNOPAUSE -dQUIET -dBATCH -sOutputFile=output.pdf input.pdf
2012-02-29 21:30:20
User: DavideRiboli
Functions: gs
Tags: pdf compression
0
Up
Down
Compress PDF

Useful if you want to reduce PDF file size using command line by ghostscript.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
ssh 10.0.0.4 "gzip -c /tmp/backup.sql" |gunzip > backup.sql
2012-01-06 17:44:06
User: ultips
Functions: gunzip ssh
Tags: ssh gzip compression
0
Up
Down
Speed Up WAN File Transfer With Compression

If you have servers on Wide Area Network (WAN), you may experience very long transfer rates due to limited bandwidth and latency.

To speed up you transfers you need to compress the data so you will have less to transfer.

So the solution is to use a compression tools like gzip or bzip or compress before and after the data transfer.

Using ssh "-C" option is not compatible with every ssh version (ssh2 for instance).

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
function xzv() { THREADS=`grep processor /proc/cpuinfo | wc -l`; for file in $*; do pv -s `stat -c%s $file` < $file | pxz -q -T $THREADS > $file.xz ; done; }
2011-12-14 08:22:08
User: oernii2
Functions: file wc
Tags: compression parallel oernii xz
0
Up
Down
Parallel XZ with progress bar

You need: pxz for the actual work (http://jnovy.fedorapeople.org/pxz/). The function could be better with better multifile and stdin/out support.

Comments (2) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
optipng -o3 *png && advpng -z -4 *png && advdef -z -4 *png
2010-05-22 23:30:21
User: tamasrepus
Tags: compression png
3
Up
Down
Maximum PNG compression with optipng, advpng, and advdef

optipng and advancecomp (for the the advpng and advdef tools) are the best FOSS tools for losslessly compressing PNGs. With the above tool chain, you can cut off as much as 20% off a PNG's file size.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
ssh <host> 'tar -cz /<folder>/<subfolder>' | tar -xvz
2009-11-10 20:06:47
User: polaco
Functions: ssh tar
Tags: ssh copy tar compression
9
Up
Down
Copy a folder tree through ssh using compression (no temporary files)

This command will copy a folder tree (keeping the parent folders) through ssh. It will:

- compress the data

- stream the compressed data through ssh

- decompress the data on the local folder

This command will take no additional space on the host machine (no need to create compressed tar files, transfer it and then delete it on the host).

There is some situations (like mirroring a remote machine) where you simply cant wait for a huge time taking scp command or cant compress the data to a tarball on the host because of file system space limitation, so this command can do the job quite well.

This command performs very well mainly when a lot of data is involved in the process. If you copying a low amount of data, use scp instead (easier to type)

Show sample output | Comments (4) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
cat somefile.css | awk '{gsub(/{|}|;/,"&\n"); print}' >> uncompressed.css
2009-06-02 15:51:51
User: lrvick
Functions: awk cat
Tags: awk compression css
-1
Up
Down
Uncompress a CSS file

Ever compress a file for the web by replacing all newline characters with nothing so it makes one nice big blob?

It is a great idea, however what about when you want to edit that file? ...Serious pain in the butt.

I ran into this today in that my only copy of a CSS file was "compressed" with no newlines.

I whipped this up and it converted back into nice human readable CSS :-)

It could be nicer, but it does the job.

Comments (4) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
rar a -m5 -v5M -R myarchive.rar /home/
2009-05-27 15:53:18
User: piovisqui
Tags: rar compression split
0
Up
Down
Compress archive(s) or directory(ies) and split the output file

a - archive

m5 - compression level, 0= lowest compression...1...2...3...4...5= max compression

-v5M split the output file in 5 megabytes archives, change to 700 for a CD, or 4200 for a DVD

R recursive for directories, do not use it for files

It's better to have the output of a compression already split than use the 'split' command after compression, would consume the double amount of disk space. Found at http://www.ubuntu-unleashed.com/2008/05/howto-create-split-rar-files-in-ubuntu.html

Comments (4) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate