Hide

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again.

Delete that bloated snippets file you've been using and share your personal repository with the world. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

If you have a new feature suggestion or find a bug, please get in touch via http://commandlinefu.uservoice.com/

Get involved!

You can sign-in using OpenID credentials, or register a traditional username and password.

OpenID

First-time OpenID users will be automatically assigned a username which can be changed after signing in.

Hide

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using gzip

Hide

News

2011-03-12 - Confoo 2011 presentation: Slides are available from the commandlinefu presentation at Confoo 2011: http://presentations.codeinthehole.com/confoo2011/
2011-01-04 - Moderation now required for new commands: To try and put and end to the spamming, new commands require moderation before they will appear on the site.
2010-12-27 - Apologies for not banning the trolls sooner: Have been away from the interwebs over Christmas. Will be more vigilant henceforth.
2010-09-24 - OAuth and pagination problems fixed: Apologies for the delay in getting Twitter's OAuth supported. Annoying pagination gremlin also fixed.

Hide

Functions

Hide

Credits

Site by David Winterbottom (user root).

Commands using gzip

Terminal - Commands using gzip - 48 results

dd if=/dev/<device location> | gzip -c /<path to backup location>/<disk image name>.img.gz

2009-11-10 22:57:51

User: awjrichards

Functions: dd gzip

-3

Up
Down

Compress and Backup a disk image

Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

mysqldump -uUSERNAME -pPASSWORD database | gzip > /path/to/db/files/db-backup-`date +%Y-%m-%d`.sql.gz ;find /path/to/db/files/* -mtime +5 -exec rm {} \;

2009-10-28 19:49:39

User: nadavkav

Functions: gzip rm

Tags: mysql backup find gzip mysqldump

Up
Down

backup local MySQL database into a folder and removes older then 5 days backups

Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

gzip *

2009-10-15 03:28:22

User: haplo

Functions: gzip

Up
Down

GZip all files in a directory separately

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

for file in *.foo; do gzip "$file"; done

2009-10-15 01:27:05

User: dfrios

Functions: file gzip

Up
Down

GZip all files in a directory separately

It gzip each file in a directory separately

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

sitepass() { echo -n "$@" | md5sum | sha1sum | sha224sum | sha256sum | sha384sum | sha512sum | gzip - | strings -n 1 | tr -d "[:space:]" | tr -s '[:print:]' | tr '!-~' 'P-~!-O' | rev | cut -b 2-11; history -d $(($HISTCMD-1)); }

2009-10-01 20:14:57

User: syssyphus

Functions: cut echo gzip md5sum rev sha1sum strings tr

Tags: Security

Up
Down

generate a unique and secure password for every website that you login to

usage: sitepass MaStErPaSsWoRd example.com

description: An admittedly excessive amount of hashing, but this will give you a pretty secure password, It also eliminates repeated characters and deletes itself from your command history.

tr '!-~' 'P-~!-O' # this bit is rot47, kinda like rot13 but more nerdy

rev # this avoids the first few bytes of gzip payload, and the magic bytes.

find /home/dir -mtime +1 -print -exec gzip -9 {} \; -exec mv {}.gz {}_`date +%F`.gz \;

2009-09-15 06:49:59

User: sagan

Functions: find gzip mv

Up
Down

Backup files older than 1 day on /home/dir, gzip them, moving old file to a dated file.

Useful for backing up old files, custom logs, etc. via a cronjob.

for db in $(mysql -e 'show databases' -s --skip-column-names); do mysqldump $db | gzip > "/backups/mysqldump-$(hostname)-$db-$(date +%Y-%m-%d-%H.%M.%S).gz"; done

2009-09-10 16:27:38

User: syssyphus

Functions: gzip

Up
Down

Backup all MySQL Databases to individual files

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

tar -cf - /home/user/test | gzip -c | ssh user@sshServer 'cd /tmp; tar xfz -'

2009-08-24 18:35:38

User: esplinter

Functions: gzip ssh tar

Tags: ssh file move

Up
Down

move a lot of files over ssh

Useful to move many files (thousands or millions files) over ssh. Faster than scp because this way you save a lot of tcp connection establishments (syn/ack packets).

If using a fast lan (I have just tested gigabyte ethernet) it is faster to not compress the data so the command would be:

tar -cf - /home/user/test | ssh user@sshServer 'cd /tmp; tar xf -'

Comments (5) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

find $MAILDIR/ -type f -printf '%T@ %p\n' | sort --reverse | sed -e '{ 1,100d; s/[0-9]*\.[0-9]* $.*$/\1/g }' | xargs -i sh -c "cat {}&&rm -f {}" | gzip -c >>ARCHIVE.gz

2009-08-11 20:12:15

User: maergil

Functions: find gzip sed sh sort xargs

Tags: bash sort find mail

Up
Down

Move all but the newest 100 emails to a gzipped archive

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

curl http://www.commandlinefu.com/commands/by/<your username>/rss|gzip ->commandlinefu-contribs-backup-$(date +%Y-%m-%d-%H.%M.%S).rss.gz

2009-08-10 12:43:33

User: linuxrawkstar

Functions: date gzip

Tags: backup curl date gzip commandlinefu zless

Up
Down

back up your commandlinefu contributed commands

Use `zless` to read the content of your *rss.gz file:

zless commandlinefu-contribs-backup-2009-08-10-07.40.39.rss.gz

FECHA=$(date +"%F") FINAL="$FECHA.sql.gz" mysqldump -h localhost -u user --password="pass" --opt jdiaz61_lupajuridica | gzip > /home/jdiaz61/www/backup/$FINAL

2009-08-09 14:51:46

User: juancabo

Functions: date gzip

-2

Up
Down

Script para hacer un acopia d ela base de datos mysql

Tres lineas en un shell script para copiar la base de datos diaramente

Comments (2) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

for I in $(mysql -e 'show databases' -s --skip-column-names); do mysqldump $I | gzip > "$I.sql.gz"; done

2009-08-07 00:25:23

User: lingo

Functions: gzip

Up
Down

Backup all MySQL Databases to individual files

Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

gzip -dc /tmp/pavanlimo.gz | psql -U user db

2009-07-20 04:32:59

User: pavanlimo

Functions: gzip

Tags: gzip PostGres

Up
Down

Run gunzipped sql file in PostGres, adding to the library since I couldnt find this command anywhere else on the web.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

# dd if=/dev/sda | gzip -c | ssh user@ip 'dd of=/mnt/backups/sda.dd'

2009-07-06 19:05:55

User: coolman

Functions: dd gzip ssh

Tags: ssh dd gzip

Up
Down

clone a hard drive to a remote directory via ssh tunnel, and compressing the image

Comments (2) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

pg_dump otrs2 | gzip > dump.gz

2009-07-04 19:56:04

User: m03hr3

Functions: gzip

Up
Down

make pgsql backup and gzip it

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

mysqldump [options] |gzip ->mysqldump-$(date +%Y-%m-%d-%H.%M.%S).gz

2009-06-12 12:42:59

User: linuxrawkstar

Functions: date gzip

Up
Down

get a mysqldump with a timestamp in the filename and gzip it all in one go

Performs a mysqldump and gzip-compresses the output file with a timestamp in the resulting dump file. Inspect the file for integrity or fun with this command afterward, if you desire:

zcat mysqldump-2009-06-12-07.41.01.tgz | less

dd if=/dev/sda5 bs=2048 conv=noerror,sync | gzip -fc | lftp -u user,passwd domain.tld -e "put /dev/stdin -o backup-$(date +%Y%m%d%H%M).gz; quit"

2009-05-29 21:56:32

User: sputnick

Functions: dd gzip lftp

Up
Down

Backup sda5 partition to ftp ( using pipes and gziped backup )

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

tar cvf - foodir | gzip > foo.tar.gz

2009-05-19 11:33:51

User: sharfah

Functions: gzip tar

Tags: tar gzip

-9

Up
Down

Create a tar.gz in a single command

Where foodir is the directory you want to zip up.

Comments (5) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

< /dev/urandom tr -dc A-Za-z0-9_ | head -c $((1024 * 1024)) | tee >(gzip -c > out.gz) >(bzip2 -c > out.bz) > /dev/null

2009-04-04 13:23:01

User: jnash

Functions: bzip2 gzip head tee tr

Tags: bzip2, gzip, compression,

-2

Up
Down

gzip vs bzip2 at compressing random strings?

Does that count as a win for bzip2?

for x in `psql -e\l | awk '{print $1}'| egrep -v "(^List|^Name|\-\-\-\-\-|^\()"`; do pg_dump -C $x | gzip > /var/lib/pgsql/backups/$x-nightly.dmp.gz; done

2009-02-21 15:21:09

User: f4nt

Functions: awk egrep gzip

Up
Down

for x in `psql -e\l | awk '{print $1}'| egrep -v "(^List|^Name|\-\-\-\-\-|^\()"`; do pg_dump -C $x | gzip > /backups/$x-back.gz

Ran as the postgres user, dumps each database individually. It dumps with the create statements as well, so you can just 'zcat $x-nightly.dmp.gz | psql' to reimport/recreate a database from a backup.

Comments (2) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

find . -type f -name "*" -mtime +10 -print -exec gzip {} \;

2009-02-16 14:33:32

User: migueldiab

Functions: find gzip

Up
Down

Gzip files older than 10 days matching *

Useful for a cron job that runs nightly, gzipping or alternatively deleting files from a specific directory that are older than 10 days (in this case)

Comments (2) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

cat /dev/urandom | gzip -9 > /dev/null &

2009-02-16 14:12:38

User: jacquesloonen

Functions: cat gzip

Up
Down

useless load

check your load with top... Start more of these jobs to get an multi-core cpu busy...

pv access.log | gzip > access.log.gz

2009-02-06 08:50:40

User: p3k

Functions: gzip

Up
Down

Monitor progress of a command

Pipe viewer is a terminal-based tool for monitoring the progress of data through a pipeline. It can be inserted into any normal pipeline between two processes to give a visual indication of how quickly data is passing through, how long it has taken, how near to completion it is, and an estimate of how long it will be until completion. Source: http://www.catonmat.net/blog/unix-utilities-pipe-viewer/

< 1 2