Commands using gzip sorted by votes

Commands using gzip (59)

sorted by

get a mysqldump with a timestamp in the filename and gzip it all in one go

Performs a mysqldump and gzip-compresses the output file with a timestamp in the resulting dump file. Inspect the file for integrity or fun with this command afterward, if you desire: zcat mysqldump-2009-06-12-07.41.01.tgz | less Show Sample Output
This is sample output - yours may be different.
```
no output, just a new file named something like "mysqldump-2009-06-12-07.41.01.tgz"
```
1

mysqldump [options] |gzip ->mysqldump-$(date +%Y-%m-%d-%H.%M.%S).gz

linuxrawkstar · 2009-06-12 12:42:59 6
clone a hard drive to a remote directory via ssh tunnel, and compressing the image
This is sample output - yours may be different.
1

# dd if=/dev/sda | gzip -c | ssh user@ip 'dd of=/mnt/backups/sda.dd'

coolman · 2009-07-06 19:05:55 7
GZip all files in a directory separately

It gzip each file in a directory separately
This is sample output - yours may be different.
1

for file in *.foo; do gzip "$file"; done

dfrios · 2009-10-15 01:27:05 3
Email an svn dump

Dumps a compressed svn backup to a file, and emails the files along with any messages as the body of the email
This is sample output - yours may be different.
1

(svnadmin dump /path/to/repo | gzip --best > /tmp/svn-backup.gz) 2>&1 | mutt -s "SVN backup `date +\%m/\%d/\%Y`" -a /tmp/svn-backup.gz emailaddress

max · 2010-03-08 05:49:01 7
dump the whole database
This is sample output - yours may be different.
1

mysqldump --lock-tables --opt DBNAME -u UNAME --password=PASS | gzip > OUTFILE

neundl · 2010-03-19 10:27:39 5
tar directory and compress it with showing progress and Disk IO limits

tar directory and compress it with showing progress and Disk IO limits. Pipe Viewer can be used to view the progress of the task, Besides, he can limit the disk IO, especially useful for running Servers. Show Sample Output
This is sample output - yours may be different.
```
7.85GB 0:20:27 [6.54MB/s] [=========================================================================>] 100%
```
1

tar pcf - home | pv -s $(du -sb home | awk '{print $1}') --rate-limit 500k | gzip > /mnt/c/home.tar.gz

Sail · 2010-04-02 15:29:03 8

Useful when you have multiple files or binary files that you need to transfer to a different host and scp or the like is unavailable. To unpack on the destination host copy paste output using the opposite order: openssl enc -d -base64 | gunzip | tar -x Terminate openssl input using ^d Note: gzip is outside of tar because using -z in tar produces lots of extra padding. Show Sample Output

tar -c bins/ | gzip -9 | openssl enc -base64

mweed · 2011-02-24 22:15:23 6

A command to copy mysql tables from a remote host to current host via ssh.

This version compresses the data for transport.
This is sample output - yours may be different.
1

ssh username@remotehost 'mysqldump -u <dbusername> -p<dbpassword> <dbname> tbl_name_1 tbl_name_2 tbl_name_3 | gzip -c -' | gzip -dc - | mysql -u <localusername> -p<localdbpassword> <localdbname>

putnamhill · 2011-03-11 14:57:04 9
IBM AIX: Extract a .tar.gz archive in one shot

This command is for UNIX OSes that have plain vanilla System V UNIX commands instead of their more functional GNU counterparts, such as IBM AIX.
This is sample output - yours may be different.
1

gzip -cd gzippedarchive.tar.gz | tar -xf -

RAKK · 2013-09-18 17:41:25 51
Get gzip compressed web page using wget.

Like the original command, but the -f allows this one to succeed even if the website returns uncompressed data. From gzip(1) on the -f flag: If the input data is not in a format recognized by gzip, and if the --stdout is also given, copy the input data without change to the standard output: let zcat behave as cat.
This is sample output - yours may be different.
1

wget -q -O- --header="Accept-Encoding: gzip" <url> | gzip -cdf > out.html

tempusername · 2014-11-29 20:42:21 8
Run gunzipped sql file in PostGres, adding to the library since I couldnt find this command anywhere else on the web.
This is sample output - yours may be different.
0

gzip -dc /tmp/pavanlimo.gz | psql -U user db

pavanlimo · 2009-07-20 04:32:59 3
Backup all MySQL Databases to individual files

just better bash
This is sample output - yours may be different.
0

while read; do mysqldump $REPLY | gzip > "/backup/mysql/$REPLY.sql.gz"; done < <( mysql -e 'show databases' -s --skip-column-names )

unixmonkey27800 · 2011-11-26 23:12:18 10
DD with progressbar using pv for backing up entire block device
This is sample output - yours may be different.
0

sudo dd if=/dev/block/device bs=1MB | pv -s `sudo blockdev --getsize64 /dev/block/device' | gzip -9 > output.img.gz

hur1can3 · 2011-12-05 23:21:59 4
CPIO better than TAR

Archive all .sh files in a directory into a gzip archive.
This is sample output - yours may be different.
0

find . -type f -name '*.sh' -print | cpio -o | gzip >sh.cpio.gz

djangofan · 2011-12-21 21:13:29 11
Find the mounted storages
This is sample output - yours may be different.
0

sudo find . -name "syslog*.gz" -type f | xargs gzip -cd | grep "Mounted"

alamati · 2012-02-29 06:24:27 5
backup your history

this one works on user crontab
This is sample output - yours may be different.
0

gzip -c ~/.bash_history > ~/.backup/history-save-$(date +\%d-\%m-\%y-\%T).gz

tictacbum · 2013-01-11 17:31:07 5
create tar.gz on solaris
This is sample output - yours may be different.
0

tar cfp - file-to-be-archived | gzip > archive.tar.gz

vaaclav · 2013-04-30 08:06:16 8
generate an initrd file

This commands compresses the "tmp" directory into an initrd file.
This is sample output - yours may be different.
0

cd tmp ; find . |cpio -o -H newc| gzip > ../initrd.gz

akiuni · 2014-09-24 14:07:54 8
gzip only that files that are not gzipped and are not open by any process
This is sample output - yours may be different.
0

find -type f ! -name "*.gz" ! -exec fuser -s {} ';' -exec gzip {} \;

jazgot · 2014-11-26 11:57:40 7
dd with progress bar and statistics to gzipped image

Sets the size of the disk to $DISKSIZE so that the percentage readout of pv is correct. set /dev/sdb to whatever your disk is /dev/sdX. Next pipe dd to pv, then pipe pv to gzip so that you get a gzipped image file. Show Sample Output
This is sample output - yours may be different.
```
4.15GB 0:04:03 [20.1MB/s] [======>                                               ] 13% ETA 0:24:57
```
0

DISKSIZE=`sudo blockdev --getsize64 /dev/sdb` && sudo dd bs=4096 if=/dev/sdb | pv -s $DISKSIZE | sudo gzip -9 > ~/USBDRIVEBACKUP.img.gz

frame45 · 2016-08-31 00:03:56 14
Find and archive old, large files. Great for manually cleaning up logs when logrotate can't be used.
This is sample output - yours may be different.
0

find . -type f -size +100M -mtime +30 -exec gzip {} \;

strex · 2016-10-06 20:43:03 20
Import MySQL db to localhost.
This is sample output - yours may be different.
0

ssh remote_user@remote_host 'mysqldump -h localhost -u username -ppass -B db_name | gzip -cf' | gunzip -c | mysql -uroot

panuka · 2017-01-07 15:05:48 16
decompress to new file with gzip and progress

When decompressing big files it can be nice to know how long you have to go grab coffee. Show Sample Output
This is sample output - yours may be different.
```
61MiB 0:00:07 [36.6MiB/s] [===>                                    ]  5% ETA 0:01:54

4.43GiB 0:02:01 [37.4MiB/s] [=================================================================>] 100%
```
0

pv file.gz | gzip -d -c > file.out

skidder · 2017-10-21 21:51:10 21
backup all data in compressed format

error out to a different file every day if it is part of a cron entry. The backup file will overwrite older version.
This is sample output - yours may be different.
0

mysqldump --routines --all-databases | gzip > /home/mydata.sql.gz 2> /home/mydata.date '+\%b\%d'.err

shantanuo · 2020-02-09 07:46:42 229
Extract 2 copies of .tar.gz content

Sometimes you might need to have two copies of data that is in tar. You might unpack, and then copy, but if IO is slow, you might lower it by automatically writing it twice (or more times)
This is sample output - yours may be different.
-1

mkdir copy{1,2}; gzip -dc file.tar.gz | tee >( tar x -C copy1/ ) | tar x -C copy2/

depesz · 2011-04-14 17:02:05 6
< 1 2 3 >

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

tar and remove files which are older that 100 days

tar does not have a -mtime option as find. tar appends all the file to an existing tar file.

Run remote web page, but don't save the results

I have a remote php file that I want to run once an hour. I set up cron to run this wget. I don't really care about what's in the file though, I don't want to save the results, so I run the -O and send it to /dev/null

Broadcast your shell thru ports 5000, 5001, 5002 ...

run 'nc yourip 5000', 'nc yourip 5001' or 'nc yourip 5002' elsewhere will produce an exact same mirror of your shell. This is handy when you want to show someone else some amazing stuff in your shell without giving them control over it.

Oneliner to run commands on multiple servers

Oneliner to run commands on multiple servers over ssh. - First parameter "$1" is the command you want to execute remotely. ( It can be multiple commands e.g. "hostname;uptime") - Second parameter "${@:2}" represents the remote host/s you want to run the command/s on.

lists files and folders in a folder

lists files and folders in a folder with summary.

draw honeycomb

$ tput setaf 1 && tput rev && seq -ws "___|" 81|fold -69|tr "0-9" "_" && tput sgr0 $ $ # (brick wall)

List your sudo rights

List the commands you have the right to use with sudo.

Making scripts runs on backgourd and logging output

Save all output to a log.

SSH connection through host in the middle

Postpone a command [zsh]

When writing on the command line of zsh, by pressing Alt+q the command will be cleaned, and you can insert another one. The command you were writing will be recorder, and pasted on the prompt immediately after the "interrupting" command is inserted.

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using gzip

Commands using gzip (59) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using gzip (59)

sorted by