Commands tagged backup sorted by votes

Commands tagged backup (67)

sorted by

create compressed encrypted backup

Create compressed, encrypted backup from $source to $targetfile with password $key and exclude-file $excludefile
This is sample output - yours may be different.
0

tar --exclude-from=$excludefile -zcvp "$source" | openssl aes-128-cbc -salt -out $targetfile -k $key

klausman · 2013-12-13 19:35:20 9
Full remote server backup over cstream using tar (excluding unnecessary files) (reports every 10 seconds)

The files are automatically uncompressed when they reach the destination machine. This is a fast way to backup your server to your local computer while it's running (shutting down services is recommended). A file named "exclude.txt" is needed at /tmp/ containing the following : /dev/* /media/* /mnt/* /proc/* /sys/* /tmp/* /home/*/.local/share/Trash /home/*/.gvfs /home/*/.cache /home/*/.thumbnails /etc/fstab /lib/modules/*/volatile/.mounted /var/run/* /var/lock/* /var/tmp/* /var/cache/apt/archives/* /lost+found/* Show Sample Output
This is sample output - yours may be different.
```
895643648 B 854.2 MB 2125.2 s (35:25 min) 421438 B/s 411.56 KB/s
898371584 B 856.8 MB 2132.5 s (35:32 min) 421280 B/s 411.41 KB/s
901783552 B 860.0 MB 2139.8 s (35:39 min) 421431 B/s 411.55 KB/s
904785920 B 862.9 MB 2147.0 s (35:46 min) 421420 B/s 411.54 KB/s
908300288 B 866.2 MB 2154.0 s (35:54 min) 421678 B/s 411.79 KB/s
911953920 B 869.7 MB 2161.2 s (36:01 min) 421969 B/s 412.08 KB/s
914890752 B 872.5 MB 2168.4 s (36:08 min) 421929 B/s 412.04 KB/s
919408640 B 876.8 MB 2175.4 s (36:15 min) 422647 B/s 412.74 KB/s
923365376 B 880.6 MB 2182.6 s (36:22 min) 423061 B/s 413.15 KB/s
```
0

tar -cj / -X /tmp/exclude.txt | cstream -v 1 -c 3 -T 10 | ssh user@host 'tar -xj -C /backupDestination'

fantleas · 2014-07-21 18:52:19 9
10 files backup rotate in crontab

this command can be added to crontab so as to execute a nightly backup of directories and store only the 10 last backup files.
This is sample output - yours may be different.
0

for file in $(find /var/backup -name "backup*" -type f |sort -r | tail -n +10); do rm -f $file; done ; tar czf /var/backup/backup-system-$(date "+\%Y\%m\%d\%H\%M-\%N").tgz --exclude /home/dummy /etc /home /opt 2>&- && echo "system backup ok"

akiuni · 2014-09-24 14:04:11 11
rsync over ssh using alternative port number

Useful, when you need to backup/copy/sync a folder over ssh with a non standard port number
This is sample output - yours may be different.
0

rsync -arvz -e 'ssh -p 2233' --progress --delete remote-user@remote-server.org:/path/to/folder /path/to/local/folder

nadavkav · 2014-09-26 10:42:26 8
lftp backup from server to dev for a drupal site

sets the option set ftp:ssl-allow false, excludes some files I don't want to synchronize
This is sample output - yours may be different.
0

lftp -u user,pass -e "set ftp:ssl-allow false; mirror --exclude settings.php --exclude .htaccess serverdir devdir" serverhost

aufumy · 2015-09-08 21:25:41 10
Generate a directory path based on the date and time

Great for backup / restore scripts. May want to remove the %M/%S to group backups by hour. If using a script, set a variable earlier with the date command, then reference that variable. Otherwise, time will keep on rolling ;-) declare -rx script_start_time="$(date '+./%Y/%m/%d/%H/%M/%S')" mkdir -p "$script_start_time" Show Sample Output
This is sample output - yours may be different.
```
forest@murgatroyd:~/2015/11/21/00/39/56$ pwd
/home/forest/2015/11/21/00/39/56
```
0

mkdir -p "$(date '+./%Y/%m/%d/%H/%M/%S')"

forestb · 2015-09-25 08:56:26 11
Dump and compress a drive over ssh with current speeds

first line is the speed the uncompressed data is read, second line is the compressed data sent over ssh. change sdb to your target drive/partition to be backed up. change pbzip -c1 to suit your compression. and ssh to your target file. don't forget to run zerofree/fstrim first! Show Sample Output
This is sample output - yours may be different.
```
16.4GiB [17.1MiB/s] [40.8MiB/s]
3.64GiB [  11MiB/s] [9.04MiB/s]
```
0

dd if=/dev/sdb | pv -rabc | pbzip2 -c1 | pv -rabc | ssh user@192.168.0.1 'cat > /dump.bz2'

sexyrms · 2016-06-19 23:27:03 11
Split a file into equal size chunks and archive to (e)mail account.

This is just a little snippit to split a large file into smaller chunks (4mb in this example) and then send the chunks off to (e)mail for archival using mutt. I usually encrypt the file before splitting it using openssl: openssl des3 -salt -k <password> -in file.tgz -out file.tgz.des3 To restore, simply save attachments and rejoin them using: cat file.tgz.* > output_name.tgz and if encrypted, decrypt using: openssl des3 -d -salt -k <password> -in file.tgz.des3 -out file.tgz edit: (changed "g" to "e" for political correctness)
This is sample output - yours may be different.
-1

split -b4m file.tgz file.tgz. ; for i in file.tgz.*; do SUBJ="Backup Archive"; MSG="Archive File Attached"; echo $MSG | mutt -a $i -s $SUBJ YourEmail@(E)mail.com

tboulay · 2010-03-20 16:49:19 9
Compressed Backup of the /etc

Simple Compressed Backup of the /etc Linux compatible
This is sample output - yours may be different.
-1

tar jcpf /home/[usuario]/etc-$(hostname)-backup-$(date +%Y%m%d-%H%M%S).tar.bz2 /etc

mack · 2011-04-29 22:53:11 5
copy root to new device

preserve all except context and xattr. useful when moving a running system to a new partition.
This is sample output - yours may be different.
-1

cp -dpRx /* /mnt/target/

unixmonkey24812 · 2011-08-22 14:22:01 6
purge half of files in backup directory

If you have a directory with lot of backups (full backups I mean), when it gets to some size, you could want to empty some space. With this command you'll remove half of the files. The command assumes that your backup files starts with YYYYMMDD or that they go some alphabetical order. Show Sample Output
This is sample output - yours may be different.
```
(nothing, it will remove half of the files)
```
-1

find . | sort | awk 'NR%2==0' | xargs rm $1

sucotronic · 2013-07-11 07:36:18 11
backup file with tar

backup your files in tar archive + timestamp of backup Show Sample Output
This is sample output - yours may be different.
```
medamin@inismhost:~/Documents/Developement/conf/bind9$ tar -cvf bind9-config-`date +%s`.tar *
db.192
db.192~
db.host.go
db.host.go~
named.conf.local
named.conf.local~
named.conf.options
named.conf.options~
medamin@inismhost:~/Documents/Developement/conf/bind9$
```
-1

tar -cvf bind9-config-`date +%s`.tar *

Fuonum · 2014-10-29 05:15:15 9
Back up a PLESK Installation
This is sample output - yours may be different.
-2

/opt/psa/bin/pleskbackup server -v --output-file=plesk_server.bak

m03hr3 · 2009-07-14 18:28:28 3
tar per directory

Very simple and useful, you need to change the word "directory" for your directory
This is sample output - yours may be different.
-3

cd <YOUR_DIRECTORY>; for i in `ls ./`; do tar czvf "$i".tar.gz "$i" ; done

ElAlecs · 2009-06-11 18:33:27 19
backup and remove files with access time older than 5 days.

This deals nicely with files having special characters in the file name (space ' or "). Parallel is from https://savannah.nongnu.org/projects/parallel/
This is sample output - yours may be different.
-3

tar -zcvpf backup_`date +"%Y%m%d_%H%M%S"`.tar.gz `find <target> -atime +5 -type f` 2> /dev/null | parallel -X rm -f

unixmonkey8046 · 2010-01-28 12:41:41 4
Backup a file with a date-time stamp

This backup function preserve the file suffix allowing zsh suffix aliases and desktop default actions to work with the backup file too. Show Sample Output
This is sample output - yours may be different.
```
> ls
image.jpg

> buf image.jpg; ls
image.2010-12-14.jpg
```
-3

buf () {oldname=$1; if [ "$oldname" != "" ]; then datepart=$(date +%Y-%m-%d); firstpart=`echo $oldname | cut -d "." -f 1`; newname=`echo $oldname | sed s/$firstpart/$firstpart.$datepart/`; cp -i ${oldname} ${newname}; fi }

Seebi · 2010-12-14 19:58:34 5
Start a quick rsync daemon for fast copying on internal secure network

An example config file is placed in the sample output along with the command line call to use it. The rsync daemon here is setup on the destination, thus requiring the read only = false flag. Also it uses uid and gid of root, change as required. Show Sample Output
This is sample output - yours may be different.
```
# contents of .rsyncd.conf
uid = root
gid = root
use chroot = no
[somefile]
        path = /root/somefile/
        comment = somefile
        read only = false
# command to connect to this daemon on port 9999
# rsync --progress -rv somefile/ rsync://yd3:9999/somefile/
```
-3

rsync --daemon --port 9999 --no-detach -v --config .rsyncd.conf

pykler · 2011-09-22 20:48:31 4
< 1 2 3

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Which processes are listening on a specific port (e.g. port 80)

swap out "80" for your port of interest. Can use port number or named ports e.g. "http"

Extract raw URLs from a file

you can also use cut instead of awk. less powerful but probably faster. ;)

Binary search/replace

Replace all instances of "A" with "B" in file "source" saved as file "destination". !! IF A/B is multi-byte, then separate bytes with spaces like so: "s/20\ 0A/00/g".

Find ulimit values of currently running process

When dealing with system resource limits like max number of processes and open files per user, it can be hard to tell exactly what's happening. The /etc/security/limits.conf file defines the ceiling for the values, but not what they currently are, while $ ulimit -a will show you the current values for your shell, and you can set them for new logins in /etc/profile and/or ~/.bashrc with a command like: $ ulimit -S -n 100000 >/dev/null 2>&1 But with the variability in when those files get read (login vs any shell startup, interactive vs non-interactive) it can be difficult to know for sure what values apply to processes that are currently running, like database or app servers. Just find the PID via "ps aux | grep programname", then look at that PID's "limits" file in /proc. Then you'll know for sure what actually applies to that process.

convert Decimal to IP from stdin

https://stackoverflow.com/questions/10768160/ip-address-converter

Fibonacci With Case

Returns the '$1'th Fibonacci number.

how to export a table in .csv file

Exports the result of query in a csv file

list block devices

Shows all block devices in a tree with descruptions of what they are.

Adding specific CustomLog for each Virtual Domain of Apache

Count opening and closing braces in a string.

This function counts the opening and closing braces in a string. This is useful if you have eg long boolean expressions with many braces and you simply want to check if you didn't forget to close one.

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands tagged backup

Commands tagged backup (67) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands tagged backup (67)

sorted by