Commands by brainstorm

Commands by brainstorm (8)

sorted by

AWS Route53 hosted zone export

Frustrated with the manual domain migration process AWS has, I unsuccessfully tried to install cli53, route53-transfer. I instead wrote this oneliner to ease the export (which is not supported via the AWS console ATM). The output can be easily pasted into the "Import Hosted Zone" dialog in Route53. SOA/NS records are excluded since they cannot be automatically imported. Show Sample Output
This is sample output - yours may be different.
```
$ORIGIN   umccr.org.
$TTL      1h
umccr.org.	MX	10 inbound-smtp.eu-west-1.amazonaws.com
umccr.org.	TXT	"google-site-verification=foo"
(...)
```
1

echo -e "\$ORIGIN\tumccr.org.\n\$TTL\t1h\n" && aws route53 list-resource-record-sets --hosted-zone-id Z1EEXAMPLE9SF3 | jq -r '.ResourceRecordSets[] | [.Name, .Type, .ResourceRecords[0].Value] | join("\t")' - | grep -vE "NS|SOA"

brainstorm · 2018-06-15 01:19:21 233
Virtualbox rsync copy (without defining any virtualbox configuration)

That is, after running `vagrant ssh-config` to determine ports and ip's: vagrant ssh-config Host default HostName 127.0.0.1 User vagrant Port 2200 UserKnownHostsFile /dev/null StrictHostKeyChecking no PasswordAuthentication no IdentityFile /Users/romanvg/tmp/.vagrant/machines/default/virtualbox/private_key IdentitiesOnly yes LogLevel FATAL
This is sample output - yours may be different.
1

rsync -a --progress -e 'ssh -p 2200 -i .vagrant/machines/default/virtualbox/private_key' vagrant@127.0.0.1:/vagrant/vm/old_timecapsule_backup /Volumes/2TB/

brainstorm · 2015-12-17 15:28:12 12
iMovie compatible ffmpeg transcoding

After updating to the latest ffmpeg with homebrew
This is sample output - yours may be different.
0

ffmpeg -i $video -c:v prores -profile:v 2 -c:a copy ${video}.mov

brainstorm · 2014-03-10 16:24:34 18
VLC transcode for OSX

Transcodes mpg2 files, that cannot be read by iMovie to m4v files. Show Sample Output
This is sample output - yours may be different.
```
[0x100246090] dummy interface: using the dummy interface module...
[0x1006138d0] x264 encoder: using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX AVX2 FMA3 LZCNT BMI2

[0x1006138d0] x264 encoder: profile High, level 2.0

[0x1006138d0] x264 encoder: final ratefactor: 18,60

[0x1006138d0] x264 encoder: using SAR=178/163

[0x1006138d0] x264 encoder: using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX AVX2 FMA3 LZCNT BMI2

[0x1006138d0] x264 encoder: profile High, level 2.0
```
0

/opt/homebrew-cask/Caskroom/vlc/2.1.0/VLC.app/Contents/MacOS/VLC --sout-avcodec-strict=-2 -I dummy $video :sout="#transcode{vcodec=h264,vb=1024,acodec=mpga,ab=256,scale=1,channels=2,audio-sync}:std{access=file,mux=mp4,dst=${video}.m4v}" vlc://quit

brainstorm · 2014-03-08 13:53:13 10
Timelapse with ffmpeg (after symlinking pictures as per ffmpeg FAQ)
This is sample output - yours may be different.
-1

ffmpeg -r 12 -i img%03d.jpg -sameq -s hd720 -vcodec libx264 -crf 25 OUTPUT.MP4

brainstorm · 2013-05-04 18:46:36 9
Count all files in directories recursively with find

Counts the files present in the different directories recursively. One only has to change maxdepth to have further insight in the directory hierarchy. Found at unix.stackexchange.com: http://unix.stackexchange.com/questions/4105/how-do-i-count-all-the-files-recursively-through-directories Show Sample Output
This is sample output - yours may be different.
```
./Data: 5011
./Data/Intensities:     3
./Data/Intensities/BaseCalls:   2
./Data/Status_Files:    28
./Data/Status_Files/RefreshBtn: 4
./Data/reports: 4978
```
1

find -maxdepth 3 -type d | while read -r dir; do printf "%s:\t" "$dir"; find "$dir" | wc -l; done

brainstorm · 2012-10-15 15:00:09 7
Efficient remote forensic disk acquisition gpg-crypted for multiple recipients

Acquires a bit-by-bit data image, gzip-compresses it on multiple cores (pigz) and encrypts the data for multiple recipients (gpg -e -r). It finally sends it off to a remote machine.
This is sample output - yours may be different.
3

dd if=/dev/sdb | pigz | gpg -r <recipient1> -r <recipient2> -e --homedir /home/to/.gnupg | nc remote_machine 6969

brainstorm · 2010-12-31 19:24:37 7
Check a server is up. If it isn't mail me.

For some reason the 2&>1 does not work for me, but the shorter stdout/stderr redirection >& works perfectly (Ubuntu 10.04).
This is sample output - yours may be different.
2

ping -q -c1 -w3 server.example.com >& /dev/null || echo server.example.com ping failed | mail -ne -s'Server unavailable' admin@example.com

brainstorm · 2010-09-08 12:19:29 4

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Recursively remove directory with many files quickly

rsync'ing an empty directory over a directory to be deleted recursively is much faster than using rm -rf, for various reasons. Relevant only for directories with really a lot of files.

Copies currently played song in Audacious to selected directory

Maybe it could work for any music player if you change "audacious2" with the string you see in `ps aux` for your player. Needs testing in different systems.

Recursive replace of directory and file names in the current directory.

no grep, no perl, no pipe. even better in zsh/bash4: $ for i in **/*oldname*; do "mv $i ${i/oldname/newname/}"; done No find, no grep, no perl, no pipe

Emulate tail using awk.

This awk codes emulates tail. For efficiency it uses a circular array, which stores only N number of records. Using awk gives the flexibility of modifying the output as needed, for example adding the record number (NR) at the output and much more.

Rename files in batch

Generate a list of installed packages on Debian-based systems

Export a subset of a database

Limits the number of rows per table to X

Convert the contents of a directory listing into a colon-separated environment variable

Useful for making a CLASSPATH out of a list of JAR files, for example. Also: export CLASSPATH=.:$(find ./lib -name '*.jar' -printf '%p:')

Find usb device in realtime

Using this command you can track a moment when usb device was attached.

Convert CSV to JSON

Replace 'csv_file.csv' with your filename.

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands by brainstorm