Commands by snipertyler

Commands by snipertyler (28)

sorted by

Convert CSV to JSON - Python3 and Bash function

Based / Inspired by malathion's below command http://www.commandlinefu.com/commands/view/20528/convert-csv-to-json Is written for python3 and is very easy to use csv2json *csv will convert all files ending in csv to json eg csv2json file.csv will output a file to file.json Validity of json tested in python3 and below site https://jsonformatter.curiousconcept.com/
This is sample output - yours may be different.
1

csv2json() { for file in $@; do python -c "import csv,json,fileinput; print(json.dumps(list(csv.reader(fileinput.input()))))" "$file" 1> "${file%%csv}json"; done; }

snipertyler · 2017-06-28 04:28:32 16
Speed up or slow down video (and audio)

Usage: videospeed video_filename speedchange newfilename videospeed foo.mp4 0.5 foo_slow.mp4 Range of 0.5 (50%) - 2.0 (200%) is valid.
This is sample output - yours may be different.
4

videospeed() { vname="$1"; speedc="$2"; vs=$(python3 -c "print(1/$speedc)"); aspeed=$(python3 -c "print(1*$speedc)"); ffmpeg -i "$vname" -filter:a "atempo=$aspeed" -filter:v "setpts=$vs*PTS" "${3:-converted_$1}"; }

snipertyler · 2017-03-07 22:44:06 19
Convert entire audio library in parallel

Uses parallel processing Reiteration of my earlier command https://www.commandlinefu.com/commands/view/15246/convert-entire-music-library Usage lc Old_Directory New_DIrectory Old_Format New_Format lc ~/Music ~/Music_ogg mp3 ogg Show Sample Output
This is sample output - yours may be different.
3

lc() { od="$1"; nd="$2"; of=$3; nf=$4; cp -rl "$od" "$nd"; parallel -0 "ffmpeg -i {1} -loglevel error -q:a 6 {1.}.{2} && { rm {1}; echo {1.}.{2}; }" :::: <(find "$nd" -type f -iname \*$of -print0) ::: "$nf"; }

snipertyler · 2017-03-02 17:37:34 39
Convert entire music library

Music Library Convert Usage lc Old_Directory New_DIrectory Old_Format New_Format lc ~/Music ~/Music_ogg mp3 ogg This will convert all audio files in the old directory to the new directory from the old format to the new format. It will leave the original library alone. The converted library will retain folder structure.
This is sample output - yours may be different.
0

lc() { od="$1"; nd="$2"; of=$3; nf=$4; cp -rl "$od" "$nd"; find $nd -type f -iname \*$of -print -execdir ffmpeg -i {} -loglevel error -q:a 6 {}.$nf \; -execdir rm {} +; find $nd -type f -iname \*.$of.$nf -execdir rename "s/$of.$nf/$nf/" {} +; }

snipertyler · 2015-12-16 20:16:01 18
Create higher quality gif from videos

I had to compress it a bit to meet the 255 limit. See sample for full command (274) usage: ffgif foo.ext Supports 3 arguments (optional) ffgif filename seek_time time_duration scale ffgif foo 10 5 320 will seek 10 seconds in, convert for 5 seconds at a 320 scale. Default will convert whole video to gif at 320 scale. Inspiration - http://superuser.com/questions/556029/how-do-i-convert-a-video-to-gif-using-ffmpeg-with-reasonable-quality/556031#556031 Show Sample Output
This is sample output - yours may be different.
```
ffgif() { ffmpeg -y -ss ${2:-0} -t ${3:-0} -i "$1" -vf fps=10,scale=${4:-320}:-1:flags=lanczos,palettegen .p.png && ffmpeg -ss ${2:-0} -t ${3:-0} -i "$1" -i .p.png -filter_complex "fps=10,scale=${4:-320}:-1:flags=lanczos[x];[x][1:v]paletteuse" "${1%.*}".gif; rm .p.png; }
```
3

ffgif() { p="fps=10,scale=${4:-320}:-1:flags=lanczos"; ffmpeg -y -ss ${2:-0} -t ${3:-0} -i "$1" -vf ${p},palettegen .p.png && ffmpeg -ss ${2:-0} -t ${3:-0} -i "$1" -i .p.png -filter_complex "${p}[x];[x][1:v]paletteuse" "${1%.*}".gif && rm .p.png; }

snipertyler · 2015-09-08 21:13:17 15
Search and play youtube videos directly to terminal (no X needed)

Same as other command, however uses youtube-dl internal search (thanks to qoxxxx mentioning this) It does however seem to be a little buggy and youtube-dl crashes sometimes. ## pyt 'Stairway to heaven - Led Zeppelin' pyt 'brain damage - Pink Floyd' No web browser or even X needed. Just a cli and internet connection! mplayer is pauseable and can skip ahead This may break if youtube changes their search html.
This is sample output - yours may be different.
6

pyt() { youtube-dl -q -f bestaudio --max-downloads 1 --no-playlist --default-search ${2:-ytsearch} "$1" -o - | mplayer -vo null /dev/fd/3 3<&0 </dev/tty; }

snipertyler · 2015-07-27 15:19:59 14
Search and play youtube videos directly to terminal (no X needed)

pyt 'Stairway to heaven - Led Zeppelin' pyt 'brain damage - Pink Floyd' No web browser or even X needed. Just a cli and internet connection! mplayer is pauseable and can skip ahead This may break if youtube changes their search html.
This is sample output - yours may be different.
4

pyt() { id=$(curl -s 'https://www.youtube.com/results?search_query='$(tr ' ' + <<<"$1") | grep -om3 '"[[:alnum:]]\{11\}"' | awk NR==3 | tr -d \"); youtube-dl -q 'https://www.youtube.com/watch?v='"$id" -o - | mplayer -vo null /dev/fd/3 3<&0 </dev/tty; }

snipertyler · 2015-07-20 05:30:27 16
Randomly succeeding command

Command will succeed n% of the time. ran 75 will cause command to succeed 75% of the time. No argument will cause it to succeed 50% of the time. Show Sample Output
This is sample output - yours may be different.
```
$ for i in {1..1000}; do ran 75 >> /tmp/ran_test; done
$ grep -c TRUE /tmp/ran_test
776
$ for i in {1..10}; do ran 75 >> /tmp/ran_test; done
$ grep -c TRUE /tmp/ran_test
7
$ for i in {1..1000000}; do ran 16 >> /tmp/ran_test; done
$ echo $(grep -c TRUE /tmp/ran_test)/1000000 | bc -l
.15952300000000000000

ran 80
TRUE
```
0

ran() { R=$((RANDOM%100)); if [ $R -gt "${1:-50}" ]; then echo FALSE; false; else echo TRUE; true; fi; }

snipertyler · 2015-07-15 15:34:56 9
Play online music videos in terminal

pvl 'link1' 'link2' 'link3' Play Youtube, Vimeo, etc links without visual elements. Great for music videos when you just want the audio. You can control mplayer with this! Hit Ctrl-C twice to exit (if you're playing multiple files)
This is sample output - yours may be different.
4

pvl() { (for i in "$@"; do youtube-dl -q --max-downloads 1 --no-playlist "$i" -o - | mplayer -vo null /dev/fd/3 3<&0 </dev/tty; sleep .5; done); }

snipertyler · 2015-07-14 04:44:36 26
Stream youtube videos

Streams youtube-dl video to mplayer. Usage: syt 'youtube.com/link' 'anotherlinkto.video' Uses mplayer controls
This is sample output - yours may be different.
5

syt() { pipe=`mktemp -u`; mkfifo -m 600 "$pipe" && for i in "$@"; do youtube-dl -qo "$pipe" "$i" & mplayer "$pipe" || break; done; rm -f "$pipe"; }

snipertyler · 2015-03-14 01:48:20 20
Secure netcat chat - SSH

client: nc localhost 9876
This is sample output - yours may be different.
0

ssh hostname nc -l 9876

snipertyler · 2015-01-14 20:11:50 12
Do command when logged in from certain ips using ssh

Place in ~/.bashrc If you login to a ssh server from different ips, sometimes you want to do something specific for each. e.g., quickly go into screen -x session from a phone, but not your desktop.
This is sample output - yours may be different.
4

if [ "${SSH_CLIENT%% *}" == "ipaddr" ]; then command; fi

snipertyler · 2015-01-13 22:09:38 10
Submit command & rewrite orginal command

Similar to entering a command, but will not erase the command from the command line. Basically a shortcut from entering command, then pushing the up arrow key. Show Sample Output
This is sample output - yours may be different.
```
~ > echo hello
hello
~ > echo hello
hello
~ > echo hello
hello
~ > echo hello
hello
```
9

<ctrl>+o

snipertyler · 2014-12-28 22:00:15 12
Convert current symbolic directory into physical directory

Show Sample Output
This is sample output - yours may be different.
```
~/Foobar $ cd -P .
/media/Files/date_time/backup/Foobar $
```
1

cd -P .

snipertyler · 2014-12-16 15:39:29 7
Viewable terminal session over network.

connect to it with any network command (including web browser - if you don't mind weird formatting) curl 127.0.0.1:9876 nc 127.0.0.1 9876 Show Sample Output
This is sample output - yours may be different.
```
[1] 9879
Script started, file is /tmp/view
```
5

mkfifo /tmp/view; nc -l 9876 < /tmp/view& script -f /tmp/view

snipertyler · 2014-06-23 05:06:13 8
View online pdf documents in cli

Probably will not work very well with scanned documents.
This is sample output - yours may be different.
4

curl 'LINK' | pdftotext - - | less

snipertyler · 2014-06-21 00:47:02 6
Simple multi-user encrypted chat server for 5 users

Client ~$ ncat --ssl localhost 9876 Change localhost to the correct ip address. Show Sample Output
This is sample output - yours may be different.
```
ncat --verbose --listen --max-conns 5 --ssl --chat --source-port 9876
```
19

ncat -vlm 5 --ssl --chat 9876

snipertyler · 2014-06-07 19:17:29 12
View Owner, Group & Permissions.

#Alias alias perm="stat -c '%n %U:%G-%a'" #Function perm() { for ll in $@; do stat -c "%n %U:%G-%a" "$ll"; done; } Show Sample Output
This is sample output - yours may be different.
```
~$ perm test hide
test user:group-644
hide user:group-600
```
3

stat -c '%n %U:%G-%a' *

snipertyler · 2014-05-03 04:56:23 17

Dump audio from video without re-encoding.

This removes the video and subsequent file size and directly copies the audio. Show Sample Output

ffmpeg -i file.ext -acodec copy -vn out.ext

snipertyler · 2014-04-25 14:24:57 6

checksum a directory / files

Doesn't create a file Make sure to list the files / directories in the same order every time.
This is sample output - yours may be different.
-3

tar -cf - file1 dir1/ dir2/ | md5sum

snipertyler · 2014-04-17 14:33:44 10
Conversion of media stream

This encodes it in ogg format. Does on-the-fly encoding of the incoming stream. Great for radio streams as they're often flv format.
This is sample output - yours may be different.
0

curl 'AudioStream' | ffmpeg -i - -acodec libvorbis file.ogg

snipertyler · 2014-03-31 02:07:20 8
Create named LUKS encrypted volume

You need to be root to do this. So check the command before running it. You enter the same password for Enter LUKS passphrase: Verify passphrase: Enter passphrase for /dev/loopn: ___ You can then copy the .img file to somewhere else. Loop it it with losetup -f IMAGENAME.img and then mount it with a file manager (eg nemo) or run mount /dev/loopn /media/mountfolder Acts similar to a mounted flash drive Show Sample Output
This is sample output - yours may be different.
```
~$ edrv Testing
1+0 records in
1+0 records out
1 byte (1 B) copied, 0.000525913 s, 1.9 kB/s

WARNING!
========
This will overwrite data on /dev/loop2 irrevocably.

Are you sure? (Type uppercase yes): YES
Enter LUKS passphrase: 
Verify passphrase: 
Enter passphrase for /dev/loop2: 
mkfs.vfat 3.0.16 (01 Mar 2013)
unable to get drive geometry, using default 255/63
losetup -d /dev/loop2 to unmount
```
2

edrv() { N=${1:-edrv}; truncate -s ${2:-256m} $N.img && L=$(losetup -f) && losetup $L $N.img && cryptsetup luksFormat --batch-mode $L && cryptsetup luksOpen $L $N && mkfs.vfat /dev/mapper/$N -n $N; cryptsetup luksClose $N; echo losetup -d $L to unmount; }

snipertyler · 2014-02-24 01:38:21 11
Toggle a temporary ram partition

Creates a temporary ram partition To use: ram 3 to make a 3gb partition (Defaults to 1gb) Show Sample Output
This is sample output - yours may be different.
```
$ ram
/mnt/ram 1
$ ram
Enter to Remove Ram Partition 
/mnt/ram 0
```
3

ram() { mt=/mnt/ram && grep "$mt" < /proc/mts > /dev/null; if [ $? -eq 0 ] ; then read -p"Enter to Remove Ram Partition ";sudo umount "$mt" && echo $mt 0; else sudo mt -t tmpfs tmpfs "$mt" -o size=$(( ${1:-1} * 1024 ))m && echo $mt '-' "${1:-1}"gb; fi; }

snipertyler · 2013-12-13 05:22:02 9
Stream and copy a video from lan

Requires a listening port on HOST eg. "cat movie.mp4 | nc -l 1356 " (cat movie.mp4 | nc -l PORT) Useful if you're impatient and want to watch a movie immediately and download it at the same time without using extra bandwidth. You can't seek (it'll crash and kill the stream) but you can pause it.
This is sample output - yours may be different.
7

nc HOST PORT | tee movie.mp4 | mplayer -

snipertyler · 2013-11-28 01:38:29 10
Google text-to-speech in mp3 format

Usage: t2s 'How are you?' Nice because it automatically names the mp3 file up to 15 characters Modified (uses bash manip instead of tr) t2s() { wget -q -U Mozilla -O $(cut -b 1-15
This is sample output - yours may be different.
14

t2s() { wget -q -U Mozilla -O $(tr ' ' _ <<< "$1"| cut -b 1-15).mp3 "http://translate.google.com/translate_tts?ie=UTF-8&tl=en&q=$(tr ' ' + <<< "$1")"; }

snipertyler · 2013-10-16 23:29:59 9
1 2 >

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

uniq without pre-sorting

Reads stdin, and outputs each line only once - without sorting ahead of time. This does use more memory than your system's sort utility.

Create a mirror of a local folder, on a remote server

Create a exact mirror of the local folder "/root/files", on remote server 'remote_server' using SSH command (listening on port 22) (all files & folders on destination server/folder will be deleted)

Recursive Line Count

We use `-not -name ".*"` for the reason we must omit hidden files (which unnecessary). We can only show up total lines like this: $ find * -type f -not -name ".*" | xargs wc -l | tail -1

Show the PATH, one directory per line (part 2)

Here is another way to show the path, one directory per line. The command `tr` translates the colon into the new line, taking input from the $PATH variable

a function to create a box of '=' characters around a given string.

First argument: string to put a box around. Second argument: character to use for box (default is '=') Same as command #4962, cleaned up, shortened, and more efficient. Now a ' * ' can be used as the box character, and the variables get unset so they don't mess with anything else you might have. They marked c++ as a function for this command, but I'm not sure why. Must be a bug.

list files recursively by size

Mount Fat USB with RWX

after that, you can launch bash script in your usb drive in FAT32.

check open ports without netstat or lsof

Read funny developer comments in the Linux source tree

These are way better than fortune(6).

list files recursively by size

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands by snipertyler