Commands by prees

Commands by prees (5)

sorted by

sorta apache logs by ip frequency
This is sample output - yours may be different.
0

cat access.log | awk '{print $1}' | sort -n | uniq -c | sort -nr | head -20

prees · 2016-05-05 20:52:03 13
split a multi fasta file into separate files
This is sample output - yours may be different.
0

csplit -z --prefix=PUT_PREFIX_HERE FILE_TO_SPLIT '/>/' '{*}'

prees · 2015-09-03 14:49:26 10
tsv file to json file

Need to change values of 'field 1'...'field 3' to column names. input_file.tsv is the tab file you want to conver output_file.json is the file that is created with the json output. Assumes your tsv has no headers.
This is sample output - yours may be different.
0

export FIELDS=field_1,field_2,field_3; cat input_file.tsv| ruby -rjson -ne 'puts ENV["FIELDS"].split(",").zip($_.strip.split("\t")).inject({}){|h,x| h[x[0]]=x[1];h}.to_json' > output_file.json

prees · 2015-07-24 15:00:34 10
List a large directory of files quickly
This is sample output - yours may be different.
0

ls -U1

prees · 2015-07-21 16:12:28 9
Delete a large amount of files
This is sample output - yours may be different.
0

find . -type f -delete

prees · 2015-07-21 16:04:09 8

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

start vim in diff mode

vim will open both files side by side and show colored diffs

rename files according to file with colums of corresponding names

Maybe simpler, but again, don't know how it will work with space in filename.

Convert CSV to JSON

Replace 'csv_file.csv' with your filename.

port forwarding

pem file used by AWS servers for additional security

Copy via tar pipe while preserving file permissions (cp does not!; run this command with root!)

cp options: -p will preserve the file mode, ownership, and timestamps -r will copy files recursively also, if you want to keep symlinks in addition to the above: use the -a/--archive option

Ext3 format Terabytes in Seconds

Record microphone input and output to date stamped mp3 file

record audio notes or meetings requires arecord and lame run mp3gain on the resulting file to increase the volume / quality ctrl-c to stop recording

Just convert your all books DJVU format to PDF, with one line

Find usb device in realtime

Using this command you can track a moment when usb device was attached.

Identify differences between directories (possibly on different servers)

This can be much faster than downloading one or both trees to a common servers and comparing the files there. After, only those files could be copied down for deeper comparison if needed.

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands by prees