Commands by theist

Commands by theist (8)

sorted by

mysql bin log events per minute

shows number of mysql bin log events (which are mysql server events) per minute, useful to check stress times postmortem Show Sample Output
This is sample output - yours may be different.
```
....
      6  0:18
      1  0:17
     69  0:18
   4270  0:19
   7032  0:20
   1118  0:21
....
```
1

mysqlbinlog <logfiles> | grep exec | grep end_log_pos | cut -d' ' -f2- | cut -d: -f-2 | uniq -c

theist · 2012-05-30 09:42:21 8
mysqlbinlog headers sorted by event time

Shows sorted by query time, the headers of mysqlbinlog entries. Then is easy to locate the heavier events on the raw log dump Show Sample Output
This is sample output - yours may be different.
```
...
1 - #120528 21:55:39 server id 1  end_log_pos 10474343      Query   thread_id=2446084       exec_time=1     error_code=0
15 - #120528 21:55:17 server id 1  end_log_pos 10473569      Query   thread_id=2446071       exec_time=15    error_code=0
22 - #120528 21:55:17 server id 1  end_log_pos 10474905      Query   thread_id=2446084       exec_time=22    error_code=0
...
```
0

mysqlbinlog <logfiles> | grep exec | grep end_log_pos | grep -v exec_time=0 | sed 's/^$.*exec_time=\([0-9]\+$.*\)/\2 - \1 /' | sort -n

theist · 2012-05-30 09:38:02 6
Per country GET report, based on access log. Easy to transform to unique IP

Per country GET report, based on access log. Easy to transform to unique IP Show Sample Output
This is sample output - yours may be different.
```
     71 , Poland
    116 , France
    300 , United States
   2426 , Spain
```
-1

cat /var/log/nginx/access.log | grep -oe '^[0-9.]\+' | perl -ne 'system("geoiplookup $_")' | grep -v found | grep -oe ', [A-Za-z ]\+$' | sort | uniq -c | sort -n

theist · 2012-05-08 13:28:25 4
Debug redirects between production reloads

Watches the headers of a curl, following any redirects and printing only the HTTP status and the location of the possible redirects. Show Sample Output
This is sample output - yours may be different.
```
Every 2,0s: curl -s ...

HTTP/1.1 301 Moved Permanently
Location: http://fooo.bar/
HTTP/1.1 302 Moved Temporarily
Location: http://fooo.bar/ho
HTTP/1.1 404 Not Found
```
3

watch 'curl -s --location -I http://any.site.or.url | grep -e "$HTTP\|Location$"'

theist · 2012-04-23 17:05:29 5
filter rails log to count requests sliced in seconds

Commandline perl filter for, using a production.log from a rails app, display on realtime the count of requests grouped by "seconds to complete" (gross round, but fair enough for an oneliner) :) Show Sample Output
This is sample output - yours may be different.
```
0s: 30
1s: 43
2s: 12
5s: 1

0s: 33
1s: 43
2s: 13
5s: 1
```
0

tail -f production.log | perl -ne 'if (/^Completed.in.(\d+)/){$d = int($1/1000);print "\n";$f{$d}++;for $t (sort(keys(%f))){print $t."s: ".$f{$t}."\n"}}'

theist · 2012-02-23 14:37:33 4
cat a bunch of small files with file indication

If you have a bunch of small files that you want to cat to read, you can cat each alone (boring); do a cat *, and you won't see what line is for what file, or do a grep . *. "." will match any string and grep in multifile mode will place a $filename: before each matched line. It works recursively too!! Show Sample Output
This is sample output - yours may be different.
```
file1.txt:foo
file1.txt:bar
file2.txt:foo
file3.txt:foo
```
18

grep . *

theist · 2011-09-01 09:16:04 11
Create a booklet ps file out of a normal ps (A4 Size)

'booklet' is the name they'll give it in fineprint windows alternative. It's a postscript file prepared to be printed dual side, one page per sheet, and, once finished you can place staples in the middle of the print, fold, and read it like a book.
This is sample output - yours may be different.
0

psbook file.ps | psnup -2 -l -m0.5cm | pstops '2:0,1U(210mm,297mm)' > file.booklet.ps

theist · 2011-03-24 08:56:32 4
Fix all the commit log messages from a user of a bad subversion client

Let's supose some moron used some m$ shit to commit to a later svnsynced repo. On a svn sync all his message logs cause a svnsync: Error setting property 'log': this commands finds all its contributions and fix all his commit logs Show Sample Output
This is sample output - yours may be different.
```
property 'svn:log' set on repository revision ###
property 'svn:log' set on repository revision ###
property 'svn:log' set on repository revision ###
...
```
0

for R in `svn log file:///path/repo | grep ^r | grep dude | cut -d' ' -f1 | cut -dr -f2`; do svn ps svn:log --revprop -r $R "`svn pg svn:log --revprop -r $R file:///path/repo; perl -e 'print ".\n";' | fromdos`" file:///path/repo; done

theist · 2011-03-24 08:29:15 7

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

shell function which allows you to tag files by creating symbolic links directories in a 'tags' folder.

shell function which allows you to tag files by creating symbolic links directories in a 'tags' folder. The tag function takes a tag name as its first argument, then a list of files which take that tag. The directory $HOME/tags/tagname will then hold symbolic links to each of the tagged files. This function was modified from bartonski's (http://www.commandlinefu.com/commands/view/10216) inspired by tmsu (found at https://bitbucket.org/oniony/tmsu/wiki/Home) with readlink function by flxndn (http://www.commandlinefu.com/commands/view/10222). Example: $ tag dog airedale.txt .shizturc weimeraner.pl This will create $HOME/tags/dog which contains symbolic links to airedale.txt .shizturc and weimeraner.pl

TCPDUMP & Save Capture to Remote Server w/ GZIP

NOTE: When opening the files you might need to strip the very top line with notepad++ as its a mistake header This is useful when the local machine where you need to do the packet capture with tcpdump doesn?t have enough room to save the file, where as your remote host does tcpdump -i eth0 -w - | ssh forge.remotehost.com -c arcfour,blowfish-cbc -C -p 50005 "cat - | gzip > /tmp/eth0.pcap.gz" Your @ PC1 doing a tcpdump of PC1s eth0 interface and its going to save the output @ PC2 who is called save.location.com to a file /tmp/eth0-to-me.pcap.gz again on PC2 More info @: http://www.kossboss.com/linuxtcpdump1

List all active access_logs for currently running Apache or Lighttpd process

Ever logged into a *nix box and needed to know which webserver is running and where all the current access_log files are? Run this one liner to find out. Works for Apache or Lighttpd as long as CustomLog name is somewhat standard. HINT: works great as input into for loop, like this: $ for i in `lsof -p $(netstat -ltpn|awk '$4 ~ /:80$/ {print substr($7,1,index($7,"/")-1)}')| awk '$9 ~ /access.log$/ {print $9| "sort -u"}'` ; do echo $i; done Very useful for triage on unfamiliar servers!

Do quick arithmetic on numbers from STDIN with any formatting using a perl one liner.

Good for summing the numbers embedded in text - a food journal entry for example with calories listed per food where you want the total calories. Use this to monitor and keep a total on anything that ouputs numbers.

list block devices

Shows all block devices in a tree with descruptions of what they are.

Get the Last tweet (Better than Twitter feed rrs)

I was using some twitter bots and twitter bloks my IP. Now im using some proxys and i use these command to validate the tweet was published.

Create named LUKS encrypted volume

You need to be root to do this. So check the command before running it. You enter the same password for Enter LUKS passphrase: Verify passphrase: Enter passphrase for /dev/loopn: ___ You can then copy the .img file to somewhere else. Loop it it with losetup -f IMAGENAME.img and then mount it with a file manager (eg nemo) or run mount /dev/loopn /media/mountfolder Acts similar to a mounted flash drive

grep (or anything else) many files with multiprocessor power

Parallel does not suffer from the risk of mixing of output that xargs suffers from. -j+0 will run as many jobs in parallel as you have cores. With parallel you only need -0 (and -print0) if your filenames contain a '\n'. Parallel is from https://savannah.nongnu.org/projects/parallel/

list block devices

Shows all block devices in a tree with descruptions of what they are.

Find the package that installed a command

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands by theist