Commands by theist

Commands by theist (8)

sorted by

mysql bin log events per minute

shows number of mysql bin log events (which are mysql server events) per minute, useful to check stress times postmortem Show Sample Output
This is sample output - yours may be different.
```
....
      6  0:18
      1  0:17
     69  0:18
   4270  0:19
   7032  0:20
   1118  0:21
....
```
1

mysqlbinlog <logfiles> | grep exec | grep end_log_pos | cut -d' ' -f2- | cut -d: -f-2 | uniq -c

theist · 2012-05-30 09:42:21 8
mysqlbinlog headers sorted by event time

Shows sorted by query time, the headers of mysqlbinlog entries. Then is easy to locate the heavier events on the raw log dump Show Sample Output
This is sample output - yours may be different.
```
...
1 - #120528 21:55:39 server id 1  end_log_pos 10474343      Query   thread_id=2446084       exec_time=1     error_code=0
15 - #120528 21:55:17 server id 1  end_log_pos 10473569      Query   thread_id=2446071       exec_time=15    error_code=0
22 - #120528 21:55:17 server id 1  end_log_pos 10474905      Query   thread_id=2446084       exec_time=22    error_code=0
...
```
0

mysqlbinlog <logfiles> | grep exec | grep end_log_pos | grep -v exec_time=0 | sed 's/^$.*exec_time=\([0-9]\+$.*\)/\2 - \1 /' | sort -n

theist · 2012-05-30 09:38:02 6
Per country GET report, based on access log. Easy to transform to unique IP

Per country GET report, based on access log. Easy to transform to unique IP Show Sample Output
This is sample output - yours may be different.
```
     71 , Poland
    116 , France
    300 , United States
   2426 , Spain
```
-1

cat /var/log/nginx/access.log | grep -oe '^[0-9.]\+' | perl -ne 'system("geoiplookup $_")' | grep -v found | grep -oe ', [A-Za-z ]\+$' | sort | uniq -c | sort -n

theist · 2012-05-08 13:28:25 4
Debug redirects between production reloads

Watches the headers of a curl, following any redirects and printing only the HTTP status and the location of the possible redirects. Show Sample Output
This is sample output - yours may be different.
```
Every 2,0s: curl -s ...

HTTP/1.1 301 Moved Permanently
Location: http://fooo.bar/
HTTP/1.1 302 Moved Temporarily
Location: http://fooo.bar/ho
HTTP/1.1 404 Not Found
```
3

watch 'curl -s --location -I http://any.site.or.url | grep -e "$HTTP\|Location$"'

theist · 2012-04-23 17:05:29 5
filter rails log to count requests sliced in seconds

Commandline perl filter for, using a production.log from a rails app, display on realtime the count of requests grouped by "seconds to complete" (gross round, but fair enough for an oneliner) :) Show Sample Output
This is sample output - yours may be different.
```
0s: 30
1s: 43
2s: 12
5s: 1

0s: 33
1s: 43
2s: 13
5s: 1
```
0

tail -f production.log | perl -ne 'if (/^Completed.in.(\d+)/){$d = int($1/1000);print "\n";$f{$d}++;for $t (sort(keys(%f))){print $t."s: ".$f{$t}."\n"}}'

theist · 2012-02-23 14:37:33 4
cat a bunch of small files with file indication

If you have a bunch of small files that you want to cat to read, you can cat each alone (boring); do a cat *, and you won't see what line is for what file, or do a grep . *. "." will match any string and grep in multifile mode will place a $filename: before each matched line. It works recursively too!! Show Sample Output
This is sample output - yours may be different.
```
file1.txt:foo
file1.txt:bar
file2.txt:foo
file3.txt:foo
```
18

grep . *

theist · 2011-09-01 09:16:04 11
Create a booklet ps file out of a normal ps (A4 Size)

'booklet' is the name they'll give it in fineprint windows alternative. It's a postscript file prepared to be printed dual side, one page per sheet, and, once finished you can place staples in the middle of the print, fold, and read it like a book.
This is sample output - yours may be different.
0

psbook file.ps | psnup -2 -l -m0.5cm | pstops '2:0,1U(210mm,297mm)' > file.booklet.ps

theist · 2011-03-24 08:56:32 4
Fix all the commit log messages from a user of a bad subversion client

Let's supose some moron used some m$ shit to commit to a later svnsynced repo. On a svn sync all his message logs cause a svnsync: Error setting property 'log': this commands finds all its contributions and fix all his commit logs Show Sample Output
This is sample output - yours may be different.
```
property 'svn:log' set on repository revision ###
property 'svn:log' set on repository revision ###
property 'svn:log' set on repository revision ###
...
```
0

for R in `svn log file:///path/repo | grep ^r | grep dude | cut -d' ' -f1 | cut -dr -f2`; do svn ps svn:log --revprop -r $R "`svn pg svn:log --revprop -r $R file:///path/repo; perl -e 'print ".\n";' | fromdos`" file:///path/repo; done

theist · 2011-03-24 08:29:15 7

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Find the date of the first commit in a git repository

Finds the date of the first commit in a git repository branch

Lines per second in a log file

Create and replay macros in vim

You can record, then replay a series of keystrokes in vim. In command mode 'q', then a letter [a-zA-Z] starts macro recording mode. Enter a series of vim commands. When done, enter command mode again, and press 'q' to stop recording. To replay, enter command mode, then press @{letter}

This is how you should push a string in a command's stdin.

Don't do this: $echo word | command Using a bash "here strings" and "here documents" look leeter than piping echo into the command. Also prevents subshell execution. Word is also expanded as usual.

Find the annual salary of any White House staffer.

Query the Socrata Open Data API being used by the White House to find any employee's salary using curl, grep and awk. Change the value of the search parameter (example uses Axelrod) to the name of any White House staffer to see their annual salary.

Which processes are listening on a specific port (e.g. port 80)

swap out "80" for your port of interest. Can use port number or named ports e.g. "http"

Use md5sum to check your music and movie files. Also use diff.

This is a beginning script. You can create a file with > filename. You can also use diff to compare output run at different times to verify no change in your files. I apologize in advance if this is too simple. For some it should be a start.

Extract audio track from a video file using mencoder

Extracts an MP3 encoded audio stream from an input video file.

Clean way of re-running bash startup scripts.

This replaces the current bash session with a new bash session, run as an interactive non-login shell... useful if you have changed /etc/bash.bashrc, or ~/.bashrc If you have changed a startup script for login shells, use $ exec bash -l Suitable for re-running /etc/profile, ~/.bash_login and ~/.profile. edit: chinmaya points out that $ env - HOME=$HOME TERM=$TERM bash -s "exec bash -l" will clear any shell variables which have been set... since this verges on unwieldy, might want to use $ alias bash_restart='env - HOME=$HOME TERM=$TERM bash -s "exec bash -l"'

Performance tip: compress /usr/

Periodically run the one-liner above if/when there are significant changes to the files in /usr/ = Before rebooting, add following to /etc/fstab : = $ /squashed/usr/usr.sfs /squashed/usr/ro squashfs loop,ro 0 0 $ usr /usr aufs udba=reval,br:/squashed/usr/rw:/squashed/usr/ro 0 0 No need to delete original /usr/ ! (unless you don't care about recovery). Also AuFS does not work with XFS

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands by theist