Hide

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again.

Delete that bloated snippets file you've been using and share your personal repository with the world. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

If you have a new feature suggestion or find a bug, please get in touch via http://commandlinefu.uservoice.com/

Get involved!

You can sign-in using OpenID credentials, or register a traditional username and password.

OpenID

First-time OpenID users will be automatically assigned a username which can be changed after signing in.

Hide

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands by hute37

Hide

News

2012-05-20 - test: test
2012-05-20 - test: test
2012-05-20 - test: test
2012-05-20 - Test tweets: YU not working?

Hide

Functions

Hide

Credits

Site by David Winterbottom (user root).

Commands by hute37

Terminal - Commands by hute37 - 17 results

cat z.log | perl -ne 'BEGIN{ print "DATE;RATE\n"; } /\[(\d.*)\]/ && print $1; /CURRENT RATE: +(\S+) msg.*/ && print ";" .$1 . "\n"; '

This is sample output - yours may be different.

from file:


@SG: --------------------------------------------------------------------
@SG: [pmphost6] [2012-04-02 21:23:59.268]
@SG: --------------------------------------------------------------------
@SG: [SAFEGUARD STATUS]
@SG:   > RATE THRESHOLD:           30 msg/sec
@SG:   > TIME TO LIVE:           1800 sec
@SG:   > CURRENT RATE:         43.017 msg/sec  2581.000 msg/min
@SG:   > ELAPSED TIME:             60 sec
@SG:   > TIME COUNT:                0 sec
@SG:   > TIME TO LIVE COUNT:      360 sec
@SG:   > SAFEGUARD STATUS:         ON
@SG: --------------------------------------------------------------------
@SG: --------------------------------------------------------------------
@SG: [pmphost6] [2012-04-02 21:24:59.268]
@SG: --------------------------------------------------------------------
@SG: [SAFEGUARD STATUS]
@SG:   > RATE THRESHOLD:           30 msg/sec
@SG:   > TIME TO LIVE:           1800 sec
@SG:   > CURRENT RATE:         42.417 msg/sec  2545.000 msg/min
@SG:   > ELAPSED TIME:             60 sec
@SG:   > TIME COUNT:                0 sec
@SG:   > TIME TO LIVE COUNT:      420 sec
@SG:   > SAFEGUARD STATUS:         ON
@SG: --------------------------------------------------------------------
@SG: --------------------------------------------------------------------
@SG: [pmphost6] [2012-04-02 21:25:59.269]
@SG: --------------------------------------------------------------------
@SG: [SAFEGUARD STATUS]
@SG:   > RATE THRESHOLD:           30 msg/sec
@SG:   > TIME TO LIVE:           1800 sec
@SG:   > CURRENT RATE:         42.833 msg/sec  2570.000 msg/min
@SG:   > ELAPSED TIME:             60 sec
@SG:   > TIME COUNT:                0 sec
@SG:   > TIME TO LIVE COUNT:      480 sec
@SG:   > SAFEGUARD STATUS:         ON
@SG: --------------------------------------------------------------------


estract csv


DATE;RATE
2012-04-02 21:23:59.268;43.017
2012-04-02 21:24:59.268;42.417
2012-04-02 21:25:59.269;42.833

2012-04-03 13:52:20

User: hute37

Functions: cat perl

Up
Down

multiline data block parse and CSV data extraction with perl

extract data in multiline blocks of data with perl pattern matching loop

cat z.log | cut -d ':' -f1,2 | uniq -c

2012-02-28 17:29:46

User: hute37

Functions: cat cut uniq

Tags: uniq

Up
Down

Count loglines by time (minute)

depends on date format locale ...

2012-02-28 17:25:14

User: hute37

Functions: cat cut echo grep sort uniq wc xargs

Tags: uniq xargs

Up
Down

Report summary of string occurrence by time period (hour) - alternate

useful to count events in logs

@see: http://www.commandlinefu.com/commands/view/10327/report-summary-of-string-occurrence-by-time-period-hour#comment

cat z.log | grep Timeout | cut -d ':' -f1 | sort | uniq -c

2012-02-28 17:22:17

User: hute37

Functions: cat cut grep sort uniq

Tags: uniq

Up
Down

Report summary of string occurrence by time period (hour)

useful to count events in logs

#(see sample) $ cat x | perl -pe 'BEGIN{ print "TIME;...\n"; } s!(\S+) - (\S+) - \[(\d\d)/(\S\S\S)/(\S+):(\d\d):(\d\d:\d\d) \S+\] "(\S+) (.*/)(\S+)(?:\.([^?]*)(\?\S*)?) HTTP/\S+" (\d+) (\S+)!$3-$4-$5 $6:$7;$6;$2;$1;$8;$13;1;$14;$11;$10;$9;$12;!' > x.csv

2012-02-10 16:58:50

User: hute37

Functions: cat perl

Up
Down

Apache CLF access log format to CSV converter

- excel date compatible with a separate hour field

- added a fixed 1 for easier request counter aggregation

- split URL in directory, filename, fileext, query

- used with tomcat valve with response bytes replaced by elapsed time

pcregrep --color -M -N CRLF -e "SQLEngine\.\w+\W*$[^$]*\)" -r --include='\.java$'

2012-01-16 09:19:40

User: hute37

Tags: grep perlregrep

-1

Up
Down

multiline re search recursive

Comments (2) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

cat table-mv.txt | perl -pe 's{([^;]+);([^;]+)}{tbl$1/tbl$2}' | perl -pe 's{(\S+)}{perl -i -pe #s/$1/g# xxx.sql}' | tr "#" "\'" | bash

2011-10-05 15:55:34

User: hute37

Functions: cat perl tr

Up
Down

Multiple Perl Search/Replace from a file

with a semicolon text file map, apply multiple replace to a single file

perl -i -pe 'BEGIN{undef $/;} s/START.*?STOP/replace_string/smg' file_to_change

2011-10-05 11:22:36

User: hute37

Functions: perl

Tags: perl

Up
Down

Multiline Search/Replace with Perl

from http://stackoverflow.com/questions/1030787/multiline-search-replace-with-perl

added greedy trick in wildcard match (.*?) from

http://www.troubleshooters.com/codecorn/littperl/perlreg.htm#Greedy

while true ; do sleep 1 ; clear ; (netstat -tn | grep -P ':36089\s+\d') ; done

2011-09-28 11:39:43

User: hute37

Functions: clear grep netstat sleep true

-3

Up
Down

Monitoring a port connections

shell loop to scan netstat output avoiding loolback aliases (local/remote swap for local connections)

/bin/ls *.png | xargs -l1 -I {} convert {} -modulate 100,100,70 ../../icons/32x32/{}

2011-06-13 14:35:10

User: hute37

Functions: xargs

Tags: ImageMagick image xargs icons

-4

Up
Down

use ImageMagik to convert tint (hue rotation) of an icon set directory.

see http://www.imagemagick.org/Usage/color_mods/#modulate

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

while sleep 1; do date; (netstat -a -n | grep 80) ; done

2011-05-16 07:56:56

User: hute37

Functions: grep netstat sleep

Tags: netstat logging

-4

Up
Down

Polls fos network port usage

Comments (2) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

convert -compress jpeg *.jpg mydoc.pdf

2011-05-01 13:37:09

User: hute37

Tags: ImageMagick pdf scanner

Up
Down

Generate a (compressed) pdf from images

use imagemagik convert

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

ls *.jpg | awk -F'.' '{ printf "%s %04d.%s\n", $0, $1, $2; }' | xargs -n2 mv

2011-05-01 13:32:58

User: hute37

Functions: awk ls printf xargs

Tags: awk mv xargs

Up
Down

Numeric zero padding file rename

rename file name with fixed length nomeric format pattern

setxkbmap it

2011-03-31 09:52:45

User: hute37

Tags: X X Window

Up
Down

Set keyboard layout in X

change keyboard layout in X

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

pcregrep -r --exclude_dir='.svn' --include='.*jsp$' -A 2 -B 2 --color "pHtmlHome" .

2010-12-09 15:26:07

User: hute37

Tags: perl grep

Up
Down

Recursive source regexp search with pcregrep

range context (-A -B) search, with exclusion of vcs directories

pcregrep --color -M -N CRLF "owa_pattern\.\w+\W*$[^$]*\)" source.sql

2010-11-11 12:53:40

User: hute37

Tags: perl grep regex

Up
Down

Source multiline grep with pcregrep

grep multiline in Perl regexp syntax with pcregrep

sudo hwinfo --framebuffer

2010-10-03 14:45:02

User: hute37

Functions: sudo

Tags: Linux grub boot hwinfo

Up
Down

show framebuffer console modes to use in grub vga option

look at /boot/grub/menu.lst for somethig like:

## additional options to use with the default boot option, but not with the

## alternatives

## e.g. defoptions=vga=791 resume=/dev/hda5

## defoptions=vga=795

# defoptions=vga=873

## altoption boot targets option

## multiple altoptions lines are allowed

## e.g. altoptions=(extra menu suffix) extra boot options

## altoptions=(recovery) single

# altoptions=(verbose mode) vga=775 debug

# altoptions=(console mode) vga=ask

# altoptions=(graphic mode) quiet splash

# altoptions=(recovery mode) single

vga=(decimal value) is framebuffer mode

A PHP Error was encountered

A PHP Error was encountered

What's this?

Get involved!

Stay in the loop…

News

Tags

Functions

Credits

Commands by hute37