Commands using awk sorted by votes

Commands using awk (1,418)

sorted by

Find the average QTime for all queries ran within the last hour for solr
This is sample output - yours may be different.
-2

cat /service/solr/log/main/current | tai64nlocal | grep "$`date '+%F %H'`\|`date '+%F %H %M' | awk '{print $1" 0"$2-1":"$3}'`$" | grep QTime | awk '{print $NF}' | awk -F\= '{ s += $2} END {print s/NR}'

allrightname · 2009-08-26 14:02:02 3
free swap

simple way to show free swap Show Sample Output
This is sample output - yours may be different.
```
2979
```
-2

free -m | awk '/Swap/ {print $4}'

voyeg3r · 2009-09-02 11:46:17 3
Show directories in the PATH, one per line

Removes trailing newline; colon becomes record separator and newline becomes field separator, only the first field is ever printed. Replaces empty entries with $PWD. Also prepend relative directories (like ".") with the current directory ($PWD). Can change PWD with env(1) to get tricky in (non-Bourne) scripts. Show Sample Output
This is sample output - yours may be different.
```
/tmp/src
/tmp
/usr/java/jdk1.6.0_11/bin
/home/arcege/local/bin
/home/arcege/bin
/usr/local/sbin
/usr/local/bin
/usr/sbin
/usr/bin
/sbin
/bin
/usr/games
/opt/real/RealPlayer
/tmp/.
/usr/java/apache-ant-1.7.0/bin
```
-2

echo src::${PATH} | awk 'BEGIN{pwd=ENVIRON["PWD"];RS=":";FS="\n"}!$1{$1=pwd}$1!~/^\//{$1=pwd"/"$1}{print $1}'

arcege · 2009-09-09 04:03:46 3
Delete all but the latest 5 files

I have a directory containing log files. This command delete all but the 5 latest logs. Here is how it works: * The ls -t command list all files with the latest ones at the top * The awk's expression means: for those lines greater than 5, delete.
This is sample output - yours may be different.
-2

ls -t | awk 'NR>5 {system("rm \"" $0 "\"")}'

haivu · 2009-09-16 04:58:08 4
Laminate a file

Consider this file : laminate this file with awk hello to commandlinefu I can use awk substring to laminate words : lamin this file with hello comma Similar to http://www.commandlinefu.com/commands/view/2000/laminate-files-line-by-line Show Sample Output
This is sample output - yours may be different.
```
lamin
this
file
with 
hello
comma
```
-2

awk '{print(substr($0,1,5))}' file

servermanaged · 2009-10-05 18:58:49 4
umount all nfs mounts on machine
This is sample output - yours may be different.
-2

mount | awk '/:/ { print $3 } ' | xargs sudo umount

uid0 · 2009-11-05 17:19:11 3
remove files and directories with acces time older than a given date

remove files with access time older than a given date. If you want to remove files with a given modification time replace %A@ with %T@. Use %C@ for the modification time. The time is expressed in epoc but is easy to use any other format. Show Sample Output
This is sample output - yours may be different.
```
~/tmp$ find . -printf '%p : %A@\n' | awk '{FS=" : " ; if($2 < 1258734167 ) print $1 ;}' | xargs rm --verbose -fr ;
removed `./file_1'
removed `./file_2'
removed `./file_3'
removed `./file_4'
removed `./file_5'
removed `./file_6'
removed `./file_7'
removed `./file_8'
removed `./file_9'
```
-2

find <dir> -printf '%p : %A@\n' | awk '{FS=" : " ; if($2 < <time in epoc> ) print $1 ;}' | xargs rm --verbose -fr ;

angleto · 2009-11-20 16:31:58 9
Checks apache's access_log file, strips the search queries and shoves them up your e-mail

It's not a big line, and it *may not* work for everybody, I guess it depends on the detail of access_log configuration in your httpd.conf. I use it as a prerotate command for logrotate in httpd section so it executes before access_log rotation, everyday at midnight.
This is sample output - yours may be different.
-2

cat /var/log/httpd/access_log | grep q= | awk '{print $11}' | awk -F 'q=' '{print $2}' | sed 's/+/ /g;s/%22/"/g;s/q=//' | cut -d "&" -f 1 | mail youremail@isp.com -s "[your-site] search strings for `date`"

isma · 2009-11-22 03:03:06 9
Sorted list of established destination connections

Sometimes I need a quick visual way to determine if there is a particular server who is opening too many connections to the database machine.
This is sample output - yours may be different.
-2

netstat | grep EST | awk '{print $5}' | sort

unixoid · 2009-11-24 13:38:28 4
Killing multiplpe process for one program like apache, wget, postfix etc.
This is sample output - yours may be different.
-2

ps aux| grep -v grep| grep httpd| awk {'print $2'}| xargs kill -9

r00t4u · 2009-12-06 05:39:50 7
Killing multiplpe process for one program like apache, wget, postfix etc.
This is sample output - yours may be different.
-2

ps ax| awk '/[h]ttpd/{print $1}'| xargs kill -9

r00t4u · 2009-12-07 09:53:18 4
Find all uses of PHP constants in a set of files
This is sample output - yours may be different.
-2

$class=ExampleClass; $path=src; for constant in `grep ' const ' $class.php | awk '{print $2;}'`; do grep -r "$class::$constant" $path; done

BluesDragon · 2009-12-24 11:32:24 4
Check if file is greater than 20 bytes, such as an empty gzip archive

If you gzip an empty file it becomes 20 bytes. Some backup checks i do check to see if the file is greater than zero size (-s flag) but this is no good here. Im sure someone has a better check than me for this? No check to see if file exists before checking it's size.
This is sample output - yours may be different.
-2

BACKUP_FILE_SIZE=`eval ls -l ${BACKUP_FILE} | awk {'print $5'}`; if [ $BACKUP_FILE_SIZE -le 20 ]; then echo "its empty"; else echo "its not empty"; fi

Redrocket · 2009-12-29 08:34:37 3
Purge frozen messages in Exim

Although Exim will purge frozen (undeliverable) messages over time, the command "exim -Mrm #id#" where #id# is a particular message ID will purge a message immediately. Being lazy, I don't want to type the command for each frozen message, so I wrote the one-liner to do it for me.
This is sample output - yours may be different.
-2

for i in `mailq | awk '$6 ~ /^frozen$/ {print $3}'`; do exim -Mrm $i; done

rjamestaylor · 2010-01-13 21:28:45 3
transfer files locally to be sure that file permissions are kept correctly showing progress

This may seem like a long command, but it is great for making sure all file permissions are kept in tact. What it is doing is streaming the files in a sub-shell and then untarring them in the target directory. Please note that the -z command should not be used for local files and no perfomance increase will be visible as overhead processing (CPU) will be evident, and will slow down the copy. You also may keep simple with, but you don't have the progress info: cp -rpf /some/directory /other/path Show Sample Output
This is sample output - yours may be different.
```
7MB 0:00:01 [59.7MB/s] [============>        ] 57% ETA 0:00:00
```
-2

dir='path to file'; tar cpf - "$dir" | pv -s $(du -sb "$dir" | awk '{print $1}') | tar xpf - -C /other/path

starchox · 2010-01-19 19:05:45 3
add all files not under version control to repository

xargs deals badly with special characters (such as space, ' and "). To see the problem try this: touch important_file touch 'not important_file' ls not* | xargs rm Parallel https://savannah.nongnu.org/projects/parallel/ does not have this problem.
This is sample output - yours may be different.
-2

svn status |grep '\?' |awk '{print $2}'| parallel -Xj1 svn add

unixmonkey8046 · 2010-01-28 08:47:54 3
irssi log histogram

This awk command prints a histogram of the number of times 'emergency' is the first word in a line, per day, in an irssi (IRC client) log file. Show Sample Output
This is sample output - yours may be different.
```
2009-Jun-25 **
2009-Jun-26 ***
2009-Jun-27 
2009-Jun-28 *
2009-Jun-29 *
2009-Jun-30 *
2009-Jul-01 
2009-Jul-02 *
2009-Jul-03 
2009-Jul-04 
2009-Jul-05 
2009-Jul-06 ***
2009-Jul-07 *****
2009-Jul-08 ***
2009-Jul-09 ***
2009-Jul-10 *****
2009-Jul-11 
2009-Jul-12 
2009-Jul-13 **
2009-Jul-14 *****
2009-Jul-15 
2009-Jul-16 
2009-Jul-17 *
2009-Jul-18 *
2009-Jul-19 *
2009-Jul-20 ****
2009-Jul-21 *
2009-Jul-22 ***
2009-Jul-24 **
2009-Jul-25 **
```
-2

awk '/^--- Day changed (.*)/ {st=""; for (i=0;i<ar[date];i++) {st=st"*"} print date" "st; date=$7"-"$5"-"$6} /> emergency/ {ar[date]++} END {st=""; for (i=0;i<ar[date];i++) {st=st"*"}; print date" "st}' #engineyard.log

MarcoN · 2010-02-24 23:10:03 3
simple echo of IPv4 IP addresses assigned to a machine

Easy way to grab the IP address of a machine for easy script use. If needed a "| grep -v 127.0.0.1" at the end will suppress localhost. Show Sample Output
This is sample output - yours may be different.
```
192.168.15.250
127.0.0.1
```
-2

ifconfig | awk '/inet addr/ {print $2 }' | sed 's/.*://g'

Guyverix · 2010-03-04 08:15:08 5
Find MAC address of Active Eth connection
This is sample output - yours may be different.
-2

/sbin/ifconfig|grep -B 1 inet |head -1 | awk '{print $5}'

octopus · 2010-04-22 06:35:29 6
Get IPv6 of eth0 for use with scripts
This is sample output - yours may be different.
-2

/sbin/ifconfig eth0 | grep 'inet6 addr:' | awk {'print $3'}

williamruckman · 2010-06-26 02:11:00 3
mac address for eth0
This is sample output - yours may be different.
-2

ifconfig eth0 | grep 'HWaddr' | awk '{print $5}'

minigeek · 2010-06-26 05:24:31 4
kill all instances of an annoying or endless, thread-spawning process
This is sample output - yours may be different.
-2

ps auxwww | grep outofcontrolprocess | awk '{print $2}' | xargs kill -9

unixmonkey8311 · 2010-06-30 15:52:52 6
Read multiple lines of a file based on regex matching a single line

Finds the line number matching the regex, then passes that to BC for some math, passes that to head, and uses tail to trim off the unwanted section at the top. The whole thing is spit out to a script that can then be shared or run. Comes in handy for reading select sections from error logs.
This is sample output - yours may be different.
-2

for i in `grep -n "SomeRegEx" foo.txt | sed 's/:/ /' | awk '{print $1}'`; do echo "head -n `echo "$i+4" | bc` foo.txt | tail -n 5"; done > headsandtails.sh

reklis · 2010-07-01 05:48:02 5
Minimize CSS/JS while preserving functionality.

This command, or a derivative like it, is a must-have if you're a server administrator interested in website optimization: https://kinqpinz.info/?%C2%B6=287a7ba6 Command requires Yahoo's YUI, find it here: http://developer.yahoo.com/yui/ Show Sample Output
This is sample output - yours may be different.
```
% gominify c.css c-min.css 
Saved c.css (12K) to c-min.css (8.0K)
```
-2

gominify() { if [ $# -ne 2 ]; then echo 'gominify < src > < dst >'; return; fi; s="$1"; d="$2"; java -jar yui.jar $s >$d; if [ $? == 0 ]; then a=$( ls -sh $s | awk '{print $1}' ); b=$( ls -sh $d | awk '{print $1}' ); echo "Saved $s ($a) to $d ($b)"; fi;}

meathive · 2010-08-03 10:19:24 3
Random Decimal in the interval 0 ≤ n < 1 and 2d6 dice roll

2d6 dice: awk 'BEGIN { srand(); a=int(rand()*6)+1; b=int(rand()*6)+1; print a " + " b " = " a+b }' 3 + 6 = 9 Show Sample Output
This is sample output - yours may be different.
```
0.902879
```
-2

awk 'BEGIN { srand(); print rand() }'

dennisw · 2010-08-07 14:33:12 5
‹ First < 51 52 53 54 55 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Sort movies by length, longest first

handles file names with spaces and colons, fixes sort (numeric!), uses mplayer, same output format as other alternatives

monitor my process group tree

Grab just the title of a youtube video

There's another version on here that uses GET but some people don't have lwp-request, so here's an alternative. It's also a little shorter and should work with most youtube URLs since it truncates at the first &

Rename files in batch

Rename file to same name plus datestamp of last modification.

Note that the -i will not help in a script. Proper error checking is required.

extract email addresses from some file (or any other pattern)

Find Duplicate Files (based on size first, then MD5 hash)

If you have the fdupes command, you'll save a lot of typing. It can do recursive searches (-r,-R) and it allows you to interactively select which of the duplicate files found you wish to keep or delete.

See why a program can't seem to access a file

Sometimes a program refuses to read a file and you're not sure why. You may have display_errors turned off for PHP or something. In this example, fopen('/var/www/test/foo.txt') was called but doesn't have read access to foo.txt. Strace can tell you what went wrong. E.g., if php doesn't have read access to the file, strace will say "EACCESS (Permission denied)". Or, if the file path you gave doesn't exist, strace will say "ENOENT (No such file or directory)", etc. This works for any program you can run from the command-line, e.g., strace python myapp.py -e open,access... Note: the above command uses php-cli, not mod_php, which is a different SAPI with diff configs, etc.

Find usb device in realtime

Using this command you can track a moment when usb device was attached.

Convert CSV to JSON

Replace 'csv_file.csv' with your filename.

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using awk

Commands using awk (1,418) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using awk (1,418)

sorted by